| openstackgerrit | Merged openstack/puppet-tripleo master: Add capability to configure simple-crypto backend for barbican https://review.openstack.org/517312 | 00:08 |
|---|---|---|
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 00:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 00:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 00:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 00:10 |
| *** achadha has joined #tripleo | 00:10 | |
| *** achadha_ has joined #tripleo | 00:11 | |
| *** zshi has joined #tripleo | 00:14 | |
| *** achadha has quit IRC | 00:15 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove deprecated Telemetry services from roles data https://review.openstack.org/509645 | 00:20 |
| *** apetrich has quit IRC | 00:20 | |
| *** apetrich has joined #tripleo | 00:21 | |
| *** dmsimard is now known as dmsimard|off | 00:22 | |
| *** eck` is now known as eck`gone | 00:23 | |
| *** bobh has joined #tripleo | 00:27 | |
| *** jlabarre has quit IRC | 00:31 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 00:35 |
| *** Usman has quit IRC | 00:52 | |
| *** akrivoka has quit IRC | 00:55 | |
| *** ramishra has joined #tripleo | 00:58 | |
| *** achadha has joined #tripleo | 01:02 | |
| fultonj | dsneddon: are you around? | 01:06 |
| *** achadha_ has quit IRC | 01:06 | |
| *** achadha has quit IRC | 01:06 | |
| dsneddon | fultonj, Hey | 01:09 |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 01:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 01:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 01:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 01:10 |
| *** zshi has quit IRC | 01:11 | |
| fultonj | dsneddon: thanks for repsonding, was tripleoclient modified to deal with certain files not existing as a result of them being rendered in pike? | 01:12 |
| fultonj | i ask because i'm trying to update https://github.com/openstack/tripleo-heat-templates/blob/master/environments/hyperconverged-ceph.yaml#L4 | 01:12 |
| fultonj | which presently complains that resources.StorageMgmtPort: resources[2].Property error: resources.StorageMgmtPort.properties.network: Error validating value 'storage_mgmt': Unable to find network with name or id 'storage_mgmt' | 01:13 |
| fultonj | so i was wondering if I need to tell the tripleo client to have faith that it will be rendered, or if you think i'm on the wrong path. thanks | 01:14 |
| *** bobh has quit IRC | 01:15 | |
| dsneddon | fultonj, The files are rendered based on the contents of network_data.yaml, although I don't recall if we put in anything to check to see if it's actually enabled on any roles. | 01:15 |
| dsneddon | fultonj, Is your deployment supposed to use storage_mgmt network? | 01:16 |
| fultonj | yes | 01:16 |
| dsneddon | fultonj, It could be a path issue. | 01:16 |
| fultonj | this template used to work | 01:16 |
| dsneddon | fultonj, You can test out to see what files are rendered by running ./tools/process_templates.py in the THT root | 01:16 |
| dsneddon | fultonj, You did use "-n /path/to/network_data.yaml" with the deploy command, right? | 01:17 |
| dsneddon | fultonj, That's new, but it's required if you want the isolated network templates to be rendered. | 01:17 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add Docker service to the undercloud roles https://review.openstack.org/518454 | 01:19 |
| fultonj | dsneddon: that's sort of my point... let me give more context... | 01:19 |
| fultonj | normally to deploy HCI you compose a role | 01:19 |
| fultonj | e.g. add the CephOSD service to the compute role for example | 01:20 |
| dsneddon | fultonj, Actually, I just checked, and the network_data.yaml file in the THT root (or the directory specified with --templates) is used. | 01:20 |
| fultonj | prior to pike you'd add add the ports in by hands | 01:20 |
| dsneddon | fultonj, Ah, well the storage_mgmt network isn't enabled by default for that role. So you will need to add that network to the networks: declaration in the compute role definition. | 01:20 |
| fultonj | exactly | 01:20 |
| fultonj | so... | 01:20 |
| fultonj | we made this file which we carry in ocata and newtown | 01:21 |
| fultonj | so the user doesn't have to compose a role to do HCI | 01:21 |
| fultonj | https://github.com/openstack/tripleo-heat-templates/blob/master/environments/hyperconverged-ceph.yaml#L4 | 01:21 |
| fultonj | now these files are rendered | 01:21 |
| fultonj | so we'd have to send the user back to the world of "render stuff" by composing the role | 01:21 |
| fultonj | right? | 01:22 |
| dsneddon | fultonj, It seems that we should just carry a role for this in the roles directory | 01:22 |
| dsneddon | fultonj, Not enabled by default, but there if the user wants to use it. | 01:22 |
| dsneddon | fultonj, We already have several such roles in the THT/Roles directory, like Networker | 01:22 |
| fultonj | ahh | 01:23 |
| * fultonj looks in the roles dir | 01:23 | |
| fultonj | https://github.com/openstack/tripleo-heat-templates/blob/master/roles/ComputeHCI.yaml | 01:24 |
| dsneddon | fultonj, There is already a ComputeHCI.yaml | 01:24 |
| fultonj | exactly | 01:24 |
| dsneddon | fultonj, And it has the storage_mgmt network enabled. | 01:24 |
| *** cshastri has joined #tripleo | 01:24 | |
| *** zshi has joined #tripleo | 01:25 | |
| fultonj | i suppose it's a matter of backwards compatability then with users who have been asked to -e environments/hyperconverged-ceph.yaml | 01:25 |
| dsneddon | fultonj, Aren't both required? | 01:26 |
| fultonj | i either update environments/hyperconverged-ceph.yaml so it has the effect of using the new role or tell the user to directly use the new role | 01:26 |
| dsneddon | fultonj, Oh, we should really get rid of environments/hyperconverged-ceph.yaml, or make it a noop file with comments explaining how to do it now. | 01:27 |
| fultonj | no, -e environments/hyperconverged-ceph.yaml worked without needing to use -r for example | 01:27 |
| fultonj | it was kind of a hack | 01:27 |
| fultonj | it should have been a roles/ thing from the beginning i suppose | 01:27 |
| dsneddon | fultonj, Should I submit a patch to make it a noop? | 01:27 |
| dsneddon | fultonj, Oh, wait, what about upgrades? We probably still need to carry that file, but warn people not to use it in new deployments. | 01:29 |
| fultonj | do we have documentation on the new roles dir? | 01:29 |
| * fultonj looks | 01:29 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Install ssh keys of tripleo ci admins on nodes https://review.openstack.org/518638 | 01:30 |
| fultonj | seems to only be about adding your own https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/custom_roles.html | 01:31 |
| fultonj | dsneddon: shouldn't the file be deprecated? | 01:32 |
| fultonj | not removed, but kept with a commented out reference for how to do it now | 01:33 |
| fultonj | if we just keep it as is people will have the error about not finding that file | 01:34 |
| fultonj | as ./network/ports/storage_mgmt.yaml won't be there | 01:34 |
| fultonj | dsneddon: thanks for your advice, how about i create a bug and submit changes to environments/hyperconverged-ceph.yaml as well as a doc change? | 01:40 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add various functionality to nodepool role https://review.openstack.org/518560 | 01:40 |
| *** ykarel|afk has joined #tripleo | 01:58 | |
| *** ykarel|afk has quit IRC | 02:05 | |
| *** fragatina has quit IRC | 02:06 | |
| dsneddon | fultonj, That sounds good to me, thanks. | 02:07 |
| fultonj | dsneddon: ok, cool | 02:07 |
| *** dmacpher has joined #tripleo | 02:07 | |
| *** achadha has joined #tripleo | 02:09 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 02:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 02:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 02:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 02:10 |
| *** achadha has quit IRC | 02:14 | |
| *** zshi has quit IRC | 02:19 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add --config-download https://review.openstack.org/514701 | 02:28 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Add --output-dir https://review.openstack.org/514789 | 02:28 |
| openstackgerrit | James Slagle proposed openstack/tripleo-quickstart master: fs010: use --config-download from tripleoclient https://review.openstack.org/514736 | 02:29 |
| *** bobh has joined #tripleo | 02:35 | |
| *** dougbtv__ has quit IRC | 02:45 | |
| *** threestrands_ has joined #tripleo | 02:49 | |
| *** bswartz has quit IRC | 02:49 | |
| *** sai has quit IRC | 02:49 | |
| *** hewbrocca_afk has quit IRC | 02:50 | |
| *** thrash|g0ne has quit IRC | 02:50 | |
| *** bcafarel has quit IRC | 02:50 | |
| *** lyarwood has quit IRC | 02:50 | |
| *** thrash has joined #tripleo | 02:50 | |
| *** thrash has joined #tripleo | 02:50 | |
| *** hewbrocca_afk has joined #tripleo | 02:50 | |
| *** etingof has quit IRC | 02:51 | |
| *** jaosorior has quit IRC | 02:51 | |
| *** daidv has quit IRC | 02:51 | |
| *** fultonj has quit IRC | 02:51 | |
| *** migi has quit IRC | 02:51 | |
| *** markmc has quit IRC | 02:51 | |
| *** safchain has quit IRC | 02:51 | |
| *** toure_biab has quit IRC | 02:51 | |
| *** Vijayendra_ has joined #tripleo | 02:51 | |
| *** threestrands has quit IRC | 02:51 | |
| *** ansmith has quit IRC | 02:51 | |
| *** dmellado has quit IRC | 02:51 | |
| *** lifeless has quit IRC | 02:51 | |
| *** remix_tj has quit IRC | 02:51 | |
| *** leifmadsen has quit IRC | 02:51 | |
| *** migi has joined #tripleo | 02:52 | |
| *** lyarwood has joined #tripleo | 02:52 | |
| *** sai has joined #tripleo | 02:52 | |
| *** toure has joined #tripleo | 02:52 | |
| *** remix_tj has joined #tripleo | 02:52 | |
| *** fultonj has joined #tripleo | 02:53 | |
| *** Vijayendra has quit IRC | 02:53 | |
| *** achadha has joined #tripleo | 02:53 | |
| *** oanson has quit IRC | 02:53 | |
| *** bandini has quit IRC | 02:53 | |
| *** achadha_ has joined #tripleo | 02:54 | |
| *** bandini has joined #tripleo | 02:54 | |
| *** leifmadsen has joined #tripleo | 02:57 | |
| *** safchain has joined #tripleo | 02:57 | |
| *** achadha has quit IRC | 02:57 | |
| *** markmc has joined #tripleo | 02:57 | |
| *** dtrainor has quit IRC | 02:57 | |
| *** dmellado has joined #tripleo | 02:57 | |
| *** daidv has joined #tripleo | 02:57 | |
| *** lifeless has joined #tripleo | 02:58 | |
| *** oanson has joined #tripleo | 03:00 | |
| *** ansmith has joined #tripleo | 03:04 | |
| *** jaosorior has joined #tripleo | 03:05 | |
| *** bobh has quit IRC | 03:10 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 03:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 03:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 03:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 03:10 |
| openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo stable/ocata: Remove condition to match hdr(host) in haproxy redirect rule https://review.openstack.org/477637 | 03:10 |
| *** gvrangan has joined #tripleo | 03:14 | |
| *** gfidente[m] has quit IRC | 03:14 | |
| *** trown|outtypewww has quit IRC | 03:14 | |
| *** apetrich has quit IRC | 03:15 | |
| *** trown has joined #tripleo | 03:16 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Temporarily disable fluentd from scenario001-multinode-containers https://review.openstack.org/517497 | 03:21 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Add --detailed-exitcodes when running puppet via ansible https://review.openstack.org/517022 | 03:21 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Unset MountFlags in docker.service systemd directives https://review.openstack.org/518548 | 03:21 |
| mwhahaha | HEH https://review.openstack.org/#/c/516771/ won the lottery on failures, it hit both 1731032 and 1731063 in the gate | 03:21 |
| openstackgerrit | Keith Schincke proposed openstack/puppet-tripleo master: Set ACLs on ceph client keyrings https://review.openstack.org/517347 | 03:22 |
| colonwq | tonight's patch update has been brought to you by the word 'scope' and bone headed mistakes made by people everywhere. | 03:23 |
| mwhahaha | :D | 03:23 |
| *** apetrich has joined #tripleo | 03:30 | |
| *** gvrangan has quit IRC | 03:30 | |
| *** gvrangan has joined #tripleo | 03:31 | |
| *** achadha has joined #tripleo | 03:33 | |
| *** links has joined #tripleo | 03:34 | |
| *** achadha_ has quit IRC | 03:36 | |
| *** rlandy has quit IRC | 03:37 | |
| *** achadha has quit IRC | 03:37 | |
| *** raissa has quit IRC | 03:45 | |
| *** raissa has joined #tripleo | 03:45 | |
| *** psachin has joined #tripleo | 03:46 | |
| *** mdnadeem has joined #tripleo | 03:54 | |
| *** PagliaccisCloud has quit IRC | 03:56 | |
| *** mwhahaha changes topic to "CI status: MASTER: RED, STABLE/*: GREENish, For master jobs please do not approve things that are not critical (also see alerts). stable/* patches appear to be OK to merge for now | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/" | 03:57 | |
| *** PagliaccisCloud has joined #tripleo | 03:58 | |
| *** mdnadeem is now known as mdnadeem|afk | 03:59 | |
| *** bandini has quit IRC | 03:59 | |
| *** gvrangan has quit IRC | 04:00 | |
| *** bandini has joined #tripleo | 04:01 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM, Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 04:04 |
| *** shreshtha_ has joined #tripleo | 04:07 | |
| *** ykarel has joined #tripleo | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 04:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 04:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 04:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 04:10 |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 04:10 |
| *** ratailor has joined #tripleo | 04:13 | |
| *** skramaja has joined #tripleo | 04:13 | |
| *** liverpooler has quit IRC | 04:19 | |
| *** ecerquei has quit IRC | 04:23 | |
| *** dbecker has quit IRC | 04:24 | |
| *** jtomasek has joined #tripleo | 04:24 | |
| *** chlong has joined #tripleo | 04:25 | |
| *** stendulker has joined #tripleo | 04:26 | |
| *** chlong has quit IRC | 04:27 | |
| *** fragatina has joined #tripleo | 04:27 | |
| *** fragatina has quit IRC | 04:30 | |
| *** fragatina has joined #tripleo | 04:30 | |
| *** jtomasek has quit IRC | 04:35 | |
| *** zshi has joined #tripleo | 04:36 | |
| *** dbecker has joined #tripleo | 04:37 | |
| *** pdeore has joined #tripleo | 04:39 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Deprecate hyperconverged-ceph.yaml https://review.openstack.org/518650 | 04:44 |
| *** gbarros has quit IRC | 05:04 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Deprecate hyperconverged-ceph.yaml https://review.openstack.org/518650 | 05:07 |
| *** noslzzp has joined #tripleo | 05:08 | |
| *** vpickard has quit IRC | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 05:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 05:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 05:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 05:10 |
| *** gbarros has joined #tripleo | 05:12 | |
| *** jaganathan has joined #tripleo | 05:14 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 05:16 |
| *** pgadiya has joined #tripleo | 05:16 | |
| *** anilvenkata has quit IRC | 05:21 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 05:22 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 05:22 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for nova-libvirt container to log to stdout/stderr https://review.openstack.org/510562 | 05:23 |
| *** vpickard has joined #tripleo | 05:23 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for heat containers to log to stdout/stderr https://review.openstack.org/515038 | 05:23 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add option for panko container to log to stdout/stderr https://review.openstack.org/516378 | 05:24 |
| *** noslzzp has quit IRC | 05:24 | |
| *** fragatina has quit IRC | 05:32 | |
| *** gfidente[m] has joined #tripleo | 05:39 | |
| *** masco has joined #tripleo | 05:44 | |
| Tengu | hello there! | 05:44 |
| *** marios has joined #tripleo | 05:46 | |
| jaosorior | yo! | 05:46 |
| jaosorior | good morning | 05:46 |
| Tengu | how are you today, jaosorior ? | 05:48 |
| jaosorior | sleepy | 05:48 |
| jaosorior | but getting coffee | 05:48 |
| jaosorior | you? | 05:48 |
| *** dsneddon has quit IRC | 05:50 | |
| *** threestrands_ has quit IRC | 05:53 | |
| *** anilvenkata has joined #tripleo | 05:53 | |
| *** pgadiya has quit IRC | 05:53 | |
| Tengu | tired as well. | 05:53 |
| Tengu | but today it's a small day, at least. I finish around 12 (part-time job ;)) | 05:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Set metric procssing delay for metricd https://review.openstack.org/515684 | 05:55 |
| jaosorior | Tengu: that's not too bad | 05:56 |
| Tengu | indeed | 05:57 |
| *** moshele has joined #tripleo | 05:57 | |
| *** threestrands has joined #tripleo | 06:00 | |
| *** threestrands has joined #tripleo | 06:00 | |
| *** janki has joined #tripleo | 06:03 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 06:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 06:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 06:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 06:10 |
| *** artom has quit IRC | 06:11 | |
| *** artom has joined #tripleo | 06:11 | |
| *** timothyb89_ has joined #tripleo | 06:13 | |
| *** dpawar has joined #tripleo | 06:13 | |
| *** ykarel_ has joined #tripleo | 06:14 | |
| *** zzzeek_ has joined #tripleo | 06:14 | |
| *** zzzeek has quit IRC | 06:15 | |
| *** arxcruz- has quit IRC | 06:15 | |
| *** Slower has quit IRC | 06:15 | |
| *** zoli has quit IRC | 06:15 | |
| *** ed_b has quit IRC | 06:15 | |
| *** timothyb89 has quit IRC | 06:15 | |
| *** ed_b has joined #tripleo | 06:15 | |
| *** skramaja_ has joined #tripleo | 06:16 | |
| *** Usman has joined #tripleo | 06:16 | |
| *** Slower has joined #tripleo | 06:16 | |
| *** arxcruz_ has joined #tripleo | 06:16 | |
| *** mandre has quit IRC | 06:17 | |
| *** zoli has joined #tripleo | 06:17 | |
| *** Tyrantelf_ has joined #tripleo | 06:17 | |
| *** bandini has quit IRC | 06:18 | |
| *** bandini has joined #tripleo | 06:19 | |
| *** dsariel__ has joined #tripleo | 06:20 | |
| *** anilvenkata has quit IRC | 06:22 | |
| *** dbecker has quit IRC | 06:22 | |
| *** skramaja has quit IRC | 06:22 | |
| *** ykarel has quit IRC | 06:22 | |
| *** links has quit IRC | 06:22 | |
| *** apetrich has quit IRC | 06:22 | |
| *** Tyrantelf has quit IRC | 06:22 | |
| *** links has joined #tripleo | 06:28 | |
| *** anilvenkata has joined #tripleo | 06:28 | |
| *** dtrainor has joined #tripleo | 06:28 | |
| *** gbarros_ has joined #tripleo | 06:29 | |
| *** dbecker has joined #tripleo | 06:29 | |
| *** apetrich has joined #tripleo | 06:29 | |
| *** gbarros has quit IRC | 06:30 | |
| *** brault_ has joined #tripleo | 06:33 | |
| *** brault has quit IRC | 06:35 | |
| Usman | I am trying to create an instance using the boot from image (create new volume) but it's failing | 06:38 |
| Usman | the error logged in volume.log is ERROR oslo_messaging.rpc.server TypeError: 'NoneType' object is not iterable | 06:38 |
| Usman | File "/usr/lib/python2.7/site-packages/cinder/image/glance.py", line 340, in download for chunk in image_chunks: | 06:39 |
| moshele | skramaja_ : hi | 06:40 |
| *** tzumainn has quit IRC | 06:40 | |
| skramaja_ | moshele: hi | 06:40 |
| Usman | can anybody help me with this issue? | 06:41 |
| *** gbarros_ has quit IRC | 06:41 | |
| moshele | skramaja_: we want to support ODL with OVS Hardware Offload | 06:42 |
| skramaja_ | moshele: janki would be able to help with odl | 06:42 |
| moshele | skramaja_: thanks | 06:43 |
| moshele | janki: around? | 06:43 |
| *** aditya_r has joined #tripleo | 06:43 | |
| *** rwsu has joined #tripleo | 06:43 | |
| moshele | skramaja_: what jank timezone? | 06:44 |
| skramaja_ | moshele: IST (based out of Pune, India) | 06:44 |
| moshele | skramaja_: thanks | 06:45 |
| *** iranzo has joined #tripleo | 06:45 | |
| *** pdeore has quit IRC | 06:47 | |
| *** threestrands has quit IRC | 06:48 | |
| *** pdeore has joined #tripleo | 06:51 | |
| bandini | gfidente[m]: how do I debug these http://logs.openstack.org/73/516373/1/check-tripleo/legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024/d16790e/logs/undercloud/var/log/mistral/engine.log.txt.gz#_2017-11-09_05_23_45_544 ? | 06:52 |
| *** agurenko has joined #tripleo | 06:53 | |
| *** dpawar has quit IRC | 06:54 | |
| *** hanish has joined #tripleo | 06:55 | |
| jaosorior | bandini: what's the patch that threw that error? | 06:56 |
| hanish | Hi all, I am trying to invoke a tripleo-puppet module from ComputePostConfig templates, puppet module is not invoked, would this model work | 06:57 |
| *** agurenko has quit IRC | 06:57 | |
| bandini | jaosorior: https://review.openstack.org/#/c/516373/ | 06:59 |
| jaosorior | bandini: wow, that sure seems unrelated. | 06:59 |
| *** agurenko has joined #tripleo | 06:59 | |
| bandini | yeah I am absolutely certain it is unrelated. I use the patch in the review on a daily basis | 07:00 |
| bandini | and exceptionally (due to a number of reasons) that patch is already in pike, just not in master | 07:01 |
| *** udesale has joined #tripleo | 07:02 | |
| bandini | jaosorior: wonder if http://logs.openstack.org/73/516373/1/check-tripleo/legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024/d16790e/logs/overcloud-cephstorage-0/var/log/messages.txt.gz#_Nov__9_05_19_04 is related | 07:04 |
| *** spectr has joined #tripleo | 07:06 | |
| jaosorior | bandini: it could be related | 07:07 |
| jaosorior | bandini: is that for pike or master? | 07:07 |
| bandini | master | 07:07 |
| bandini | it happens right after "ASK [authorize TripleO Mistral key for user tripleo-admin]" so my hunch says it is indeed related | 07:08 |
| jaosorior | bandini: so, it could be that the node doesn't trust the undercloud's CA cert | 07:08 |
| jaosorior | bandini: does it only happen for the cephstorage node? | 07:08 |
| *** dr_gogeta86 has quit IRC | 07:09 | |
| *** matbu has quit IRC | 07:09 | |
| jaosorior | bandini: where is that cephstorage node's role defined? | 07:09 |
| *** EmilienM has quit IRC | 07:09 | |
| bandini | jaosorior: looking into it. Wonder if we are missing the CAcerts service for the ceph role | 07:09 |
| *** mjblack has quit IRC | 07:09 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 07:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 07:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 07:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 07:10 |
| jaosorior | bandini: that's what I was thinking about | 07:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 07:10 |
| jaosorior | bandini: some services are missing it apparently | 07:10 |
| jaosorior | bandini: I'm gonna head and add it for everything | 07:10 |
| bandini | jaosorior: aye. so from http://logs.openstack.org/73/516373/1/check-tripleo/legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024/d16790e/logs/undercloud/home/zuul/overcloud-deploy.sh it seems that no custom roles are being used? | 07:11 |
| openstackgerrit | Siyi Luo proposed openstack/tripleo-quickstart-extras master: Update the documentation link for doc migration https://review.openstack.org/504017 | 07:11 |
| jaosorior | wha | 07:12 |
| jaosorior | ok | 07:12 |
| jaosorior | bandini: so, the default CephStorage has CACerts there | 07:13 |
| jaosorior | bandini: that job is supposed to enable public TLS | 07:13 |
| jaosorior | and I don't even see the TLS-related environments there | 07:14 |
| jaosorior | wtf | 07:14 |
| jaosorior | bandini: | 07:15 |
| jaosorior | wait a minute | 07:15 |
| jaosorior | so yeah | 07:15 |
| jaosorior | that's the issue | 07:15 |
| jaosorior | undercloud SSL is enabling | 07:15 |
| jaosorior | * undercloud SSL is enabled | 07:15 |
| jaosorior | and the trust anchor injection is not being done, cause the environment is not being passed. | 07:15 |
| bandini | ah okay that would explain it | 07:16 |
| jaosorior | bandini: so, is that job consistently failing then? | 07:16 |
| bandini | is that job supposed to be public-tls or was it enabled on the undercloud by accident or something? | 07:16 |
| *** jprovazn has joined #tripleo | 07:16 | |
| bandini | jaosorior: good question ;) | 07:16 |
| bandini | jaosorior: http://tripleo.org/cistatus.html I'd say yes? | 07:17 |
| jaosorior | bandini: ok, so we have two options now | 07:17 |
| bandini | last working one on master was http://logs.openstack.org/90/518590/4/check-tripleo/legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024/88b08d9/ | 07:17 |
| janki | moshele, hey | 07:18 |
| jaosorior | bandini: one option is to fix this, in quickstart; so when undercloud TLS is enabled, we should pass the CA injection template (with the undercloud's CA) | 07:18 |
| jaosorior | bandini: the other option (easier one) is to just disable undercloud TLS | 07:18 |
| jaosorior | in that job | 07:19 |
| jaosorior | hint: I'm more keen for the first option | 07:19 |
| bandini | jaosorior: ack. let's find out when/how the undercloud tls was enabled, because this job worked a day or two ago | 07:19 |
| *** mjblack has joined #tripleo | 07:19 | |
| jaosorior | bandini: can you file a bug in launchpad? | 07:19 |
| bandini | jaosorior: how do you tell tls is enabled on undercloud the fastest way? | 07:19 |
| * bandini disappears for some breakfast | 07:20 | |
| jaosorior | bandini: looking for undercloud_generate_service_certificate | 07:20 |
| *** ykarel_ is now known as ykarel | 07:22 | |
| *** yprokule has joined #tripleo | 07:23 | |
| *** dpawar has joined #tripleo | 07:25 | |
| jaosorior | bandini: so it might have been that it used to use a private endpoint and now it's using a public one, so that's why it's failing. But it seems to me that it would have never worked due to the way things are being set up now | 07:28 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/pike: Fix rights to local_settings.d for dockerized Horizon https://review.openstack.org/518533 | 07:31 |
| *** mandre has joined #tripleo | 07:33 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Make overcloud trust undercloud CA if undercloud has TLS https://review.openstack.org/518675 | 07:39 |
| jaosorior | bandini: ^^ | 07:39 |
| *** dmacpher has quit IRC | 07:41 | |
| *** kbyrne has quit IRC | 07:44 | |
| *** rcernin has quit IRC | 07:45 | |
| *** kbyrne has joined #tripleo | 07:47 | |
| mandre | therve: hey, good morning. What do you think of the approach in https://review.openstack.org/#/c/518589/, is there a chance it gets merged? | 07:48 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Make overcloud trust undercloud CA if undercloud has TLS https://review.openstack.org/518675 | 07:49 |
| chandankumar | therve: hello | 07:52 |
| chandankumar | therve: i saw your ping, you have some queries related to tempest packaging, feel free to shoot it | 07:52 |
| *** mcornea has joined #tripleo | 07:53 | |
| *** jbadiapa_ has joined #tripleo | 07:54 | |
| *** jbadiapa has quit IRC | 07:57 | |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-heat-templates stable/pike: Env files for ODL deployments https://review.openstack.org/518260 | 08:00 |
| *** ykarel is now known as ykarel|lunch | 08:00 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Set ipc=host for services attaching encrypted volumes https://review.openstack.org/517209 | 08:01 |
| *** tesseract has joined #tripleo | 08:01 | |
| *** ffiore has joined #tripleo | 08:02 | |
| *** moshele has quit IRC | 08:04 | |
| *** oidgar_ has joined #tripleo | 08:06 | |
| *** oidgar_ is now known as oidgar | 08:07 | |
| *** aufi has joined #tripleo | 08:10 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 08:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 08:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 08:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 08:10 |
| *** ebarrera has joined #tripleo | 08:11 | |
| openstackgerrit | Siyi Luo proposed openstack/tripleo-quickstart-extras master: Update the documentation link for doc migration https://review.openstack.org/504017 | 08:18 |
| *** anshul has joined #tripleo | 08:21 | |
| *** ebarrera has quit IRC | 08:21 | |
| *** ebarrera has joined #tripleo | 08:22 | |
| *** adac has joined #tripleo | 08:24 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Do not set cluster in maintenance mode during split stack upgrade https://review.openstack.org/518597 | 08:25 |
| openstackgerrit | Merged openstack/tripleo-common stable/pike: Derive params support for ODL DPDK feature https://review.openstack.org/511410 | 08:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Set bind mount propegatation to shared for /var/lib/nova. https://review.openstack.org/518554 | 08:25 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Fix wrong permission on database during mysql_init tasks. https://review.openstack.org/518513 | 08:26 |
| *** marios has quit IRC | 08:28 | |
| *** ykarel|lunch is now known as ykarel | 08:28 | |
| *** yprokule_ has joined #tripleo | 08:29 | |
| *** d0ugal_ has quit IRC | 08:30 | |
| *** marios has joined #tripleo | 08:30 | |
| *** d0ugal has joined #tripleo | 08:30 | |
| *** d0ugal has quit IRC | 08:30 | |
| *** d0ugal has joined #tripleo | 08:30 | |
| *** yprokule has quit IRC | 08:32 | |
| *** yprokule_ is now known as yprokule | 08:32 | |
| *** rcernin has joined #tripleo | 08:37 | |
| *** moshele has joined #tripleo | 08:39 | |
| therve | chandankumar, Thanks, we sorted it out! | 08:41 |
| chandankumar | therve: np :-) | 08:41 |
| therve | mandre, Yeah I saw the patch. Not super excited about it | 08:41 |
| *** anilvenkata has quit IRC | 08:42 | |
| mandre | therve: yeah... I understand, but I don't see a clean solution for it... I don't want to copy all the logic in python-tripleoclient | 08:43 |
| mandre | therve: and rendering the templates before is also a bit tricky I think | 08:44 |
| *** jaosorior has quit IRC | 08:44 | |
| therve | mandre, I'm mostly worried that it will hide errors at some point | 08:44 |
| Tengu | erf… nova instance resize fails. | 08:45 |
| * Tengu needs more coffee | 08:45 | |
| mandre | therve: note I do not change the default, I just make it possible to not blow up on missing file | 08:45 |
| mandre | therve: if you call the function with ignore_missing=True, I assume you know what you're doing | 08:45 |
| *** dsariel__ has quit IRC | 08:46 | |
| therve | mandre, Right, but how many places in tripleo call that? | 08:46 |
| therve | I only saw the tripleo.templates.process action | 08:47 |
| *** aditya_ra has joined #tripleo | 08:47 | |
| mandre | therve: oh I don't worry about the tripleo calls, I'll just do it in the one place in tripleoclient that may call the function early | 08:48 |
| mandre | therve: that's in the prepare command | 08:48 |
| therve | Ah ok, that's not in a workflow then | 08:48 |
| *** jistr is now known as jistr|mtg | 08:48 | |
| mandre | therve: I was waiting to get positive feedback on the approach before submitting the tripleoclient change, I can do it right away if that helps you picture it better | 08:49 |
| *** jpich has joined #tripleo | 08:49 | |
| *** aditya_r has quit IRC | 08:50 | |
| therve | mandre, Just maybe don't change ignore_if, and catch the error instead | 08:51 |
| therve | get_file_contents supports URLs, os.path won't help there | 08:52 |
| mandre | therve: ack, agreed the patch needs more work | 08:53 |
| *** dtantsur|afk is now known as dtantsur | 08:53 | |
| moshele | janki: hi | 08:54 |
| *** achadha has joined #tripleo | 08:54 | |
| moshele | janki: I have question to regarding odl setup | 08:55 |
| janki | moshele, hey ya sure. go ahead | 08:55 |
| openstackgerrit | Martin André proposed openstack/python-tripleoclient master: Ignore missing rendered heat envs in prepare https://review.openstack.org/518688 | 08:58 |
| *** achadha has quit IRC | 08:59 | |
| mandre | therve: ^^ that's the tripleoclient change, I'm now going to rework a bit the heatclient one if you're fine with the approach | 08:59 |
| *** zshi has quit IRC | 08:59 | |
| therve | Yeah that sounds ok, let me think about it a bit more to be sure | 09:00 |
| mandre | I think it's a valid use case BTW | 09:00 |
| *** zshi has joined #tripleo | 09:00 | |
| *** anilvenkata has joined #tripleo | 09:01 | |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates stable/pike: Re-enable containerized fluentd https://review.openstack.org/518690 | 09:02 |
| therve | mandre, Sooo, alternative suggestion :) | 09:02 |
| therve | mandre, There are trick arguments, env_path_is_object and object_request | 09:02 |
| therve | If you implement those, you should be able to define your own behavior | 09:03 |
| *** yprokule_ has joined #tripleo | 09:04 | |
| mandre | therve: I'm not sure to understand how env_path_is_object and object_request work, do you have an example somewhere? | 09:06 |
| *** gfidente has joined #tripleo | 09:07 | |
| therve | Sure writing something | 09:07 |
| *** yprokule has quit IRC | 09:07 | |
| *** yprokule_ is now known as yprokule | 09:07 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 09:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 09:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 09:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 09:10 |
| therve | mandre, Something like that: http://paste.openstack.org/show/625888/ | 09:10 |
| *** lennyb has joined #tripleo | 09:10 | |
| gfidente | marios didn't do it yesterday | 09:11 |
| gfidente | will do it now :D | 09:11 |
| mandre | therve: wow! | 09:11 |
| mandre | therve: if it works it's insanely cool, let me try it out | 09:12 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: OVN: Provide the option to define NeutronBridgeMappings as a role parameter https://review.openstack.org/518440 | 09:12 |
| *** brault_ has quit IRC | 09:13 | |
| *** brault has joined #tripleo | 09:14 | |
| *** waleedm has joined #tripleo | 09:15 | |
| *** ukalifon has joined #tripleo | 09:18 | |
| *** suuuper has joined #tripleo | 09:18 | |
| marios | gfidente: which bit? | 09:18 |
| gfidente | marios step0 validation | 09:20 |
| marios | ah ack | 09:20 |
| *** aditya_ra has quit IRC | 09:22 | |
| *** lucas-afk is now known as lucasagomes | 09:24 | |
| mandre | therve: that seems to do the trick, awesome! I'll make the change to tripleoclient and abandon the heatclient's one | 09:24 |
| therve | mandre, Great let me know if you have an issue later on | 09:25 |
| *** EmilienM has joined #tripleo | 09:31 | |
| *** ChanServ sets mode: +v EmilienM | 09:31 | |
| *** gfidente has quit IRC | 09:31 | |
| *** matbu_ has joined #tripleo | 09:31 | |
| *** gfidente has joined #tripleo | 09:32 | |
| *** gfidente has quit IRC | 09:32 | |
| *** gfidente has joined #tripleo | 09:32 | |
| *** bcafarel has joined #tripleo | 09:32 | |
| mandre | therve: do I need env_base_url? seems unused | 09:32 |
| *** panda|ruck|bbl is now known as panda|ruck | 09:32 | |
| therve | mandre, Ah no you can remove that | 09:33 |
| *** hjensas has joined #tripleo | 09:34 | |
| *** hjensas has quit IRC | 09:34 | |
| *** hjensas has joined #tripleo | 09:34 | |
| moshele | janki: my understanding is that when you deploy with opendalight you first need to add it to the overcloud-full image, is that right? | 09:34 |
| janki | moshele, are you doing non-containarised deployment? | 09:35 |
| *** dr_gogeta86 has joined #tripleo | 09:35 | |
| *** dr_gogeta86 has joined #tripleo | 09:35 | |
| moshele | janki: yes | 09:35 |
| janki | then ya, you need to customise overcloud-full image to include ODL rpm | 09:36 |
| janki | I would suggest you to move to containrised deployment though | 09:36 |
| moshele | janki: why ? | 09:36 |
| janki | moshele, because that's recommended way since Pike and I think going to be default after few releases | 09:37 |
| *** ffiore has quit IRC | 09:39 | |
| Tengu | submitting my first patch against an oslo lib \o/ | 09:41 |
| *** bogdando has joined #tripleo | 09:42 | |
| *** derekh has joined #tripleo | 09:42 | |
| *** ffiore has joined #tripleo | 09:44 | |
| gfidente | guys. was thinking, do we have a policy for environment files deprecation? | 09:46 |
| moshele | janki: but I want to tested with an opendaylight that has unmerged patches | 09:46 |
| gfidente | like renaming them and append -deprecated suffix or something? | 09:46 |
| gfidente | marios ^^ ? | 09:47 |
| moshele | janki: so that why I want to test the non-containarised deployment first. | 09:47 |
| janki | moshele, give me 5 mins. I will get back. in middle of something | 09:47 |
| moshele | janki: np | 09:47 |
| *** suuuper has quit IRC | 09:48 | |
| *** suuuper has joined #tripleo | 09:48 | |
| Tengu | gfidente: I think I saw at least in some of them a " #deprecated, use <> instead" | 09:50 |
| Tengu | gfidente: for example: openstack-tripleo-heat-templates/environments/enable-tls.yaml:# DEPRECATED: Use tripleo-heat-templates/environments/ssl/enable-tls.yaml instead. | 09:51 |
| *** skramaja_ has quit IRC | 09:51 | |
| *** salmankhan has joined #tripleo | 09:52 | |
| *** dsariel__ has joined #tripleo | 09:55 | |
| marios | gfidente: not that i know of we do have a 'services/disabled' subdirectory for things we are deprecating/and or not deploy by default | 09:56 |
| gfidente | I was thinking about appending a -deprecated suffix to the file names | 09:57 |
| gfidente | so they are still in the directory where the docs point | 09:57 |
| gfidente | but people immediately realizes they are deprecated because the name changed | 09:57 |
| *** dsariel_ has joined #tripleo | 09:57 | |
| gfidente | (and hopefully go read the comments in the file) | 09:57 |
| *** skramaja has joined #tripleo | 09:58 | |
| Tengu | gfidente: on my own, I now make a `git grep -ri deprecated' when I update the template repository. | 09:58 |
| Tengu | hmm, what happens to the openstack CLI when we point to an env file that doesn't exist anymore, in fact? | 09:59 |
| gfidente | Tengu it fails because the file doesn't exist | 10:01 |
| *** dsariel__ has quit IRC | 10:01 | |
| Tengu | gfidente: good. I have nothing a renaming, on the contrary, in that case. | 10:02 |
| Tengu | git-grep-ing is fun, but there are sooo many matches it's a bit overhelming. | 10:02 |
| *** dsariel__ has joined #tripleo | 10:02 | |
| gfidente | marios the upgrade_tasks are executed on the baremetal node right? | 10:03 |
| *** dsariel_ has quit IRC | 10:05 | |
| marios | gfidente: yes | 10:05 |
| *** ffiore has quit IRC | 10:06 | |
| *** ffiore has joined #tripleo | 10:07 | |
| *** dsariel_ has joined #tripleo | 10:08 | |
| openstackgerrit | Martin André proposed openstack/python-tripleoclient master: Ignore missing rendered heat envs in prepare https://review.openstack.org/518688 | 10:08 |
| openstackgerrit | Martin André proposed openstack/python-tripleoclient master: Ignore missing rendered heat envs in prepare https://review.openstack.org/518688 | 10:09 |
| mandre | therve: ^^ thanks a lot for the help | 10:09 |
| *** tosky has joined #tripleo | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 10:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 10:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 10:10 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Fail on upgrade if legacy ceph::profile::params::osds hiera is found https://review.openstack.org/518698 | 10:11 |
| gfidente | marios https://review.openstack.org/#/c/518698/ ? | 10:11 |
| *** dsariel__ has quit IRC | 10:12 | |
| gfidente | marios I am not sure if/how I can send back a meaningful error message? | 10:12 |
| *** cshastri has quit IRC | 10:14 | |
| *** dsariel__ has joined #tripleo | 10:14 | |
| *** jistr|mtg is now known as jistr | 10:15 | |
| *** links has quit IRC | 10:15 | |
| *** dpawar has quit IRC | 10:17 | |
| *** dsariel_ has quit IRC | 10:18 | |
| *** dsariel_ has joined #tripleo | 10:19 | |
| *** hanish has quit IRC | 10:19 | |
| *** dsariel__ has quit IRC | 10:21 | |
| janki | moshele, hey | 10:23 |
| *** dsariel__ has joined #tripleo | 10:24 | |
| moshele | janki: hi | 10:24 |
| janki | moshele, sorry to keep you waiting. go ahead please | 10:25 |
| moshele | janki: google hungout or bluejeans session? it will be easier for me :) | 10:27 |
| moshele | janki: can we do a google hungout or bluejeans session? it will be easier for me :) | 10:27 |
| janki | moshele, sure. how about bluejeans? | 10:27 |
| *** dsariel_ has quit IRC | 10:28 | |
| moshele | janki: yes can you send me your link? | 10:28 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Install ssh keys of tripleo ci admins on nodes https://review.openstack.org/518638 | 10:28 |
| *** dsariel_ has joined #tripleo | 10:29 | |
| *** Usman has quit IRC | 10:32 | |
| *** dsariel__ has quit IRC | 10:33 | |
| marios | gfidente: hmm good question. not sure we do that for any of the tasks you know. there must be some ansible logging module though | 10:33 |
| marios | gfidente: http://docs.ansible.com/ansible/latest/syslogger_module.html | 10:34 |
| openstackgerrit | Martin André proposed openstack/python-tripleoclient master: Ignore missing rendered heat envs in prepare https://review.openstack.org/518688 | 10:34 |
| marios | gfidente: http://docs.ansible.com/ansible/latest/fail_module.html | 10:34 |
| *** dsariel__ has joined #tripleo | 10:34 | |
| *** dsariel_ has quit IRC | 10:37 | |
| *** dsariel_ has joined #tripleo | 10:44 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Send ARA statistics to Graphite server https://review.openstack.org/479882 | 10:44 |
| *** dtantsur is now known as dtantsur|bbl | 10:46 | |
| *** chem has joined #tripleo | 10:47 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: WIP: send graphite stats from ARA https://review.openstack.org/480121 | 10:47 |
| *** dsariel__ has quit IRC | 10:48 | |
| *** dsariel__ has joined #tripleo | 10:50 | |
| *** dsariel_ has quit IRC | 10:52 | |
| jistr | mandre: can you plese check out https://review.openstack.org/#/c/518583 ? Then i'll move the patch that adds logging readmes on top of jaosorior's logging patches, as there are unavoidable conflicts. I'll have to put the patch into the chain of work that Juan is doing, otherwise it would keep getting -1'd by zuul every day :) | 10:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: RHSM: when using proxy, test its connectivity first https://review.openstack.org/517442 | 10:57 |
| openstackgerrit | Merged openstack/instack-undercloud stable/pike: Add one level of verbosity for memcached https://review.openstack.org/518020 | 10:57 |
| *** raildo has joined #tripleo | 10:57 | |
| *** dsariel__ has quit IRC | 10:59 | |
| *** dpawar has joined #tripleo | 11:02 | |
| gfidente | marios test != if | 11:05 |
| gfidente | commented in gerrit | 11:05 |
| *** jprovazn has quit IRC | 11:06 | |
| marios | gfidente: k thanks for checking | 11:07 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 11:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 11:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 11:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 11:10 |
| *** etingof has joined #tripleo | 11:11 | |
| *** rfolco has joined #tripleo | 11:14 | |
| *** ratailor has quit IRC | 11:16 | |
| *** ansmith has quit IRC | 11:16 | |
| *** ansmith_ has quit IRC | 11:17 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Install ssh keys of tripleo ci admins on nodes https://review.openstack.org/518638 | 11:17 |
| *** shreshtha_ has quit IRC | 11:19 | |
| openstackgerrit | Lee Yarwood proposed openstack/python-tripleoclient master: Add setup-heat-outputs option to get heat stack outputs https://review.openstack.org/495658 | 11:20 |
| *** zshi has quit IRC | 11:21 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/pike: Make docker network configurable https://review.openstack.org/517661 | 11:21 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Change default ml2 firewall driver back to iptables_hybrid https://review.openstack.org/518590 | 11:21 |
| *** paramite has joined #tripleo | 11:23 | |
| *** stendulker_ has joined #tripleo | 11:24 | |
| *** dpawar has quit IRC | 11:25 | |
| *** rcernin has quit IRC | 11:26 | |
| *** stendulker has quit IRC | 11:26 | |
| *** anilvenkata has quit IRC | 11:26 | |
| *** chem has quit IRC | 11:27 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-common stable/pike: Healthcheck for nova_migration_target container https://review.openstack.org/518709 | 11:27 |
| *** salmankhan has quit IRC | 11:27 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Write readme.txt into old log directories https://review.openstack.org/518584 | 11:27 |
| *** anilvenkata has joined #tripleo | 11:28 | |
| *** stendulker_ has quit IRC | 11:29 | |
| owalsh | mandre: when you have a minute could you please take a look at https://review.openstack.org/517125 | 11:30 |
| *** salmankhan has joined #tripleo | 11:31 | |
| *** jaganathan has quit IRC | 11:33 | |
| mandre | owalsh: let me know if you want me to approve too, I'm not sure but I think the tripleo policy around backports allows it | 11:42 |
| owalsh | mandre: yea, please do. policy allows it AFAIK | 11:43 |
| mandre | owalsh: we almost had it right, https://specs.openstack.org/openstack/tripleo-specs/specs/policy/expedited-approvals.html#single-2-approvals | 11:45 |
| mandre | owalsh: now I'll need to propose you as core | 11:45 |
| *** ffiore has quit IRC | 11:47 | |
| *** jkilpatr has quit IRC | 11:47 | |
| *** jaosorior has joined #tripleo | 11:47 | |
| owalsh | mandre: :-) | 11:48 |
| owalsh | mandre: might be quicker to get another +2 though | 11:49 |
| jaosorior | sshnaidm, adarazs|rover how can I see the logs from these jobs https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-master-nv/1783/console ? | 11:49 |
| sshnaidm | jaosorior, scroll to the end of page | 11:49 |
| sshnaidm | jaosorior, there is a link to logs | 11:50 |
| adarazs|rover | yep, one of the last lines. | 11:50 |
| adarazs|rover | though we should actually output the log link instead of the jenkins link. | 11:50 |
| adarazs|rover | that's some config on the jenkins side. | 11:50 |
| jaosorior | sshnaidm: oh, thanks! | 11:51 |
| jaosorior | adarazs|rover, sshnaidm: By the way the gate-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024 job has been failing with TLS issues and I'm trying to fix it here https://review.openstack.org/#/c/518675/ | 11:52 |
| *** chem has joined #tripleo | 11:57 | |
| sshnaidm | jaosorior, ack, thanks | 11:57 |
| jaosorior | sshnaidm: I was missing the passing of the environment file | 11:57 |
| jaosorior | adding that next | 11:57 |
| *** jprovazn has joined #tripleo | 11:58 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Make overcloud trust undercloud CA if undercloud has TLS https://review.openstack.org/518675 | 12:03 |
| jaosorior | gfidente: I need a bit more info on the ceph issue you asked about | 12:05 |
| jaosorior | where does the docker socket name change? | 12:05 |
| jaosorior | which socket name? | 12:05 |
| openstackgerrit | waleed mousa proposed openstack/tripleo-heat-templates master: Adds environment file for ODL OVS Hardware Offload https://review.openstack.org/518715 | 12:06 |
| jaosorior | bandini: hey, if you have a chance can you check this out https://review.openstack.org/#/c/516732/ ? | 12:07 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 12:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 12:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 12:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 12:10 |
| *** ramishra has quit IRC | 12:13 | |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce Fast Forward Upgrade tasks and playbooks https://review.openstack.org/499221 | 12:13 |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: WIP ffu: tripleo-packages repo management https://review.openstack.org/515429 | 12:13 |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: WIP ffu: Introduce keystone fast-forward upgrade tasks https://review.openstack.org/514621 | 12:13 |
| openstackgerrit | Lee Yarwood proposed openstack/tripleo-heat-templates master: DNM ffu: Workaround missing repo control when moving to Queens https://review.openstack.org/518719 | 12:13 |
| *** pradk has joined #tripleo | 12:17 | |
| openstackgerrit | Pranali Deore proposed openstack/puppet-tripleo stable/newton: Sync the db as part of the glance-api install https://review.openstack.org/515333 | 12:19 |
| gfidente | jaosorior the issue isnt' with the socket name | 12:20 |
| gfidente | jaosorior we just need to pass an additional param to ceph-ansible | 12:20 |
| gfidente | when we're using fqdn | 12:20 |
| gfidente | so I wanted to figure a way to add a condtion | 12:21 |
| jaosorior | gfidente: can we do bluejeans so you can explain the whole picture better? honestly I'm not sure if I understand the problem. | 12:21 |
| jaosorior | what's the issue when you use an fqdn? | 12:21 |
| gfidente | jaosorior fqdn isn't the issue | 12:22 |
| *** mandre_ has joined #tripleo | 12:22 | |
| *** jkilpatr has joined #tripleo | 12:22 | |
| gfidente | the issue I have is adding a condition to pass an additional param to ceph-ansible when we're using fqdn | 12:22 |
| gfidente | so I was thinking to look at CloudDomain | 12:22 |
| gfidente | is that sufficient? | 12:22 |
| jaosorior | sufficient for what? | 12:22 |
| gfidente | to determine if we're using fqdn | 12:23 |
| jaosorior | gfidente: why not always use an FQDN? | 12:23 |
| gfidente | jaosorior ok give me a few mins | 12:24 |
| gfidente | then we can have a call | 12:24 |
| gfidente | can I ping you in ~1h ? | 12:24 |
| jaosorior | gfidente: sure. | 12:24 |
| gfidente | ack thanks | 12:24 |
| jaosorior | gfidente: sorry about that, but I really need more context in order to provide a better solution or recommendation. | 12:24 |
| gfidente | yep | 12:24 |
| gfidente | it's fine | 12:24 |
| gfidente | I wouldn't have pinged if I didn't want feedback :D | 12:25 |
| sri__ | hello folks, I've deployed overcloud with enabling docker, overcloud deployed successfully but I am getting this error: Failed to discover available identity versions when contacting http://192.168.15.129:5000/v2.0. Attempting to parse version from URL | 12:27 |
| *** pdeore has quit IRC | 12:27 | |
| sri__ | http://paste.openstack.org/show/625917/ | 12:27 |
| jaosorior | sri__: what version? | 12:28 |
| sri__ | stable/pike | 12:28 |
| *** marios has quit IRC | 12:28 | |
| jaosorior | sri__: when you do curl http://192.168.15.129:5000/v2.0 do you get anything? | 12:28 |
| sri__ | jaosorior: Failed connect to 192.168.15.129:5000; Connection refused | 12:28 |
| jaosorior | right | 12:28 |
| *** marios has joined #tripleo | 12:29 | |
| jaosorior | sri__: can you show your overcloud deploy command? | 12:29 |
| sri__ | j http://paste.openstack.org/show/625917/ | 12:29 |
| *** cylopez has joined #tripleo | 12:30 | |
| jaosorior | sri__: ok, so no network isolation, no HA, and no SSL | 12:30 |
| jaosorior | sri__: can you log into your controller and show me what containers are running? | 12:30 |
| sri__ | jaosorior: no containers running ? | 12:30 |
| jaosorior | sri__: you're logged in as root in a controller, and docker ps doesn't show anything? | 12:31 |
| sri__ | jaosorior: yes , no images also | 12:31 |
| jaosorior | sri__: can you do journalctl -t os-collect-config ? | 12:31 |
| jaosorior | sri__: does that show any suspicious errors? | 12:31 |
| sri__ | jaosorior: no, | 12:33 |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-common master: Octavia post deployment mistral wrapper https://review.openstack.org/515402 | 12:33 |
| jaosorior | sri__: can you try pulling an image from your registry? | 12:33 |
| sri__ | jaosorior: I didn't pull the images to my local registry ? | 12:34 |
| jaosorior | well, you said there weren't any images. So if you try to pull them yourself, does that succeed? or does that give you any errors? | 12:35 |
| sri__ | docker pull trunk.registry.rdoproject.org/master/centos-binary-aodh-api:tripleo-passed-ci | 12:35 |
| sri__ | something like this | 12:35 |
| jaosorior | right | 12:35 |
| jaosorior | is that working? | 12:35 |
| sri__ | Trying to pull repository trunk.registry.rdoproject.org/master/centos-binary-aodh-api ... Pulling repository trunk.registry.rdoproject.org/master/centos-binary-aodh-api Error: image master/centos-binary-aodh-api:tripleo-passed-ci not found | 12:35 |
| jaosorior | right | 12:35 |
| jaosorior | that seems to be the issue then | 12:35 |
| jaosorior | sri__: does your overcloud have any external connectivity? | 12:36 |
| *** bobh has joined #tripleo | 12:36 | |
| sri__ | jaosorior: yes | 12:36 |
| sri__ | I can pull from dockerhub | 12:36 |
| jaosorior | ok | 12:36 |
| *** cylopez has quit IRC | 12:36 | |
| jaosorior | uhm | 12:37 |
| sri__ | I think this tag not there tripleo-passed-ci! | 12:37 |
| *** bobh has quit IRC | 12:37 | |
| jaosorior | sri__: IIRC adarazs|rover and sshnaidm were talking about there being an issue with tripleo-passed-ci | 12:37 |
| *** bobh has joined #tripleo | 12:38 | |
| adarazs|rover | jaosorior: are we talking about containers and tags? | 12:38 |
| jaosorior | adarazs|rover: sri__ is getting errors such as: Trying to pull repository trunk.registry.rdoproject.org/master/centos-binary-aodh-api ... Pulling repository trunk.registry.rdoproject.org/master/centos-binary-aodh-api Error: image master/centos-binary-aodh-api:tripleo-passed-ci not found | 12:39 |
| sri__ | jaosorior: how did I get message : c1133620-0fef-4d80-9105-ec651289a3d7 | overcloud | 87b61d6a3845458a887b5517f9e74fde | CREATE_COMPLETE | 2017-11-09T11:32:28Z | None | 12:39 |
| jaosorior | sri__: magic? | 12:39 |
| jaosorior | sri__: no idea | 12:39 |
| sri__ | jaosorior: this is the first time I've using containers , it's looks like lot of fun | 12:40 |
| adarazs|rover | first, it should not be "tripleo-passed-ci", it's either "passed-ci" , but whatever config you're using, it should be "current-tripleo" now. | 12:40 |
| openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Setting default log url for tempestmail https://review.openstack.org/518723 | 12:41 |
| *** bobh has quit IRC | 12:42 | |
| *** dsariel__ has joined #tripleo | 12:43 | |
| *** shreshtha has joined #tripleo | 12:45 | |
| sri__ | jaosorior, adarazs|rover, I can pull the images using this tag only "tripleo-ci-testing" , I've tried with passed-ci, current-tripleo this tag are not working | 12:45 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart master: Fix ansible syntax error for dlrn_hash_tag https://review.openstack.org/518724 | 12:45 |
| ykarel | adarazs|rover, should sri__ use docker.io instead of trunk.registry.rdoproject.org and tripleomaster instead of master(until tags fro trunk.registry.rdoproject.org is fixed) because we have tags there: https://hub.docker.com/r/tripleomaster/centos-binary-aodh-api/tags/ | 12:54 |
| *** ansmith has joined #tripleo | 12:55 | |
| sri__ | ykarel: ok, thanks | 12:55 |
| *** ansmith_ has joined #tripleo | 12:55 | |
| *** abishop has joined #tripleo | 12:55 | |
| adarazs|rover | sri__: yeah, we have a problem with tagging correctly on rdo registry. it should work after this merges and we have a new promotion: https://review.rdoproject.org/r/10453 | 12:57 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Send graphite stats from ARA https://review.openstack.org/480121 | 12:57 |
| *** jlabarre has joined #tripleo | 12:57 | |
| *** bobh has joined #tripleo | 12:58 | |
| sri__ | adarazs|rover: got it , thanks | 12:58 |
| sri__ | openstack overcloud container image prepare --namespace docker.io/tripleomaster --tag current-tripleo --env-file ~/docker_registry.yaml | 13:00 |
| openstackgerrit | waleed mousa proposed openstack/tripleo-heat-templates master: Adds environment file for ODL OVS Hardware Offload https://review.openstack.org/518715 | 13:00 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix devmode by right order of playbooks https://review.openstack.org/518336 | 13:00 |
| sshnaidm | ykarel, ^^ | 13:00 |
| ykarel | sshnaidm, Ok i will abandon my patches now | 13:01 |
| adarazs|rover | sshnaidm: can you add Closes-bug: #1730997 ? | 13:03 |
| openstack | bug 1730997 in tripleo "quickstart devmode.sh fails on OVB deployment on the "Run virt-customize on the provided image" task" [High,Triaged] https://launchpad.net/bugs/1730997 | 13:03 |
| adarazs|rover | sshnaidm: people seem to be favoring random email threads about this instead of a bug it seems o_O :) | 13:03 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix devmode run of quickstart https://review.openstack.org/518336 | 13:05 |
| sshnaidm | adarazs|rover, updated | 13:05 |
| *** eck`gone is now known as eck` | 13:08 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 13:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1730111 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 13:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 13:10 |
| *** achadha has joined #tripleo | 13:10 | |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 13:10 |
| openstack | Launchpad bug 1730111 in tripleo "Volume service hostgroup@tripleo_iscsi failed to start.: CappedVersionUnknown: Unrecoverable Error" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 13:10 |
| *** bobh has quit IRC | 13:11 | |
| *** achadha has quit IRC | 13:14 | |
| *** ramishra has joined #tripleo | 13:15 | |
| openstackgerrit | Janki Chhatbar proposed openstack/puppet-tripleo master: Enables websocket based port status for OpenDaylight https://review.openstack.org/515576 | 13:15 |
| *** sshnaidm is now known as sshnaidm|bbl | 13:17 | |
| *** dtantsur|bbl is now known as dtantsur | 13:18 | |
| *** tzumainn has joined #tripleo | 13:20 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Write readme.txt into old log directories https://review.openstack.org/518584 | 13:20 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Add missing host_prep_tasks for memcached https://review.openstack.org/518729 | 13:20 |
| *** milan has joined #tripleo | 13:23 | |
| *** liverpooler has joined #tripleo | 13:26 | |
| milan | bogdando, hey, w/r this email thread: http://lists.openstack.org/pipermail/openstack-dev/2017-November/124160.html ; I don't think there's been any conclusion. I might have forgotten to mention that inspector has to shut-dow/start-up dnsmasq too | 13:27 |
| milan | bogdando, so would you guys accept the supervisord as a solution? | 13:27 |
| *** shreshtha has quit IRC | 13:27 | |
| * milan talks about the fat container | 13:28 | |
| milan | esp. would such a solution survive 1--2 cycles? | 13:28 |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: Implements AIDE Intrusion Detection System https://review.openstack.org/483025 | 13:28 |
| milan | EmilienM, ^^ | 13:29 |
| milan | dtantsur, ^^^ ;) | 13:29 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: Implements AIDE Intrusion Detection System https://review.openstack.org/483028 | 13:30 |
| dtantsur | thanks for raising this, milan | 13:30 |
| dtantsur | folks, we're going to commit to some architecture in ironic-inspector, and we need your input | 13:30 |
| milan | dtantsur, no prob | 13:30 |
| *** masco has quit IRC | 13:31 | |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart master: Add playbook argument to full-deploy-ovb.sh https://review.openstack.org/518732 | 13:32 |
| *** ratailor has joined #tripleo | 13:33 | |
| jkilpatr | jaosorior, I think I accidentally nuked your review sorry | 13:35 |
| * jkilpatr didn't even know you could do that | 13:35 | |
| jaosorior | jkilpatr: neither did I | 13:36 |
| *** rlandy has joined #tripleo | 13:37 | |
| *** dpawar has joined #tripleo | 13:37 | |
| *** jmelvin has joined #tripleo | 13:37 | |
| openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Deprecate hyperconverged-ceph.yaml https://review.openstack.org/518650 | 13:38 |
| jaosorior | jkilpatr: done | 13:38 |
| *** salmankhan has quit IRC | 13:40 | |
| *** dpawar has quit IRC | 13:43 | |
| gfidente | jaosorior can we make that call now? | 13:45 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add option for nova compute container to log to stdout/stderr https://review.openstack.org/510537 | 13:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Set keystone notification topics if ceilometer is enabled https://review.openstack.org/516979 | 13:46 |
| gfidente | hola fultonj | 13:46 |
| fultonj | hi gfidente | 13:47 |
| jaosorior | gfidente: sure | 13:47 |
| gfidente | jaosorior https://bluejeans.com/u/gfidente | 13:47 |
| *** aditya_r has joined #tripleo | 13:48 | |
| milan | OK so let's ask gfidente for instance :D gfidente ; gfidente, hey, long time no see ;) what would you say to a fat container that has 2 services inside, managed with supervisord due to it seemingly being an easier way forward? | 13:49 |
| milan | would you approve? :) | 13:49 |
| *** aputtur_ has joined #tripleo | 13:50 | |
| *** jaosorior has quit IRC | 13:51 | |
| *** aputtur_ has quit IRC | 13:51 | |
| *** aputtur_ has joined #tripleo | 13:52 | |
| gfidente | milan I don't understand the reasons for it but unless necessary I'd avoid that | 13:52 |
| gfidente | milan though if that is a pattern for other services that behave similarily, that would be fine | 13:53 |
| *** skramaja has quit IRC | 13:53 | |
| *** jaosorior has joined #tripleo | 13:53 | |
| milan | gfidente, thanks, honestly, I don't know about how other services handle this situation, may be inspector is unique with these requirements (contained pair of tightly bound services) | 13:54 |
| milan | so far I've got bogdando 's suggestion for a side-cart container but it seems more complicated to me at least on the first glance | 13:54 |
| milan | so I'm looking for more options/opinions or a way forward | 13:55 |
| *** fpan has joined #tripleo | 13:57 | |
| *** ramishra has quit IRC | 13:58 | |
| *** ramishra has joined #tripleo | 14:00 | |
| *** myoung|afk is now known as myoung | 14:00 | |
| *** cdearborn has joined #tripleo | 14:00 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements https://review.openstack.org/511633 | 14:00 |
| *** lblanchard has joined #tripleo | 14:01 | |
| milan | gfidente maybe a different question: if I decide to take this path with the supervisord/fat container would it be something against some policy in TripleO? | 14:02 |
| *** atoth has joined #tripleo | 14:02 | |
| *** udesale has quit IRC | 14:02 | |
| *** lblanchard has joined #tripleo | 14:02 | |
| *** cdearborn_ has joined #tripleo | 14:02 | |
| *** shreshtha has joined #tripleo | 14:03 | |
| *** cdearborn has quit IRC | 14:04 | |
| owalsh | milan: did consider this for nova & libvirt, but didn't have a compelling enough reason to combine them (at least not yet) | 14:04 |
| *** ecerquei has joined #tripleo | 14:05 | |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart master: Add playbook argument to full-deploy-ovb.sh https://review.openstack.org/518732 | 14:06 |
| milan | owalsh, in my case I'd like to be able to: a) turn dnsmasq on/off from inspector b) directly configure dnsmasq via an inspector "driver" as a filtering mechanism c) always schedule those together on the same node d) make sure dnsmasq isn't left running in case inspector died | 14:06 |
| *** salmankhan has joined #tripleo | 14:08 | |
| owalsh | milan: could run systemd in the container maybe | 14:09 |
| *** anilvenkata has quit IRC | 14:09 | |
| bogdando | milan: AFAIK, we approach containerized services as lightweight containers running no init-like systems | 14:09 |
| milan | owalsh, yup, implementations aside | 14:09 |
| bogdando | milan: so supervisord doesn't fit well into that | 14:09 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 14:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 14:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 14:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 14:10 |
| jistr | therve, ramishra: hi, could someone with more Heat knowledge please peek at https://bugs.launchpad.net/tripleo/+bug/1731032 ? It looks like there's an issue somewhere between Heat and os-collect-config. Heat thinks UpdateDeployment should be happening, but os-collect-config doesn't even have metadata for it available. | 14:10 |
| milan | bogdando, so if I made a pull request with a fat container, i'd be -2 due to incompatible approach? | 14:11 |
| therve | jistr, Yeah had a look. No idea what's happening | 14:11 |
| therve | jistr, Do you know how often that happens? | 14:11 |
| bogdando | milan: if we want another process to be running alongside, like httpd for WSGI services, we just use a separate docker step in t-h-t. Can't say how PIDONE folks inject pacemaker_remote though. dciabrin here, perchance?.. | 14:11 |
| bogdando | milan: let's figure that out :) | 14:12 |
| milan | bogdando, thaks :) | 14:12 |
| milan | *thanks | 14:12 |
| * owalsh suspects there are corner cases with nova & libvirt start/stop ordering that will have similar issues | 14:13 | |
| bogdando | IKR | 14:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Make overcloud trust undercloud CA if undercloud has TLS https://review.openstack.org/518675 | 14:14 |
| milan | owalsh, this has also quite big impact on the inspector HA architecture, that's where the need for tight control comes from in my case | 14:14 |
| bogdando | milan: I think for HA it should follow the existing pattern, see https://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/docker/services/pacemaker | 14:15 |
| bogdando | *design pattern | 14:15 |
| dtantsur | bogdando: it's active/active | 14:15 |
| bogdando | pacemaker can roll it as you wish, AFAIK | 14:16 |
| dtantsur | the question is whether ironic-inspector should launch its dnsmasq process or co-exist with it | 14:16 |
| dtantsur | both have pros and cons | 14:16 |
| milan | dtantsur ++ | 14:16 |
| bogdando | rabbit and galeray and haproxy are a/a afaik | 14:16 |
| bogdando | galera* | 14:17 |
| *** janki has quit IRC | 14:17 | |
| bogdando | that depends on OCF/bundle agents I think, not the t-h-t template | 14:17 |
| jistr | therve: hmm no i don't know. haven't seen it yet anywhere else than the instance in the bug /cc mwhahaha | 14:17 |
| bogdando | You really should ask PIDONE folks, dtantsur, milan | 14:17 |
| milan | bogdando, cool, but this leaves us with no -2 on the fat container design, correct? ;) | 14:18 |
| bogdando | I'm not sure | 14:18 |
| dtantsur | milan: I start feeling that launching the dnsmasq process ourself is a lesser evil.. | 14:19 |
| mwhahaha | therve: it happened 2 times yesterday with a really short queue. Unfortunately logstash is backed up so it's hard to tell. Is there some additional debugging we can enable more info we can grab to help? | 14:19 |
| therve | mwhahaha, I'm trying to compare to a successful run to see | 14:20 |
| therve | mwhahaha, Do you have the link to the other failure? | 14:20 |
| *** aditya_r has quit IRC | 14:20 | |
| mwhahaha | therve: I linked 2 in the bug | 14:21 |
| mwhahaha | One in the comments | 14:21 |
| therve | Oh I didn't refresh... | 14:21 |
| therve | It fails at the exact same step, so it doesn't seem like a coincidence | 14:23 |
| therve | But it doesn't happen every time either | 14:23 |
| *** ramishra_ has joined #tripleo | 14:23 | |
| *** ramishra has quit IRC | 14:25 | |
| *** anilvenkata has joined #tripleo | 14:28 | |
| *** sshnaidm|bbl is now known as sshnaidm | 14:29 | |
| *** akrivoka has joined #tripleo | 14:37 | |
| *** rlandy is now known as rlandy|brb | 14:38 | |
| *** Lokesh_Jain__ has joined #tripleo | 14:44 | |
| milan | dtantsur, hmmm... probably mod the part inspector dies, but I guess we could set the tht of haproxy to tear down the container in case GET@/v1/ fails | 14:44 |
| Lokesh_Jain__ | Hi.. can somebody take a look at review https://review.openstack.org/#/c/511569/.. its in need of workflow label for a while | 14:44 |
| dtantsur | milan: yeah, I think this is something containers should support out of box | 14:44 |
| *** jmelvin has quit IRC | 14:44 | |
| owalsh | mandre: would you mind giving this one more quick look when you have a minute? https://review.openstack.org/513867 | 14:45 |
| *** chlong has joined #tripleo | 14:46 | |
| *** rlandy|brb is now known as rlandy | 14:47 | |
| *** aditya_r has joined #tripleo | 14:48 | |
| *** ramishra_ has quit IRC | 14:51 | |
| sshnaidm | mwhahaha, hi, can you please merge it? https://review.openstack.org/#/c/515462 seems like downloading cirros image hit some gate jobs | 14:52 |
| mwhahaha | sshnaidm: ok | 14:52 |
| sshnaidm | thanks | 14:52 |
| weshay | mandre++ | 14:53 |
| *** ramishra has joined #tripleo | 14:53 | |
| milan | dtantsur, cool, modulo the fact we replaced a more generic/recommended way (supervisord) with our own service; let's check whether folks approve such design: bogdando, probably? | 14:54 |
| * mwhahaha throws things at jaosorior for aproving random stuff | 14:54 | |
| milan | I mean what ever moves us fwd | 14:54 |
| mandre | owalsh: aye aye sir | 14:54 |
| dtantsur | milan: yes, but then we become less dependent on external deployers. they just run a service, like before. | 14:54 |
| *** anshul has quit IRC | 14:54 | |
| dtantsur | if they don't want to handle the case when ironic-inspector dies - their problem. if they cannot handle it - ditto :) | 14:55 |
| jaosorior | mwhahaha: what did I do? | 14:55 |
| jaosorior | mwhahaha: I thought that was over | 14:55 |
| milan | dtantsur, OK, I'm cool :) I hope we won't get -2 for such a design here | 14:55 |
| jaosorior | mwhahaha: ah, just read the topic | 14:55 |
| mwhahaha | jaosorior: y u no read emails about not merging critical stuff for master | 14:55 |
| jaosorior | mwhahaha: what should I unapprove? | 14:55 |
| mwhahaha | jaosorior: nothing we'll see if it hit stuff | 14:55 |
| mwhahaha | i just don't want a ton of extra stuff in the gate to block fixes | 14:56 |
| dtantsur | milan: it's just starting ironic-inspector-worker, right? :) it's hard to -2 for that | 14:57 |
| bogdando | dtantsur: what do you mean handle the case when ironic-inspector dies? is it special so restart: always doesn't cover it? | 14:58 |
| milan | dtantsur, you just closed the requirement for the api-worker split | 14:58 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations stable/pike: Fix the Network Gateway Validation https://review.openstack.org/518743 | 14:58 |
| dtantsur | bogdando: it laucnhes a child process. if it dies, the child process must die too | 14:58 |
| dtantsur | that's the only limitation we have | 14:59 |
| *** moshele has quit IRC | 14:59 | |
| dtantsur | milan: right, yes | 14:59 |
| bogdando | dtantsur: AFAIK, kolla runs dumb init which passes signals for child processes, it's up to them how to react | 14:59 |
| dtantsur | bogdando: depends on which signals it passes.. can it pass SIGKILL? :) | 15:00 |
| *** bobh has joined #tripleo | 15:00 | |
| *** waleedm has quit IRC | 15:00 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Ensure cinder has access to tripleo.cnf during db sync. https://review.openstack.org/518744 | 15:00 |
| owalsh | mandre: thank you sir | 15:00 |
| bogdando | dtantsur: actually this should be tested, if inspector KILLed, in a container, what happens to its childs | 15:00 |
| bogdando | dtantsur: IMO, a healthcheck to detect that and tell docker to restart the "bundle" | 15:01 |
| dtantsur | yeah, a healthcheck will work | 15:01 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Ensure cinder has access to tripleo.cnf during db sync. https://review.openstack.org/518744 | 15:01 |
| mandre | owalsh: looking at the diff, you just took the hieradata off, right? it's a bit hard to see with the rebase | 15:02 |
| *** ansiwen[q] has quit IRC | 15:02 | |
| bogdando | so no cases for supervisord so far | 15:02 |
| *** dtantsur is now known as dtantsur|bbl | 15:02 | |
| *** ansiwen[q] has joined #tripleo | 15:02 | |
| owalsh | mandre: yea, and previous patchset was to include 2 missing env vars for openstack client | 15:02 |
| milan | bogdando, dtantsur|bbl also logs might be an issue :-/ | 15:04 |
| milan | I mean how to log dnsmasq and inspector in a single container | 15:04 |
| *** michchap has joined #tripleo | 15:05 | |
| bogdando | milan: if dnsmasq logs to syslog, it should be all-right | 15:05 |
| bogdando | we share /dev/log/ so containers write to syslog with the correct context to identify the source | 15:05 |
| milan | bogdando, so there's no issues logging to dnsmasq from 2 processes from a single container? | 15:05 |
| mandre | mwhahaha: does the merge ban include everything outside the patches to fix CI, or important fixes like https://review.openstack.org/#/c/513867/ are fine? | 15:05 |
| *** ansiwen[q] has quit IRC | 15:05 | |
| milan | aah | 15:05 |
| bogdando | milan: nope | 15:05 |
| *** colonwq has quit IRC | 15:05 | |
| milan | bogdando, OK cool | 15:06 |
| milan | folks, thanks for the discussion; I'll refactor the filter so it doesn't ctl but spawn the dnsmasq then | 15:07 |
| owalsh | mandre, mwhahaha: was just about to ask. Ideally would wait for slagle too but it's getting a bit urgent now, and it's not a clean backport | 15:07 |
| mandre | mwhahaha, weshay: talking about fixing CI, there is https://review.openstack.org/#/c/518724/ too | 15:07 |
| *** colonwq has joined #tripleo | 15:07 | |
| mandre | ^^ less critical since the job is non voting but still | 15:08 |
| weshay | oy | 15:09 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Ensure cinder has access to tripleo.cnf during db sync. https://review.openstack.org/518744 | 15:09 |
| slagle | owalsh: mandre: i think the 2 critical issues that mwhahaha pointed out ought to be addressed before merging that. it's not a critical fix for CI | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 15:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 15:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| slagle | other than that, i'm ok with the patch for now | 15:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 15:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 15:10 |
| *** bkopilov has quit IRC | 15:10 | |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] | 15:10 |
| owalsh | slagle: ack, thanks | 15:10 |
| slagle | owalsh: what was the fix for the timeout on the multinode job? was it adding the env vars in the script? | 15:11 |
| owalsh | slagle: yea, ovb too | 15:11 |
| milan | bogdando, although right now I'm seriously tempted to just import supervisord in my code O:-) | 15:12 |
| milan | re: spawning | 15:12 |
| slagle | owalsh: ok, cool | 15:12 |
| mwhahaha | mandre, owalsh, slagle: so the bug associated with that review is critical so i would be more inclined to allow that to merge. | 15:12 |
| * milan feels reinventing the wheel of process ctl | 15:12 | |
| mwhahaha | what i don't want is a bunch of random stuff blocking the path to get CI fixes but since we don't currently have CI fixes, we can slowly merge in critical issues | 15:12 |
| bogdando | milan: would that work if kolla start just starts it unconditionally? | 15:13 |
| slagle | mwhahaha: sure, i have no objection either way. the bug is high fwiw | 15:13 |
| *** jmelvin has joined #tripleo | 15:13 | |
| mwhahaha | oh it was critical when i looked last night | 15:13 |
| bogdando | milan: the same way as it does for httpd for WSGI? | 15:13 |
| bogdando | and a healthcheck to ensure both are atomically restarted if container goes red | 15:13 |
| milan | bogdando, I need to kill it on exit | 15:13 |
| mwhahaha | slagle: oh no that one is high, but the dependant patch is critical | 15:13 |
| mwhahaha | cause upgrades | 15:14 |
| bogdando | hm, I'm not sure how docker handles that | 15:14 |
| milan | s/need/I better do kill it | 15:14 |
| sshnaidm | bnemec, this is only for rh1 and rdo clouds, no need for approve from infra: https://review.openstack.org/#/c/518638/ | 15:14 |
| bogdando | needs to be tested :) | 15:14 |
| * milan poettering :D | 15:14 | |
| slagle | mwhahaha: ah, i see | 15:14 |
| mwhahaha | mandre, owalsh, slagle: i'll keep an eye on the queue and merge the cell stuff later when the queue gets smaller and if we dont' identify fixes for the current alerts | 15:15 |
| milan | I mean I'm going to reinvent systemd to some extent ;) | 15:15 |
| owalsh | mwhahaha: ack, thanks! mandre slagle too | 15:16 |
| *** dhill_ has quit IRC | 15:16 | |
| * milan need to vanish | 15:17 | |
| milan | thx | 15:17 |
| *** milan has quit IRC | 15:17 | |
| openstackgerrit | Merged openstack/diskimage-builder master: diskimage_builder: lib: common-functions: Fix options for devpts mount https://review.openstack.org/517886 | 15:18 |
| *** dhill_ has joined #tripleo | 15:22 | |
| *** trown is now known as trown|brb | 15:25 | |
| *** tzumainn has quit IRC | 15:26 | |
| *** agurenko has quit IRC | 15:27 | |
| *** ratailor has quit IRC | 15:28 | |
| jistr | therve, mwhahaha: updated https://bugs.launchpad.net/tripleo/+bug/1731063 -- it seems like metadata is the issue for the broken tempest as well | 15:33 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 15:33 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: Allow running toci_gate_test on pre-provisioned ovb env https://review.openstack.org/518748 | 15:33 |
| jistr | does Heat metadata go through Nova in the setup we have in CI? | 15:33 |
| mwhahaha | jistr: i don't think tempest task uses heat like the previous pingtest | 15:34 |
| jistr | right, the tempest metadata doesn't go through heat, it's Nova metadata that's broken with the tempest bug | 15:34 |
| mwhahaha | hmm good question | 15:35 |
| *** trown|brb is now known as trown | 15:35 | |
| jistr | but i wondered if Heat metadata travelled through Nova in some way too, the root cause for those two could be the same, in Nova | 15:35 |
| mwhahaha | sounds logical | 15:35 |
| *** spectr has quit IRC | 15:35 | |
| therve | jistr, Only to bootstrap AFAIR | 15:36 |
| *** spectr has joined #tripleo | 15:37 | |
| jistr | therve: to bootstrap os-collect-config.conf? i checked that in the other bug (the one with os-collect-config vs. Heat), and the conf file looked fine | 15:37 |
| jistr | so it may be two different issues then... :/ | 15:37 |
| therve | It's multinode too so it may not need any metadata a all | 15:38 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/diskimage-builder master: elements: Respect devpts mount options https://review.openstack.org/518749 | 15:42 |
| bogdando | let's merge https://review.openstack.org/#/c/508558 folks! | 15:43 |
| therve | Not sure it falls into the critical fixes | 15:44 |
| *** oidgar has quit IRC | 15:45 | |
| bogdando | therve: oh, right, the mwhahaha's warning... | 15:47 |
| therve | Well the topic right there too :) | 15:47 |
| *** moshele has joined #tripleo | 15:49 | |
| *** dtantsur|bbl is now known as dtantsur | 15:52 | |
| chandankumar | mwhahaha: hello | 15:56 |
| mwhahaha | chandankumar: hey | 15:56 |
| chandankumar | mwhahaha: please comment on this review https://review.openstack.org/#/c/504899/ | 15:56 |
| chandankumar | they need confirmation from tripleo in order to merge it | 15:56 |
| mwhahaha | chandankumar: ok i'll take a look | 15:56 |
| chandankumar | mwhahaha: https://review.rdoproject.org/r/10456 here is the patch from rdo side also | 15:56 |
| chandankumar | mwhahaha: thanks :-) | 15:56 |
| *** sri__ has quit IRC | 15:57 | |
| mwhahaha | chandankumar: so i remember ther being chat in the cix meeting yesterday about this rename causing problems in newton | 15:57 |
| mwhahaha | chandankumar: because we were pulling in the newer tempest for ocata | 15:57 |
| mwhahaha | let me see if i can dig up the info | 15:57 |
| chandankumar | mwhahaha: sure | 15:57 |
| *** aditya_r has quit IRC | 15:57 | |
| *** spectr has quit IRC | 16:00 | |
| *** jaosorior has quit IRC | 16:02 | |
| mwhahaha | chandankumar: oh nevermind, it was designate not zaqar | 16:02 |
| chandankumar | mwhahaha: it is also fixed now | 16:02 |
| mwhahaha | k | 16:02 |
| *** itlinux has joined #tripleo | 16:03 | |
| chandankumar | mwhahaha: https://review.rdoproject.org/r/10447 and https://review.rdoproject.org/r/10456 | 16:03 |
| *** aufi has quit IRC | 16:04 | |
| *** achadha has joined #tripleo | 16:04 | |
| *** achadha_ has joined #tripleo | 16:05 | |
| mwhahaha | chandankumar: I don't see the package in https://trunk.rdoproject.org/centos7-master/current-passed-ci/ | 16:05 |
| *** paramite has quit IRC | 16:06 | |
| mwhahaha | chandankumar: It is in https://trunk.rdoproject.org/centos7-master/current/ | 16:06 |
| chandankumar | mwhahaha: yup | 16:07 |
| mwhahaha | chandankumar: so i guess we should be ok if we're using tempest from packaging it'll just get picked up on next promotion | 16:07 |
| chandankumar | mwhahaha: yup | 16:07 |
| mwhahaha | k commented | 16:07 |
| *** achadha has quit IRC | 16:09 | |
| chandankumar | mwhahaha: thanks :-) | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 16:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 16:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 16:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 16:10 |
| *** moshele has quit IRC | 16:11 | |
| *** psachin has quit IRC | 16:15 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: EARLY WIP: Convert tags to when statements for Q major upgrade workflow https://review.openstack.org/510902 | 16:16 |
| *** ebarrera has quit IRC | 16:17 | |
| *** yprokule has quit IRC | 16:19 | |
| *** gvrangan has joined #tripleo | 16:19 | |
| *** akrivoka has quit IRC | 16:20 | |
| *** thrash is now known as thrash|biab | 16:21 | |
| *** mary_grace has joined #tripleo | 16:21 | |
| *** itlinux has quit IRC | 16:23 | |
| *** mcornea has quit IRC | 16:24 | |
| *** itlinux has joined #tripleo | 16:24 | |
| *** salmankhan has quit IRC | 16:25 | |
| *** salmankhan has joined #tripleo | 16:26 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Don't calculate hashes for rh1 images https://review.openstack.org/518629 | 16:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: libvirt: Remove unnecessary binding of /var/log/containers/nova https://review.openstack.org/510561 | 16:27 |
| *** tesseract has quit IRC | 16:27 | |
| *** tzumainn has joined #tripleo | 16:29 | |
| weshay | Slower, yo yo checking in | 16:30 |
| *** mdnadeem|afk has quit IRC | 16:32 | |
| *** dsariel__ has quit IRC | 16:32 | |
| *** fragatina has joined #tripleo | 16:32 | |
| *** fragatina has quit IRC | 16:33 | |
| *** fragatina has joined #tripleo | 16:33 | |
| *** iranzo has quit IRC | 16:35 | |
| *** ukalifon has quit IRC | 16:35 | |
| *** akrivoka has joined #tripleo | 16:38 | |
| atoth | mwhahaha, quick questioned I should have asked ages ago, is there any difference in the overcloud image (files included, folder structure, etc) when building the image from packages vs building it from source? | 16:38 |
| *** fragatina has quit IRC | 16:38 | |
| *** marios has quit IRC | 16:38 | |
| mwhahaha | atoth: the files may be different (puppet modules versions) | 16:39 |
| mwhahaha | but the structure should be the same | 16:39 |
| *** ykarel has quit IRC | 16:39 | |
| mwhahaha | we don't really do much from source anymore and i don't know if it's really well tested | 16:39 |
| atoth | mwhahaha, it is not | 16:39 |
| atoth | mwhahaha, I'm just trying to set up a dev baseline to to the F% specific itegration | 16:40 |
| mwhahaha | depending on what you're deving, it's probably better to build from packages and inject the modified versions | 16:40 |
| atoth | mwhahaha, so your answer helps | 16:40 |
| atoth | :-) | 16:40 |
| mwhahaha | either via virt-customize or using deploy artifacts (http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html) | 16:40 |
| atoth | mwhahaha, that was my thought, thanks for verifying | 16:40 |
| atoth | mwhahaha, yeah, I'm using shardy's blog :-) | 16:41 |
| mwhahaha | though i'm not sure how deploy artifacts works with containers | 16:42 |
| mwhahaha | the puppet stuff is fine, packages maybe not so much | 16:43 |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-validations stable/pike: Fix the Network Gateway Validation https://review.openstack.org/518743 | 16:44 |
| *** adac has quit IRC | 16:45 | |
| *** aditya_r has joined #tripleo | 16:49 | |
| *** aditya_r has quit IRC | 16:50 | |
| *** aditya_r has joined #tripleo | 16:55 | |
| *** dhill_ has quit IRC | 16:57 | |
| mwhahaha | stupid metadata errors | 16:58 |
| *** ramishra has quit IRC | 16:59 | |
| openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo stable/ocata: Support for Dell EMC VMAX ISCSI Cinder Driver https://review.openstack.org/518345 | 17:01 |
| *** dhill_ has joined #tripleo | 17:01 | |
| *** jbadiapa_ has quit IRC | 17:02 | |
| *** fragatina has joined #tripleo | 17:02 | |
| openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates stable/ocata: Add support for Dell EMC VMAX ISCSI Backend https://review.openstack.org/518352 | 17:03 |
| openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates stable/ocata: Add support for Dell EMC VMAX ISCSI Backend https://review.openstack.org/518352 | 17:06 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 17:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 17:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 17:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 17:10 |
| *** mary_grace has quit IRC | 17:11 | |
| *** mary_grace has joined #tripleo | 17:11 | |
| *** abregman is now known as abregman|afk | 17:11 | |
| *** iranzo has joined #tripleo | 17:16 | |
| *** iranzo has joined #tripleo | 17:16 | |
| *** fragatina has quit IRC | 17:18 | |
| *** iranzo has quit IRC | 17:22 | |
| *** moshele has joined #tripleo | 17:25 | |
| weshay | arxcruz, ping.. you scheduled the tripleo-ci planning meeting on tuesday over the tripleo meeting | 17:26 |
| *** lucasagomes is now known as lucas-afk | 17:26 | |
| weshay | arxcruz, you are subscribed to "RHOS Team Meetings" ya? | 17:26 |
| *** suuuper has quit IRC | 17:27 | |
| *** salmankhan has quit IRC | 17:27 | |
| *** mary_grace has quit IRC | 17:35 | |
| *** mary_grace has joined #tripleo | 17:35 | |
| arxcruz | weshay: yes, sorry, updated to after tripleo meeting | 17:38 |
| mwhahaha | it also conflicts with the ua/tc meetings but i guess that's up to you guys if you can do both | 17:39 |
| * arxcruz facepalm | 17:40 | |
| *** mary_grace has quit IRC | 17:41 | |
| *** mary_grace has joined #tripleo | 17:41 | |
| arxcruz | weshay: there's no other spot for tuesday that fits everybody on the team | 17:41 |
| *** fragatina has joined #tripleo | 17:44 | |
| *** thrash|biab is now known as thrash | 17:47 | |
| weshay | arxcruz, I think it's good now, hopefully we wont need 2hrs | 17:47 |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Document use of tripleo-repos https://review.openstack.org/518631 | 17:50 |
| *** dtantsur is now known as dtantsur|afk | 17:54 | |
| *** bogdando has quit IRC | 17:55 | |
| *** dsneddon has joined #tripleo | 17:57 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make ovb-manage-stack role usable for upstream reproducers https://review.openstack.org/518765 | 17:58 |
| *** aditya_r has quit IRC | 18:00 | |
| *** derekh has quit IRC | 18:02 | |
| *** tosky has quit IRC | 18:03 | |
| *** itlinux has quit IRC | 18:04 | |
| *** itlinux has joined #tripleo | 18:05 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Document use of tripleo-repos https://review.openstack.org/518631 | 18:06 |
| *** moshele has quit IRC | 18:06 | |
| *** moshele has joined #tripleo | 18:07 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 18:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 18:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 18:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 18:10 |
| *** shreshtha has quit IRC | 18:10 | |
| *** trown is now known as trown|lunch | 18:10 | |
| *** jpich has quit IRC | 18:12 | |
| *** ebarrera has joined #tripleo | 18:12 | |
| *** pblaho has quit IRC | 18:17 | |
| *** achadha_ has quit IRC | 18:17 | |
| *** moshele has quit IRC | 18:26 | |
| *** shreshtha has joined #tripleo | 18:26 | |
| *** gvrangan has quit IRC | 18:40 | |
| *** shreshtha has quit IRC | 18:41 | |
| tdasilva | hello, i'm trying to deploy barbican with tripleo, so I tried to use the featureset configs that include scenario02, but they are all failing | 18:49 |
| tdasilva | can anybody provide any pointers to how to deploy barbican with tripleo-quickstart | 18:49 |
| mwhahaha | tdasilva: what are they failing with? | 18:52 |
| *** ecerquei_ has joined #tripleo | 18:52 | |
| tdasilva | mwhahaha: https://paste.fedoraproject.org/paste/q7lIRzYmPu7J3p5JR2eSpg | 18:52 |
| tdasilva | mwhahaha: I used cmd to deploy: ./quickstart.sh --playbook quickstart-extras.yml --config config/general_config/featureset006.yml --teardown all --tags all --clean --release pike 127.0.0.2 | 18:53 |
| tdasilva | I picked feature006 from here: https://docs.openstack.org/tripleo-quickstart/latest/feature-configuration.html | 18:53 |
| jlabarre | for the tripleo-quickstart, is there an option to have the script use local copies of the undercloud/overcloud VM images? | 18:53 |
| mwhahaha | tdasilva: looks like the overcloud roles file is wrong or something | 18:54 |
| *** ecerquei has quit IRC | 18:54 | |
| mwhahaha | tdasilva: are you using an older install of quickstart or anything? | 18:55 |
| * mwhahaha would also like to point out this is why we needed tools to generate roles_data.yaml | 18:55 | |
| *** sshnaidm_ has joined #tripleo | 18:55 | |
| *** sshnaidm_ is now known as sshnaidm|off | 18:56 | |
| *** sshnaidm has quit IRC | 18:56 | |
| tdasilva | mwhahaha: it was a bit old (about 1 month), just did a new pull to get latest | 18:57 |
| mwhahaha | tdasilva: so it's failing because the upgrade flag is missing on the compute role in the generated file, would need to work back to see why that's missing | 18:57 |
| mwhahaha | tdasilva: you may try cleaning up the .quickstart files and try again with a current version | 18:58 |
| mwhahaha | jlabarre: I think you can specify a url to pull from with a config | 18:58 |
| tdasilva | mwhahaha: this is the overcloud_roles file: https://paste.fedoraproject.org/paste/NfGVLBxRCGtJsFTm4o5ZGg | 18:58 |
| mwhahaha | tdasilva: that seems to be missing all the services | 18:59 |
| tdasilva | mwhahaha: i found it strange that it had only controller there and not compute, but wasn't sure | 18:59 |
| tdasilva | mwhahaha: ah, ok, so it is missing a bunch of stuff | 18:59 |
| mwhahaha | yea | 18:59 |
| tdasilva | cool, i'm going to do the clean up and try running again | 18:59 |
| mwhahaha | yea | 18:59 |
| tdasilva | mwhahaha: thank you! | 18:59 |
| tdasilva | mwhahaha: just fyi...my quickstart install was not 1 month old, it's was 1 week old | 19:01 |
| tdasilva | mwhahaha: https://github.com/openstack/tripleo-quickstart/commit/d5d7218fa18d92160e4bfbf79e3c1d86332742e0 | 19:02 |
| mwhahaha | tdasilva: hmm i guess the next question would be what was your quickstart cmline | 19:02 |
| tdasilva | ./quickstart.sh --playbook quickstart-extras.yml --config config/general_config/featureset006.yml --teardown all --tags all --clean --release pike 127.0.0.2 | 19:02 |
| mwhahaha | that seems to be ok, though i've personally never had luck with localhost deploys | 19:03 |
| tdasilva | it works fine for other configs like containers_minimal.yml | 19:04 |
| mwhahaha | i would have to defer to a quickstart expert on this one then | 19:05 |
| *** ansmith has quit IRC | 19:05 | |
| *** ansmith_ has quit IRC | 19:05 | |
| *** jprovazn has quit IRC | 19:07 | |
| *** salmankhan has joined #tripleo | 19:08 | |
| *** ebarrera has quit IRC | 19:09 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 19:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 19:10 |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 19:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 19:10 |
| jlabarre | I did see in the config/release/pike.yml it pointed to the URL for images, I presume I'd edit that one? | 19:11 |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart-extras master: DNM: Update quickstart extras with undercloud install for containers https://review.openstack.org/517444 | 19:11 |
| *** ecerquei__ has joined #tripleo | 19:11 | |
| *** salmankhan has quit IRC | 19:13 | |
| *** ecerquei_ has quit IRC | 19:14 | |
| *** trown|lunch is now known as trown | 19:14 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-quickstart master: DNM: Update undercloud install options for containers https://review.openstack.org/517445 | 19:15 |
| *** ansmith_ has joined #tripleo | 19:20 | |
| *** ansmith has joined #tripleo | 19:20 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add missing host_prep_tasks for log dirs creation https://review.openstack.org/518583 | 19:32 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Workflow to get Horizon URL endpoint https://review.openstack.org/516991 | 19:33 |
| *** moshele has joined #tripleo | 19:35 | |
| *** adac has joined #tripleo | 19:47 | |
| *** achadha has joined #tripleo | 19:49 | |
| *** achadha has quit IRC | 19:54 | |
| rook | https://review.openstack.org/#/c/497524/ anyone wanna WF me :D | 19:57 |
| rook | mwhahaha: since you love logging so much ^ | 19:57 |
| mwhahaha | rook: at the moment we're holding off on extra stuff due to ci issues | 19:57 |
| * rook waits for "Get off my lawn you logging hippie!" | 19:57 | |
| mwhahaha | we need that patch but it's hard enough getting critical stuff merged :/ | 19:58 |
| *** ansmith_ has quit IRC | 19:58 | |
| *** ansmith has quit IRC | 19:58 | |
| rook | mwhahaha: roger. :*( | 19:58 |
| rook | mwhahaha sure man, i get it. | 19:58 |
| *** ansmith_ has joined #tripleo | 19:58 | |
| *** ansmith has joined #tripleo | 19:58 | |
| rook | This is a nice to have. | 19:58 |
| mwhahaha | we'll get it eventually :D | 19:59 |
| *** tzumainn has quit IRC | 19:59 | |
| * mwhahaha hopes 516402 merges so we might actually clear the gate queue | 20:02 | |
| * mwhahaha crosses fingers | 20:02 | |
| honza | my nodes are going to maintenance mode on their own, what's up with that? this is ovb | 20:02 |
| *** moshele has quit IRC | 20:03 | |
| *** akrivoka has quit IRC | 20:05 | |
| *** ecerquei_ has joined #tripleo | 20:05 | |
| *** ecerquei__ has quit IRC | 20:08 | |
| *** fragatina has quit IRC | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729586 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 20:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 20:10 |
| openstack | Launchpad bug 1729586 in tripleo "CI: rdocloud node randomly going offline during jobs" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 20:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 20:10 |
| *** moshele has joined #tripleo | 20:11 | |
| * mwhahaha sighs | 20:11 | |
| weshay | matbu_, I'm going to assign you to this bug https://bugs.launchpad.net/tripleo/+bug/1724328 | 20:12 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] | 20:12 |
| mwhahaha | 516402 timed out | 20:12 |
| mwhahaha | on log collection | 20:12 |
| weshay | dam | 20:12 |
| *** brault has quit IRC | 20:13 | |
| mwhahaha | no not log collection, during validations | 20:14 |
| mwhahaha | so much for possibly getting a clean run | 20:14 |
| *** brault has joined #tripleo | 20:14 | |
| mwhahaha | everything after it was green | 20:14 |
| mwhahaha | http://logs.openstack.org/02/516402/3/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-puppet/13077af/job-output.txt.gz#_2017-11-09_19_55_45_540514 | 20:14 |
| weshay | mwhahaha, well.. it's not like we get any elastic-recheck queries merged either | 20:15 |
| mwhahaha | wouldn't matter because it's behind by over a day | 20:15 |
| *** itlinux has quit IRC | 20:16 | |
| mwhahaha | staring at the dashboard and preloading tabs is the only way to track this stuff | 20:16 |
| openstackgerrit | wes hayutin proposed openstack-infra/tripleo-ci master: fix the undercloud-oooq job's subunit failures https://review.openstack.org/517428 | 20:19 |
| matbu_ | weshay: ack, i feel like im back 1 year in the past :) | 20:22 |
| weshay | matbu_, feels good to be younger right? | 20:23 |
| weshay | you're a new man! | 20:23 |
| matbu_ | hehe | 20:23 |
| *** toure is now known as toure_biab | 20:24 | |
| *** tzumainn has joined #tripleo | 20:28 | |
| *** ebarrera has joined #tripleo | 20:29 | |
| *** fpan_ has joined #tripleo | 20:34 | |
| *** fpan has quit IRC | 20:34 | |
| *** aputtur_ has quit IRC | 20:37 | |
| weshay | http://logs.openstack.org/38/517038/4/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/a46d566/logs/ | 20:43 |
| weshay | hrm.. | 20:43 |
| weshay | mwhahaha, going to recheck https://review.openstack.org/#/c/517038/ as the undercloud did not get logged | 20:43 |
| weshay | cant see how tempest failed | 20:44 |
| mwhahaha | meh that one still hasn't merged? | 20:45 |
| mwhahaha | i don't think that one is as important now that we had new containers but yea it should get merged | 20:45 |
| *** lblanchard has quit IRC | 20:46 | |
| weshay | mwhahaha, you can use http://cistatus.tripleo.org:8000/ to some degree | 20:47 |
| weshay | "TripleO CI gate jobs" is only tracking gate jobs now | 20:47 |
| weshay | so in the absense of openstack health, it's an alternative | 20:48 |
| mwhahaha | nifty | 20:48 |
| weshay | I think legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container is the worst job | 20:49 |
| mwhahaha | do we run that one more than others? | 20:50 |
| weshay | mwhahaha, more often? | 20:52 |
| mwhahaha | yea | 20:52 |
| mwhahaha | is that one on more changes | 20:52 |
| weshay | mwhahaha, I think so but would have to parse project config | 20:52 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 20:53 |
| mwhahaha | or compare runs | 20:53 |
| weshay | mwhahaha, 75/76% for the gate is really bad | 20:53 |
| weshay | always failing in tempest | 20:53 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add container update to feature set files https://review.openstack.org/514435 | 20:54 |
| weshay | volumebootpattern | 20:54 |
| weshay | mwhahaha, never fails on pike | 20:54 |
| mwhahaha | so 001 is ceph | 20:54 |
| mwhahaha | right i think there's a regression in master | 20:55 |
| bnemec | honza: That usually means Ironic had trouble contacting the bmc. | 20:55 |
| mwhahaha | which unfortunately now trying to figure out 50+ days later is really hard | 20:55 |
| weshay | ya | 20:55 |
| mwhahaha | ugh 8g on undercloud isn't enough anymore | 20:55 |
| bnemec | honza: Make sure you can ping the bmc ips, and if so check the console log to see if there were any errors starting it. | 20:55 |
| mwhahaha | (slightly unrelated) | 20:56 |
| *** jkilpatr has quit IRC | 20:56 | |
| bnemec | I've been using 16 GB underclouds for a while now. | 20:56 |
| bnemec | Although that's partially because my underclouds are longer lived than the ci ones. | 20:56 |
| mwhahaha | i've been using 8g forever in rh2 | 20:57 |
| mwhahaha | w/o swap | 20:57 |
| mwhahaha | and it just puked on me | 20:57 |
| *** fragatina has joined #tripleo | 20:59 | |
| *** moshele has quit IRC | 21:06 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 21:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 21:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 21:10 |
| *** itlinux has joined #tripleo | 21:12 | |
| *** jkilpatr has joined #tripleo | 21:13 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Don't force injection of repos into image https://review.openstack.org/518800 | 21:16 |
| *** akrivoka has joined #tripleo | 21:18 | |
| *** raildo has quit IRC | 21:20 | |
| *** achadha has joined #tripleo | 21:21 | |
| *** moshele has joined #tripleo | 21:22 | |
| weshay | sshnaidm|off, check that review | 21:23 |
| *** ansmith_ has quit IRC | 21:23 | |
| *** ansmith has quit IRC | 21:23 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Don't force injection of repos into image https://review.openstack.org/518800 | 21:24 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Don't force injection of repos into image https://review.openstack.org/518800 | 21:24 |
| *** achadha has quit IRC | 21:25 | |
| *** itlinux has quit IRC | 21:29 | |
| *** trown is now known as trown|outtypewww | 21:34 | |
| *** achadha has joined #tripleo | 21:35 | |
| *** achadha has quit IRC | 21:41 | |
| *** ebarrera has quit IRC | 21:42 | |
| *** liverpooler has quit IRC | 21:44 | |
| *** liverpooler has joined #tripleo | 21:44 | |
| *** moshele has quit IRC | 21:47 | |
| *** achadha has joined #tripleo | 21:49 | |
| *** adac has quit IRC | 21:54 | |
| *** achadha has quit IRC | 22:00 | |
| *** akrivoka has quit IRC | 22:01 | |
| *** mary_grace has quit IRC | 22:01 | |
| *** rcernin has joined #tripleo | 22:01 | |
| *** moshele has joined #tripleo | 22:03 | |
| *** mary_grace has joined #tripleo | 22:06 | |
| *** mary_grace has quit IRC | 22:06 | |
| *** itlinux has joined #tripleo | 22:07 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 22:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 22:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 22:10 |
| *** ansmith_ has joined #tripleo | 22:13 | |
| *** ansmith has joined #tripleo | 22:13 | |
| *** dougbtv__ has joined #tripleo | 22:14 | |
| *** cdearborn_ has quit IRC | 22:15 | |
| *** akrivoka has joined #tripleo | 22:19 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Only mount selinux sysfs in nova_libvirt container https://review.openstack.org/517125 | 22:19 |
| *** mary_grace has joined #tripleo | 22:24 | |
| *** mary_grace has quit IRC | 22:24 | |
| *** mary_grace has joined #tripleo | 22:25 | |
| *** mary_grace has quit IRC | 22:25 | |
| *** achadha has joined #tripleo | 22:26 | |
| *** achadha has quit IRC | 22:30 | |
| *** moshele has quit IRC | 22:31 | |
| *** etingof has quit IRC | 22:33 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add trunk service plugin to OVN environment files https://review.openstack.org/502542 | 22:37 |
| owalsh | mwhahaha: hey, re https://review.openstack.org/513867 and the change that depends on it.... | 22:48 |
| mwhahaha | owalsh: ya? | 22:48 |
| owalsh | mwhahaha: no movement yet? | 22:48 |
| mwhahaha | owalsh: not really, but i'll trade you. You look into https://bugs.launchpad.net/tripleo/+bug/1731063 cause it seems to be a nova-metadata issue and i'll +A your cell v2 thing | 22:49 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 22:49 |
| mwhahaha | cause it's basically the reason why the queue is still like 7 hours old with on a handful of patches merging today :( | 22:50 |
| *** tzumainn has quit IRC | 22:50 | |
| *** dougbtv__ has quit IRC | 22:50 | |
| owalsh | mwhahaha: more bugs, just what I need right now :-) I'll see what I can do | 22:50 |
| mwhahaha | owalsh: the good news is that it doesn't happen in pike, so you can just diff nova master from stable/pike and figure it out :D | 22:51 |
| mwhahaha | only like 2 months of commits, no biggie | 22:52 |
| owalsh | mwhahaha: <- evil laugh yea | 22:52 |
| * mwhahaha <- | 22:52 | |
| *** etingof has joined #tripleo | 22:54 | |
| *** kbyrne has quit IRC | 23:02 | |
| *** kbyrne has joined #tripleo | 23:02 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add dlrn_hash_tag to promotion-testing-hash config files https://review.openstack.org/518808 | 23:05 |
| *** gfidente has quit IRC | 23:05 | |
| *** jmelvin has quit IRC | 23:08 | |
| *** bobh has quit IRC | 23:09 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1724328 | 23:10 |
| openstack | Launchpad bug 1724328 in tripleo "Netwon to Ocata upgrade failure because of ceilometer-upgrade" [Critical,Triaged] - Assigned to mathieu bultel (mat-bultel) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1729253 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731032 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731063 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1731282 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1729253 in tripleo "CI issue: Failed to run cinder task ScheduleCreateVolumeTask, No valid backend was found" [Critical,In progress] - Assigned to Martin André (mandre) | 23:10 |
| openstack | Launchpad bug 1731032 in tripleo "CI: Deployment fails on controller timeout with task creation in heat timing out" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1731282 in tripleo "fs24 ovb jobs failing on overcloud.AllNodesDeploySteps.WorkflowTasks_Step2_Execution" [Critical,Triaged] - Assigned to Juan Antonio Osorio Robles (juan-osorio-robles) | 23:10 |
| *** ecerquei_ has quit IRC | 23:10 | |
| *** abishop has quit IRC | 23:13 | |
| *** mary_grace has joined #tripleo | 23:21 | |
| *** mary_grace has quit IRC | 23:22 | |
| *** itlinux has quit IRC | 23:26 | |
| *** newmember has quit IRC | 23:32 | |
| *** newmember has joined #tripleo | 23:33 | |
| owalsh | tonyb: ping | 23:36 |
| *** dmacpher has joined #tripleo | 23:38 | |
| owalsh | mwhahaha: this looks suspect - https://review.openstack.org/#/c/500954/2/nova/api/metadata/base.py | 23:39 |
| tonyb | owalsh: pong | 23:39 |
| tonyb | owalsh: 'sup? | 23:39 |
| mwhahaha | indeed | 23:39 |
| *** mary_grace has joined #tripleo | 23:39 | |
| *** mary_grace has quit IRC | 23:40 | |
| owalsh | tonyb: any ideas for https://bugs.launchpad.net/tripleo/+bug/1731063 | 23:40 |
| openstack | Launchpad bug 1731063 in tripleo "CI: tempest TestVolumeBootPattern tests fail due to not being able to ssh to the VM" [Critical,Triaged] | 23:40 |
| * tonyb looks | 23:40 | |
| owalsh | tonyb: https://review.openstack.org/#/c/500954/2/nova/api/metadata/base.py looks suspect | 23:40 |
| *** achadha has joined #tripleo | 23:40 | |
| *** achadha has quit IRC | 23:40 | |
| *** achadha has joined #tripleo | 23:41 | |
| tonyb | owalsh: Perhaps but wouldn't expect a None to result in a 404 with the debug log landing | 23:45 |
| tonyb | *without* | 23:46 |
| owalsh | tonyb: public_key not set in the dict though - https://review.openstack.org/#/c/500954/2/nova/api/metadata/base.py@358 | 23:48 |
| tonyb | Is the master or pike? (the review is a stable backport but the bug implies master) but I may have just misread it. | 23:49 |
| mwhahaha | we've seen it in master primarily | 23:50 |
| *** gfidente has joined #tripleo | 23:50 | |
| mwhahaha | you are right, that was for ocata owalsh | 23:50 |
| mwhahaha | https://review.openstack.org/#/c/476122 | 23:50 |
| tonyb | mwhahaha: thanks. | 23:50 |
| mwhahaha | is the master one | 23:50 |
| owalsh | bah, yea wrong link | 23:51 |
| mwhahaha | of course we haven't put nearly the number of changes through the stable branches as we have been for master | 23:51 |
| tonyb | cool. It could still be a regression we introduced but I'm not convinced we'd be see that inm CI | 23:51 |
| mwhahaha | but we're hitting it fairly regularly in master | 23:51 |
| mwhahaha | it's not 100% | 23:51 |
| mwhahaha | which makes it really annoying | 23:52 |
| mwhahaha | perhaps it's a race condition somewhere? cause the log did say it was using cached info | 23:52 |
| * mwhahaha doesn't know how the nova metadata service works | 23:52 | |
| tonyb | does the tripleo CI work with Depends-on? I'd kinda expect not given git->rpm->contain type generation steps | 23:52 |
| mwhahaha | http://logs.openstack.org/71/516771/1/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/276d17b/logs/subnode-2/var/log/containers/nova/nova-api-metadata.log.txt.gz#_2017-11-09_02_39_25_884 | 23:52 |
| mwhahaha | tonyb: yes it does | 23:52 |
| tonyb | mwhahaha: oh cool :) | 23:53 |
| *** mary_grace has joined #tripleo | 23:53 | |
| *** mary_grace has quit IRC | 23:54 | |
| owalsh | mwhahaha: cache is 15s by default | 23:55 |
| tonyb | Can I see the nova.conf fro the api container in CI? | 23:57 |
| owalsh | tonyb: http://logs.openstack.org/71/516771/1/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/276d17b/logs/subnode-2/var/log/config-data/nova/etc/nova/nova.conf.txt.gz | 23:58 |
| tonyb | Yeah so that chnages is cells specific as according to http://logs.openstack.org/71/516771/1/gate/legacy-tripleo-ci-centos-7-scenario001-multinode-oooq-container/276d17b/logs/subnode-2/var/log/containers/nova/nova-api-metadata.log.txt.gz#_2017-11-09_02_32_45_458 we're not enabling cells so I dont' think that's the smoking gun | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!