openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add heat api container to run cron purge_deleted https://review.openstack.org/485865 | 00:05 |
---|---|---|
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add keystone cron container to run token_flush https://review.openstack.org/485863 | 00:06 |
*** cdearborn_ has joined #tripleo | 00:08 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 00:10 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
*** kambiz has quit IRC | 00:10 | |
*** kambiz has joined #tripleo | 00:13 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add cinder cron container to run db purge https://review.openstack.org/485873 | 00:14 |
*** cdearborn__ has joined #tripleo | 00:16 | |
*** itlinux has quit IRC | 00:17 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add heat api container to run cron purge_deleted https://review.openstack.org/485865 | 00:17 |
*** cdearborn has quit IRC | 00:18 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add keystone cron container to run token_flush https://review.openstack.org/485863 | 00:19 |
*** tzumainn has quit IRC | 00:21 | |
*** rlandy has quit IRC | 00:22 | |
*** cdearborn_ has quit IRC | 00:29 | |
*** psahoo has joined #tripleo | 00:32 | |
*** ecerquei_ has quit IRC | 00:33 | |
*** cdearborn__ has quit IRC | 00:35 | |
openstackgerrit | daixianmeng proposed openstack/diskimage-builder master: update element growroot Add support for XFS format https://review.openstack.org/485895 | 00:39 |
*** bfournie has joined #tripleo | 00:47 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Bump fedora-minimal DIB_RELEASE 26 https://review.openstack.org/482570 | 00:50 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon https://review.openstack.org/485899 | 00:50 |
*** fragatin_ has joined #tripleo | 00:51 | |
*** fragatina has quit IRC | 00:54 | |
*** fragati__ has joined #tripleo | 00:54 | |
*** fragatin_ has quit IRC | 00:55 | |
*** fragatina has joined #tripleo | 00:56 | |
*** fragatina has quit IRC | 00:57 | |
*** fragatin_ has joined #tripleo | 00:57 | |
*** jkilpatr has quit IRC | 00:58 | |
*** fragatin_ has quit IRC | 00:59 | |
*** fragatina has joined #tripleo | 00:59 | |
*** fragati__ has quit IRC | 00:59 | |
*** itlinux has joined #tripleo | 01:01 | |
*** fragatina has quit IRC | 01:03 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon https://review.openstack.org/485899 | 01:05 |
larsks | In a containerized deployment...what controls from where the overcloud pulls images? My overcloud is pulling images from docker.io, rather than the registry on the undercloud, and I want to change that. | 01:08 |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 01:10 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
*** psahoo has quit IRC | 01:10 | |
*** fragatina has joined #tripleo | 01:12 | |
*** fragatina has quit IRC | 01:14 | |
*** ansmith has quit IRC | 01:28 | |
*** psahoo has joined #tripleo | 01:29 | |
*** psahoo_ has joined #tripleo | 01:35 | |
*** psahoo has quit IRC | 01:37 | |
*** psahoo_ has quit IRC | 01:39 | |
*** psahoo has joined #tripleo | 01:40 | |
*** psahoo has quit IRC | 01:40 | |
*** psahoo has joined #tripleo | 01:42 | |
*** fzdarsky_ has joined #tripleo | 01:43 | |
*** fzdarsky|afk has quit IRC | 01:46 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon https://review.openstack.org/485899 | 01:46 |
*** itlinux has quit IRC | 01:49 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon https://review.openstack.org/485899 | 01:54 |
*** yamahata has quit IRC | 01:56 | |
*** gbarros has joined #tripleo | 01:57 | |
*** tvignaud has quit IRC | 01:58 | |
*** itlinux has joined #tripleo | 02:04 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Move setfiles to outside chroot with runcon https://review.openstack.org/485899 | 02:08 |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 02:10 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
*** yamahata has joined #tripleo | 02:42 | |
*** cschwede has joined #tripleo | 02:55 | |
*** cschwede_ has quit IRC | 02:57 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 03:10 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
*** cnf has quit IRC | 03:10 | |
*** rbrady has joined #tripleo | 03:12 | |
*** rbrady has joined #tripleo | 03:12 | |
*** fragatina has joined #tripleo | 03:12 | |
*** chem has quit IRC | 03:15 | |
*** fragatina has quit IRC | 03:16 | |
*** gbarros has quit IRC | 03:26 | |
*** gbarros has joined #tripleo | 03:27 | |
*** jaganathan has joined #tripleo | 03:28 | |
*** jaganathan has quit IRC | 03:35 | |
*** gkadam has joined #tripleo | 03:48 | |
*** dbecker has quit IRC | 03:54 | |
*** fragatina has joined #tripleo | 03:56 | |
*** fragatina has quit IRC | 03:56 | |
*** fragatina has joined #tripleo | 03:57 | |
*** flepied has quit IRC | 04:00 | |
*** yamahata has quit IRC | 04:06 | |
*** yamahata has joined #tripleo | 04:07 | |
*** dbecker has joined #tripleo | 04:07 | |
*** gbarros has quit IRC | 04:07 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 04:10 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Bump fedora-minimal DIB_RELEASE 26 https://review.openstack.org/482570 | 04:13 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move setfiles to outside chroot with runcon https://review.openstack.org/485899 | 04:13 |
*** dmacpher has joined #tripleo | 04:15 | |
numans | Hello reviewers. The patch https://review.openstack.org/#/c/475423/ to increase OVN coverage for tripleo got merged in project-config. | 04:27 |
numans | This patch also runs tripleo job for networking-ovn project and the CI for networking-ovn is broken. | 04:27 |
numans | It would be nice if the reviewers can review this patch - https://review.openstack.org/#/c/484868/ | 04:28 |
numans | in order to unblock networking-ovn gate | 04:28 |
*** dsariel_ has joined #tripleo | 04:33 | |
*** rbrady has quit IRC | 04:36 | |
*** psachin has joined #tripleo | 04:50 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 05:10 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
*** marios has joined #tripleo | 05:14 | |
*** fragatina has quit IRC | 05:15 | |
*** marios_ has joined #tripleo | 05:19 | |
*** rcernin has quit IRC | 05:22 | |
*** skramaja has joined #tripleo | 05:26 | |
*** radeks has joined #tripleo | 05:34 | |
*** iranzo has joined #tripleo | 05:35 | |
*** iranzo has joined #tripleo | 05:35 | |
*** rcernin has joined #tripleo | 05:36 | |
*** flepied has joined #tripleo | 05:38 | |
*** cshastri has joined #tripleo | 05:41 | |
*** marios_ has quit IRC | 05:43 | |
*** coolsvap has joined #tripleo | 05:43 | |
*** marios has quit IRC | 05:43 | |
*** marios has joined #tripleo | 05:43 | |
*** lmiccini has joined #tripleo | 05:47 | |
*** anshul has joined #tripleo | 05:47 | |
*** aufi has joined #tripleo | 05:49 | |
*** masco has joined #tripleo | 05:51 | |
*** radeks has quit IRC | 05:51 | |
*** ccamacho has quit IRC | 06:02 | |
*** jfrancoa has joined #tripleo | 06:02 | |
*** ccamacho has joined #tripleo | 06:02 | |
*** jbadiapa has joined #tripleo | 06:03 | |
*** dsariel has joined #tripleo | 06:04 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Fix lint issues to upgrade to puppet-lint 2.3 https://review.openstack.org/485782 | 06:09 |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 06:10 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
*** pgadiya has joined #tripleo | 06:11 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Check lint upgrade to 2.3 https://review.openstack.org/485706 | 06:12 |
*** flepied has quit IRC | 06:15 | |
*** psachin has quit IRC | 06:16 | |
*** ccamacho is now known as ccamacho|brb | 06:21 | |
*** jprovazn has joined #tripleo | 06:28 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Let's make yum transaction less expensive for tempest https://review.openstack.org/485574 | 06:35 |
*** links has joined #tripleo | 06:37 | |
*** ffiore has joined #tripleo | 06:39 | |
*** jaganathan has joined #tripleo | 06:45 | |
*** jlinkes has joined #tripleo | 06:46 | |
*** ccamacho|brb is now known as ccamacho | 06:48 | |
*** flepied has joined #tripleo | 06:48 | |
*** _milan_ has joined #tripleo | 06:49 | |
*** athomas has joined #tripleo | 06:49 | |
*** yamahata has quit IRC | 06:50 | |
openstackgerrit | Karthik S proposed openstack/tripleo-heat-templates master: Provide DPDK nic configs and add multiqueue config https://review.openstack.org/474533 | 06:54 |
*** fzdarsky_ is now known as fzdarsky | 06:55 | |
*** gfidente has joined #tripleo | 06:57 | |
*** gfidente has quit IRC | 06:57 | |
*** gfidente has joined #tripleo | 06:57 | |
*** bogdando has joined #tripleo | 06:57 | |
*** rcernin has quit IRC | 06:58 | |
*** rcernin has joined #tripleo | 06:58 | |
*** dtantsur|afk is now known as dtantsur | 07:00 | |
*** radeks has joined #tripleo | 07:02 | |
*** florianf has joined #tripleo | 07:02 | |
*** fzdarsky has quit IRC | 07:04 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Convert scenario001-multinode-containers job to ceph-ansible https://review.openstack.org/479288 | 07:06 |
*** ebarrera has joined #tripleo | 07:06 | |
*** _milan_ is now known as milan | 07:07 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 07:10 |
*** fzdarsky has joined #tripleo | 07:10 | |
*** yprokule has joined #tripleo | 07:11 | |
*** amoralej|off is now known as amoralej | 07:11 | |
*** psachin has joined #tripleo | 07:13 | |
*** tesseract has joined #tripleo | 07:16 | |
*** ffiore has quit IRC | 07:18 | |
*** fzdarsky has quit IRC | 07:19 | |
*** fzdarsky has joined #tripleo | 07:24 | |
*** bogdando has quit IRC | 07:25 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Fix lint issues to upgrade to puppet-lint 2.3 https://review.openstack.org/485782 | 07:25 |
*** itlinux has quit IRC | 07:26 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Check lint upgrade to 2.3 https://review.openstack.org/485706 | 07:28 |
*** ffiore has joined #tripleo | 07:29 | |
*** dpawar has joined #tripleo | 07:31 | |
*** hewbrocca_afk is now known as hewbrocca | 07:34 | |
*** bogdando has joined #tripleo | 07:37 | |
*** ccamacho is now known as ccamacho|brb | 07:43 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add nova::compute::rbd setting into nova-libvirt profile https://review.openstack.org/485206 | 07:51 |
openstackgerrit | Merged openstack/tripleo-puppet-elements master: scsi-target-utils is not used in RHEL7+ https://review.openstack.org/475001 | 07:51 |
*** psahoo has quit IRC | 07:57 | |
sri_ | Hello everybody : I have one doubt when we deploying overcloud "--control-scale 3 --control-flavor control " is control is role of Controller right ? , I am trying to deploy my overcloud with custom roles exp role names (CephStorageMON ) how to I pass the cephstoragemon-scale 3 --cephstoragemon-flavor ceph-mon , I've created that flavor and tag to node. | 07:58 |
*** dmacpher has quit IRC | 08:01 | |
*** lucas-afk is now known as lucasagomes | 08:03 | |
*** psahoo has joined #tripleo | 08:03 | |
*** dsariel_ has quit IRC | 08:06 | |
*** dsariel has quit IRC | 08:06 | |
dpawar | Hi, gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container failing repeatedly. failure does not looks to be related to https://review.openstack.org/#/c/475765/17. Anything broken here ? http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5a89111/console.html | 08:06 |
gfidente | sri_ set the number of nodes in role_data | 08:07 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Exposing the ability to enable/disable the repository https://review.openstack.org/452521 | 08:07 |
saneax | sri_, take a look at http://hardysteven.blogspot.in/2016/10/tripleo-composablecustom-roles.html | 08:08 |
gfidente | sri_ or pass as parameter $rolenameCount: $n | 08:09 |
openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Add Swift dispersion profile https://review.openstack.org/476255 | 08:09 |
gfidente | for example CephStorageMONCount: 3 | 08:09 |
*** snecklifter has joined #tripleo | 08:09 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1705481 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 08:10 |
sri_ | gfidente: hi I tried that I run into this error ResourceInError: resources.CephStorageMON: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500" http://paste.openstack.org/show/616058/ | 08:10 |
sri_ | gfidente: this is updated roles.yaml file http://paste.openstack.org/show/616130/ | 08:13 |
gfidente | sri_ yeah that is because of the flavor matching I think | 08:14 |
sri_ | gfidente: yes first link there is typo but here i fixed that typo but still facing same issue http://paste.openstack.org/show/616130/ | 08:15 |
sri_ | gfidente: OvercloudCephStorageMONFlavor: ceph-mon , OvercloudCephStorageOSDFlavor: ceph-osd | 08:16 |
*** cnf has joined #tripleo | 08:16 | |
gfidente | sri_ so check in the nova logs why it says there aren't nodes | 08:17 |
gfidente | btw you don't need both | 08:18 |
gfidente | puppet-ceph.yaml and storage-environment.yaml | 08:18 |
gfidente | but this is unrelated | 08:18 |
*** cylopez has joined #tripleo | 08:18 | |
sri_ | gfidente: understood | 08:18 |
*** egonzalez has joined #tripleo | 08:21 | |
gfidente | sri_ it's probably in the scheduler logs | 08:22 |
sri_ | gfidente: root@undercloud stack]# grep -i error /var/log/nova/nova-scheduler.log -- is empty | 08:23 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Switch MonitoringRabbitUseSSL to boolean https://review.openstack.org/485621 | 08:24 |
openstackgerrit | Merged openstack/tripleo-repos master: It's _RDO Trunk_ repos https://review.openstack.org/466416 | 08:24 |
gfidente | sri_ well I can't point you to a specific line to grep fore | 08:25 |
gfidente | but you should see the returned error from the compute nodes where it attempted to schedule the node | 08:25 |
gfidente | so check the compute node too | 08:26 |
gfidente | *compute logs | 08:26 |
sri_ | gfidente: ok | 08:26 |
dpawar | mwahahaha: gfidente: any idea about this faulilure ? http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5a89111/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-21_07_26_01 | 08:27 |
dpawar | mwahahaha: ^ | 08:27 |
dpawar | mwhahaha: ^ | 08:28 |
sri_ | gfidente: I've one quick question role name of controller is "Controller" in cli we pass the "control-flavor" where do this link together ? | 08:30 |
gfidente | dpawar Jul 21 07:25:49 localhost os-collect-config: "2017-07-21 07:24:57,532 ERROR: 14843 -- Failed running docker-puppet.py for sensu", | 08:31 |
gfidente | in http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container/5a89111/logs/subnode-2/var/log/messages.txt.gz#_Jul_21_07_25_49 | 08:31 |
gfidente | sri_ the default roles were hardcoded into the client cli | 08:33 |
gfidente | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/utils.py#L556 | 08:33 |
gfidente | deprecated in favor of $roleCount: $n parameter | 08:33 |
openstackgerrit | Jan Provaznik proposed openstack/tripleo-heat-templates master: WIP add ganesha and ganesha VIP https://review.openstack.org/471245 | 08:36 |
openstackgerrit | Jan Provaznik proposed openstack/tripleo-heat-templates master: Let mds create manila key and fs https://review.openstack.org/482496 | 08:36 |
sri_ | gfidente: Ok so can override those in environment file ? I seen some were that example file but I am not able to find it again , Instead of using cli to pass the parameters we can use environment file !! | 08:36 |
gfidente | sri_ yes totally | 08:37 |
*** tvignaud has joined #tripleo | 08:38 | |
dpawar | gfidente: is it look related to any of the following ? https://review.openstack.org/#/c/475765/17 https://review.rdoproject.org/r/#/c/7740/ https://review.openstack.org/#/c/481085/ | 08:39 |
*** ckyriakidou has joined #tripleo | 08:39 | |
*** AbhishekKane has joined #tripleo | 08:41 | |
*** marios has quit IRC | 08:41 | |
*** derekh has joined #tripleo | 08:42 | |
*** marios has joined #tripleo | 08:42 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Open up firewall for the control-ports in the bundles https://review.openstack.org/486048 | 08:43 |
gfidente | dpawar probably https://bugs.launchpad.net/tripleo/+bug/1705481 | 08:46 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz) | 08:46 |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Fix up the control-port for rabbitmq bundles https://review.openstack.org/485751 | 08:47 |
dpawar | gfidente: i saw that, but the error signature is different http://logs.openstack.org/70/482170/9/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/214d3dc/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-20_10_52_50 | 08:48 |
*** ccamacho|brb is now known as ccamacho | 08:51 | |
sri_ | gfidente: I've created a environment file for " parameter_defaults: ControllerCount: 3 ComputeCount: 1 CephStorageOSDCount: 3 CephStorageMONCount: 3" , here we take role name and added Count , for flavor's is it like ControllerFlavor ? | 08:51 |
*** chem has joined #tripleo | 08:51 | |
*** shardy has joined #tripleo | 08:54 | |
gfidente | sri_ it's Overcloud$nameFlavor | 08:54 |
gfidente | sri_ https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/role.role.j2.yaml#L10 | 08:55 |
sri_ | gfidente: got it | 08:56 |
AbhishekKane | mwhahaha gfidente: https://bugs.launchpad.net/tripleo/+bug/1705481 seemed to be merged. If I recheck my patch now https://review.openstack.org/#/c/475765/17 , will it pick up the fix or is some rebase required on my patch? | 08:56 |
openstack | Launchpad bug 1705481 in tripleo "scenario001 broken due to sensu puppet module update" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz) | 08:56 |
AbhishekKane | mwhahaha: Ok. I see that one review request is marked in progress. | 08:59 |
*** ramishra has quit IRC | 09:00 | |
*** ramishra has joined #tripleo | 09:02 | |
AbhishekKane | http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/ab705ac/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-21_06_54_28 shows that "openstack stack failures list overcloud --long" was run. Which file has these logs? | 09:08 |
*** paramite has joined #tripleo | 09:10 | |
*** akrivoka has joined #tripleo | 09:11 | |
skramaja | AbhishekKane: it is in the same file, few lines above - http://logs.openstack.org/65/475765/17/check/gate-tripleo-ci-centos-7-scenario001-multinode-oooq/ab705ac/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-21_06_54_22 | 09:12 |
AbhishekKane | skramaja: oh! thanks! | 09:13 |
openstackgerrit | Derek Higgins proposed openstack/tripleo-heat-templates master: Add ironic config to scenario 004 https://review.openstack.org/485261 | 09:14 |
*** paramite has quit IRC | 09:22 | |
*** salmankhan has joined #tripleo | 09:25 | |
*** paramite has joined #tripleo | 09:28 | |
paramite | Hey guys, I have a problem with recent THT master. It seem that even though I've set DockerNamespace: 192.168.24.1:8787/tripleoupstream and DockerNamespaceIsRegistry: true , the images are pulled from docker.io. Did anything changed recently? | 09:29 |
gfidente | paramite yes it did | 09:31 |
shardy | paramite: try running openstack overcloud container image prepare --namespace=192.168.1.16:8787/tripleoupstream --env-file=$HOME/containers-parameters.yaml | 09:31 |
shardy | with whatever IP you need for your local registry obviously ;) | 09:31 |
shardy | that will generate an environment file containing all the image references, which aren't calculated via DockerNamespace anymore | 09:32 |
shardy | paramite: make sure you have latest tripleoclient and tripleo-common | 09:32 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/486075 | 09:34 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP Make HA container bundle work on remote nodes https://review.openstack.org/486076 | 09:35 |
*** paramite has quit IRC | 09:37 | |
openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo master: Fix lint issues to upgrade to puppet-lint 2.3 https://review.openstack.org/485782 | 09:42 |
*** marios has quit IRC | 09:43 | |
*** marios has joined #tripleo | 09:43 | |
*** masco has quit IRC | 09:43 | |
*** katkapilatova has joined #tripleo | 09:48 | |
*** katkapilatova has left #tripleo | 09:48 | |
openstackgerrit | zenghui.shi proposed openstack/tripleo-specs master: Tripleo PTP (Precision Time Protocol) support https://review.openstack.org/483227 | 09:49 |
*** paramite has joined #tripleo | 09:51 | |
paramite | shardy, thans | 09:51 |
paramite | thanks! | 09:51 |
sri_ | shardy: Hi I am trying to deploy overcloud with custom roles , I am getting no valid host error ""Message: No valid host was found. There are not enough hosts available., Code: 500" , this is my environment http://paste.openstack.org/show/616146/, I am doing something wrong here ? | 09:53 |
*** Vijayendra has quit IRC | 09:55 | |
shardy | sri_: I'd check the node profiles/tagging - you're using specific flavors for control/compute/ceph-osd/ceph-mon, are you sure you have enough notes availble of each type, and that they're correctly tagged (check the capabilities in ironic node-show matches the capability in nova flavor show) | 09:56 |
shardy | the error tells us nova can't find enough nodes that match the flavors you've requested | 09:56 |
*** stendulker has joined #tripleo | 09:56 | |
*** jprovazn has quit IRC | 09:56 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 09:57 |
shardy | hmm the profiles list output looks OK though... | 09:57 |
shardy | sri_: you may need to check the nova-scheduler logs to work out which criteria aren't being met, e.g could it be disk or ram isn't correctly set for some nodes in ironic? | 09:59 |
chandankumar | mwhahaha: finally the job passed, https://review.openstack.org/485477 | 10:00 |
*** stendulker_ has joined #tripleo | 10:00 | |
*** Vijayendra has joined #tripleo | 10:01 | |
sri_ | shardy: yes , I've tested without custom roles like 3 ceph nodes 3 controllers 1 compute it worked , ok let me check that | 10:01 |
*** stevebaker has quit IRC | 10:03 | |
*** stendulker has quit IRC | 10:04 | |
*** slagle has quit IRC | 10:04 | |
*** stendulker_ has quit IRC | 10:05 | |
sri_ | shardy: you're right I think I miss configured node , Let me validate node's with profile and flavors ----> nova-scheduler.log http://paste.openstack.org/show/616149/ | 10:07 |
gfidente | sri_ so it was in there :D | 10:17 |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Open up firewall for the control-ports in the bundles https://review.openstack.org/486048 | 10:17 |
sri_ | dfidente: yes lol, | 10:18 |
*** psahoo has quit IRC | 10:24 | |
*** ramishra has quit IRC | 10:24 | |
*** ramishra has joined #tripleo | 10:26 | |
*** jkilpatr has joined #tripleo | 10:26 | |
*** paramite has quit IRC | 10:26 | |
*** jprovazn has joined #tripleo | 10:27 | |
*** jkilpatr has quit IRC | 10:33 | |
shardy | marios, dciabrin: Hey I'm about to add update_tasks, do we know how many steps are like to be required at this point? | 10:34 |
shardy | Or should I just assume the same as upgrade_tasks as a starting point? | 10:34 |
marios | shardy: :/ been pulled into a case am afraid so not really able to respond too much here. well, lets make it same 6 but right don't expecte we'll need them all (maybe for bring down cluster before package update is the most immediate/obvious things we have to orchestrate) | 10:35 |
shardy | marios: ack, yeah I was thinking we'd probably need less (do we even need all 6 for upgrade now?) but I'll make them same to start with and we can iterate on it | 10:36 |
*** fzdarsky is now known as fzdarsky|afk | 10:37 | |
*** skramaja has quit IRC | 10:38 | |
*** artom_ has quit IRC | 10:45 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move step_config/docker_config calculation into services.yaml https://review.openstack.org/485250 | 10:57 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move docker_puppet_tasks calculation into services.yaml https://review.openstack.org/485685 | 10:57 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move services.yaml output calculation into Value resources https://review.openstack.org/479254 | 10:57 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add RoleConfig output https://review.openstack.org/485731 | 10:57 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Move deploy-steps-playbook to deploy-steps-tasks https://review.openstack.org/485686 | 10:57 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Consolidate puppet/docker deployments with one deploy steps workflow https://review.openstack.org/483293 | 10:57 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Default docker_puppet_debug to false https://review.openstack.org/486103 | 10:57 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks https://review.openstack.org/486104 | 10:57 |
*** rook has quit IRC | 10:57 | |
*** dtantsur is now known as dtantsur|bbl | 10:57 | |
*** sai_ has quit IRC | 10:57 | |
shardy | matbu: Hey interested in your opinion on https://review.openstack.org/486104 - I'm wondering if we should convert upgrade tasks to when conditionals instead of tags, so we can do the same approach for generating an upgrade_tasks_playbook | 10:58 |
*** sai has joined #tripleo | 10:58 | |
*** rook has joined #tripleo | 10:58 | |
shardy | If we do that we could remove the playbook generation special-case from tripleoclient | 10:58 |
*** rook is now known as Guest11562 | 10:59 | |
*** flepied has quit IRC | 11:02 | |
*** cylopez has quit IRC | 11:03 | |
*** flepied has joined #tripleo | 11:03 | |
*** jkilpatr has joined #tripleo | 11:09 | |
*** shardy is now known as shardy_lunch | 11:10 | |
*** pkovar has joined #tripleo | 11:16 | |
*** ccamacho is now known as ccamacho|lunch | 11:17 | |
*** pgadiya has quit IRC | 11:24 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Remove Mitaka release reference from validate-tempest https://review.openstack.org/468862 | 11:25 |
*** coolsvap has quit IRC | 11:27 | |
*** ffiore has quit IRC | 11:29 | |
atoth | beagles, can I assume you know a thing or two about the ci scenarios? | 11:30 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Let's make yum transaction less expensive for tempest https://review.openstack.org/485574 | 11:37 |
*** colonwq has quit IRC | 11:38 | |
therve | Can I do a depend-on in tht on a puppet module? | 11:38 |
therve | It doesn't seem to be taken into account | 11:38 |
*** shardy_lunch is now known as shardy | 11:38 | |
shardy | therve: it should work for openstack puppet modules | 11:39 |
shardy | therve: got a link to the patch? | 11:39 |
therve | shardy, https://review.openstack.org/#/c/485124/1 | 11:39 |
*** colonwq has joined #tripleo | 11:39 | |
shardy | therve: the depends-on already merged so did you just get unlucky and have CI run after it merged but before rdo current was updated? | 11:41 |
therve | shardy, I don't think so :). It merged yesterday, the build is from 2 days ago | 11:42 |
shardy | therve: k, let me look more closely then :) | 11:42 |
shardy | https://trunk.rdoproject.org/centos7/current/ seems to have the version you need now at least | 11:42 |
therve | shardy, Well it was more for info :) Now it should be good indeeed | 11:42 |
*** paramite has joined #tripleo | 11:43 | |
shardy | therve: ah this is an upgrades job | 11:43 |
beagles | atoth: maybe literally "two things"... I can try to help if you want regardless | 11:43 |
beagles | atoth, what's on the go | 11:43 |
shardy | we don't enable the overlay repo until the upgrade is started IIRC | 11:43 |
therve | shardy, Hum no I was not looking at that one | 11:43 |
therve | shardy, Was looking at the config on the regular jobs | 11:43 |
shardy | Ah I just looked at the only one that failed :) | 11:43 |
therve | shardy, Like http://logs.openstack.org/24/485124/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/5684e11/logs/subnode-2/rpm-qa.txt.gz | 11:44 |
therve | puppet-zaqar-11.2.0-0.20170719095646.4369b01.el7.centos.noarch | 11:44 |
shardy | http://logs.openstack.org/24/485124/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/020df72/console.html#_2017-07-19_09_59_00_802263 | 11:46 |
shardy | So we see it get built there | 11:46 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 11:47 |
therve | shardy, Doesn't it say "packages not built correctly" ? | 11:47 |
*** lucasagomes is now known as lucas-hungry | 11:47 | |
shardy | yeah I think that's a weird dlrn thing, it built one package and complains it didn't build $others I think | 11:47 |
*** abishop has joined #tripleo | 11:48 | |
*** sbrzozow has joined #tripleo | 11:49 | |
shardy | http://logs.openstack.org/24/485124/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/020df72/logs/overcloud-controller-0/var/log/yum.log.txt.gz | 11:50 |
shardy | http://logs.openstack.org/24/485124/1/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/020df72/logs/undercloud/home/jenkins/install_built_repo.log.txt.gz | 11:50 |
shardy | those seem to show puppet-zaqar and t-h-t get updated from gating_repo? | 11:51 |
atoth | beagles, scenerio003 blows up neutron when I add the lbaas stuff to it. I'm trying to test locally doing a overcloud deploy with scenario 3 yaml passed as a -e arg. the problem there is the install blows up even if I don't add the lbaas stuff to it | 11:51 |
beagles | atoth, is there a patch u/s that I can look at logs? | 11:52 |
beagles | atoth, I think the answer is yes, right.. I was just looking at one last night :) | 11:52 |
atoth | beagles, so I'm looking to figure out how to run the scenario with out having the push the patchset each time as I'm going to piecemeal the lbaas stuff in to see which piece is breaking it | 11:52 |
shardy | http://logs.openstack.org/24/485124/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq/5684e11/logs/undercloud/home/jenkins/install_built_repo.log.txt.gz | 11:52 |
therve | shardy, Ah so it installed the right version? | 11:53 |
shardy | therve: ^^ so it's installed that version, but you think it's not built the right hash? | 11:53 |
therve | Hum I don't know about that actually | 11:53 |
therve | shardy, Sorry, maybe my change didn't work then | 11:54 |
shardy | therve: ack, np - let me know if you dig further and think it is CI related | 11:54 |
therve | Thanks for looking | 11:55 |
*** colonwq has quit IRC | 11:55 | |
beagles | atoth, ah... I wonder if neutron-lbaas package isn't getting installed in multinode | 11:55 |
therve | It worked in the puppet CI scenario002 which is weird | 11:55 |
beagles | atoth, multinode is a slightly different beast - 1s | 11:55 |
atoth | beagles, oops looks like I switched channels there mistakenly :-) | 11:56 |
beagles | atoth, :) | 11:56 |
*** colonwq has joined #tripleo | 11:56 | |
*** paramite has quit IRC | 11:56 | |
atoth | beagles, yeah, but I thought the ensure package was taking care of that, or are you saying it isn't available in the repo? | 11:57 |
beagles | atoth, that's a good point... mmm | 11:57 |
atoth | beagles, when I looked at the neutron log I was wondered if the lbaasv2 alias wasn't defined, but as I don't know where those aliases are defined I could verify it | 11:59 |
*** morazi has joined #tripleo | 11:59 | |
chandankumar | trown|outtypewww: can we get -2 removed from this patch https://review.openstack.org/#/c/468862/ as mitaka eol is already tagged | 12:01 |
beagles | atoth, does the config (not CI, just regular deployment) work in your development environment? | 12:02 |
atoth | beagles, yep | 12:03 |
beagles | atoth (I think it's done in setup.cfg btw) | 12:03 |
atoth | beagles, I'm assuming it's the aliases are not changed for individual scenarios though | 12:04 |
*** cylopez has joined #tripleo | 12:04 | |
beagles | atoth, no.. which leads me back to things not being installed properly.. | 12:05 |
* beagles ruminates on other service plugins that are not part of the neutron package that might be exercised in CI | 12:05 | |
beagles | I can't think of one | 12:05 |
openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Add Swift dispersion profile https://review.openstack.org/476255 | 12:05 |
beagles | atoth, if you want to "hack in" a check you could put the full class name instead of the alias in the scenario | 12:06 |
*** artom has joined #tripleo | 12:07 | |
numans | EmilienM, shardy, beagles Hi, with the patch https://review.openstack.org/#/c/475423/ merged in project-config, networking-ovn gate is broken. can you please have a look at this patch - https://review.openstack.org/#/c/484868/ | 12:07 |
beagles | atoth, whether it works or not you know something new, if it works, then the install is "funny" and not behaving as expected - if it doesn't work, then you know it isn't getting installed at all | 12:07 |
atoth | beagles, yeah, one of the avenues I was going to go, but if I can't test it locally it'll take for ever to run | 12:07 |
beagles | atoth, can you clarify what is happening locally? | 12:08 |
weshay | easy doc review if someone has a sec https://review.openstack.org/#/c/447576/ | 12:08 |
*** paramite has joined #tripleo | 12:08 | |
atoth | beagles, let me throw together a pastebin for you | 12:09 |
beagles | atoth, cool | 12:09 |
therve | shardy, I'm a dummy, it got built before a fix on the depend | 12:11 |
shardy | therve: aha, mystery solved :) | 12:11 |
*** fragatina has joined #tripleo | 12:14 | |
shardy | numans: lgtm but as EmilienM said we need to recheck to trigger the scenario, I just did that | 12:14 |
numans | shardy, thanks. | 12:14 |
panda|off | is there some documentation for the containers prepare command ? | 12:15 |
*** panda|off is now known as panda | 12:15 | |
numans | shardy, i am not too familiar with CI, is this tripleo quickstart patch also required ? - https://review.openstack.org/#/c/484097/ | 12:15 |
*** slagle has joined #tripleo | 12:15 | |
shardy | panda: there is https://review.openstack.org/#/c/475958/ | 12:15 |
shardy | needs a rebase by the looks of it | 12:15 |
panda | shardy: ah thanks. I thought I could specify also the registry to use to pull images from | 12:19 |
atoth | beagles, https://pastebin.com/0PQKqe0v | 12:19 |
beagles | atoth, mmmm.. what is this of, are you trying to run the scenario locally or is this just a deployment? | 12:20 |
shardy | panda: yup you can like openstack overcloud container image prepare --namespace=192.168.1.16:8787/tripleoupstream --env-file=$HOME/containers-parameters.yaml | 12:20 |
shardy | where 192.168.1.16:878 is the registry host/port | 12:20 |
atoth | beagles, good question :-) | 12:20 |
atoth | beagles, I want to run the scenario but the only way I could think to do it was through an overcloud deploy | 12:21 |
panda | shardy: so even something like openstack overcloud container image prepare --namespace=trunk.registry.rdoproject.org/tripleo would work ? | 12:21 |
atoth | beagles, how SHOULD I run a scenario? | 12:21 |
beagles | atoth, yup, that's cool... I was just wondering if you figured out how to do a multinode scenario locally - in which case I'm going to be useless :) | 12:22 |
shardy | panda: yup I think so | 12:22 |
beagles | atoth, though it probably isn't that big of a deal, I just haven't tried it ... | 12:22 |
atoth | beagles, now I'm thinking it may be because I'm only using 1 compute and one controller but couldn't say for sure as I know nothing about these scenarios :-) | 12:23 |
panda | shardy: \o/ thanks. | 12:23 |
beagles | atoth, mmmm... wait | 12:23 |
*** jaganathan has quit IRC | 12:23 | |
*** dprince has joined #tripleo | 12:24 | |
beagles | atoth, can you supply the command line for how you're deploying? | 12:25 |
beagles | atoth, if you are trying to pull in multinode specific yaml with a straight deploy that probably isn't going to work | 12:25 |
beagles | atoth, you might be better off just doing away with your alias in your scenario patch and see what happens - | 12:26 |
beagles | atoth, because if it works in your environment both ways, you learn nothing except "it is supposed to work" | 12:26 |
*** ansmith has joined #tripleo | 12:27 | |
beagles | atoth, at the moment the lbaas packages have either been installed directly in the disk image or container | 12:28 |
openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: Fall back to non-containerized cinder-backup and cinder-volume for HA https://review.openstack.org/486121 | 12:28 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks https://review.openstack.org/486104 | 12:28 |
atoth | beagles, openstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/ci/environments/scenario003-multinode.yaml | 12:28 |
beagles | atoth, so multinode might be throuwing a wringle | 12:28 |
beagles | atoth, yeah, I would not expect that to work | 12:28 |
atoth | beagles, ok, why not? | 12:28 |
beagles | atoth, maybe it should, but I wouldn't expect it to | 12:29 |
atoth | :-) | 12:29 |
beagles | atoth, hold on... | 12:29 |
*** gkadam has quit IRC | 12:29 | |
atoth | beagles, I know nothing about it so I could say whether it should work or not :-) | 12:30 |
beagles | atoth, OS::TripleO::Controller::Net::SoftwareConfig: ../common/net-config-multinode.yaml | 12:32 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 12:32 |
beagles | atoth, you *could* try just commenting out those lines locally and see what you get | 12:32 |
beagles | atoth, (there's one for Compute as well) | 12:33 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/newton: Revert "Use optimal (instead of default) tunables for Ceph on upgrade" https://review.openstack.org/485746 | 12:33 |
atoth | beagles, ok I'll give that a shot, what is in that file? | 12:34 |
beagles | atoth, multinode involves "pre-setup", those files contain commands like adding ip addrs to existing devices | 12:34 |
atoth | beagles, ah | 12:34 |
beagles | atoth, if you try running them in a non-multinode setup those things (among others likely) will fail | 12:35 |
atoth | beagles, deploy started, we'll see what happens :-) | 12:35 |
beagles | atoth, kind of curious because if it works, I'll toss some modified scenarios in my deployment mix | 12:36 |
*** rlandy has joined #tripleo | 12:36 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 12:36 |
*** atoth is now known as atoth_guinea_pig | 12:37 | |
* beagles is slowly getting around to a "standardized + variables" setup including mixed baremetal virtual overcloud nodes | 12:37 | |
beagles | (for SR-IOV) | 12:37 |
*** atoth_guinea_pig is now known as atoth | 12:37 | |
beagles | just wish I had an IPMI capable SR-IOV box.. fake_pxe is getting on my nerves | 12:37 |
atoth | :-) | 12:38 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 12:38 |
*** pchavva has joined #tripleo | 12:39 | |
*** trown|outtypewww is now known as trown | 12:40 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 12:40 |
trown | chandankumar: I will do 1 better and put +2 :) | 12:40 |
*** lucas-hungry is now known as lucasagomes | 12:45 | |
*** leitan has joined #tripleo | 12:48 | |
openstackgerrit | Steven Hardy proposed openstack/python-tripleoclient master: Consume new RoleConfig data in config download https://review.openstack.org/485732 | 12:48 |
*** jrist has quit IRC | 12:49 | |
chandankumar | afazekas: panda: sshnaidm please have a look on this review https://review.openstack.org/#/c/485574/5 | 12:49 |
*** ffiore has joined #tripleo | 12:50 | |
*** cylopez has quit IRC | 12:50 | |
*** ccamacho|lunch is now known as ccamacho | 12:51 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 12:51 |
*** rhallisey has joined #tripleo | 12:51 | |
*** florianf has quit IRC | 12:52 | |
*** paramite has quit IRC | 12:54 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks https://review.openstack.org/486104 | 12:54 |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Move setfiles to outside chroot with runcon https://review.openstack.org/485899 | 12:55 |
openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart-extras master: Undercloud deploy with multiple source containers https://review.openstack.org/486135 | 12:56 |
bogdando | folks, w/o that patch ^^ undercloud deploy fails for me with "Property DockerNeutronConfigImage not assigned" | 12:56 |
bogdando | I wonder how does it pass CI... | 12:57 |
*** cylopez has joined #tripleo | 12:57 | |
*** florianf has joined #tripleo | 12:59 | |
shardy | florianf: Hi! | 13:00 |
shardy | florianf: Hey I was wondering, is there a reason we do role.lower() in tripleo-ansible-inventory? | 13:00 |
shardy | I would prefer it if we maintained the case so it matches all the data output by heat | 13:00 |
shardy | any objections to me pushing a patch for that? | 13:00 |
shardy | same question re service names, but I think they're all lowercase in t-h-t anyway | 13:01 |
*** dparkes has joined #tripleo | 13:01 | |
*** gbarros has joined #tripleo | 13:01 | |
*** jrist has joined #tripleo | 13:03 | |
*** ramishra has quit IRC | 13:03 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Don't modify case of role names in inventory https://review.openstack.org/486140 | 13:03 |
*** jcoufal has joined #tripleo | 13:04 | |
*** cdearborn has joined #tripleo | 13:04 | |
*** ramishra has joined #tripleo | 13:05 | |
leitan | Hi guys, my nodes are not "asuming" the roles that i have specified for them , im using preprovisioned nodes, they run basic tasks but the openstack undercloud installation never starts | 13:06 |
leitan | any pinpoint ? | 13:06 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 13:07 |
bogdando | leitan: os-cloud-config should be reconfigured to detach from host openstack cloud | 13:07 |
florianf | shardy: I think the only reason is to maintain some sort of consistency. | 13:07 |
shardy | florianf: Ok, consistent with what? :) | 13:07 |
leitan | os-cloud-configs gets the URL and i can see on the heat resource detail that the ControllerDeployedNode role is assigned | 13:07 |
shardy | I was thinking it's be more consistent if it matched what's in roles_data.yaml, and the heat outputs | 13:08 |
bogdando | leitan: like here https://github.com/slagle/traas/blob/085da1462972c39c4edcece2e2b7a4691b3dd5ad/templates/toci-job.yaml#L113 | 13:08 |
shardy | but open to other ideas | 13:08 |
leitan | so im wondering why it doesnt start installing, what do you mean to be "reconfigured" bogdando ? | 13:08 |
florianf | shardy: With the way the inventory sections are usually named. | 13:08 |
shardy | florianf: if we think it's going to break anything, I can add duplicate groups with case maintained and .lower() | 13:08 |
florianf | shardy: But I don't have a strong opinion on that. :-) | 13:08 |
bogdando | leitan: for my case, it was just hanging until timed out, w/o that reconfiguration step | 13:08 |
shardy | florianf: ack, I ran into it testing minor updates | 13:09 |
*** suuuper has joined #tripleo | 13:09 | |
shardy | florianf: and it's kind of weird do to --limit controller | 13:09 |
shardy | when the role is called Controller | 13:09 |
shardy | but I guess we could support both | 13:09 |
florianf | shardy: I guess duplicates would be confusing. So I'm fine with getting rid of the .lower() conversion | 13:09 |
shardy | --limit computeovsdpdkcustomrolefoo | 13:09 |
shardy | florianf: Ok thanks, I pushed a patch so perhaps you can check it when you get a moment :) | 13:10 |
flaper87 | gfidente: http://logs.openstack.org/59/471759/37/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/103f2fa/logs/undercloud/var/log/heat/heat-engine.log.txt.gz#_2017-07-20_14_46_54_078 | 13:10 |
flaper87 | gfidente: debugging now | 13:10 |
florianf | shardy: Sure, of course :-) | 13:10 |
atoth | beagles, same story, deploy fails | 13:10 |
*** agopi has joined #tripleo | 13:11 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Let's make yum transaction less expensive for tempest https://review.openstack.org/485574 | 13:11 |
leitan | bogdando: its weird cause when i inspect the stack, the only thing i see that its going to be installed of tripleO is OS::TripleO::DeployedServer::ControlPlanePort OS::TripleO::DeployedServer::Bootstrap | 13:11 |
beagles | atoth, with NetworkDeployment failures? | 13:11 |
beagles | atoth, or something else? | 13:11 |
atoth | beagles, yep | 13:11 |
leitan | bogdando: nothing about neutron, glance, nova, etc ... | 13:11 |
atoth | beagles, I did not comment out OS::TripleO::Compute::Net::SoftwareConfig: ../common/net-config-multinode.yaml though | 13:12 |
beagles | atoth, oh haha | 13:12 |
bogdando | leitan: do you use undercloud install or undercloud deploy? | 13:13 |
beagles | atoth, that's probably the issue | 13:13 |
beagles | atoth, you basically don't want anything multinode specific | 13:13 |
bogdando | the latter works for me on openstack cloud based VMs, but I have yet tried the former leitan, can't say much about it | 13:13 |
leitan | bogdando: undercloud deploy (following the docs of pre-provisioned nodes) | 13:13 |
beagles | atoth, in the meantime I recommend you try the fully-scoped class in the u/s patch instead of the alias - fight the battle on two fronts | 13:13 |
bogdando | leitan: manual, or with quickstart roles? | 13:14 |
atoth | beagles, yeah, that was my thought too :-) | 13:14 |
leitan | bogdando: we are using custom roles | 13:14 |
*** tzumainn has joined #tripleo | 13:14 | |
flaper87 | gfidente: oh, mmh, apparently, on-success is missing in Heat's mistral external resource definition | 13:15 |
bogdando | leitan: aside from https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/deployed_server.html I can only share inventory variables that work for me... | 13:15 |
gfidente | flaper87 no this is unrelated to the execution | 13:15 |
gfidente | it's related to the task resource | 13:15 |
leitan | bogdando: that will be very helpfull | 13:16 |
bogdando | basically, I'm struggling to deploy custom roles UC then overcloud on top, leitan | 13:16 |
sri_ | shardy: while deploying overcloud faild with this error "Error: ceilometer-upgrade --skip-metering-database returned 1 instead of one of [0]" , i've seen there is couple of bug reports on this but that was 2 to 3 months ego , I am using stable/ocata !! | 13:16 |
*** jmelvin has joined #tripleo | 13:16 | |
leitan | bogdando: we are struggling with custom roles for the overcloud | 13:16 |
flaper87 | gfidente: oh, mmh, it's on_success | 13:16 |
flaper87 | gfidente: not on-success | 13:16 |
bogdando | didn't yet succeed with overcloud on pre-provisioned, by quickstart. But UC works for me | 13:16 |
flaper87 | why is this inconsistent? | 13:16 |
gfidente | flaper87 yeah check os::mistral::task properties | 13:16 |
bogdando | leitan: so here is my inventory vars / playbooks https://github.com/bogdando/oooq-warp | 13:16 |
flaper87 | gfidente: already did, it's on_success | 13:17 |
*** fzdarsky|afk is now known as fzdarsky | 13:17 | |
jrist | honza: are you familiar with this error? http://logs.openstack.org/75/486075/1/check/gate-tripleo-ui-nodejs6-npm-run-lint/7a17625/console.html | 13:17 |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 13:18 |
leitan | bogdando: ill check that out thanks ! | 13:18 |
shardy | sri_: pradk may be able to help identify the ocata backports needed, so you can ensure you have them | 13:18 |
jrist | honza: or can I just fire off a recheck | 13:18 |
honza | jrist: looking | 13:18 |
honza | jrist: recheck won't help, the language check fails http://logs.openstack.org/75/486075/1/check/gate-tripleo-ui-nodejs6-npm-run-lint/7a17625/console.html#_2017-07-21_09_47_36_170597 | 13:19 |
shardy | jtomasek: Hey, does the UI currently have support for controlling minor updates? | 13:20 |
jrist | honza: ahhhh, I was wondering about that | 13:20 |
bogdando | leitan: this is my current playbook https://github.com/bogdando/oooq-warp/blob/master/playbooks/oooq-traas-under.yaml and the inventory vars https://github.com/bogdando/oooq-warp/blob/master/custom.yaml_example. In order to create a static inventory from openstack, I use my custom patches https://review.openstack.org/#/c/463701/ and this playbook https://github.com/bogdando/oooq-warp/blob/master/playbooks/oooq-traas.yaml | 13:20 |
shardy | e.g the workflow implemented via openstack overcloud update | 13:20 |
bogdando | can't say how it is expected to go with the quickstart.sh / devmode leitan. I'm using that off-road way only so far | 13:21 |
honza | jrist: needs to be added here https://github.com/openstack/tripleo-ui/blob/master/src/js/constants/i18n.js#L1 | 13:21 |
honza | jrist: 'fr' | 13:21 |
sri_ | shardy: thanks | 13:21 |
jrist | honza: for that patch? or permanently | 13:23 |
honza | jrist: permanently --- each new language should be added | 13:23 |
jtomasek | shardy: what does it mean specifically? | 13:23 |
jrist | honza: should be automatic https://review.openstack.org/#/c/486075/ ? | 13:23 |
jrist | ah | 13:24 |
jrist | honza: separate patch? | 13:24 |
jrist | depends-on ? | 13:24 |
honza | jrist: probably | 13:24 |
shardy | jtomasek: it does a rolling minor update of the nodes, using breakpoints to apply a script that controls pacemaker and runs yum update on each node | 13:24 |
honza | jrist: hmmm, i guess we could update the zanata one | 13:24 |
honza | jrist: that might be cleaner | 13:24 |
jrist | honza: go on... :) | 13:24 |
jrist | I'm listening | 13:24 |
honza | jrist: want me to do it? | 13:24 |
jrist | how? | 13:24 |
jrist | or tell me and I wil :) | 13:25 |
shardy | jtomasek: the reason I ask is the approach is changing to support containers soon, I just pushed a bunch of patches and wasn't sure if we need to consider UI updates | 13:25 |
jrist | this wasn't covered in jpich's deep dive :) | 13:25 |
leitan | bogdando: im actually trying to install a production cloud with triple0, finding it unnecesarily complicated (used to deploy full clouds with ansible) but it need it for homologation | 13:25 |
*** catintheroof has joined #tripleo | 13:25 | |
openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: Prevent haproxy to run iptables during docker-puppet configuration https://review.openstack.org/486141 | 13:25 |
jtomasek | shardy: we can't do this from UI, so I think the patches does not affect UI | 13:25 |
honza | jrist: pull down that patch, add the 'fr': 'French' entry to the constants/i18n.js file, amend the commit and git review | 13:25 |
jrist | honza: ah | 13:25 |
jrist | honza: noted! | 13:26 |
jrist | will do | 13:26 |
jrist | honza: I thought you meant do something in zanata | 13:26 |
honza | jrist: thanks --- i think we could improve the lint error message, too | 13:26 |
shardy | jtomasek: Ok that's good - FYI the new approach is using ansible, so I suspect we can drive it via a mistral workflow similar to validations in future | 13:26 |
honza | jrist: ie add next steps | 13:26 |
jrist | honza: separate patch :) | 13:26 |
shardy | if the UI doesn't need that right now though, we might run ansible from tripleoclient as a first step | 13:26 |
*** catinthe_ has joined #tripleo | 13:26 | |
honza | jrist: yes, for sure | 13:26 |
honza | jrist: low priority | 13:26 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 13:26 |
pabelanger | EmilienM: is anybody working on making undercloud-containers more stable? http://status.openstack.org/elastic-recheck/data/others.html#gate-tripleo-ci-centos-7-undercloud-containers | 13:27 |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: tripleo-common sudoers file is to permissive. https://review.openstack.org/486142 | 13:27 |
pabelanger | EmilienM: I tried to debug a job failure but don't see much logging collected. Seems to be missing some log files compared to quickstart jobs | 13:27 |
*** iranzo has quit IRC | 13:27 | |
jtomasek | shardy: cool | 13:27 |
pabelanger | eg: undercloud log folder | 13:27 |
*** iranzo has joined #tripleo | 13:28 | |
*** iranzo has joined #tripleo | 13:28 | |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: tripleo-common sudoers file is to permissive. https://review.openstack.org/486142 | 13:28 |
*** eck`gone is now known as eck` | 13:28 | |
bogdando | leitan: I've shared that I have for development environments by quickstart ansible roles, like devstack for openstack, you know... I suppose that does not fit production environments :) Other folks here should know more on that topic | 13:28 |
*** ecerquei has joined #tripleo | 13:30 | |
openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/486075 | 13:30 |
jrist | honza: ^ | 13:30 |
*** catintheroof has quit IRC | 13:30 | |
jrist | akrivoka: ^ | 13:30 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 13:30 |
honza | jrist: that should do it | 13:31 |
*** florianf has quit IRC | 13:32 | |
*** dtantsur|bbl is now known as dtantsur | 13:32 | |
jrist | honza: thanks for your help (and brainzzzz) | 13:32 |
honza | jrist: np! | 13:32 |
jrist | also I might have reordered it because I'm slightly OCD that way | 13:33 |
*** florianf has joined #tripleo | 13:33 | |
leitan | bogdando: we were looking forward to do it too, once we have a working deploy | 13:34 |
sri_ | pradk : hi can you help with this , while deploying overcloud faild with this error "Error: ceilometer-upgrade --skip-metering-database returned 1 instead of one of [0]" , i've seen there is couple of bug reports on this but that was 2 to 3 months ego , I am using stable/ocata !! | 13:36 |
bogdando | leitan: there are also much better experts here for pre-provisioned nodes and custom overcloud roles, like shardy and slagle :) | 13:36 |
pradk | sri_, yea we fixed this recently | 13:36 |
pradk | sri_, https://review.openstack.org/#/c/482712/ is the ocata patch | 13:37 |
bogdando | I can try to help to address quickstart questions though | 13:37 |
bogdando | there is also a #oooq channel for advanced quickstart topics | 13:37 |
sri_ | pradk: thanks | 13:38 |
*** rbowen has quit IRC | 13:38 | |
*** rbowen has joined #tripleo | 13:38 | |
*** anshul has quit IRC | 13:38 | |
honza | jtomasek: would you mind hitting the +1 workflow on this? https://review.openstack.org/#/c/483979/ thanks | 13:40 |
leitan | bogdando: thanks for the help ! | 13:40 |
jtomasek | honza: done | 13:41 |
honza | jtomasek: \o/ | 13:41 |
*** jcoufal_ has joined #tripleo | 13:41 | |
leitan | shardy slagle do you guys know why after running BootsTrap and ControlPlanePort, my nodes stops there and doesnt start the component installations ? (im using pre provisioned nodes, defined the roles ) | 13:41 |
leitan | im seem that after running deployed-servers.yml, doesnt do anything else | 13:42 |
*** george_goh has quit IRC | 13:43 | |
*** links has quit IRC | 13:43 | |
*** jcoufal has quit IRC | 13:43 | |
EmilienM | hello | 13:43 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/ocata: Revert "Use optimal (instead of default) tunables for Ceph on upgrade" https://review.openstack.org/485745 | 13:43 |
*** suuuper has quit IRC | 13:43 | |
*** suuuper has joined #tripleo | 13:44 | |
leitan | shardy slagle were passing the "-r deployed-server-roles-data-mycustom.yaml" at the end of the command, seems to be ignoring it | 13:44 |
openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Use correct manage_firewall hieradata https://review.openstack.org/485709 | 13:44 |
EmilienM | pabelanger: not afik | 13:44 |
EmilienM | pabelanger: what is the problem? I'm happy to help now | 13:45 |
pabelanger | EmilienM: http://status.openstack.org/elastic-recheck/data/others.html | 13:45 |
pabelanger | EmilienM: these are the reasons why the gate pipeline for tripleo jobs are so high | 13:45 |
pabelanger | EmilienM: just curious if anybody is working to fix them | 13:45 |
pabelanger | pep8 seems like a easy fix | 13:46 |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-common master: tripleo-common sudoers file is to permissive. https://review.openstack.org/486147 | 13:46 |
pabelanger | but not sure how broken code would have landed in tripleo-heat-templates | 13:46 |
EmilienM | pabelanger: I'm not sure if someone is working on this one (I just woke up) | 13:47 |
slagle | leitan: you could start by checking the agents on the nodes to see if they're stuck doing something, or pulling new metadata from heat, etc | 13:47 |
pabelanger | EmilienM: okay | 13:47 |
EmilienM | http://logs.openstack.org/35/483535/4/gate/gate-tripleo-heat-templates-pep8-ubuntu-xenial/6dcbcb6/console.html#_2017-07-20_17_22_51_089402 | 13:48 |
*** nmathew has joined #tripleo | 13:48 | |
EmilienM | sounds like contrail broke us | 13:48 |
EmilienM | pabelanger: let me investigate | 13:48 |
leitan | slagle: they are not, they finish running basic tasks from BoosTrap and our nooped Ports, and they stop doing anything | 13:48 |
EmilienM | pabelanger: the problem seems resolved: https://review.openstack.org/#/c/485685 | 13:48 |
EmilienM | pabelanger: I don't see the problem anymore | 13:49 |
EmilienM | at least for pep8 | 13:49 |
openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: Fix creation of iptables rules for non-HA containerized HAproxy https://review.openstack.org/474183 | 13:49 |
pabelanger | EmilienM: any idea on what fixed it or why it broke? | 13:50 |
leitan | slagle: but wondering also, why our nova/neutron etc roles, doesnt come up on the list when we do a stack resource list using the phyisical resource id of the Role | 13:50 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 13:50 |
EmilienM | pabelanger: you also mentioned gate-tripleo-ci-centos-7-undercloud-containers, let me see | 13:50 |
EmilienM | pabelanger: if you look at gate-tripleo-ci-centos-7-undercloud-containers on http://cistatus.tripleo.org/ - it has more than 85% of success overall, and 92.7 yesterday | 13:51 |
EmilienM | pabelanger: so not sure why you say it's unstable | 13:51 |
slagle | leitan: do you mean you resource list the respective OS::Heat::ResourceGroup and it's empty? | 13:51 |
pabelanger | EmilienM: that is on gate pipeline? | 13:52 |
EmilienM | pabelanger: I found why pep8 is failing | 13:52 |
EmilienM | pabelanger: yes, gate pipeline | 13:52 |
EmilienM | pabelanger: for pep8, this is the reason: https://review.openstack.org/#/c/483535/ | 13:52 |
leitan | slagle: openstack stack resource show overcloud ControllerDeployedServer -c physical_^Csource_id -f value | 13:53 |
leitan | then | 13:53 |
leitan | openstack stack resource show 5b7dc02d-97f1-4e65-be14-e5a400fd85fd ControllerDeployedServer -c physical_resource_id -f value | 13:53 |
EmilienM | pabelanger: we'll look at this one more closely | 13:53 |
leitan | and finally openstack stack resource list 32677512-63f3-4373-b290-2a6d9516a752 | 13:53 |
mwhahaha | EmilienM: that hasn't merged yet? | 13:53 |
sri_ | pradk: if I want to monkey patch this bug https://review.openstack.org/#/c/482712/ where do I need modify my heat-templates ? | 13:53 |
leitan | slagle: and inside , theres only this: | 13:53 |
pabelanger | EmilienM: IMO, you need to bump that pass rate much higher. Because, any failure in gate pipeline will cause subsequent jobs to be re-run (a gate reset). This is the reason your change queue is up to 16hr+ ATM | 13:53 |
EmilienM | mwhahaha: sounds like now | 13:54 |
atoth | beagles, Success! commenting out those 2 lines worked locally :-) | 13:54 |
mwhahaha | strigazi: http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html example 2 to monkey patch puppet-tripleo | 13:54 |
pabelanger | EmilienM: the removal of citycloud-sto2 has helpped also | 13:54 |
EmilienM | pabelanger: sounds like easy to say | 13:54 |
leitan | slagle: http://paste.openstack.org/show/616169/ | 13:54 |
atoth | beagles, time to see if my update breaks stuff locally too :-) | 13:54 |
mwhahaha | strigazi: sorry wrong person | 13:54 |
mwhahaha | sri_: -^ | 13:54 |
pabelanger | EmilienM: Yup, devstack starts blowing up if more then 1% failures | 13:54 |
slagle | leitan: 32677512-63f3-4373-b290-2a6d9516a752 is a nested stack for a given individual server | 13:55 |
strigazi | @mwhahaha np | 13:55 |
slagle | leitan: you aren't going to see other nodes/roles/whatever there | 13:55 |
slagle | leitan: you'd need to list the top level stacks of type OS::Heat::ResourceGroup to see the other nested stacks | 13:55 |
chandankumar | EmilienM: can we get this merged https://review.openstack.org/#/c/485477/ ? so that you can rebase your package, we will fulfull qa wishes xD | 13:55 |
leitan | slagle: so the roles that should be applied to the nodes are going, like nova neutron etc, should be on the top level stacks ? | 13:56 |
sri_ | mwhahaha: thanks | 13:56 |
slagle | leitan: resource list accepts a --filter, i'd suggest using that to filter on type. it's easier to see OS::Heat::ResourceGroup that way | 13:56 |
pabelanger | EmilienM: cool, will keep and eye on 483535 | 13:56 |
beagles | atoth, awesomee | 13:56 |
*** ffiore has quit IRC | 13:56 | |
slagle | leitan: what i'm saying is that the other nodes resources are in different stacks | 13:57 |
pabelanger | EmilienM: how long as undercloud-containers been in the gate? Recent addition? | 13:57 |
slagle | leitan: you have to go resource list those stacks to see those resources | 13:57 |
leitan | slagle: ok but thats not what im doing when checking the resource show at the "ControllerDeployedServer" ? | 13:58 |
EmilienM | pabelanger: let me find out in git | 13:58 |
slagle | leitan: nope. ControllerDeployedServer would only contain the stacks for nodes corresponding to the role ControllerDeployedServer | 13:59 |
slagle | leitan: here is another way you can see the resoruces: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/deployed_server.html#manual-configuration-of-heat-agents | 13:59 |
leitan | slagle: right, but inside that stacks should be the nova api / neutron roles ? or should be on the top stack ? | 14:00 |
*** ffiore has joined #tripleo | 14:00 | |
openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Make HA container bundle work on remote nodes https://review.openstack.org/486076 | 14:00 |
leitan | slagle: ill create the stack again and follow that guid | 14:00 |
leitan | e | 14:00 |
slagle | leitan: each role has it's own corresponding OS::Heat::ResourceGroup stack, that is at the first level under "overcloud" | 14:01 |
slagle | leitan: the name of that stack matches the role name | 14:01 |
*** anshul has joined #tripleo | 14:01 | |
slagle | as I said, if you filter on OS::Heat::ResourceGroup you will see them | 14:01 |
EmilienM | chandankumar: I thought you would rebase my patch ;-) | 14:02 |
EmilienM | chandankumar: kidding. I'll do it | 14:02 |
leitan | slagle: great ill try that as first, still wondering why it doesnt start installing the roles after running the basic Boostrap and ControlPlanePort , ill dig a little bit more | 14:02 |
*** Goneri has joined #tripleo | 14:02 | |
chandankumar | EmilienM: debian screwed me last night, i still didnot why it is not getting from pip | 14:02 |
EmilienM | pabelanger: almost a month: https://review.openstack.org/#/c/478257/ | 14:03 |
chandankumar | s/why/get why | 14:03 |
nmathew | one quick regarding stack update | 14:03 |
*** anshul has quit IRC | 14:03 | |
nmathew | why --update-plan-only is not taking changed environment file? | 14:03 |
*** anshul has joined #tripleo | 14:03 | |
*** tzumainn has quit IRC | 14:03 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Change default network isolation type to multi-nic https://review.openstack.org/476704 | 14:04 |
*** dparkes has quit IRC | 14:05 | |
*** _milan_ has joined #tripleo | 14:06 | |
*** psachin has quit IRC | 14:06 | |
matbu | shardy: if you don't have time for adding flag to disable update via heat, don't hesitate to ping i would be able to add it | 14:07 |
matbu | thx for the awesome work btw :) | 14:07 |
*** milan has quit IRC | 14:07 | |
*** cylopez has quit IRC | 14:07 | |
shardy | matbu: ack thanks! | 14:08 |
shardy | matbu: one thing I may not have time to finish is https://review.openstack.org/#/c/483943/ | 14:08 |
shardy | matbu: I noticed the config download data is world-readable, that fixes it but the tests need updating | 14:08 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Use stdout_lines instead of stdout for subnode inventory https://review.openstack.org/483396 | 14:08 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Add node config variables to support deployed server https://review.openstack.org/485689 | 14:09 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Remove vars from multinode common config which can be overriden https://review.openstack.org/486154 | 14:09 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job https://review.openstack.org/486155 | 14:09 |
nmathew | When I add a new parameter_defaults in new environment file, stack is failing saying unknown "parameter" any hints? | 14:09 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 14:09 |
chandankumar | trown: https://review.openstack.org/485574 packages are not getting updated on undercloud through yum install. | 14:09 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Use stdout_lines instead of stdout for subnode inventory https://review.openstack.org/483396 | 14:09 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Add node config variables to support deployed server https://review.openstack.org/485689 | 14:09 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job https://review.openstack.org/486155 | 14:09 |
chandankumar | trown: higher version of package is the available in the repo but yum is saying something installed version is the higher package | 14:10 |
chandankumar | i donot know what is wrong with the yum on undercloud | 14:10 |
chandankumar | please have a look | 14:10 |
trown | chandankumar: I think that happens just after we promote an image in tripleo-ci | 14:10 |
trown | chandankumar: because there is a repo on the image that is not yet propogated to mirrors | 14:11 |
chandankumar | trown: how to get it fixed? | 14:11 |
trown | chandankumar: should fix itself later today if that is the issue | 14:11 |
trown | chandankumar: just takes time for the repo to propogate | 14:11 |
chandankumar | trown: tempest jobs are failing as it failed to pick the latest tempestconf packages | 14:11 |
chandankumar | arxcruz: ^^ | 14:12 |
chandankumar | trown: ack! | 14:12 |
trown | chandankumar: how long have they been failing... just this morning? | 14:12 |
*** jcoufal has joined #tripleo | 14:12 | |
chandankumar | trown: from tomorrow | 14:12 |
trown | hmm... that might not be it then | 14:12 |
matbu | shardy: k , i will test it and update it if needed | 14:12 |
trown | chandankumar: do you have a way to test your patch to see if it fixes the tempest jobs? | 14:13 |
chandankumar | https://review.gerrithub.io/370454 got merged tomorrow | 14:13 |
shardy | matbu: ack thanks, I think the patching of open in the test needs to be modified | 14:13 |
*** tzumainn has joined #tripleo | 14:13 | |
*** radeks has quit IRC | 14:13 | |
*** jcoufal_ has quit IRC | 14:13 | |
chandankumar | trown: patch contains rpm is available in repo and but yum is not picking it | 14:13 |
shardy | nmathew: Hi, can you share your environment, and the exact error on paste.openstack.org? | 14:13 |
*** jprovazn has quit IRC | 14:14 | |
nmathew | @shardy yes | 14:14 |
openstackgerrit | Jason E. Rist proposed openstack/tripleo-quickstart-extras master: Missing conversion for ironic-inspector port in tripleo-ui config https://review.openstack.org/477675 | 14:15 |
pradk | sri_, if you deploy from stable/ocata branch, it should already be in the tree | 14:15 |
arxcruz | chandankumar: ack | 14:15 |
EmilienM | dprince, shardy: pabelanger is asking me to disable undercloud-container in gate, which has too high % of failure (less than 20%) but it seems to block the gate since it reset the jobs when this one fails. I found out a trace in the CI job and was wondering if you know the error: | 14:15 |
EmilienM | http://logs.openstack.org/96/483096/2/gate/gate-tripleo-ci-centos-7-undercloud-containers/43be4d1/logs/var/log/undercloud_install.txt.gz#_2017-07-21_13_16_43_000 | 14:16 |
dprince | EmilienM: looking | 14:16 |
jrist | weshay: ^^^ | 14:16 |
weshay | trown, panda can we push this through please? https://review.openstack.org/#/c/477675/ | 14:17 |
jrist | weshay: oh it was the renaming of the word mistral | 14:17 |
jrist | who changed that in another patch lol | 14:17 |
leitan | slagle: im seeing this with the ResourceGroup resource_type http://paste.openstack.org/show/616171/ | 14:17 |
dprince | EmilienM: could be related to the fake keystone | 14:18 |
EmilienM | dprince: would it be race or persistent? | 14:18 |
dprince | EmilienM: I've not seen it locally so not sure | 14:18 |
dprince | EmilienM: we've recently switch to ansible so it could be a race related to that too | 14:19 |
*** Guest11562 is now known as rook | 14:19 | |
dprince | EmilienM: the feature is marked experimental so I would say having code land is probably more important than keeping this gating. That said... in the check queue this job would give us the fastest feedback (it runs *much* faster than a full overcloud) | 14:20 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: Don't fail if VM extradisks are already attached https://review.openstack.org/474981 | 14:20 |
nmathew | shardy, please find the logs http://paste.openstack.org/show/616173/ | 14:21 |
EmilienM | dprince: I know :( | 14:21 |
EmilienM | dprince: that's why I'm asking otherwise I would have just disabled it | 14:21 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: WIP Make env variables for multinode into ansible vars https://review.openstack.org/483930 | 14:22 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make deployed server bootstrap environment part of multinode https://review.openstack.org/486158 | 14:22 |
leitan | slagle: after restarting the agents, it begin installing the basics, and all the stacks got to CREATE_COMPLETE state | 14:22 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 14:22 |
leitan | slagle: as follows: http://paste.openstack.org/show/616174/ | 14:23 |
slagle | leitan: ok, then it has moved onto the next steps | 14:24 |
*** eck` is now known as eck`gone | 14:25 | |
shardy | nmathew: I think the problem is using --update-plan-only, if you do a normal deploy it will update the heat stack with the new environment | 14:26 |
shardy | nmathew: the problem is the plan in swift is updated, but heat doesn't know about the new parameter value | 14:26 |
*** jrist has quit IRC | 14:26 | |
leitan | slagle: it did, the only difference from previous runs is that we exported all the nodes into the roles variables (we were doing just 1) the deploy actually expect that all the declared nodes should be there ? | 14:26 |
shardy | the overcloud update stack command doesn't pass the new plan data to heat IIRC, although arguably it should | 14:26 |
nmathew | shardy, let me try a deployment instead of --update-plan-only | 14:27 |
slagle | leitan: check the documentation at https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/deployed_server.html#automatic-configuration-of-heat-agents | 14:28 |
*** eck`gone is now known as eck` | 14:28 | |
nmathew | shardy, this command required then "openstack overcloud update stack -i overcloud" ? | 14:28 |
EmilienM | chandankumar: is subunit2html binary deployed with the tempest package? | 14:29 |
jkilpatr | what channel would I go to if I wanted to get a coherent explanation of how oslodb works? | 14:29 |
jkilpatr | the documentation doesn't properly expalin what level of abstraction they want to do what | 14:29 |
EmilienM | chandankumar: I think it's part of python-subunit right? | 14:29 |
shardy | nmathew: overcloud deploy ... will apply the new environment, and re-run puppet, overcloud update triggers a workflow where we do a rolling yum update of the nodes | 14:29 |
shardy | so it depends which one you need (reconfigure or package update) | 14:30 |
shardy | nmathew: the issue is overcloud update can't currently do reconfigure and update in one pass | 14:30 |
shardy | even though that's technically possible via heat, it just isn't implemented that way | 14:31 |
nmathew | shardy, thanks I will give a try | 14:31 |
*** myoung|remote has quit IRC | 14:33 | |
chandankumar | EmilienM: subunit2html comes from ostestr | 14:36 |
EmilienM | chandankumar: I'm trying https://review.openstack.org/485255 | 14:36 |
*** myoung|remote has joined #tripleo | 14:36 | |
chandankumar | EmilienM: debian will again screw up, let see | 14:37 |
*** rbrady has joined #tripleo | 14:37 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Add all existing parameter mismatches to exclusion list https://review.openstack.org/483535 | 14:37 |
chandankumar | EmilienM: by queen may be we are moving stestr no dependency on testr or ostestr | 14:38 |
EmilienM | pabelanger: let me today to figure out if we disable undercloud-container job, I'm still looking at "why" it fails and see if it's random, consistent or absent | 14:38 |
EmilienM | chandankumar: it's not debian, it's ubuntu, fyi | 14:38 |
EmilienM | (slighly different on packages) | 14:38 |
*** jrist has joined #tripleo | 14:39 | |
*** jrist has joined #tripleo | 14:39 | |
EmilienM | chandankumar: why will it screw up? Because I don't pip install anymore? | 14:39 |
*** anshul has quit IRC | 14:39 | |
chandankumar | EmilienM: in my earlier patch when i doing pip install testreposity without sudo it is not picking up, so i espically added a if condition | 14:40 |
pabelanger | EmilienM: sure, I'll keep looking at other job failures too, making sure it isn't related to the infrastructure | 14:40 |
MVenesio | slagle: we are having an error installing the overcloud: "Error: Evaluation Error: The title 'cinder_volume' has already been used in this resource expression" | 14:41 |
abishop | shardy: hoping you still might have time for https://review.openstack.org/#/c/471462/ | 14:43 |
*** cshastri has quit IRC | 14:44 | |
fultonj | +1 on 471462, that would get the automated HCI tuning into pike | 14:44 |
EmilienM | chandankumar: ok I'll restore this change if I see it failing | 14:44 |
shardy | abishop: ack will do | 14:44 |
chandankumar | EmilienM: sure, | 14:44 |
fultonj | thanks | 14:45 |
*** |ance|ott has joined #tripleo | 14:45 | |
|ance|ott | hi guys, I am having issues installing the undercloud on Centos7. I got this error: | 14:45 |
|ance|ott | Error: Syntax error at 'Boolean'; expected ')' at /etc/puppet/modules/rabbitmq/manifests/init.pp:3 on node undercloud.localdomain | 14:45 |
|ance|ott | any help is appreciated | 14:46 |
abishop | shardy: many, many thx! | 14:46 |
*** rlandy is now known as rlandy|brb | 14:46 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 14:46 |
sri_ | pradk: I installed my undercloud 15 day ago | 14:47 |
nmathew | shardy, it failed again with same reason. logs here http://paste.openstack.org/show/616178/ | 14:48 |
*** jlinkes has quit IRC | 14:48 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Add support for nova live/cold-migration with containers https://review.openstack.org/471956 | 14:49 |
leitan | slagle: it started the instalation, but failed, used an amazing blog post to debug the stack by shardy, and i finally got "Evaluation Error: The title 'cinder_volume' has already been used in this resource expression at /etc/puppet/modules/tripleo/manifests/firewall.pp" | 14:50 |
*** myoung|remote has quit IRC | 14:50 | |
leitan | slagle: this can be repeated for some reason somewhere and its trying to apply the firewall rules two times ? | 14:50 |
shardy | nmathew: Hmm, can you paste the template where CssPackageName is used? | 14:51 |
nmathew | shardy, it is there in the link itself | 14:52 |
nmathew | shardy, 3rd cat | 14:52 |
sri_ | pradk: I have quick question is this "ceilometer/collector.pp" inside overcloud image ? I am not able to find this file in heat-templates | 14:52 |
*** dparkes has joined #tripleo | 14:53 | |
pradk | sri_, hmm that would be under /usr/share/openstack-tripleo-heat-templates/ on undercloud | 14:53 |
pradk | sri_, i would suggest reinstalling with latest stable/ocata .. but you can monkey patch too | 14:53 |
pradk | sri_, alternately just git checout to /tmp and point --templates to that dir | 14:54 |
*** anshul has joined #tripleo | 14:54 | |
sri_ | pradk: ok i think git checkout is easy thing to | 14:54 |
sri_ | do | 14:54 |
shardy | nmathew: ah, yeah doh! The issue is the parameters aren't defined in the template where the get_param's are used | 14:55 |
pradk | sri_, actaully wait, the fix is to the puppet code not templates | 14:55 |
bnemec | |ance|ott: It sounds like there's something wrong with your rabbitmq puppet package. Maybe try reinstalling it. It seems unlikely that a syntax error snuck into the init manifest. | 14:55 |
shardy | the heat error is a little misleading is it's undefined, not "not provided" | 14:55 |
pradk | sri_, you need to update the modules in swift | 14:55 |
pradk | sri_, one sec lemme get the link | 14:55 |
*** atoth has quit IRC | 14:56 | |
nmathew | shardy, thanks, let me see | 14:56 |
|ance|ott | @bnemec this is the log | 14:56 |
|ance|ott | https://pastebin.com/r8FX1fEP | 14:56 |
pradk | sri_, you will need to follow this http://hardysteven.blogspot.com/2016/08/tripleo-deploy-artifacts-and-puppet.html | 14:56 |
*** cdearborn_ has joined #tripleo | 14:56 | |
|ance|ott | it happens when i run openstack undercloud install | 14:57 |
pradk | sri_, see example 2 in that blog .. thats what you are looking for | 14:57 |
nmathew | shardy, oh sorry, I got it, just like any other templates we need to define it, i hope original ones like "update_identifier" are defined internally | 14:58 |
abishop | shardy: thank you !!! | 14:58 |
sri_ | pradk: Ok thanks for you help , I am reading about this on that same link I got it form mwhahaha | 14:59 |
*** gfidente is now known as gfidente|afk | 14:59 | |
shardy | nmathew: yeah anywhere you use get_param, the corresponding parameter must be defined in the parameters block | 15:00 |
shardy | abishop: np! | 15:00 |
*** chandankumar is now known as daccontant | 15:00 | |
*** gfidente has joined #tripleo | 15:00 | |
*** gfidente has quit IRC | 15:00 | |
*** gfidente has joined #tripleo | 15:00 | |
*** shardy is now known as shardy_mtg | 15:00 | |
nmathew | shardy_mtg, thanks | 15:00 |
pradk | sri_, cool | 15:02 |
slagle | leitan: yea, sounds like it's a problem with puppet and/or hieradata at this point | 15:02 |
openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates master: Use normal socket file permissions instead of polkit https://review.openstack.org/484979 | 15:02 |
bnemec | |ance|ott: That doesn't change my recommendation. There's something broken in your puppet-rabbitmq package. You have to resolve that. | 15:02 |
leitan | slagle: im specifically naming the cinder_volume to install on the controller node, but im also using the pacemaker resource, those too can be conflicting ? any quick pin points to debug this ? | 15:03 |
*** nmathew has quit IRC | 15:04 | |
*** _milan_ has quit IRC | 15:04 | |
openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo master: Revert workaround for libvirt polkit auth with containers https://review.openstack.org/479816 | 15:04 |
bnemec | Man, is there any way to see the pass/fail rate of patches in our gate? | 15:05 |
bnemec | Because it seems _terrible_. | 15:05 |
slagle | leitan: you can look at the puppet error, track that back to the manifest/module being used, then see what hieradata is configuring that module with "cinder_volume" multiple times, then track the hieradata back to something in tripleo-heat-templates | 15:05 |
bnemec | Like 20% passes, and that might be generous. | 15:05 |
slagle | leitan: you don't have cinder volume included twice in your service list or something do you? | 15:06 |
openstackgerrit | Merged openstack/tripleo-docs master: Add step about deploying HA controllers with containers https://review.openstack.org/483515 | 15:06 |
*** |ance|ott has quit IRC | 15:06 | |
leitan | i have cinder_volume and blockstorageCinderVolume, i assume that are not the same | 15:06 |
*** dprince has quit IRC | 15:07 | |
leitan | slagle: ^^ | 15:07 |
slagle | leitan: whre do you have those? | 15:07 |
slagle | can you paste your sevices list | 15:07 |
leitan | slagle: yes | 15:08 |
leitan | slagle: http://paste.openstack.org/show/616180/ | 15:08 |
slagle | leitan: yea, that's the issue. you don't want BlockStorageCinderVolume and CinderVolume on the same role | 15:10 |
slagle | leitan: afaict, they map to the same thing, so you should just use CinderVolume on ControllerDeployedServer | 15:10 |
*** itlinux has joined #tripleo | 15:11 | |
leitan | slagle: wow thanks, thats a copy paste from somewhere mistake :) | 15:11 |
leitan | re running ! | 15:11 |
slagle | i guess we have them separated like that in case you wanted to map one to the pacemaker implementation, and the other one not | 15:12 |
slagle | i don't really know | 15:12 |
*** cdearborn has quit IRC | 15:12 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 15:12 |
slagle | but you definnitely can't have them on the same role | 15:12 |
leitan | slagle: i understand, we are including pacemaker also, maybe inside is using the block one | 15:13 |
*** anshul has quit IRC | 15:14 | |
daccontant | EmilienM: here comes the failure http://logs.openstack.org/55/485255/2/check/gate-puppet-openstack-integration-4-scenario004-tempest-ubuntu-xenial/6781141/console.html#_2017-07-21_15_12_07_652977 | 15:14 |
*** rcernin has quit IRC | 15:14 | |
EmilienM | daccontant: ok, I'll revert the change after my mtg | 15:15 |
*** dparkes has quit IRC | 15:15 | |
daccontant | EmilienM: sure :-) | 15:16 |
daccontant | EmilienM: might be somethign wrong is happening with puppet-tempest, need to check | 15:16 |
*** gfidente has quit IRC | 15:16 | |
*** aufi has quit IRC | 15:17 | |
*** jrist has quit IRC | 15:18 | |
*** gfidente has joined #tripleo | 15:19 | |
*** gfidente has quit IRC | 15:19 | |
*** gfidente has joined #tripleo | 15:19 | |
*** rlandy|brb is now known as rlandy | 15:19 | |
daccontant | Regarding barbican tempest plugin support in tripleo we need it first in puppet-tempest na? | 15:20 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove DockerNamespace references https://review.openstack.org/479398 | 15:20 |
*** ffiore has quit IRC | 15:22 | |
EmilienM | daccontant: probably | 15:23 |
*** ebarrera has quit IRC | 15:25 | |
*** dsariel_ has joined #tripleo | 15:25 | |
*** suuuper has quit IRC | 15:26 | |
*** gfidente has quit IRC | 15:26 | |
*** dsariel has joined #tripleo | 15:26 | |
*** jcoufal_ has joined #tripleo | 15:26 | |
*** dpawar has quit IRC | 15:28 | |
*** jcoufal has quit IRC | 15:28 | |
*** lmiccini has quit IRC | 15:29 | |
*** anshul has joined #tripleo | 15:31 | |
*** gfidente has joined #tripleo | 15:32 | |
*** gfidente has quit IRC | 15:32 | |
*** gfidente has joined #tripleo | 15:32 | |
*** shardy_mtg is now known as shardy | 15:33 | |
EmilienM | daccontant: ./run_tests.sh: line 339: run_tempest/bin/subunit2html: No such file or directory on centos | 15:35 |
EmilienM | daccontant: sounds like subunit2html wasn't installed in the venv | 15:36 |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 15:36 |
daccontant | EmilienM: https://github.com/openstack/os-testr/blob/master/setup.cfg#L30 | 15:36 |
EmilienM | daccontant: ah, I see :) | 15:37 |
daccontant | EmilienM: mwhahaha barbican tempest plugin support for puppet-tempest https://review.openstack.org/#/c/486166/ feel free to enable scenario for barbican | 15:37 |
EmilienM | daccontant: we already have | 15:37 |
EmilienM | daccontant: we have coverage for barbican already | 15:38 |
daccontant | EmilienM: but in puppet-tempest it was not available | 15:38 |
EmilienM | daccontant: a sec | 15:38 |
daccontant | EmilienM: and we have not packaged tempest plugin for barbican, | 15:38 |
EmilienM | daccontant: we test encrypted volume test which resides in cinder probably, and use barbican | 15:39 |
EmilienM | that's why | 15:39 |
EmilienM | daccontant: http://logs.openstack.org/77/485477/10/check/gate-puppet-openstack-integration-4-scenario002-tempest-centos-7/0fabfb8/console.html#_2017-07-21_09_35_16_871515 | 15:39 |
EmilienM | I think we're happy with this test now, since we don't want to test all barbican API but just integration tests | 15:39 |
daccontant | EmilienM: sure, but if anybody needed, i have added it | 15:39 |
EmilienM | daccontant: but we can patch puppet-tempest for sure | 15:40 |
EmilienM | daccontant: yup, i'll review it | 15:40 |
EmilienM | daccontant: in fact I'm confused what is wrong in https://review.openstack.org/#/c/485255/2/run_tests.sh | 15:41 |
EmilienM | daccontant: except the pip install thing | 15:41 |
openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Cleans up exec workaround for ODL container clustering https://review.openstack.org/486169 | 15:45 |
*** iranzo has quit IRC | 15:47 | |
*** ffiore has joined #tripleo | 15:48 | |
*** bogdando has quit IRC | 15:48 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Don't modify case of role names in inventory https://review.openstack.org/486140 | 15:50 |
*** rbrady has quit IRC | 15:50 | |
*** flepied has quit IRC | 15:51 | |
openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Cleans up exec workaround for ODL container clustering https://review.openstack.org/486169 | 15:54 |
*** gfidente has quit IRC | 15:55 | |
leitan | slagle: making some progress here, did you guys see the error of neutron-server not able to start due to missing /etc/neutron/plugin.ini file ? | 15:56 |
*** florianf has quit IRC | 15:56 | |
*** jrist has joined #tripleo | 15:57 | |
*** dsariel has quit IRC | 15:57 | |
gbarros | are the container checks broken again? | 15:57 |
*** dsariel_ has quit IRC | 15:57 | |
EmilienM | gbarros: http://tripleo.org/cistatus.html | 16:00 |
EmilienM | gbarros: I don't think so, unless something broke very recently | 16:00 |
*** dparkes has joined #tripleo | 16:00 | |
gbarros | EmilienM https://review.openstack.org/#/c/475048/21 has been waiting for gate to complete for a bit over 12 hours now. http://status.openstack.org/zuul/ looks like stalled on containers? | 16:01 |
faceman | beagles, it's atoth here, this is my bouncer alias :-) | 16:02 |
beagles | faceman, yo | 16:02 |
faceman | beagles, so my updates work locally (when the two lines we talked about are commented out) | 16:03 |
gbarros | a few ahead of it taking even longer | 16:03 |
*** itlinux has quit IRC | 16:03 | |
beagles | faceman, okay cool | 16:03 |
faceman | beagles, so I'm going to push the patch with the non-aliased lbaasv2 and hope it works in the live environment :-) | 16:03 |
beagles | faceman, yup.. curious | 16:04 |
daccontant | EmilienM: http://logs.openstack.org/55/485255/3/check/gate-puppet-openstack-integration-puppet-syntax-4-centos-7/9f5b208/console.html for centos passed | 16:07 |
daccontant | EmilienM: i think we should not define testr and subunit2html under binary | 16:07 |
daccontant | let'use system binary provided by rpm | 16:07 |
daccontant | i am waiting for ubuntu how it goes. | 16:07 |
EmilienM | daccontant: we don't care about syntax job in that case | 16:08 |
EmilienM | daccontant: they don't run all these bits (tempest etc) so please ignore it | 16:08 |
EmilienM | daccontant: you have ubuntu vm? | 16:09 |
daccontant | sorry | 16:09 |
daccontant | wrong job | 16:09 |
daccontant | let the job finish | 16:09 |
*** lucasagomes is now known as lucas-afk | 16:09 | |
EmilienM | daccontant: let's take it on #puppet-openstack plz | 16:10 |
*** dsariel has joined #tripleo | 16:10 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Revert "Disable systemd-networkd & systemd-resolved" https://review.openstack.org/483946 | 16:10 |
*** dsariel_ has joined #tripleo | 16:11 | |
openstackgerrit | AndrewToth proposed openstack/tripleo-heat-templates master: Enable Neutron LBaaS Integration https://review.openstack.org/485213 | 16:11 |
*** florianf has joined #tripleo | 16:11 | |
faceman | beagles, do ci scenario updates require reno files too? | 16:11 |
*** dparkes has quit IRC | 16:15 | |
panda | shardy: for the prepare command, specifying host in the namespace doesn't work ... | 16:15 |
panda | 2017-07-21 16:07:00 | imagename: trunk.registry.rdoproject.org/tripleo/centos-binary-aodh-api:tripleo-ci-testing | 16:15 |
panda | 2017-07-21 16:07:04 | 404 Client Error: Not Found ("no such id: docker.io/trunk.registry.rdoproject.org/tripleo/centos-binary-aodh-api:tripleo-ci-testing") | 16:15 |
panda | still tries to contact dockerhub | 16:16 |
*** egonzalez has quit IRC | 16:16 | |
*** gfidente|afk is now known as gfidente | 16:16 | |
shardy | panda: can you share the generated environment file? | 16:17 |
shardy | I had similar problems but it was a combination of an old tripleo-common and wrong args to the prepare command | 16:17 |
*** rbrady has joined #tripleo | 16:18 | |
*** rbrady has joined #tripleo | 16:18 | |
panda | shardy: http://logs.openstack.org/47/475747/71/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/4281668/logs/undercloud/home/jenkins/overcloud_containers.yaml.txt.gz and http://logs.openstack.org/47/475747/71/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/4281668/logs/undercloud/home/jenkins/docker_registry.yaml.txt.gz | 16:18 |
jrist | weshay: :( | 16:19 |
*** daccontant is now known as chandankumar | 16:20 | |
openstackgerrit | Alan Bishop proposed openstack/tripleo-quickstart-extras master: Don't fail if Virtual BMCs have already been created https://review.openstack.org/486175 | 16:22 |
*** jmelvin has quit IRC | 16:24 | |
*** cschwede has quit IRC | 16:25 | |
*** yamahata has joined #tripleo | 16:27 | |
*** anshul has quit IRC | 16:27 | |
*** flepied has joined #tripleo | 16:27 | |
panda | shardy: you have a working example of pulling images from a different registry ? | 16:28 |
*** yprokule has quit IRC | 16:28 | |
shardy | panda: http://paste.openstack.org/show/616190/ is my local env, it seems to hit my local registry OK AFAICT | 16:29 |
*** itlinux has joined #tripleo | 16:29 | |
shardy | panda: however I did notice similar issues to you previously when I had an error in the file, docker just silently gives up and tries docker.io instead | 16:30 |
shardy | can't see the issue with your logs tho, sorry | 16:30 |
panda | shardy: ok, thanks fro trying. last thing, I thought prepare command was generating also DockerNamespace DockerNamespaceIsREgistry and DockerInsecureRegistryAddress, but it doesn't. Do I have to still provide those ? | 16:31 |
beagles | faceman, good question... my feeling is no. I don't see it showing up the release notes much and a sampling of scenario update commits don't include release notes | 16:31 |
*** itlinux has quit IRC | 16:31 | |
shardy | panda: No those have been removed ref https://review.openstack.org/#/c/479398/ | 16:32 |
shardy | I think the quickstart patches to remove them may still be pending tho | 16:33 |
panda | shardy: thanks. Next thing I'll try is to add the port to the registry host, maybe not specifying it confuses the command into thinking it's part of the namespace | 16:33 |
shardy | panda: yeah maybe, I wonder if there's any clues in the logs, or if you can run docker-puppet manually with debug enabled? | 16:34 |
*** paramite has joined #tripleo | 16:34 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 16:36 |
panda | shardy: no other clues, and the host is gone | 16:37 |
shardy | panda: yeah I meant test locally to help debug :) | 16:37 |
*** dmsimard is now known as dmsimard|afk | 16:37 | |
*** rbrady has quit IRC | 16:38 | |
*** ffiore has quit IRC | 16:40 | |
*** greghaynes has quit IRC | 16:40 | |
MVenesio | Guys, if an overcloud deploy fails using openstack overcloud deploy over deployed servers, do i need to do some kind of cleanup in the Servers or i've to just run the openstack overcloud deploy again ? | 16:40 |
shardy | MVenesio: in most cases you should be able to just run it again | 16:40 |
leitan | shardy: is a good practice to delete the config of /etc/os-collect-config.conf ? | 16:41 |
*** pblaho has quit IRC | 16:42 | |
*** anshul has joined #tripleo | 16:42 | |
MVenesio | shardy: or maybe cleanup some config from the puppet agent ? | 16:42 |
*** marios has quit IRC | 16:42 | |
shardy | slagle: ^^ is any special cleanup needed in the deployed-server case? | 16:42 |
*** snecklifter has quit IRC | 16:42 | |
*** ffiore has joined #tripleo | 16:43 | |
*** hewbrocca is now known as hewbrocca_afk | 16:46 | |
*** dprince has joined #tripleo | 16:48 | |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add support for update_tasks https://review.openstack.org/486104 | 16:48 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add RoleConfig output https://review.openstack.org/485731 | 16:48 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add environment to disable deploy steps https://review.openstack.org/486180 | 16:48 |
shardy | slagle: Hey FYI ^^ shows the approach I mentioned a few days ago to disable heat driven deploy steps and run them directly via ansible | 16:49 |
shardy | we could refactor more things into the playbook but atm that will still run the host_prep_tasks via heat | 16:49 |
slagle | shardy: cool, i'll have a look | 16:50 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Don't modify case of role names in inventory https://review.openstack.org/486140 | 16:51 |
leitan | slagle: how about the cleanup on pre-rpovisioned nodes ? need to do something or just re run the overcloud deploy ? | 16:51 |
*** jprovazn has joined #tripleo | 16:52 | |
*** dsariel_ has quit IRC | 16:54 | |
*** derekh has quit IRC | 16:54 | |
*** flepied has quit IRC | 16:54 | |
*** bcafarel has quit IRC | 16:54 | |
*** dsariel has quit IRC | 16:54 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Make deployed server bootstrap environment part of multinode https://review.openstack.org/486158 | 16:55 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: WIP Make env variables for multinode into ansible vars https://review.openstack.org/483930 | 16:55 |
*** athomas has quit IRC | 16:55 | |
*** trown is now known as trown|lunch | 16:55 | |
*** ramishra has quit IRC | 16:57 | |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo master: Deprecates using exec workaround for ODL clustering https://review.openstack.org/486182 | 17:03 |
slagle | leitan: if it's a whole new stack, possibly | 17:06 |
*** dbecker has quit IRC | 17:07 | |
slagle | leitan: if you're just stack updating a previously failed stack, then no | 17:07 |
-openstackstatus- NOTICE: Restarting Gerrit for our weekly memory leak cleanup. | 17:07 | |
leitan | slagle: is a whole new stack, what considerations should we take ? we added new services to a role and its not deploying it | 17:07 |
*** bcafarel has joined #tripleo | 17:08 | |
*** pkovar has quit IRC | 17:08 | |
slagle | leitan: the agent configuration needs to be reapplied for a whole new stack | 17:09 |
leitan | slagle: yes, the swift metadata url should change too ? | 17:09 |
leitan | when inspecting the stack ? | 17:09 |
leitan | or stays the same ? | 17:10 |
paramite | hey guys, can we please get some attention on https://review.openstack.org/#/q/topic:bp/container-healthchecks+status:open , so we can move on with health checks? | 17:10 |
leitan | we deleted all the os-collect-config.conf on all the nodes | 17:10 |
slagle | leitan: it changes | 17:11 |
*** atoth has joined #tripleo | 17:11 | |
*** dtantsur is now known as dtantsur|afk | 17:11 | |
slagle | leitan: you need to reconfigure it just as you did previously | 17:11 |
leitan | yes , we re-run the get-occ-config.sh again on all nodes @slagle | 17:12 |
leitan | slagle: ^^ | 17:12 |
leitan | are we missing something ? | 17:12 |
slagle | nope | 17:12 |
*** gkadam has joined #tripleo | 17:12 | |
gfidente | flaper87 you still around? | 17:13 |
gfidente | flaper87 help :D | 17:13 |
gfidente | I am trying to find why glance-api container failed in a CI job | 17:14 |
gfidente | logs.openstack.org/04/485004/1/check/gate-tripleo-ci-centos-7-undercloud-containers/d0c82fd/ | 17:14 |
gfidente | I can see an issue at the end of the undercloud install http://logs.openstack.org/04/485004/1/check/gate-tripleo-ci-centos-7-undercloud-containers/d0c82fd/logs/var/log/undercloud_install.txt.gz | 17:15 |
*** iranzo has joined #tripleo | 17:15 | |
*** greghaynes has joined #tripleo | 17:16 | |
gfidente | but I can't find infos about what went wrong in the container | 17:16 |
gfidente | have any clue? | 17:16 |
leitan | slagle: thanks | 17:21 |
trozet | mwhahaha: as promised... https://review.openstack.org/#/c/486182/ | 17:22 |
rlandy | bnemec: hello ... ovb jobs are failing IPMI validation - I assume related to https://github.com/cybertron/openstack-virtual-baremetal/commit/ae02e88b985a406face7eda22e4b8abb1cd2c61d. | 17:22 |
mwhahaha | trozet: cool i'll take a look | 17:22 |
rlandy | This is the clouds.yaml file I have | 17:22 |
rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/ovb-manage-stack/templates/clouds.yaml.j2 | 17:22 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-common master: Add health check for services connected to RabbitMQ https://review.openstack.org/483578 | 17:23 |
*** rbrady has joined #tripleo | 17:24 | |
*** ffiore has quit IRC | 17:25 | |
*** anshul has quit IRC | 17:25 | |
jrist | honza: I just tried testing https://review.openstack.org/#/c/473933/ and I don't think it's working | 17:28 |
jrist | honza: is it in the little help menu and you click debug ? | 17:28 |
honza | jrist: yes, i believe so | 17:28 |
jrist | doesn't seem to work. | 17:29 |
jrist | am I missing something perhaps? | 17:29 |
jrist | when I click it nothing appears to happen | 17:29 |
honza | jrist: anything in the console? are your node_modules up to date? | 17:29 |
honza | jrist: I can have a look in a sec | 17:30 |
jrist | I think so and maybe :) | 17:30 |
*** akrivoka has quit IRC | 17:30 | |
jrist | honza: thanks | 17:31 |
*** rbrady has quit IRC | 17:32 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-common master: Add GUI logging workflows https://review.openstack.org/469196 | 17:33 |
honza | jrist: lol, you're right, completely broken, must have happened during a rebase :( | 17:35 |
jrist | honza: yay! | 17:35 |
jrist | I'm not an idiot | 17:35 |
openstackgerrit | Sandhya Dasu proposed openstack/tripleo-heat-templates master: Modifying Cisco templates to support composable roles https://review.openstack.org/484861 | 17:35 |
*** flepied has joined #tripleo | 17:36 | |
honza | jrist: but i am :) | 17:36 |
jrist | bah | 17:36 |
jrist | everyone makes mistakes | 17:36 |
*** jkilpatr has quit IRC | 17:36 | |
*** shardy has quit IRC | 17:39 | |
*** jkilpatr has joined #tripleo | 17:40 | |
*** fragatina has quit IRC | 17:41 | |
gfidente | bnemec do you which, if any, job is using tls/ssl? | 17:43 |
gfidente | is it possible gate-tripleo-ci-centos-7-containers-multinode and gate-tripleo-ci-centos-7-undercloud-containers are? | 17:43 |
openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Adds environment file for ODL + SRIOV https://review.openstack.org/486187 | 17:44 |
*** trown|lunch is now known as trown | 17:52 | |
gbarros | how do i figure out if a gate job is stuck? looks like there are 6 now past the 12hr mark and another 7 past the 6hr mark. | 17:53 |
vkmc | hey, I'm hitting this when trying to deploy containerized overcloud... rings any bell? http://paste.openstack.org/show/616195/ | 17:56 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Provides Ceph config into OpenStack clients https://review.openstack.org/482500 | 17:58 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Download logs interface https://review.openstack.org/473933 | 18:00 |
honza | jrist: updated ^^^ | 18:00 |
bnemec | gfidente: I'm honestly not sure anymore. I think both of the non-containerized ovb jobs are though. | 18:02 |
bnemec | rlandy: Oh, is that creating the heat stack manually? | 18:03 |
rlandy | bnemec: no - using shade | 18:03 |
bnemec | Well, same difference. Not using deploy.py. | 18:03 |
rlandy | no | 18:03 |
bnemec | I really don't recommend that. | 18:04 |
bnemec | But the reason it's probably failing is that you need to pass the new parameter, whose name I can't remember off the top of my head. | 18:04 |
rlandy | OS_CLOUD? | 18:05 |
rlandy | host_cloud | 18:05 |
bnemec | rlandy: cloud_data | 18:05 |
bnemec | Hmm, which I never added a description to. I should do that. | 18:05 |
rlandy | bnemec: ok - why are you against shade? | 18:05 |
bnemec | rlandy: I'm not against shade, I'm against use of OVB without deploy.py. You're going to have to re-implement every feature I add. | 18:06 |
*** atoth has quit IRC | 18:07 | |
bnemec | rlandy: This is what you're probably missing now: https://github.com/cybertron/openstack-virtual-baremetal/blob/master/openstack_virtual_baremetal/deploy.py#L156 | 18:08 |
bnemec | Which is calling this: https://github.com/cybertron/openstack-virtual-baremetal/blob/master/openstack_virtual_baremetal/auth.py#L64 | 18:08 |
rlandy | bnemec: yes - I see that - but I'll try moving to deploy.py - it's closer to upstream - which is really what we want to reproduce | 18:10 |
*** iranzo has quit IRC | 18:13 | |
*** salmankhan has quit IRC | 18:14 | |
jrist | honza: reviewing | 18:16 |
gfidente | bnemec stay with me | 18:16 |
gfidente | https://review.openstack.org/#/c/482500/14/docker/services/glance-api.yaml | 18:16 |
bnemec | gfidente: I dunno, it's lunch time here. :-) | 18:16 |
gfidente | am I reading it right that is spawning a second container | 18:16 |
gfidente | when tls is true and not merging the config settings with the existing one? | 18:17 |
gfidente | line 130 | 18:17 |
bnemec | gfidente: I'm not sure I'm the one to ask about containers, but it does appear that way. Only for internal tls though | 18:19 |
bnemec | gfidente: So that would probably only be exercised in the experimental fakeha-tls-everywhere job. | 18:19 |
jrist | honza: works now, but http://172.16.213.154:8989/v2/executions 404 | 18:19 |
bnemec | I guess it's called ovb-fakeha-caserver | 18:19 |
pabelanger | gbarros: not stuck but the gate keeps resetting because of job that fails before said patchsets | 18:20 |
bnemec | And it appears that job is failing in general right now. :-( | 18:20 |
pabelanger | gbarros: so, right now it is about 15hr+ delayed as a result of that | 18:20 |
*** pchavva has quit IRC | 18:20 | |
gbarros | pabelanger do i need to do something or will it sort itself out? | 18:21 |
honza | jrist: right | 18:21 |
honza | jrist: you need this :( https://review.openstack.org/#/c/469196/ | 18:22 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job https://review.openstack.org/486155 | 18:23 |
jrist | honza: roger that thanks | 18:23 |
pabelanger | gbarros: zuul will evenetually clear out the back log. If you want to see why things are failing, you can use elastic-recheck: http://status.openstack.org/elastic-recheck/data/others.html | 18:23 |
jrist | honza: I think it'd be good to note that in the UI commit message | 18:23 |
honza | jrist: on it | 18:24 |
pabelanger | gbarros: by fixing those failures, the gate pipeline will merge things faster | 18:24 |
dtrainor | is there a command to delete any lingering configuration and current state left over by a failed os-net-config ? | 18:24 |
dtrainor | aside from just ifdown'ing the interfaces, deleted the config files etc | 18:24 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Download logs interface https://review.openstack.org/473933 | 18:24 |
dtrainor | os-net-config --cleanup comes close I think, but says "Cleanup unconfigured interfaces". Some interfaces are configured. | 18:24 |
gfidente | bnemec ack thanks! | 18:26 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Drop step_config as top level docker requirement https://review.openstack.org/442716 | 18:27 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Support configurable Zaqar backends https://review.openstack.org/477559 | 18:27 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: docker: Add unit tests on service_name https://review.openstack.org/442755 | 18:27 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Add docker templates to configure Ironic inspector https://review.openstack.org/457822 | 18:27 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Drop MongoDB from the undercloud https://review.openstack.org/477562 | 18:27 |
bnemec | gfidente: I think Juan is back on Monday, you may want to talk to him then. I assume he's the one who implemented all of that. | 18:27 |
dtrainor | hmmmm i guess a successful stack delete also deletes and cleans up the interface configuration | 18:27 |
*** jrist has quit IRC | 18:29 | |
dsneddon | dtrainor, os-net-config --cleanup will undefine interfaces which are defined in /etc/sysconfig but not defined in the os-net-config config.json|yaml | 18:32 |
dsneddon | dtrainor, It won't work for cleaning up interfaces which are defined in os-net-config's config file. | 18:33 |
dsneddon | dtrainor, But you can run os-net-config --cleanup with a very minimal config.yaml and then run os-net-config again on the regular config. | 18:33 |
vkmc | hey, I'm hitting this when trying to deploy containerized overcloud... rings any bell? http://paste.openstack.org/show/616195/ | 18:37 |
vkmc | dprince, ^ | 18:37 |
dtrainor | cool ,good to know, thank you | 18:37 |
dtrainor | i had a deployment fail with "/etc/sysconfig/network-scripts/ifup-eth[26635]: Error, some other host already uses address 172.16.2.7." and not quite sure how to recover with it. i was going to write it off as a fluke, clean things up, and re-deploy unless this indicative of a bigger problem | 18:38 |
dprince | vkmc: yes, you need to generate a new env file or add this to your env | 18:38 |
tdasilva | trown: EmilienM: hi, have you seen this problem that vkmc ^^^ is running into? any pointers? I'm also running into this while running oooq | 18:38 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Make EnablePackageInstall and Debug descriptions consistent https://review.openstack.org/483536 | 18:38 |
dprince | vkmc: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/environments/docker-centos-tripleoupstream.yaml | 18:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Make Deploy/UpdateIdentifier definition semi-consistent https://review.openstack.org/483537 | 18:39 |
tdasilva | oops looks like dprince has something for us | 18:39 |
tdasilva | will try that | 18:39 |
vkmc | thanks dprince | 18:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Make various password descriptions consistent https://review.openstack.org/483538 | 18:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Make RoleParameters and key_name descriptions consistent https://review.openstack.org/483539 | 18:39 |
dtrainor | dsneddon, ring any bells by chance | 18:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Make many networking parameters consistent https://review.openstack.org/483540 | 18:39 |
dtrainor | ? | 18:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Make UpgradeLevelNovaCompute parameters consistent https://review.openstack.org/484041 | 18:39 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Mount /var/lib/neutron in neutron agents for metadata proxy https://review.openstack.org/485258 | 18:39 |
EmilienM | bnemec: just rebases ^ and approving your stuff, thx! | 18:40 |
*** fragatina has joined #tripleo | 18:40 | |
dprince | vkmc: see also, http://lists.openstack.org/pipermail/openstack-dev/2017-July/119880.html | 18:40 |
EmilienM | tdasilva: ^ that | 18:40 |
-openstackstatus- NOTICE: docs.o.o is currently broken, we're investigating | 18:40 | |
dprince | vkmc: as that post mentions you can also use images from your local registry by generating a file with the new 'overcloud container image | 18:41 |
dprince | prepare | 18:41 |
dprince | ' command | 18:41 |
tdasilva | EmilienM: thanks! following dprince suggestions... | 18:42 |
dprince | 'openstack overcloud container image prepare' command | 18:42 |
*** gkadam has quit IRC | 18:44 | |
dsneddon | dtrainor, Oh, that does ring a bell. | 18:45 |
dsneddon | dtrainor, There used to be a bug where the following would occur: 1) system gets IP through DHCP, 2) os-net-config tries to assign that IP to the bridge, 3) IP conflict. | 18:46 |
dsneddon | dtrainor, We modified os-net-config at one point to make sure that the dhclient would be killed. | 18:46 |
dsneddon | dtrainor, Because for some reason an ifdown/ifup wouldn't result in a notification to the dhclient monitor. | 18:46 |
*** jkilpatr has quit IRC | 18:47 | |
*** jkilpatr has joined #tripleo | 18:50 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 18:51 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: Use prepare command for overcloud_containers.yaml https://review.openstack.org/475975 | 18:52 |
dtrainor | i see | 18:52 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 18:53 |
dtrainor | '/etc/sysconfig/network-scripts/ifup-eth[22550]: Error, some other host already uses address 172.16.1.10.' | 18:53 |
dtrainor | weird, getting it on another host too. | 18:53 |
dtrainor | cool thanks dsavineau | 18:56 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 18:56 |
dtrainor | dsneddon, rather | 18:56 |
dsneddon | dtrainor, What version is this? | 18:56 |
dtrainor | os-net-config-7.0.1-0.20170715002058.9ef9a7a.el7.centos.noarch | 18:56 |
dtrainor | does that help? | 18:56 |
dsneddon | dtrainor, Wat? That's new, so it shouldn't be exhibiting the problem I'm talking about. | 18:57 |
dtrainor | right. i'm playing around with split-stack, I think there's just a conflict between the two stacks. | 18:57 |
dsneddon | dtrainor, Are you sure that you didn't forget to instantiate a network, which can end up with the provisioning IP ending up in multiple places? | 18:57 |
dtrainor | it's not the provisioning ip, but what you described i ran in to yesterday | 18:57 |
dtrainor | i wasn't matching properly to a correct nic-config so all the interfaces got the ctrlplane ip and, well, explosions ensued | 18:58 |
dtrainor | brb | 19:01 |
dsneddon | dtrainor, Well, let me know if you need help figuring it out, but definitely let me know if you think you've found a bug. | 19:01 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: allow tqe roles to work in sync with ARA https://review.openstack.org/482237 | 19:06 |
leitan | slagle: finally, we have a working overcloud deployment ! the only thing that we have just rabbit mysql haproxy cindervolume and redis managed by pacemaker, is possible to add the rest of the apis services to the pacemaker cluster ? | 19:07 |
*** jcoufal_ has quit IRC | 19:07 | |
larsks | leitan: the model is generally that pacemaker only manages those things which are not active/active. For most of the openstack services, you can run as many instances as you want and then use haproxy to ensure availability. | 19:18 |
leitan | larsks: great then the haproxy that is deployed its actually managing all my apis behind it | 19:18 |
larsks | It should be, yes. | 19:19 |
leitan | larsks: thats the redhat model, i remember that OSP9 manage all the resources | 19:19 |
leitan | maybe it changed | 19:19 |
larsks | That's correct. | 19:19 |
*** yamahata has quit IRC | 19:20 | |
leitan | larsks: thats good news ... corosync/pacemaker gave me a lot of headahces on deployments with more than 20 nodes | 19:20 |
*** gbarros has quit IRC | 19:22 | |
leitan | larsks slagle , last question, i want to deploy ceph now, can i "update" the stack adding the cephosd and mon roles and nodes ?, how do i do that ? just adding the nodes and roles and running openstack overcloud deploy ? is gonna uddapte my existing stack ? thanks | 19:25 |
*** amoralej is now known as amoralej|off | 19:26 | |
larsks | leitan: I believe that should work. Make sure you pass all the same environment files to 'overcloud deploy' that you passed the first time. Updating an existing stack isn't something I've tried very much, so look to someone else for an authoritative answer. | 19:26 |
leitan | larsks: great thanks | 19:27 |
*** dmsimard|afk is now known as dmsimard | 19:35 | |
slagle | leitan: yea, have a look at the docs | 19:36 |
gfidente | leitan about ceph, note that in the puppet-ceph.yaml env file which you should use to enable ceph there are some defaults to configure all cinder/glance/nova/gnocchi to use ceph | 19:38 |
*** florianf has quit IRC | 19:38 | |
gfidente | but if you're updating an existing stack, you can't just change the backend of glance or nova | 19:38 |
gfidente | unless they were empty so you don't need to migrate data | 19:39 |
leitan | they are empty is a fresh install | 19:41 |
gfidente | cool | 19:43 |
leitan | thanks for the tip gfidente | 19:43 |
*** sbrzozow has quit IRC | 19:49 | |
*** paramite has quit IRC | 19:50 | |
fultonj | can non-cores vote in other core elections held on the dev mailing list? | 19:50 |
fultonj | or s/"can"/"is it normal for"/g | 19:51 |
*** thrash is now known as thrash|bbl | 19:52 | |
EmilienM | fultonj: feedback is always welcome | 19:55 |
*** yamahata has joined #tripleo | 19:55 | |
fultonj | thanks EmilienM | 19:55 |
EmilienM | fultonj: though alsmost 6 years I'm here I never saw someone saying NO in the projects I've been involved with | 19:55 |
leitan | gfidente: how can configure the disk distribution, placemente (where to put the jorunal, and where the data) ? | 19:58 |
*** catinthe_ has quit IRC | 19:58 | |
*** jkilpatr has quit IRC | 20:03 | |
fultonj | leitan: are you asking for ceph-ansible or puppet-ceph? | 20:06 |
panda | mmmh | 20:06 |
panda | 2017-07-21 19:58:35 | imagename: ceph/daemon:tag-build-master-jewel-centos-7 | 20:06 |
fultonj | leitan: i assume for ceph-ansible if you're looking at the new stuff | 20:06 |
panda | 2017-07-21 19:58:37 | 404 Client Error: Not Found ("no such id: trunk.registry.rdoproject.org/ceph/daemon:tag-build-master-jewel-centos-7") | 20:06 |
panda | 2017-07-21 19:58:37 | END return value: 1 | 20:06 |
panda | what builds this ? | 20:06 |
leitan | fultonj: im using ROSP11 so i guess its puppet-ceph | 20:07 |
fultonj | leitan: yes, puppet-ceph | 20:07 |
fultonj | panda: i will get you the URL with the docker image | 20:07 |
*** paramite has joined #tripleo | 20:07 | |
panda | fultonj: not that simple | 20:07 |
fultonj | ok, ken dryer built it | 20:08 |
leitan | fultonj: yes, how can i specify the disks on that setup | 20:08 |
fultonj | leitan: http://giuliofidente.com/2016/08/ceph-tripleo-and-the-newton-release.html | 20:10 |
fultonj | there's an example on giulio's blog ^ under Set a default disks map for the OSD nodes | 20:11 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: WIP Add featureset for 3nodes multinode job https://review.openstack.org/486155 | 20:11 |
leitan | fultonj: greaaat, ill take a look thanks ! | 20:11 |
panda | fultonj: I'm trying to use a different registry, with images built only with kolla, but the prepare command generates the same registry host for all the images. I don't know how to specify an exception to say "pull this from docker.io, the rest from the other registry" | 20:16 |
*** jprovazn has quit IRC | 20:18 | |
*** fzdarsky has quit IRC | 20:19 | |
fultonj | http://lists.openstack.org/pipermail/openstack-dev/2017-July/119880.html | 20:19 |
fultonj | i thought ^ was supposed to provide a way to do this (though I have not tried it) | 20:20 |
*** ansmith has quit IRC | 20:25 | |
*** eck` is now known as eck`gone | 20:27 | |
panda | fultonj: the format, yes. The prepare command, not quite. | 20:30 |
*** MVenesio has quit IRC | 20:30 | |
chandankumar | EmilienM: mwhahaha https://review.openstack.org/#/c/485255/ please have a look | 20:31 |
*** jrist has joined #tripleo | 20:32 | |
*** jrist has joined #tripleo | 20:32 | |
*** jfrancoa has quit IRC | 20:34 | |
panda | also, the ceph image doesn't have a Docker*Image parameter | 20:37 |
fultonj | panda: i don't know to get prepare to do that either. on my side i am using prepare to get containers.yaml and then in another env i just set DockerCephDaemonImage: brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph:2.3-3 | 20:38 |
EmilienM | chandankumar: ok | 20:39 |
panda | fultonj: manual tweaking is not an option for me :( | 20:40 |
*** chandankumar is now known as dassistant | 20:41 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: Use prepare command for overcloud_containers.yaml https://review.openstack.org/475975 | 20:43 |
*** gbarros has joined #tripleo | 20:43 | |
gfidente | panda so | 20:44 |
gfidente | the DockerCephDaemon image is coming with https://review.openstack.org/#/c/465066/41/docker/services/ceph-ansible/ceph-base.yaml | 20:45 |
panda | gfidente: fultonj I'm trying adding --exclude ceph to the prepare command | 20:45 |
gfidente | is anything is expecting to find ceph/daemon:tag-build-master-jewel-centos-7 in trunk.registry.rdoproject.org | 20:45 |
gfidente | that is wrong | 20:45 |
panda | gfidente: not even as a workaround for now ? | 20:45 |
gfidente | our image path purposely doesn't have a registry address because we want to default to docker.io | 20:45 |
gfidente | and I believe upstream code defaults to that | 20:46 |
gfidente | so what is putting there trunk.registry.rdoproject.org ? | 20:46 |
panda | gfidente: when I specify --pull-source as argument to the prepare command, every image gets the same registry | 20:47 |
gfidente | ah so it's assuming same source for all images | 20:47 |
panda | gfidente: yes, maybe you should remove it from the general template | 20:47 |
gfidente | panda "general" | 20:48 |
*** fpan has quit IRC | 20:48 | |
panda | gfidente: sorry, I'm taking a look at the template only now | 20:48 |
gfidente | panda so I am looking at the code too | 20:49 |
gfidente | in overcloud_containers.j2 | 20:49 |
gfidente | we purposely don't use {{namespace}} prefix | 20:49 |
panda | gfidente: I don't know how the prepare command adds pull_source to the list | 20:49 |
panda | I assumed it was in the template | 20:50 |
gfidente | I am not sure if the intended behavior is to add the registry host if the image doesn't use {{namespace}} | 20:50 |
*** bnemec has quit IRC | 20:50 | |
gfidente | but I agree let's remove it from the templates | 20:50 |
gfidente | just so it doesn't break existing stuff | 20:50 |
gfidente | and for now we keep the default in the ceph templates | 20:51 |
panda | so, the command loads and renders the list, then add some keys to the dictionary, like "pull_source" for all the entries. Then dumps it. | 20:52 |
*** jkilpatr has joined #tripleo | 20:52 | |
gfidente | panda yeah I noticed | 20:52 |
gfidente | the {{namespace}} prefix is not for the registry host | 20:52 |
gfidente | the right fix for this is to add a {{registry}} prefix too it seems | 20:53 |
panda | I tend to agree | 20:53 |
gfidente | but short term we can remove it from the list | 20:53 |
gfidente | and keep the default in the templates | 20:53 |
panda | that's how I imagined it was done in the first place | 20:54 |
panda | gfidente: I don't kno w how many are impacted by this, let's see if --exclude ceph does the trick. At the moment I'm not testing ceph at all in the periodic containers job | 20:54 |
panda | (I think) | 20:54 |
gfidente | panda better to remove it so it's smoother for other people | 20:55 |
panda | unless scenario001 contains ceph | 20:55 |
panda | ok | 20:55 |
gfidente | I'll keep a FIXME in the .j2 so we remember about it | 20:55 |
fultonj | thanks panda gfidente | 20:56 |
gfidente | yeah thanks panda for pointing it out | 20:56 |
jrist | weshay: pokepoke | 20:59 |
jrist | weshay: is dev mode all git clones ? | 20:59 |
weshay | jrist, hey.. saw ur change failed on gates | 20:59 |
*** abishop has quit IRC | 20:59 | |
jrist | weshay: yeah thanks for the recheck | 20:59 |
weshay | jrist, nothing runs in ooo w/o packages | 20:59 |
jrist | :( | 21:00 |
weshay | ya | 21:00 |
jrist | so what does "devmode" mean | 21:00 |
weshay | jrist, but devmode takes a change or set of changes.. and builds them into a rpm repo for you | 21:00 |
weshay | and installs them on the undercloud and overcloud nodes | 21:00 |
weshay | so that's what it means | 21:01 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-common master: Do not list Ceph specific image in overcloud_images.yaml.j2 https://review.openstack.org/485004 | 21:01 |
*** trown is now known as trown|lunch | 21:01 | |
*** trown|lunch is now known as trown|outtypewww | 21:01 | |
gfidente | panda fultonj ^^ I think that should be it | 21:01 |
gfidente | panda so location for ceph remains set in the template for now https://review.openstack.org/#/c/465066/41/docker/services/ceph-ansible/ceph-base.yaml | 21:02 |
jrist | weshay: like I want to test https://review.openstack.org/#/c/473933/ with https://review.openstack.org/#/c/469196/ | 21:02 |
gfidente | that is probably a sane default for rdo because you don't want ceph images there? | 21:03 |
gfidente | DockerCephDaemonImage | 21:03 |
gfidente | looks good? | 21:03 |
weshay | jrist, https://docs.openstack.org/tripleo-quickstart/latest/devmode.html | 21:03 |
weshay | jrist, w/ zuul mode | 21:03 |
*** eck`gone is now known as eck` | 21:03 | |
jrist | weshay: pass those two change sets in somehow? | 21:04 |
jrist | weshay: looking | 21:04 |
weshay | jrist, if they are both from the same repo.. which they are | 21:04 |
jrist | bioe' | 21:04 |
panda | gfidente: I'll add a comment to explain what happens to me, thanks. | 21:05 |
weshay | rebase one on the other and just pick the top one | 21:05 |
fultonj | gfidente: thanks | 21:05 |
jrist | weshay: nope | 21:05 |
jrist | one is tripleo-common, one is tripleo-ui | 21:05 |
weshay | panda, do you have the ssh keys for sova? | 21:05 |
weshay | jrist, oh.. then ur fine.. just specify both using the syntax in the doc | 21:05 |
gfidente | panda sure yes, update it | 21:05 |
gfidente | thanks! | 21:05 |
panda | weshay: no | 21:05 |
jrist | weshay: thanks! | 21:07 |
*** dsariel has joined #tripleo | 21:10 | |
*** agopi has quit IRC | 21:10 | |
*** dsariel_ has joined #tripleo | 21:11 | |
*** bnemec has joined #tripleo | 21:11 | |
*** paramite has quit IRC | 21:16 | |
*** mburned has quit IRC | 21:20 | |
*** faceman has quit IRC | 21:20 | |
*** myoung has quit IRC | 21:20 | |
*** lhinds has quit IRC | 21:20 | |
*** pliu has quit IRC | 21:20 | |
*** rnoriega has quit IRC | 21:20 | |
*** mburned has joined #tripleo | 21:25 | |
*** myoung has joined #tripleo | 21:29 | |
*** mburned has quit IRC | 21:30 | |
*** dprince has quit IRC | 21:34 | |
*** mburned has joined #tripleo | 21:35 | |
*** ansmith has joined #tripleo | 21:40 | |
*** trozet has quit IRC | 22:02 | |
*** leitan has quit IRC | 22:04 | |
*** Goneri has quit IRC | 22:05 | |
*** flepied has quit IRC | 22:07 | |
*** MVenesio has joined #tripleo | 22:12 | |
*** rlandy has quit IRC | 22:15 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: [GO AWAY] Provides Ceph config into OpenStack clients https://review.openstack.org/486244 | 22:17 |
*** tesseract has quit IRC | 22:25 | |
*** myoung is now known as myoung|afk | 22:26 | |
*** dcritch has quit IRC | 22:26 | |
*** morazi has quit IRC | 22:27 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: WIP, print the failed_deployment log contents to the console for users and ara https://review.openstack.org/486248 | 22:30 |
*** myoung|afk has quit IRC | 22:52 | |
*** ckyriakidou has quit IRC | 22:56 | |
*** MVenesio has joined #tripleo | 22:57 | |
*** MVenesio has quit IRC | 22:58 | |
*** Goneri has joined #tripleo | 23:01 | |
*** dsariel has quit IRC | 23:06 | |
*** dsariel_ has quit IRC | 23:07 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add a new role for ComputeOvsDpdk and clean-up parameters https://review.openstack.org/478427 | 23:30 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render isolated network templates using jinja2 https://review.openstack.org/475612 | 23:33 |
*** panda is now known as panda|off | 23:34 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render VIPs dynamically based on network_data.yaml https://review.openstack.org/486260 | 23:36 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 23:39 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render VIPs dynamically based on network_data.yaml https://review.openstack.org/486260 | 23:41 |
*** cdearborn_ has quit IRC | 23:46 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates master: Render VIPs dynamically based on network_data.yaml https://review.openstack.org/486260 | 23:56 |
*** catintheroof has joined #tripleo | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!