| *** phalmos_ has quit IRC | 00:02 | |
| *** gouthamr has joined #openstack-ansible | 00:08 | |
| *** lkoranda has quit IRC | 00:11 | |
| *** pylot has quit IRC | 00:15 | |
| *** lkoranda has joined #openstack-ansible | 00:16 | |
| *** acormier has joined #openstack-ansible | 00:26 | |
| *** acormier has quit IRC | 00:27 | |
| *** pylot has joined #openstack-ansible | 00:31 | |
| *** vnogin has joined #openstack-ansible | 00:32 | |
| *** acormier has joined #openstack-ansible | 00:34 | |
| *** vnogin has quit IRC | 00:36 | |
| *** markvoelker has quit IRC | 00:37 | |
| *** huxinhui__ has joined #openstack-ansible | 00:39 | |
| *** huxinhui__ is now known as huxinhui | 00:39 | |
| *** chyka has quit IRC | 00:41 | |
| *** chas has joined #openstack-ansible | 00:49 | |
| *** acormier has quit IRC | 00:50 | |
| *** acormier has joined #openstack-ansible | 00:51 | |
| *** chas has quit IRC | 00:53 | |
| *** jiaopengju has joined #openstack-ansible | 00:59 | |
| *** acormier_ has joined #openstack-ansible | 01:03 | |
| *** acormier_ has quit IRC | 01:03 | |
| *** vnogin has joined #openstack-ansible | 01:03 | |
| *** acormier_ has joined #openstack-ansible | 01:03 | |
| *** acormier has quit IRC | 01:05 | |
| *** vnogin has quit IRC | 01:09 | |
| *** hw_wutianwei has joined #openstack-ansible | 01:12 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 01:30 |
|---|---|---|
| *** markvoelker has joined #openstack-ansible | 01:37 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 01:40 |
| *** chas has joined #openstack-ansible | 01:43 | |
| *** chas has quit IRC | 01:47 | |
| openstackgerrit | Guoqiang Ding proposed openstack/openstack-ansible-os_horizon master: Update the doc theme https://review.openstack.org/519896 | 01:49 |
| *** chialiang has joined #openstack-ansible | 01:51 | |
| *** chyka has joined #openstack-ansible | 02:09 | |
| cloudnull | prometheanfire: seems like a good addition to get into the ops repo. | 02:13 |
| *** chyka has quit IRC | 02:14 | |
| cloudnull | Rodrigo_BR: had to step away. | 02:14 |
| cloudnull | did you figure anything out? | 02:14 |
| cloudnull | hi DimGR | 02:14 |
| prometheanfire | cloudnull: talking about the ironic scripts or the element? | 02:15 |
| cloudnull | yes | 02:15 |
| cloudnull | :) | 02:15 |
| savvas | odyssey4me: following up on those random repo errors, just had another chance to run it with some more memory allocated | 02:17 |
| savvas | failed: [infra1_repo_container-322d2cb1] (item={'_ansible_parsed': True, '_ansible_no_log': False, u'ansible_job_id': u'732082882822.5378', u'started': 1, '_ansible_item_result': True, 'item': {'name': u'keystone', 'project_group': u'keystone_all', 'fragment': None, 'url': u'https://git.openstack.org/openstack/keystone', 'version': u'e1a94f39edb6cf777c71c7a511476b1e60436ab9', 'original': u'git+https://git.openstack.org/openstack/keyst | 02:17 |
| savvas | one@e1a94f39edb6cf777c71c7a511476b1e60436ab9#egg=keystone&gitname=keystone&projectgroup=keystone_all', 'egg_name': u'keystone'}, u'finished': 0, u'results_file': u'/var/www/.ansible_async/732082882822.5378'}) => {"ansible_job_id": "732082882822.5378", "attempts": 1, "changed": false, "cmd": "/usr/bin/git clone --origin origin https://git.openstack.org/openstack/keystone /var/www/repo/openstackgit/keystone", "failed": true, "finished": | 02:17 |
| savvas | 1, "item": {"ansible_job_id": "732082882822.5378", "finished": 0, "item": {"egg_name": "keystone", "fragment": null, "name": "keystone", "original": "git+https://git.openstack.org/openstack/keystone@e1a94f39edb6cf777c71c7a511476b1e60436ab9#egg=keystone&gitname=keystone&projectgroup=keystone_all", "project_group": "keystone_all", "url": "https://git.openstack.org/openstack/keystone", "version": "e1a94f39edb6cf777c71c7a511476b1e60436ab | 02:17 |
| savvas | 9"}, "results_file": "/var/www/.ansible_async/732082882822.5378", "started": 1}, "msg": "Cloning into '/var/www/repo/openstackgit/keystone'...\nerror: RPC failed; curl 56 GnuTLS recv error (-9): A TLS packet with unexpected length was received.\nfatal: The remote end hung up unexpectedly\nfatal: early EOF\nfatal: index-pack failed", "rc": 128, "stderr": "Cloning into '/var/www/repo/openstackgit/keystone'...\nerror: RPC failed; curl 56 | 02:17 |
| savvas | GnuTLS recv error (-9): A TLS packet with unexpected length was received.\nfatal: The remote end hung up unexpectedly\nfatal: early EOF\nfatal: index-pack failed\n", "stdout": "", "stdout_lines": []} | 02:17 |
| savvas | failed: [infra1_repo_container-322d2cb1] (item={'_ansible_parsed': True, '_ansible_no_log': False, u'ansible_job_id': u'432417788621.5466', u'started': 1, '_ansible_item_result': True, 'item': {'name': u'molteniron', 'project_group': u'all', 'fragment': None, 'url': u'https://git.openstack.org/openstack/molteniron', 'version': u'stable/pike', 'original': u'git+https://git.openstack.org/openstack/molteniron@stable/pike#egg=molteniron&g | 02:17 |
| savvas | itname=molteniron&projectgroup=all', 'egg_name': u'molteniron'}, u'finished': 0, u'results_file': u'/var/www/.ansible_async/432417788621.5466'}) => {"ansible_job_id": "432417788621.5466", "attempts": 1, "changed": false, "cmd": "/usr/bin/git checkout --force stable/pike", "failed": true, "finished": 1, "item": {"ansible_job_id": "432417788621.5466", "finished": 0, "item": {"egg_name": "molteniron", "fragment": null, "name": "molteniro | 02:17 |
| savvas | n", "original": "git+https://git.openstack.org/openstack/molteniron@stable/pike#egg=molteniron&gitname=molteniron&projectgroup=all", "project_group": "all", "url": "https://git.openstack.org/openstack/molteniron", "version": "stable/pike"}, "results_file": "/var/www/.ansible_async/432417788621.5466", "started": 1}, "msg": "Failed to checkout stable/pike", "rc": 1, "stderr": "error: pathspec 'stable/pike' did not match any file(s) know | 02:17 |
| savvas | n to git.\n", "stdout": "", "stdout_lines": []} | 02:17 |
| savvas | the version checkout errors I was referring to earlier | 02:17 |
| prometheanfire | cloudnull: wfm | 02:23 |
| *** dxiri_ has quit IRC | 02:23 | |
| *** bhujay has joined #openstack-ansible | 02:23 | |
| *** dxiri has joined #openstack-ansible | 02:24 | |
| *** woodard_ has joined #openstack-ansible | 02:26 | |
| *** woodard has quit IRC | 02:26 | |
| *** dxiri has quit IRC | 02:26 | |
| *** dxiri has joined #openstack-ansible | 02:26 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 02:35 |
| *** chas has joined #openstack-ansible | 02:37 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 02:38 |
| *** bhujay has quit IRC | 02:39 | |
| *** chas has quit IRC | 02:42 | |
| *** acormier_ has quit IRC | 02:43 | |
| *** cjloader_ has quit IRC | 02:43 | |
| *** dxiri has quit IRC | 02:51 | |
| *** dxiri has joined #openstack-ansible | 02:52 | |
| *** gouthamr has quit IRC | 02:52 | |
| *** mhayden has quit IRC | 02:52 | |
| -openstackstatus- NOTICE: Due to an unexpected outage with Zuul (1 hour), you'll need to recheck any jobs that were in progress. Sorry for the inconvenience. | 02:55 | |
| *** dxiri has quit IRC | 02:56 | |
| *** mhayden has joined #openstack-ansible | 03:00 | |
| *** dave-mccowan has quit IRC | 03:09 | |
| *** japestinho has joined #openstack-ansible | 03:13 | |
| *** chas has joined #openstack-ansible | 03:31 | |
| *** cjloader_ has joined #openstack-ansible | 03:31 | |
| *** cjloader_ has quit IRC | 03:33 | |
| *** cjloader_ has joined #openstack-ansible | 03:34 | |
| *** chas has quit IRC | 03:35 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 03:39 |
| *** udesale has joined #openstack-ansible | 03:41 | |
| *** jwitko_ has quit IRC | 03:46 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 04:04 |
| *** cjloader_ has quit IRC | 04:20 | |
| *** acormier has joined #openstack-ansible | 04:20 | |
| *** chas has joined #openstack-ansible | 04:25 | |
| *** acormier has quit IRC | 04:26 | |
| *** chas has quit IRC | 04:29 | |
| *** ivve has quit IRC | 04:46 | |
| *** nshetty has joined #openstack-ansible | 04:48 | |
| *** acormier has joined #openstack-ansible | 04:53 | |
| *** cjloader_ has joined #openstack-ansible | 04:54 | |
| *** acormier has quit IRC | 05:01 | |
| *** poopcat has quit IRC | 05:09 | |
| *** cjloader_ has quit IRC | 05:19 | |
| *** chas has joined #openstack-ansible | 05:19 | |
| *** chas has quit IRC | 05:23 | |
| *** chialiang has quit IRC | 05:30 | |
| *** chyka has joined #openstack-ansible | 05:30 | |
| *** chialiang_ has joined #openstack-ansible | 05:30 | |
| *** chialiang_ has quit IRC | 05:32 | |
| *** chialiang_ has joined #openstack-ansible | 05:32 | |
| *** chyka has quit IRC | 05:35 | |
| *** ivve has joined #openstack-ansible | 05:49 | |
| *** ivve has quit IRC | 06:00 | |
| *** hybridpollo has quit IRC | 06:05 | |
| *** chas has joined #openstack-ansible | 06:13 | |
| *** chas has quit IRC | 06:18 | |
| *** huxinhui has quit IRC | 06:18 | |
| *** threestrands has quit IRC | 06:34 | |
| *** jonher has quit IRC | 06:42 | |
| *** jonher has joined #openstack-ansible | 06:44 | |
| *** michelv has joined #openstack-ansible | 06:55 | |
| *** bhujay has joined #openstack-ansible | 06:57 | |
| *** acormier has joined #openstack-ansible | 07:01 | |
| *** acormier has quit IRC | 07:06 | |
| *** chas has joined #openstack-ansible | 07:07 | |
| *** chas has quit IRC | 07:12 | |
| *** kelv_ has quit IRC | 07:18 | |
| *** nshetty is now known as nshetty|lunch | 07:24 | |
| *** Oku_OS-away is now known as Oku_OS | 07:24 | |
| *** armaan has joined #openstack-ansible | 07:28 | |
| *** nshetty|lunch has quit IRC | 07:36 | |
| *** nshetty|lunch has joined #openstack-ansible | 07:38 | |
| *** chas has joined #openstack-ansible | 07:42 | |
| *** pcaruana has joined #openstack-ansible | 07:51 | |
| *** smatzek has joined #openstack-ansible | 07:59 | |
| *** vnogin has joined #openstack-ansible | 07:59 | |
| *** mbuil has joined #openstack-ansible | 08:02 | |
| *** mbuil has joined #openstack-ansible | 08:03 | |
| *** smatzek has quit IRC | 08:03 | |
| *** cjloader_ has joined #openstack-ansible | 08:05 | |
| yifei | Hi guys, when I deploy OSA Pike on centos7.4, it always fail at "TASK [repo_server : Install repo server packages]". I checked on the repo lxc and found that it failed while installing nginx. The reason is that "Public key for gperftools-libs-2.4-7.el7.x86_64.rpm is not installed". Is this a bug or a problem of my environment? I have successfully deployed OSA Pike on ubuntu 16.04.3 on my environment. | 08:18 |
| *** Jack_Iv has joined #openstack-ansible | 08:29 | |
| *** nshetty|lunch is now known as nshetty | 08:32 | |
| *** Jack_Iv has quit IRC | 08:33 | |
| *** Jack_Iv has joined #openstack-ansible | 08:33 | |
| armaan | evrardjp: hello, i think Newton has a new tag 14.2.11 but minor upgrade doc still asks to use the 14.2.10 I was wondering which tag should be used for minor upgrade | 08:34 |
| armaan | evrardjp: this is the doc i was talking about https://docs.openstack.org/openstack-ansible/newton/upgrade-guide/minor-upgrade.html | 08:35 |
| mardim | hwoarang, odyssey4me I am getting an error in CI with the installation of the linux-headers-4.4.0-98-generic package which I do not get locally do you have any idea what could be the problem ? | 08:36 |
| mardim | hwoarang, odyssey4me this is the error https://hastebin.com/omonutovat.sm | 08:37 |
| *** jbadiapa_ is now known as jbadiapa | 08:43 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DNM] - Testing reduced packages https://review.openstack.org/507451 | 08:48 |
| *** indistylo has joined #openstack-ansible | 08:48 | |
| hwoarang | mardim: i am not sure what this error is trying to tell us | 08:50 |
| mardim | hwoarang, yeah me neither | 08:50 |
| mardim | hwoarang, The weird thing is that the same package is installed without probloem locally | 08:51 |
| mardim | hwoarang, which means that something weird is happening in CI | 08:51 |
| hwoarang | well CI uses different xenial images than what you use locally so you can't easily compare them | 08:52 |
| mardim | hwoarang, Can you point me the ubuntu CI image so I can spinuo a VM with the same image ? | 08:53 |
| mardim | spinup* | 08:53 |
| hwoarang | they are not freely available as far as i know | 08:54 |
| hwoarang | they are built using diskimage-builder | 08:54 |
| mardim | hwoarang, Ah ok | 08:54 |
| *** gkadam has joined #openstack-ansible | 09:02 | |
| *** vnogin has quit IRC | 09:04 | |
| *** vnogin has joined #openstack-ansible | 09:04 | |
| *** chyka has joined #openstack-ansible | 09:06 | |
| *** shardy has joined #openstack-ansible | 09:07 | |
| *** pbandark has joined #openstack-ansible | 09:08 | |
| *** zenpwner has joined #openstack-ansible | 09:08 | |
| *** chyka has quit IRC | 09:11 | |
| *** chialiang_ has quit IRC | 09:13 | |
| *** nshetty is now known as nshetty|BMGR | 09:22 | |
| *** chialiang_ has joined #openstack-ansible | 09:24 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 09:35 |
| *** cjloader_ has quit IRC | 09:36 | |
| *** eumel8 has joined #openstack-ansible | 09:50 | |
| eumel8 | morning | 09:50 |
| *** vnogin has quit IRC | 09:51 | |
| ccha2 | I did AIO installation. why I can't create flat network type ? just got 'Error: Failed to create network provider-net' | 09:52 |
| ccha2 | I could create an vlan network | 09:53 |
| openstackgerrit | Dimitrios Markou proposed openstack/openstack-ansible-os_neutron master: [DO_NOT_MERGE] Add OvS-NSH support https://review.openstack.org/517259 | 09:53 |
| *** SmearedBeard has joined #openstack-ansible | 09:59 | |
| *** vnogin has joined #openstack-ansible | 10:04 | |
| *** vnogin has quit IRC | 10:05 | |
| *** vnogin has joined #openstack-ansible | 10:06 | |
| *** hw_wutianwei has quit IRC | 10:09 | |
| *** yifei has quit IRC | 10:10 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/ocata: Implement retries for git clones https://review.openstack.org/520035 | 10:13 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/newton: Implement retries for git clones https://review.openstack.org/520036 | 10:14 |
| *** zenpwner has quit IRC | 10:15 | |
| *** pester has joined #openstack-ansible | 10:20 | |
| DimGR | is carina still maintained ? | 10:21 |
| *** fxpester has quit IRC | 10:23 | |
| odyssey4me | Carina is a Rackspace public cloud service - nothing to do with OSA. | 10:24 |
| odyssey4me | Or OpenStack. | 10:24 |
| DimGR | i know i asked maybe someone would know | 10:25 |
| DimGR | sorry | 10:25 |
| odyssey4me | As far as I know it's still available as a service, yes... but I personally don't really keep track of it. | 10:27 |
| odyssey4me | armaan 14.2.11 is not yet released, that's why the docs aren't showing it - it's the proposed release at the head of the branch | 10:29 |
| armaan | damn | 10:29 |
| odyssey4me | so if you want to use it, you need to use the head of the branch | 10:29 |
| odyssey4me | the current released tag is 14.2.10 as shown in the docs - they auto-update with each release | 10:30 |
| armaan | i started trying it out for minor upgrade in a test environment | 10:30 |
| odyssey4me | mardim is that error consistent? it might just be a transient error or perhaps something wrong with the infra mirror | 10:30 |
| armaan | odyssey4me: i saw this https://github.com/openstack/openstack-ansible/commits/14.2.11, so i thought it is released. | 10:31 |
| odyssey4me | armaan oh, then it is released - it might be that the docs job to publish after the merge got lost | 10:31 |
| odyssey4me | it'll auto-update on the next merge | 10:32 |
| odyssey4me | it looks like zuul may have been restarted some time in the night - I've seen a few lost jobs | 10:32 |
| armaan | odyssey4me: ah ok, i guess i am good for now then :D | 10:32 |
| armaan | odyssey4me: An update from Sydney, the workshop went splendidly well, thanks to your suggestion on memory management, i think cloudnull and spotz also attended it. | 10:33 |
| odyssey4me | excellent - happy to hear | 10:34 |
| armaan | odyssey4me: https://twitter.com/xahteiwi/status/928377863023108096 | 10:36 |
| odyssey4me | ja, saw that :) | 10:37 |
| armaan | cool :) | 10:37 |
| *** jiaopengju has quit IRC | 10:43 | |
| mardim | odyssey4me, Not sure I am rechecking right now and will seee | 10:44 |
| mardim | odyssey4me, Ci gives me again the same error | 10:49 |
| odyssey4me | mardim which review is it? | 10:54 |
| mardim | odyssey4me, https://review.openstack.org/#/c/517259/ | 10:55 |
| mardim | odyssey4me, The gate that has this error is the ovs-nsh gate | 10:55 |
| odyssey4me | looking | 10:56 |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/newton: IMAGES_ALLOW_LOCATION Wrongly Templated As String https://review.openstack.org/516750 | 10:58 |
| *** ivve has joined #openstack-ansible | 11:02 | |
| odyssey4me | mardim I suspect the issue is that the version of the package you're installing doesn't match the version of the kernel installed | 11:04 |
| odyssey4me | it's installing the latest package, but an older kernel package is installed | 11:04 |
| *** armaan has quit IRC | 11:04 | |
| odyssey4me | you'll probably have to install the matching version of whatever's installed | 11:04 |
| *** armaan has joined #openstack-ansible | 11:04 | |
| mardim | odyssey4me, at the beggining the command was linux-headers-{{ ansible_kernel }} | 11:09 |
| mardim | odyssey4me, which install the headers for the current kernel version | 11:09 |
| mardim | odyssey4me, I was getting the same error in CI | 11:09 |
| *** vnogin has quit IRC | 11:11 | |
| hwoarang | odyssey4me: do you have time to look at some zuul issue? i had a brief look with logan- last night be we couldn't find the root of the problem | 11:12 |
| hwoarang | so i wanted to check with you before going to infra | 11:12 |
| hwoarang | (again) | 11:12 |
| *** ivve has quit IRC | 11:12 | |
| *** nguyentrihai has joined #openstack-ansible | 11:14 | |
| odyssey4me | hwoarang I didn't have a chance yesterday, but saw the discussion. I take it the change made didn't work? | 11:15 |
| hwoarang | no | 11:15 |
| hwoarang | http://logs.openstack.org/51/507451/14/check/openstack-ansible-deploy-aio-ubuntu-xenial/1341b8b/job-output.txt.gz#_2017-11-15_08_55_06_598968 and http://logs.openstack.org/51/507451/14/check/openstack-ansible-deploy-aio-opensuse-423/6ebafbf/job-output.txt.gz#_2017-11-15_10_39_12_862820 | 11:16 |
| hwoarang | first one is ubuntu. works ok. second one is opensuse (centos7 has the same issue) zuul timesout | 11:16 |
| hwoarang | it's like the playbook never terminates on centos and opensuse... | 11:16 |
| odyssey4me | hwoarang could you please review https://review.openstack.org/#/c/519434/ and https://review.openstack.org/#/c/518611/ | 11:17 |
| *** vnogin has joined #openstack-ansible | 11:17 | |
| hwoarang | i'll have a look | 11:18 |
| odyssey4me | heh, I think I know what's happening there - hang on | 11:18 |
| *** jiaopengju has joined #openstack-ansible | 11:19 | |
| odyssey4me | oh, it is using become - ok, wrong thing - lemme look more closely | 11:19 |
| hwoarang | i also did a test commit using 'shell' instead of 'command' module but that didn't change much | 11:20 |
| odyssey4me | I think the whole 'check if it's nodepool or running with zuul' can be removed if we just move the log collection out of the scripts library and into its own script and execute it in the post playbook... that way only zuul will execute it anyway. | 11:24 |
| odyssey4me | it looks like some of the commands are failing and that failure may be causing the post play to fail... so while moving stuff over we can make it more robust. | 11:25 |
| *** chialiang_ has quit IRC | 11:26 | |
| hwoarang | odyssey4me: logan- has a patchset that moves log collection to the post playbook. that fails in the same way though | 11:27 |
| odyssey4me | that's what this one is doing | 11:28 |
| hwoarang | imho the problem is not that a playbook fails etc but that the playbook never finishes. it just sits there and waiting to be killed by zuul | 11:29 |
| odyssey4me | oh I see - the chmod executes, but never finishes | 11:29 |
| hwoarang | yep | 11:30 |
| odyssey4me | maybe using https://github.com/openstack/openstack-ansible-tests/blob/master/test-log-collect.sh#L29 for the rsync will help reduce the work the chmod has to do? | 11:32 |
| hwoarang | i will be very surprised if chmod is really the problem there | 11:32 |
| hwoarang | on ubuntu it takes 1 second to run chmod. i can't believe that it needs 10 minutes for the other 2 distros | 11:34 |
| hwoarang | something must be happening after chmod :( | 11:34 |
| odyssey4me | yeah, that is odd | 11:34 |
| odyssey4me | one way to test that is to switch the chmod and gzip commands around to see if it completes the chmod | 11:35 |
| odyssey4me | hmm, that's very odd | 11:36 |
| odyssey4me | I need to get on with some other work now, then will circle back to this in the evening. | 11:37 |
| hwoarang | ok then | 11:38 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DNM] - Testing zuul exit https://review.openstack.org/507451 | 11:39 |
| *** mbuil has quit IRC | 11:39 | |
| *** Jack_Iv has quit IRC | 11:41 | |
| gokhan | hi team, I have problem about nova spice console. it is not working. It gets http 503 error. I looked at nova-consoleauth but there is no error log. Only there is error on haproxy logs server is down and no server is available. How can I solve this problem. probably error is about haproxy config. I also get http 503 error on aodh. but when I removed http-check expect status 401 on aodh haproxy config it is worked. but on nova-spice console it is n | 11:46 |
| gokhan | ot worked. | 11:46 |
| *** jwitko has quit IRC | 11:50 | |
| *** fxpester has joined #openstack-ansible | 11:57 | |
| *** pester has quit IRC | 12:01 | |
| *** nshetty|BMGR is now known as nshetty | 12:02 | |
| gokhan | I removed option httpchk HEAD / | 12:03 |
| gokhan | on nova-console haproxy config it is worked. | 12:03 |
| *** ianychoi has quit IRC | 12:07 | |
| *** vnogin has quit IRC | 12:19 | |
| *** acormier has joined #openstack-ansible | 12:23 | |
| *** yifei has joined #openstack-ansible | 12:24 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Use known group names https://review.openstack.org/519434 | 12:24 |
| *** acormier has quit IRC | 12:27 | |
| *** vnogin has joined #openstack-ansible | 12:28 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.12 https://review.openstack.org/518835 | 12:30 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use tests repo for all lint tests https://review.openstack.org/520065 | 12:33 |
| *** smatzek has joined #openstack-ansible | 12:33 | |
| *** armaan has quit IRC | 12:39 | |
| openstackgerrit | Dimitrios Markou proposed openstack/openstack-ansible-os_neutron master: Add hosts to ODL test inventory https://review.openstack.org/518964 | 12:42 |
| SmearedBeard | hey, If I have a separate server for deployment, does it only need to access br-mgmt network and nothing else? | 12:44 |
| odyssey4me | SmearedBeard yes, I think so - it'll need internet access too I think | 12:46 |
| SmearedBeard | odyssey4me cool, thanks | 12:47 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use tests repo for all lint tests https://review.openstack.org/520065 | 12:54 |
| *** acormier has joined #openstack-ansible | 12:58 | |
| idlemind | does updating my local version of openstack-ansible also bump the sha's for the other projects or do i have to do that manually w/something like bootstrap-ansible.sh? | 12:59 |
| flaper87 | odyssey4me: hey, so, I think we roughly talked about this but just want to double check. I'd like to add support for oslo-config schemas to config_template. Or, in other words, I'd like to be able to pass a schema file generated with oslo-config-generator and have config_template build a config file from that. Would you be ok with that? | 13:04 |
| *** ianychoi has joined #openstack-ansible | 13:05 | |
| *** nshetty has quit IRC | 13:07 | |
| *** pester has joined #openstack-ansible | 13:07 | |
| *** smatzek has quit IRC | 13:09 | |
| *** fxpester has quit IRC | 13:10 | |
| *** smatzek has joined #openstack-ansible | 13:10 | |
| *** pester has quit IRC | 13:11 | |
| *** nguyentrihai has quit IRC | 13:16 | |
| odyssey4me | flaper87 sure, although I'm not sure what would happen there? | 13:19 |
| odyssey4me | doesn't oslo-config just generate the default config file with all the comments? | 13:20 |
| odyssey4me | idlemind if you checkout a new tag then you use bootstrap-ansible to update all the roles to the same tag... but it will only update the roles in the ansible-role-requirements file | 13:21 |
| idlemind | ok, and ansible-role-requirements is always looking at the 'master' branch of the repo's for say os_horizon at the particular sha correct? | 13:23 |
| odyssey4me | idlemind that's only the case in our master branch - stable branches are pinned to a particular SHA and updated every two weeks | 13:23 |
| odyssey4me | https://review.openstack.org/518835 is an example of a stable branch sha pin update | 13:24 |
| mardim | odyssey4me, Can you lease take a look to this https://review.openstack.org/#/c/518964/ ? | 13:26 |
| mardim | odyssey4me, When you have some spare time | 13:26 |
| mardim | : | 13:26 |
| mardim | :) | 13:26 |
| mardim | please* | 13:26 |
| flaper87 | odyssey4me: yeah, here's an example of the yaml file generated: https://docs.openstack.org/oslo.config/latest/cli/generator.html#generating-machine-readable-configs | 13:27 |
| flaper87 | odyssey4me: I'd like to have config_template generate the ini file based on that and set the various options | 13:27 |
| flaper87 | Alternatively, I could just create a base template with all that but: | 13:27 |
| flaper87 | 1) config_template strips the comments (easily fixable) | 13:28 |
| flaper87 | 2) not sure if config_template will actually set the options in the right place (I believe it won't, reason why it just strips the comments) | 13:28 |
| *** vnogin has quit IRC | 13:28 | |
| flaper87 | TBH, I think I like the idea of config_template doing it all better | 13:29 |
| *** markvoelker has quit IRC | 13:29 | |
| flaper87 | we could add a config_schema option | 13:29 |
| *** markvoelker has joined #openstack-ansible | 13:29 | |
| flaper87 | also, this would probably work only for ini files | 13:29 |
| *** nshetty has joined #openstack-ansible | 13:30 | |
| odyssey4me | mardim done | 13:30 |
| idlemind | ugh, any ideas on troubleshooting a [object Object] error message in horizon when uploading an image from file to glance. works in openstack cli via the utility container. nothing in horizon logs even with debug on, web inspection of the js doesn't seem to show anything of use | 13:30 |
| odyssey4me | flaper87 so I'm guessing you'd want to generate those, then adjust it to add whatever jinja bits you want, then use that as the template source when passing it through config_template? | 13:31 |
| wspthr | idlemind: setting "horizon_images_upload_mode: legacy" solved the upload problem for me | 13:31 |
| idlemind | wspthr thx i'll give that a try! | 13:32 |
| *** vnogin has joined #openstack-ansible | 13:32 | |
| flaper87 | odyssey4me: yes. NOte that those schemas would be generated outside config_template. We would just pass the schema to config_template and let it do its magic | 13:32 |
| *** yifei has left #openstack-ansible | 13:33 | |
| wspthr | idlemind: you are welcome, to apply the changed settings just run os-horizon.yml | 13:33 |
| *** yifei has joined #openstack-ansible | 13:33 | |
| odyssey4me | flaper87 it would seem that perhaps a simpler integration would be to keep them separate - generate the source template on a target host where the code to generate it is deployed, then pull it to the deployment node, then pass it through config_template when deploying | 13:33 |
| idlemind | ah for now i just changed it right in /etc/horizon/local_settings.py ... bad me i know | 13:33 |
| odyssey4me | flaper87 ah, but then there's no modification to config_template needed at all - it already takes a yml file as an input | 13:33 |
| flaper87 | odyssey4me: wait, mmh, I'm confused | 13:34 |
| flaper87 | not sure if I'm explaining myself correctly | 13:34 |
| *** acormier has quit IRC | 13:34 | |
| flaper87 | odyssey4me: what yaml files can config_template take ? | 13:35 |
| odyssey4me | flaper87 any | 13:35 |
| flaper87 | I think we are talking about 2 different things | 13:35 |
| flaper87 | :D | 13:35 |
| odyssey4me | here's an example: https://github.com/openstack/openstack-ansible-os_ceilometer/blob/master/tasks/ceilometer_post_install.yml#L44-L48 | 13:35 |
| *** acormier has joined #openstack-ansible | 13:36 | |
| odyssey4me | config template also has a 'content' argument instead of the 'src' argument which works like the ansible copy module | 13:36 |
| idlemind | wspthr well that seems to have done the trick, at least no error directly. now it's dropped to 'Queued' w/a little blue status bar ... #progress | 13:36 |
| idlemind | and complete | 13:37 |
| openstackgerrit | Dimitrios Markou proposed openstack/openstack-ansible-os_neutron master: Add hosts to ODL test inventory https://review.openstack.org/518964 | 13:37 |
| idlemind | so now to figure out why legacy works and direct doesn't | 13:37 |
| odyssey4me | flaper87 also https://docs.openstack.org/project-deploy-guide/openstack-ansible/latest/app-advanced-config-override.html#overriding-yml-files | 13:37 |
| idlemind | and why the default is a non-working direct | 13:37 |
| odyssey4me | flaper87 so yes - if those aren't catering for what you're wanting to do - then I'm obviously not understanding :) | 13:37 |
| flaper87 | ^^ | 13:37 |
| flaper87 | yeah, those are not what I want | 13:38 |
| *** armaan has joined #openstack-ansible | 13:38 | |
| flaper87 | What I would like to do is build a base ini file using the schema file generated with oslo-config-generator | 13:38 |
| flaper87 | and then let config_template set the variables and values. | 13:40 |
| flaper87 | lemme get a link and show you how I'm using it | 13:40 |
| flaper87 | odyssey4me: https://github.com/openstack/ansible-role-k8s-keystone/blob/master/tasks/provision.yml#L14-L19 | 13:40 |
| flaper87 | base.conf.j2 is empty and all the options are set through the config_overrides | 13:41 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/pike: Add defaults for nova metadata settings https://review.openstack.org/500929 | 13:41 |
| *** SerenaFeng has joined #openstack-ansible | 13:41 | |
| *** woodard_ has quit IRC | 13:42 | |
| odyssey4me | flaper87 ok, so just execute a task before that which runs on localhost to generate the source in a specific location, then instead of carrying a blank template, use that location as a source | 13:42 |
| *** woodard has joined #openstack-ansible | 13:43 | |
| odyssey4me | another option is to use the content argument with a lookup('pipe', 'command-to-create-the-default-file') | 13:43 |
| flaper87 | odyssey4me: right that was the other option I mentioned. The problem with that is that config_template strips comments (fixable) and, IIUC, it won't be able to set the variables in the right place. | 13:43 |
| * flaper87 re-reads the config_template code | 13:44 | |
| odyssey4me | I'm under the impression that it doesn't strip comments, but I may be wrong | 13:44 |
| *** vnogin has quit IRC | 13:44 | |
| odyssey4me | it might strip them for yaml files | 13:44 |
| idlemind | ok next error, no valid hosts found for any instance i try to create | 13:44 |
| idlemind | (even a simple cirros vm, my hypervisor is seen and available w/4 cores and 32gb of ram) | 13:45 |
| *** smatzek_ has joined #openstack-ansible | 13:45 | |
| *** smatzek has quit IRC | 13:45 | |
| odyssey4me | idlemind that's because the nova scheduler does not believe there's a hypervisor available that meets the needs of your request - you'll have to debug the scheduler to find out why - most often it's because the nova/neutron agents aren't running on the hypervisors | 13:46 |
| *** gouthamr has joined #openstack-ansible | 13:46 | |
| flaper87 | odyssey4me: what does config_template do if there's an override for this variable? https://github.com/openstack/openstack-ansible-os_ceilometer/blob/master/templates/ceilometer.conf.j2#L5 | 13:46 |
| odyssey4me | but sometimes it's another spec you may or may not be aware of | 13:46 |
| idlemind | odyssey4me thx so start w/nova-scheduler container | 13:46 |
| flaper87 | odyssey4me: does it change it? | 13:46 |
| odyssey4me | flaper87 it will change if if there is an override which tells it to change that line | 13:47 |
| odyssey4me | ie if the override contains use_stderr: blah, then that line will change to use_stderr = blah | 13:47 |
| flaper87 | ok, that's good. | 13:49 |
| flaper87 | one more thing :D | 13:49 |
| idlemind | odyssey4me ok on the hypervisor in nova-compute.log i see an error that ends in PortBindingFailed[port_id=port['id']) so that points to neutron possibly on the host? | 13:49 |
| flaper87 | something that I saw puppet-* modules do is that, when setting the config options on a file, it would duplicate the commented line, uncomment it and set the value. | 13:50 |
| flaper87 | For example | 13:50 |
| idlemind | ERROR neutron.plugins.ml2.drivers.linuxbridge.agent.linuxbridge_neutron_agent [-] Interface eth12 for physical network flat does not exist. Agent terminated! | 13:50 |
| flaper87 | if there was a line like # use_stderr = DEFAULT_VALUE, the puppet module would duplicate that line (To keep the default value as documentation in the file) and set the variable to the override value in the line below | 13:50 |
| *** hw_wutianwei has joined #openstack-ansible | 13:51 | |
| flaper87 | odyssey4me: wondering if that's something useful for config_template | 13:51 |
| idlemind | that seems to be where i've blown up, i'll have to take a look at user_config.yml to see what i messed up | 13:51 |
| flaper87 | I guess the main difference is that config_template is generic | 13:51 |
| flaper87 | and this sounds like openstack specific | 13:51 |
| *** mbuil has joined #openstack-ansible | 13:51 | |
| flaper87 | anyway, I've got enough to get me going | 13:52 |
| flaper87 | I think I know how to proceed without changing config_template | 13:52 |
| andymccr | flaper87: i think the problem is that it uses ConfigParser and then compares it to the opts, and reconstructs - so it kinda messes up ordering completely and so comments go awol. | 13:52 |
| andymccr | not sure if there is a good way to get around that | 13:52 |
| *** jwitko_ has joined #openstack-ansible | 13:52 | |
| idlemind | ahh, might be 'host_bind_override' in user_config.yml my local host knows it as br-vlan | 13:52 |
| odyssey4me | flaper87 config_template won't modify the commented line as far as I know, so the default commented option for everything should be safe | 13:53 |
| andymccr | whole sections will get reordered, which is ok for reading the config by an app, but bad for comments | 13:53 |
| flaper87 | ok | 13:53 |
| flaper87 | need to test if it preserves comments, if so, we're good :D | 13:53 |
| odyssey4me | andymccr flaper87 I thought that was sorted out some time ago | 13:53 |
| odyssey4me | if not, then there are ways to deal with it and it could be fixed | 13:54 |
| odyssey4me | I remember seeing some parsers which remeber the line each option came from and they were specifically targeting keeping comments | 13:54 |
| andymccr | odyssey4me: not in my experience playing around with it recently :) unless its fixed in master and not stable/pike | 13:55 |
| andymccr | it also wont allow you to delete spaces between delimiters :( because we're not on py3 yet | 13:55 |
| andymccr | or not entirely | 13:55 |
| andymccr | which screwed my bits for fio config :) | 13:55 |
| *** udesale has quit IRC | 13:56 | |
| andymccr | to be fair i do think configParser can handle comments fine, but i think its the bit where we join the 2 that we run into problems | 13:56 |
| odyssey4me | ah ok - I guess my memory is bad :/ | 13:57 |
| *** udesale has joined #openstack-ansible | 13:58 | |
| flaper87 | andymccr: can you point me to the point where these 2 are joined? | 13:59 |
| idlemind | can i exclude certain stig stuff from ansible-hardening? | 14:00 |
| idlemind | (aka, i hate banners - they're stupid, and my lab doesn't need super short ssh timeouts) | 14:01 |
| *** dave-mccowan has joined #openstack-ansible | 14:01 | |
| *** acormier has quit IRC | 14:01 | |
| *** chas_ has joined #openstack-ansible | 14:02 | |
| odyssey4me | flaper87 andymccr apparently https://github.com/DiffSK/configobj (py3) or http://www.voidspace.org.uk/python/configobj.html (py2) can do what we want | 14:02 |
| odyssey4me | idlemind read the docs for ansible-hardening, everything can be enabled/disabled as you wish | 14:02 |
| idlemind | odyssey4me thx i'll take read through while i wait on os-neutron to re-run | 14:03 |
| odyssey4me | flaper87 andymccr found that in https://stackoverflow.com/questions/21476554/update-ini-file-without-removing-comments | 14:03 |
| *** vnogin has joined #openstack-ansible | 14:05 | |
| *** chas has quit IRC | 14:05 | |
| *** SerenaFeng has quit IRC | 14:06 | |
| *** SerenaFeng has joined #openstack-ansible | 14:06 | |
| andymccr | yeah i think it'd be possible tbh - we just need to iterate on what we have an improverate it | 14:10 |
| ccha2 | idlemind: have you got problem with creating flat network ? | 14:12 |
| ccha2 | I got error on horizon when I create flat network, but I don't find which log I should read for more details | 14:13 |
| *** dave-mccowan has quit IRC | 14:13 | |
| ccha2 | horizon just display 'Error: Failed to create network net-test' | 14:13 |
| *** SerenaFeng has quit IRC | 14:15 | |
| armaan | folks, i am doing a minor upgrade to 14.2.11 and i just encountered this issue http://paste.openstack.org/show/626383/ Any idea what could be wrong here? | 14:15 |
| idlemind | ccha2 for me in my user-config i think the host_bind_override was messing me up | 14:17 |
| *** vnogin has quit IRC | 14:17 | |
| idlemind | ccha2 in my user_config file | 14:18 |
| armaan | perhaps i am facing this bug, https://bugs.launchpad.net/openstack-ansible/+bug/1727778 | 14:18 |
| openstack | Launchpad bug 1727778 in openstack-ansible "ceph_client Update apt cache play fails with conditional check error" [Undecided,New] | 14:18 |
| idlemind | ccha2 for me, i have neutron services in containers and locally on hosts not sure if the duplication was necessary | 14:18 |
| *** vnogin has joined #openstack-ansible | 14:20 | |
| *** dave-mccowan has joined #openstack-ansible | 14:20 | |
| armaan | odyssey4me: Could I interest you in the bug 1727778, it appears that this bug is related to this commit https://github.com/openstack/openstack-ansible-ceph_client/commit/62ecbd9eb60fe8e3b676a267c2ae84b623fc8bd4 | 14:23 |
| openstack | bug 1727778 in openstack-ansible "ceph_client Update apt cache play fails with conditional check error" [Undecided,New] https://launchpad.net/bugs/1727778 | 14:23 |
| odyssey4me | armaan I'm tied up in some other work at the moment and aren't able to look into anything else for a few hours | 14:24 |
| *** smatzek_ has quit IRC | 14:24 | |
| *** aruns has joined #openstack-ansible | 14:24 | |
| *** dave-mcc_ has joined #openstack-ansible | 14:24 | |
| armaan | odyssey4me: roger that. thanks for letting me know! | 14:24 |
| *** dave-mccowan has quit IRC | 14:25 | |
| *** indistylo has quit IRC | 14:26 | |
| *** udesale has quit IRC | 14:29 | |
| *** nshetty has quit IRC | 14:30 | |
| *** jwitko has joined #openstack-ansible | 14:34 | |
| *** armaan has quit IRC | 14:37 | |
| mhayden | would anyone else happen to have opinions on the contrib task framework for ansible-hardening? https://review.openstack.org/#/c/514385/ | 14:38 |
| mhayden | it will allow contributors to add custom tasks to the role | 14:38 |
| mhayden | (optionally included) | 14:38 |
| mardim | hwoarang, Please take a look to my comment if you have some time https://review.openstack.org/#/c/518964/ | 14:42 |
| mardim | hwoarang, Thanks | 14:42 |
| *** esberglu has quit IRC | 14:44 | |
| *** udesale has joined #openstack-ansible | 14:45 | |
| *** esberglu has joined #openstack-ansible | 14:45 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix cinder_backup for horizon dashboard and heat https://review.openstack.org/517935 | 14:47 |
| *** esberglu has quit IRC | 14:49 | |
| bhujay | mhayden: had a question in my mind regarding CIS vs STIG , is STIG has been opted for openstack-ansible because it is security wise better or more aligned with the openstack requirements ? | 14:52 |
| odyssey4me | bhujay IIRC it's because the STIG doesn't require being licensed - whereas all other frameworks do | 14:53 |
| *** aruns has quit IRC | 14:53 | |
| bhujay | got it thanks | 14:54 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add ironic image generation and node registration scripts https://review.openstack.org/519737 | 14:56 |
| *** eumel8 has quit IRC | 14:58 | |
| bhujay | pardon me it is non topic here but Sharing my excitement and gratitude to you all . Inspired by the encouragement received from you all , I ventured to write a pull request in ansible os_router openstack module . It just got approved. This wouldn't have been possible unless cloudnull taught me the IRC magic to connect with community and subsequent encouragement by you all . I find this group is the most active and helpful | 15:00 |
| *** esberglu has joined #openstack-ansible | 15:00 | |
| *** armaan has joined #openstack-ansible | 15:01 | |
| openstackgerrit | Merged openstack/ansible-hardening stable/ocata: Fix path to useradd config https://review.openstack.org/511273 | 15:03 |
| *** armaan has quit IRC | 15:03 | |
| *** armaan has joined #openstack-ansible | 15:03 | |
| openstackgerrit | Kevin Lefevre proposed openstack/openstack-ansible-os_octavia stable/pike: Fix var name in doc https://review.openstack.org/520098 | 15:04 |
| idlemind | cinder / storage_hosts for local lvm using vg of cinder-volumes ... in the lvm: stanza the example docs show the value of 'iscsi_ip_address' and an ip address. is this ip supposed to be an ip local and already present on the cinder host? | 15:04 |
| openstackgerrit | Kevin Lefevre proposed openstack/openstack-ansible-os_octavia stable/pike: add segmentation id option to octavia mgmt network creation task https://review.openstack.org/520099 | 15:04 |
| openstackgerrit | Kevin Lefevre proposed openstack/openstack-ansible-os_octavia stable/pike: Add allocation pool for octavia mgmt subnet https://review.openstack.org/520100 | 15:04 |
| openstackgerrit | Kevin Lefevre proposed openstack/openstack-ansible-os_octavia stable/pike: Remove ignore error and unnecessary when https://review.openstack.org/520101 | 15:05 |
| openstackgerrit | Kevin Lefevre proposed openstack/openstack-ansible-os_octavia stable/pike: Fix mgmt network creation tasks https://review.openstack.org/520102 | 15:05 |
| flaper87 | odyssey4me: just tested and it seems to be stripping comments off | 15:07 |
| odyssey4me | flaper87 :( I guess it'll need changes then to fix that | 15:08 |
| *** gouthamr has quit IRC | 15:12 | |
| *** hw_wutianwei has quit IRC | 15:12 | |
| *** hw_wutianwei has joined #openstack-ansible | 15:13 | |
| *** gouthamr has joined #openstack-ansible | 15:16 | |
| *** acormier has joined #openstack-ansible | 15:19 | |
| *** weezS has joined #openstack-ansible | 15:20 | |
| cloudnull | bhujay: ++ sweet! | 15:23 |
| cloudnull | that's very cool. | 15:24 |
| *** Brew has joined #openstack-ansible | 15:33 | |
| *** galstrom_zzz is now known as galstrom | 15:33 | |
| *** udesale has quit IRC | 15:37 | |
| *** dave-mcc_ has quit IRC | 15:38 | |
| *** yifei has quit IRC | 15:42 | |
| *** bhujay has quit IRC | 15:50 | |
| *** mbuil has quit IRC | 15:55 | |
| armaan | cloudnull: hello, any idea what is the meaning of this error http://paste.openstack.org/show/626410/ | 15:55 |
| idlemind | do i put my stig variables that i want to override into user_variables.yml or right in user_config.yml? | 15:57 |
| cloudnull | armaan: looking | 15:58 |
| *** cjloader_ has joined #openstack-ansible | 15:58 | |
| *** phalmos has joined #openstack-ansible | 15:58 | |
| odyssey4me | idlemind user_variables | 15:59 |
| idlemind | thx | 15:59 |
| *** dave-mccowan has joined #openstack-ansible | 15:59 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/newton: Implement retries for git clones https://review.openstack.org/520036 | 16:00 |
| *** dave-mccowan has quit IRC | 16:02 | |
| mhayden | aw, bhujay left before i could say thanks | 16:03 |
| *** acormier has quit IRC | 16:09 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/newton: Update all SHAs for 14.2.12 https://review.openstack.org/518848 | 16:09 |
| *** smatzek has joined #openstack-ansible | 16:12 | |
| *** Oku_OS is now known as Oku_OS-away | 16:13 | |
| *** smatzek_ has joined #openstack-ansible | 16:14 | |
| armaan | cloudnull: some more info, i am using 14.2.11 tag | 16:16 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally stable/newton: Updated from OpenStack Ansible Tests https://review.openstack.org/520127 | 16:16 |
| *** smatzek has quit IRC | 16:17 | |
| *** markvoelker_ has joined #openstack-ansible | 16:18 | |
| idlemind | i cannot get br-vlan to work for the life of me | 16:19 |
| *** markvoelker has quit IRC | 16:20 | |
| *** acormier_ has joined #openstack-ansible | 16:22 | |
| *** savvas_ has joined #openstack-ansible | 16:22 | |
| *** germs has joined #openstack-ansible | 16:25 | |
| *** savvas has quit IRC | 16:26 | |
| *** smatzek_ is now known as smatzek | 16:27 | |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 16:27 |
| cloudnull | armaan: Is this running using some of the tags? | 16:30 |
| armaan | cloudnull: nope, just upgrading the Newton to 14.2.11 | 16:31 |
| armaan | minor upgrade | 16:31 |
| *** germs1 has joined #openstack-ansible | 16:32 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/ocata: Implement retries for git clones https://review.openstack.org/520035 | 16:33 |
| *** germs has quit IRC | 16:34 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/pike: Fix var name in doc https://review.openstack.org/520098 | 16:34 |
| cjloader_ | cloudnull: i updated the commit message on the pw-token-gen.py patch | 16:35 |
| *** jiaopengju has quit IRC | 16:35 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally stable/ocata: Updated from OpenStack Ansible Tests https://review.openstack.org/520139 | 16:42 |
| cloudnull | armaan: interesting. I suspect this issue is being caused by the local facts. | 16:46 |
| cloudnull | however I'm still looking | 16:46 |
| armaan | cloudnull: okie, i have deleted the facts and running the nova playbook again. | 16:47 |
| cloudnull | ++ | 16:47 |
| *** chyka has joined #openstack-ansible | 16:52 | |
| *** phalmos_ has joined #openstack-ansible | 16:55 | |
| *** phalmos has quit IRC | 16:58 | |
| *** dave-mccowan has joined #openstack-ansible | 17:00 | |
| *** dxiri has joined #openstack-ansible | 17:01 | |
| armaan | cloudnull: same error http://paste.openstack.org/show/626420/ | 17:04 |
| armaan | cloudnull: I don't recall facing this issue in 14.2.8, so it must be a regression from any commits after that | 17:06 |
| *** phalmos_ has quit IRC | 17:07 | |
| armaan | cloudnull: perhaps the issue lie somewhere in the 8 commits from top | 17:08 |
| *** bhujay has joined #openstack-ansible | 17:09 | |
| armaan | ansible version is 2.1.6.0 | 17:12 |
| *** hw_wutianwei has quit IRC | 17:13 | |
| *** masber has quit IRC | 17:15 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Remove the AIO scenario & add new scenarios to maintain coverage https://review.openstack.org/516002 | 17:16 |
| *** phalmos has joined #openstack-ansible | 17:16 | |
| cloudnull | armaan: so this is where its failing https://github.com/openstack/openstack-ansible/blob/stable/newton/playbooks/os-nova-install.yml#L130-L134 | 17:17 |
| cloudnull | which I'm assuming is because the nova key is missing from the local facts file | 17:18 |
| cloudnull | armaan: do your nova nodes have the file /etc/ansible/facts.d/openstack_ansible.fact | 17:19 |
| *** michelv has quit IRC | 17:19 | |
| cloudnull | `ansible -m shell -a 'ls /etc/ansible/facts.d/openstack_ansible.fact' nova_all | 17:19 |
| cloudnull | also can we see if the file has the nova key | 17:19 |
| armaan | cloudnull: http://paste.openstack.org/show/626421/ | 17:20 |
| cloudnull | `ansible -m shell -a 'grep -A3 "\[nova\]" /etc/ansible/facts.d/openstack_ansible.fact' nova_all | 17:21 |
| armaan | cloudnull: http://paste.openstack.org/show/626422/ one failed | 17:23 |
| cloudnull | can you put that section into the failed nodes file and rerun? | 17:24 |
| armaan | sure | 17:24 |
| *** michelv has joined #openstack-ansible | 17:25 | |
| cloudnull | im not sure what would have caused the local fact to be out of sync | 17:28 |
| cloudnull | odyssey4me: any ideas? | 17:28 |
| cloudnull | something somewhere was skipped, but i don't know why? | 17:28 |
| odyssey4me | if the fact wasn't dropped, then the software wasn't dropped | 17:28 |
| odyssey4me | either that or you haven't updated the roles after doing a new repo checkout | 17:28 |
| odyssey4me | the fact is dropped in a task after the software is dropped | 17:29 |
| cloudnull | it looks like the local fact file was present, but not the nova section. | 17:29 |
| odyssey4me | the most common cause for this is a new checkout, without rebootstrapping ansible | 17:29 |
| cloudnull | and only on one container | 17:29 |
| odyssey4me | ok, sounds like the others didn't update then | 17:30 |
| cloudnull | http://paste.openstack.org/show/626422/ | 17:30 |
| odyssey4me | can you confirm whether the other containers have the updated venvs? | 17:30 |
| cloudnull | that's from armaan's run | 17:30 |
| odyssey4me | so the placement container is missing the venv | 17:30 |
| odyssey4me | the rest have them | 17:31 |
| cloudnull | ++ armaan `ansible -m shell -a 'ls -al /openstack/venvs/' nova_all | 17:31 |
| armaan | roger | 17:31 |
| odyssey4me | that's why the play failed - the task to place the venv there must have failed | 17:31 |
| armaan | ummm nova playbook is still running | 17:31 |
| odyssey4me | the venv tag *always* deploys if the play gets that far: https://github.com/openstack/openstack-ansible-os_nova/blob/stable/newton/tasks/nova_install.yml#L123-L147 | 17:32 |
| odyssey4me | so if the venv tag isn't there, then something broke before then | 17:32 |
| armaan | little bit background here, before this error i encountered two others. First one was related to keystone conatiner and ssl, second was about ceph client and yes i rebootstraped after the changing ceph client hash back to 14.2.8 because 14.2.11 is broken | 17:34 |
| armaan | so after installing keystone, i bootstrapped again so that glance playbook can access to the new ceph-client role | 17:35 |
| *** aruns has joined #openstack-ansible | 17:36 | |
| *** gkadam has quit IRC | 17:37 | |
| odyssey4me | armaan what's broken in 14.2.11 for ceph_client - there are only two extra commits there | 17:39 |
| armaan | odyssey4me: i think i forwarded you the bug report but you were working on something at that time, let me dig it up | 17:40 |
| odyssey4me | regardless, that shouldn't matter | 17:40 |
| odyssey4me | it looks like the api placement container doesn't have the right facts - is that still the case (your playbook was still running) | 17:40 |
| odyssey4me | if not, can you pastebin the whole playbook execution - then check each task against the 14.2.11 task list to see that they all ran | 17:41 |
| armaan | cloudnull: nova playbook passed with no error, here is the output you asked for http://paste.openstack.org/show/626425/ | 17:41 |
| armaan | odyssey4me: Adding the nova key fixed the issue, perhaps | 17:42 |
| odyssey4me | the nova api placement container doesn't have the new venv | 17:42 |
| odyssey4me | that's still an issue | 17:42 |
| armaan | odyssey4me: This is the bug https://bugs.launchpad.net/openstack-ansible/+bug/1727778 and this is the commit in question https://github.com/openstack/openstack-ansible-ceph_client/commit/62ecbd9eb60fe8e3b676a267c2ae84b623fc8bd4 | 17:42 |
| openstack | Launchpad bug 1727778 in openstack-ansible "ceph_client Update apt cache play fails with conditional check error" [Undecided,New] | 17:42 |
| armaan | odyssey4me: ohh, damn | 17:43 |
| odyssey4me | figure out why that's not happening, because that's the root cause | 17:43 |
| armaan | any pointers? | 17:43 |
| odyssey4me | dunno - you have the output | 17:43 |
| odyssey4me | it looks to me like somehow you've done a limit and skipped it | 17:44 |
| odyssey4me | or the play ran against it and failed, then continued | 17:44 |
| cloudnull | yea, curious why the placement api container is not getting the new venv | 17:44 |
| odyssey4me | you'll have to review your logs to figure out why | 17:44 |
| cloudnull | maybe something in the env.d files has changed? | 17:44 |
| odyssey4me | until that is there, the upgrade cannot complete and you're running a mixed version environment | 17:44 |
| * odyssey4me goes back to mucking with zookeeper | 17:45 | |
| armaan | odyssey4me cloudnull -- Ok give me few minutes and i will share the entire playbook run and the env.d file | 17:46 |
| odyssey4me | armaan before doing that, just check to see if that container is in the playbook output | 17:46 |
| odyssey4me | if it is, then check whether a task failed on it | 17:46 |
| odyssey4me | no need for us to do that for you | 17:46 |
| armaan | odyssey4me: alice_nova_api_placement_container-1f12b0c2 : ok=3 changed=1 unreachable=0 failed=0 | 17:47 |
| *** weezS has quit IRC | 17:47 | |
| odyssey4me | armaan that is hopelessly too few task results - I suspect that's one of the later ones, you're looking for the role execution, not the later plays | 17:48 |
| *** shardy has quit IRC | 17:48 | |
| *** bhujay has quit IRC | 17:49 | |
| errr | hi odyssey4me | 17:54 |
| openstackgerrit | Cameron Loader proposed openstack/openstack-ansible master: Make pw-token-gen.py more random https://review.openstack.org/519849 | 17:59 |
| *** pcaruana has quit IRC | 18:11 | |
| *** michelv has quit IRC | 18:16 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix port config in haproxy to avoid conflict https://review.openstack.org/519661 | 18:19 |
| *** chas_ has quit IRC | 18:20 | |
| odyssey4me | errr ohai | 18:24 |
| errr | :) | 18:24 |
| errr | do you have some time to help me get on a path towards success before you leave for the day? | 18:25 |
| odyssey4me | yeah, let me just wrap up with this and I'll be available | 18:30 |
| errr | thanks | 18:30 |
| mhayden | is there a master switch for disabling the rolling upgrades across the board? | 18:34 |
| *** vnogin has quit IRC | 18:36 | |
| odyssey4me | mhayden no | 18:40 |
| odyssey4me | if you're running hyperconverged, you don't really need one | 18:41 |
| armaan | odyssey4me: i just found out from the "history" that someone may have changed the "playbooks/inventory/env.d/nova.yml" and i don't see placement container there. :( | 18:41 |
| odyssey4me | armaan well, that'd be the problem | 18:42 |
| odyssey4me | the placement api is new in ocata though | 18:42 |
| odyssey4me | aren't you running newton? | 18:42 |
| odyssey4me | no placement api in the default: https://github.com/openstack/openstack-ansible/blob/stable/newton/playbooks/inventory/env.d/nova.yml | 18:43 |
| odyssey4me | but is in ocata: https://github.com/openstack/openstack-ansible/blob/stable/ocata/playbooks/inventory/env.d/nova.yml#L57 | 18:43 |
| odyssey4me | so, given that you have a placement api container it would seem that perhaps someone did a checkout to ocata and ran the inventory | 18:44 |
| odyssey4me | then perhaps reverted | 18:44 |
| odyssey4me | but by then the container exists | 18:44 |
| odyssey4me | so you should be able to destroy the container, then remove it from the inventory | 18:44 |
| odyssey4me | apologies - should have thought of that before | 18:45 |
| odyssey4me | armaan ^ | 18:45 |
| *** chas_ has joined #openstack-ansible | 18:46 | |
| odyssey4me | errr taking a break for a bit, then will come back and assist | 18:47 |
| armaan | odyssey4me: wow, i could not have thought about that | 18:47 |
| armaan | checking ... | 18:47 |
| errr | odyssey4me: about how long? a break sounds nice. | 18:47 |
| *** michelv has joined #openstack-ansible | 18:47 | |
| * errr could use some lunch | 18:48 | |
| *** cshen_ has joined #openstack-ansible | 18:52 | |
| *** TxGirlGeek has joined #openstack-ansible | 18:55 | |
| *** TxGirlGeek has joined #openstack-ansible | 18:55 | |
| *** TxGirlGeek has quit IRC | 18:58 | |
| *** TxGirlGeek has joined #openstack-ansible | 18:59 | |
| *** vnogin has joined #openstack-ansible | 18:59 | |
| *** TxGirlGeek has quit IRC | 18:59 | |
| *** TxGirlGeek has joined #openstack-ansible | 19:02 | |
| *** TxGirlGeek has quit IRC | 19:02 | |
| *** TxGirlGeek has joined #openstack-ansible | 19:02 | |
| *** poopcat has joined #openstack-ansible | 19:06 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Improve lint test flexibility https://review.openstack.org/520177 | 19:10 |
| *** albertcard1 has joined #openstack-ansible | 19:11 | |
| *** rodolof has joined #openstack-ansible | 19:12 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use tests repo for all lint tests https://review.openstack.org/520065 | 19:13 |
| *** cshen_ has quit IRC | 19:13 | |
| *** poopcat has quit IRC | 19:14 | |
| *** cshen_ has joined #openstack-ansible | 19:18 | |
| *** Rodrigo_BR has quit IRC | 19:19 | |
| *** weezS has joined #openstack-ansible | 19:22 | |
| *** albertcard1 is now known as poopcat | 19:23 | |
| *** idlemind has quit IRC | 19:24 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use tests repo for all lint tests https://review.openstack.org/520065 | 19:26 |
| *** TxGirlGeek has quit IRC | 19:26 | |
| *** vnogin has quit IRC | 19:26 | |
| *** TxGirlGeek has joined #openstack-ansible | 19:34 | |
| *** michelv has quit IRC | 19:34 | |
| *** TxGirlGeek has quit IRC | 19:43 | |
| *** NeilHanlon has left #openstack-ansible | 19:44 | |
| *** TxGirlGeek has joined #openstack-ansible | 19:44 | |
| *** vnogin has joined #openstack-ansible | 19:45 | |
| openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-ops master: Enable support for hardware that brings the network up slowly https://review.openstack.org/520186 | 19:46 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Improve lint test flexibility https://review.openstack.org/520177 | 19:47 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use tests repo for all lint tests https://review.openstack.org/520065 | 19:50 |
| *** cshen_ has quit IRC | 19:50 | |
| *** vnogin has quit IRC | 19:50 | |
| *** cjloader_ has quit IRC | 19:51 | |
| *** michelv has joined #openstack-ansible | 19:52 | |
| *** TxGirlGeek has quit IRC | 19:53 | |
| *** cjloader_ has joined #openstack-ansible | 19:55 | |
| *** schwicht has joined #openstack-ansible | 19:56 | |
| *** vnogin has joined #openstack-ansible | 19:56 | |
| *** TxGirlGeek has joined #openstack-ansible | 19:59 | |
| *** TxGirlGeek has quit IRC | 20:00 | |
| *** hybridpollo has joined #openstack-ansible | 20:04 | |
| hwoarang | odyssey4me: fwiw chmod is not a problem http://logs.openstack.org/51/507451/15/check/openstack-ansible-deploy-aio-opensuse-423/69a69b1/job-output.txt.gz#_2017-11-15_19_14_25_241073 | 20:05 |
| hwoarang | the script finishes correctly... so it must be a playbook/zuul thing | 20:05 |
| hwoarang | i don't know if we should involve infra on this | 20:05 |
| *** cshen_ has joined #openstack-ansible | 20:06 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use tests repo for all lint tests https://review.openstack.org/520065 | 20:06 |
| *** hybridpolio has joined #openstack-ansible | 20:09 | |
| *** hybridpollo has quit IRC | 20:10 | |
| *** vnogin has quit IRC | 20:10 | |
| *** vnogin has joined #openstack-ansible | 20:11 | |
| *** hybridpolio is now known as hybridpollo | 20:11 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DNM] - Testing zuul exit https://review.openstack.org/507451 | 20:13 |
| *** cjloader_ has quit IRC | 20:26 | |
| *** michelv has quit IRC | 20:26 | |
| *** cjloader_ has joined #openstack-ansible | 20:26 | |
| *** hachi_ has joined #openstack-ansible | 20:30 | |
| *** vnogin has quit IRC | 20:32 | |
| *** weezS_ has joined #openstack-ansible | 20:32 | |
| *** jbadiapa_ has joined #openstack-ansible | 20:33 | |
| *** weezS has quit IRC | 20:33 | |
| *** weezS_ is now known as weezS | 20:33 | |
| *** jbadiapa has quit IRC | 20:36 | |
| *** vnogin has joined #openstack-ansible | 20:36 | |
| *** Smeared_Beard has joined #openstack-ansible | 20:36 | |
| *** SmearedBeard has quit IRC | 20:38 | |
| *** pbandark has quit IRC | 20:38 | |
| *** vnogin has quit IRC | 20:39 | |
| *** armaan has quit IRC | 20:40 | |
| *** michelv has joined #openstack-ansible | 20:50 | |
| *** cjloader_ has quit IRC | 20:51 | |
| odyssey4me | hwoarang that's odd | 20:52 |
| *** cjloader_ has joined #openstack-ansible | 20:54 | |
| *** cjloader_ has quit IRC | 20:55 | |
| *** vnogin has joined #openstack-ansible | 20:55 | |
| *** armaan has joined #openstack-ansible | 20:55 | |
| *** cjloader_ has joined #openstack-ansible | 21:00 | |
| *** hachi_ has quit IRC | 21:00 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DNM] - Testing zuul exit https://review.openstack.org/507451 | 21:00 |
| *** cshen_ has quit IRC | 21:00 | |
| *** TxGirlGeek has joined #openstack-ansible | 21:00 | |
| hwoarang | odyssey4me: yeah i dont know. i am running out of ideas | 21:00 |
| *** Smeared_Beard has quit IRC | 21:02 | |
| *** vnogin has quit IRC | 21:03 | |
| *** SmearedBeard has joined #openstack-ansible | 21:03 | |
| *** TxGirlGeek has quit IRC | 21:04 | |
| *** cshen_ has joined #openstack-ansible | 21:06 | |
| *** aruns__ has joined #openstack-ansible | 21:11 | |
| *** cshen_ has quit IRC | 21:12 | |
| *** smatzek has quit IRC | 21:12 | |
| *** aruns has quit IRC | 21:13 | |
| *** indistylo has joined #openstack-ansible | 21:15 | |
| *** aruns__ has quit IRC | 21:16 | |
| *** michelv has quit IRC | 21:24 | |
| *** armaan has quit IRC | 21:31 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/pike: Add allocation pool for octavia mgmt subnet https://review.openstack.org/520100 | 21:31 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DNM] - Testing zuul exit https://review.openstack.org/507451 | 21:31 |
| *** threestrands has joined #openstack-ansible | 21:32 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/pike: Fix mgmt network creation tasks https://review.openstack.org/520102 | 21:32 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/pike: add segmentation id option to octavia mgmt network creation task https://review.openstack.org/520099 | 21:32 |
| *** vnogin has joined #openstack-ansible | 21:34 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/pike: IMAGES_ALLOW_LOCATION Wrongly Templated As String https://review.openstack.org/516751 | 21:34 |
| *** vnogin has quit IRC | 21:39 | |
| *** SmearedBeard has quit IRC | 21:44 | |
| *** Smeared_Beard has joined #openstack-ansible | 21:46 | |
| *** savvas_ has quit IRC | 21:51 | |
| *** vnogin has joined #openstack-ansible | 21:52 | |
| *** savvas has joined #openstack-ansible | 21:52 | |
| *** acormier_ has quit IRC | 21:53 | |
| *** acormier has joined #openstack-ansible | 21:54 | |
| *** vnogin has quit IRC | 21:57 | |
| *** acormier has quit IRC | 21:58 | |
| *** michelv has joined #openstack-ansible | 21:58 | |
| *** smatzek has joined #openstack-ansible | 22:00 | |
| *** smatzek has quit IRC | 22:04 | |
| *** pbandark has joined #openstack-ansible | 22:04 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DNM] - Testing zuul exit https://review.openstack.org/507451 | 22:05 |
| *** weezS has quit IRC | 22:06 | |
| *** pbandark has quit IRC | 22:09 | |
| *** pbandark has joined #openstack-ansible | 22:09 | |
| *** rodolof has quit IRC | 22:11 | |
| *** snowman4839 has joined #openstack-ansible | 22:12 | |
| *** indistylo has quit IRC | 22:17 | |
| *** jwitko__ has joined #openstack-ansible | 22:22 | |
| *** jwitko has quit IRC | 22:25 | |
| *** jwitko__ has quit IRC | 22:27 | |
| *** michelv has quit IRC | 22:32 | |
| *** rcarrillocruz has quit IRC | 22:34 | |
| *** esberglu has quit IRC | 22:36 | |
| *** esberglu has joined #openstack-ansible | 22:37 | |
| *** esberglu has quit IRC | 22:41 | |
| *** rcarrillocruz has joined #openstack-ansible | 22:41 | |
| *** jwitko has joined #openstack-ansible | 22:51 | |
| *** vnogin has joined #openstack-ansible | 22:56 | |
| *** idlemind has joined #openstack-ansible | 22:57 | |
| *** phalmos has quit IRC | 22:59 | |
| *** vnogin has quit IRC | 23:01 | |
| *** chas_ has quit IRC | 23:01 | |
| *** chas_ has joined #openstack-ansible | 23:03 | |
| *** schwicht has quit IRC | 23:07 | |
| *** chas_ has quit IRC | 23:08 | |
| *** galstrom is now known as galstrom_zzz | 23:09 | |
| *** dave-mccowan has quit IRC | 23:19 | |
| *** gouthamr has quit IRC | 23:28 | |
| *** masber has joined #openstack-ansible | 23:30 | |
| *** esberglu has joined #openstack-ansible | 23:32 | |
| *** ianychoi has quit IRC | 23:37 | |
| *** cjloader_ has quit IRC | 23:43 | |
| *** vnogin has joined #openstack-ansible | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!