Tuesday, 2016-09-13

*** itsuugo has joined #openstack-ansible00:00
*** AnarchyAo has quit IRC00:09
*** johnmilton has joined #openstack-ansible00:11
*** johnmilton has quit IRC00:16
*** johnmilton has joined #openstack-ansible00:17
openstackgerritSteve Lewis (stevelle) proposed openstack/openstack-ansible: Configure Ceilometer middleware for Gnocchi-Swift  https://review.openstack.org/36627900:18
*** thorst_ has joined #openstack-ansible00:20
prometheanfiresooooo many timeouts00:23
stevelleikr00:23
*** itsuugo has quit IRC00:24
*** itsuugo has joined #openstack-ansible00:26
*** thorst_ has quit IRC00:28
*** Jeffrey4l has quit IRC00:33
*** smatzek_ has joined #openstack-ansible00:34
openstackgerritSteve Lewis (stevelle) proposed openstack/openstack-ansible: Configure Ceilometer middleware for Gnocchi-Swift  https://review.openstack.org/36627900:39
openstackgerritSteve Lewis (stevelle) proposed openstack/openstack-ansible: Gnocchi identities created before Swift playbook  https://review.openstack.org/36693100:39
*** itsuugo has quit IRC00:40
*** itsuugo has joined #openstack-ansible00:42
*** Jeffrey4l has joined #openstack-ansible00:47
*** itsuugo has quit IRC00:48
*** itsuugo has joined #openstack-ansible00:49
hughmFLEXinquick question, are changes to the user_config yml stored somewhere? They don't seem to be reflected on re-runs00:54
MatiashughmFLEXin: some settings are copied to the inventory00:56
MatiashughmFLEXin: try to look at openstack_inventory.json00:57
*** itsuugo has quit IRC00:59
hughmFLEXinyup...00:59
hughmFLEXinMatias: so can i just delete this file00:59
hughmFLEXinand it'll regenerate new info from the config01:00
MatiashughmFLEXin: not really01:00
Matiasyou will loose info about which ip addr each container has01:00
Matiasand also the random letters at the end of the container names01:00
Matiasso, edit the file, but never delete it01:00
Matiasand keep a backup01:00
*** itsuugo has joined #openstack-ansible01:00
hughmFLEXini want to modify the container interface and redeploy the lxcs01:01
hughmFLEXini made a dumb mistake by thinking that container interface are one and same correlation to host vlan interface, which is why i think im having issues deploying01:01
MatiashughmFLEXin: then first run lxc-containers-destroy.yml01:02
MatiashughmFLEXin: make sure all containers are destroyed, only then you may delete the inventory file01:02
hughmFLEXinyup thanks01:02
Matiasotherwise you would need to destroy them by yourself.. it is not so hard, but it is inconvenient anyway01:03
hughmFLEXinis there a clean up play for the hosts themselves? All the virtual interfaces that get created and such?01:04
*** fishcried has quit IRC01:04
Matiasvirtual interfaces should be cleaned up when the containers are destroyed01:05
hughmFLEXinah sweet ok01:05
Matiaswhen I want to make sure I'm starting on clean slate, I call IPMI, switch to PXE and reinstall everything using cobbler01:05
hughmFLEXini figured01:06
Matiashowever destroying the containers should be enough on most cases01:06
*** schwicht has quit IRC01:08
Matiascloudnull: i sent some comments to your PR, if you include the mods i proposed it seems to be working neatly01:09
*** pmannidi has joined #openstack-ansible01:13
*** michauds has joined #openstack-ansible01:18
hughmFLEXinMatias: muahah it workedddd01:22
openstackgerritMerged openstack/openstack-ansible: Enable the opportunistic strategy  https://review.openstack.org/34948501:22
*** schwicht has joined #openstack-ansible01:22
hughmFLEXincloudnull:01:22
MatiashughmFLEXin: nice01:22
Matiasi'm out to get some sleep, good evening all01:22
hughmFLEXingnite!01:22
*** itsuugo has quit IRC01:25
*** itsuugo has joined #openstack-ansible01:25
*** thorst_ has joined #openstack-ansible01:26
*** schwicht has quit IRC01:28
*** hughmFLEXin has quit IRC01:32
*** thorst_ has quit IRC01:33
*** hughmFLEXin has joined #openstack-ansible01:34
*** itsuugo has quit IRC01:34
*** itsuugo has joined #openstack-ansible01:36
*** schwicht has joined #openstack-ansible01:37
*** itsuugo has quit IRC01:41
*** itsuugo has joined #openstack-ansible01:42
*** smatzek_ has quit IRC01:46
*** v1k0d3n has quit IRC01:47
*** v1k0d3n has joined #openstack-ansible01:47
*** itsuugo has quit IRC01:50
*** v1k0d3n has quit IRC01:51
*** v1k0d3n has joined #openstack-ansible01:51
*** itsuugo has joined #openstack-ansible01:51
*** weezS has joined #openstack-ansible01:58
*** itsuugo has quit IRC01:58
*** v1k0d3n has quit IRC01:59
*** itsuugo has joined #openstack-ansible02:00
*** v1k0d3n has joined #openstack-ansible02:00
*** schwicht has quit IRC02:02
prometheanfirerecheckrecheckrecheck02:02
*** schwicht has joined #openstack-ansible02:05
*** itsuugo has quit IRC02:09
*** itsuugo has joined #openstack-ansible02:10
*** thorst_ has joined #openstack-ansible02:10
*** schwicht has quit IRC02:11
*** gouthamr has quit IRC02:15
*** itsuugo has quit IRC02:15
*** itsuugo has joined #openstack-ansible02:17
openstackgerritNeill Cox proposed openstack/openstack-ansible-pip_install: Make pip_install honour pip_install_options  https://review.openstack.org/36912102:19
*** itsuugo has quit IRC02:21
*** itsuugo has joined #openstack-ansible02:22
*** itsuugo has quit IRC02:27
*** itsuugo has joined #openstack-ansible02:28
*** spedione|AWAY is now known as spedione02:29
*** spedione is now known as spedione|AWAY02:31
*** itsuugo has quit IRC02:34
*** itsuugo has joined #openstack-ansible02:37
*** psilvad has quit IRC02:47
*** itsuugo has quit IRC02:50
*** itsuugo has joined #openstack-ansible02:51
*** pmannidi has quit IRC03:19
*** itsuugo has quit IRC03:20
*** itsuugo has joined #openstack-ansible03:22
*** itsuugo has quit IRC03:29
*** markvoelker has quit IRC03:30
*** sdake has joined #openstack-ansible03:31
*** itsuugo has joined #openstack-ansible03:31
*** thorst_ has quit IRC03:41
*** thorst_ has joined #openstack-ansible03:53
*** fxpester has joined #openstack-ansible03:55
*** fxpester has quit IRC03:55
*** michauds has quit IRC03:56
*** poopcat has quit IRC03:59
*** itsuugo has quit IRC04:01
*** itsuugo has joined #openstack-ansible04:02
*** pmannidi has joined #openstack-ansible04:04
*** jamielennox is now known as jamielennox|away04:05
*** schwicht has joined #openstack-ansible04:05
*** jamielennox|away is now known as jamielennox04:08
*** itsuugo has quit IRC04:11
*** itsuugo has joined #openstack-ansible04:12
*** itsuugo has quit IRC04:16
*** itsuugo has joined #openstack-ansible04:17
*** itsuugo has quit IRC04:22
*** itsuugo has joined #openstack-ansible04:24
*** itsuugo has quit IRC04:31
*** itsuugo has joined #openstack-ansible04:32
*** Fenuks has joined #openstack-ansible04:33
*** itsuugo has quit IRC04:36
*** itsuugo has joined #openstack-ansible04:37
*** jamielennox is now known as jamielennox|away04:41
*** itsuugo has quit IRC04:42
*** itsuugo has joined #openstack-ansible04:43
*** jamielennox|away is now known as jamielennox04:46
*** itsuugo has quit IRC04:48
*** itsuugo has joined #openstack-ansible04:49
*** chhavi has joined #openstack-ansible04:52
*** itsuugo has quit IRC04:53
*** itsuugo has joined #openstack-ansible04:55
*** Jeffrey4l_ has joined #openstack-ansible05:00
*** weezS has quit IRC05:02
*** Jeffrey4l has quit IRC05:04
*** itsuugo has quit IRC05:06
*** itsuugo has joined #openstack-ansible05:06
*** sdake_ has joined #openstack-ansible05:10
*** itsuugo has quit IRC05:11
*** sdake has quit IRC05:12
*** itsuugo has joined #openstack-ansible05:12
*** itsuugo has quit IRC05:17
*** itsuugo has joined #openstack-ansible05:17
*** thorst_ has quit IRC05:23
*** itsuugo has quit IRC05:24
*** itsuugo has joined #openstack-ansible05:25
*** thorst_ has joined #openstack-ansible05:29
*** markvoelker has joined #openstack-ansible05:30
*** itsuugo has quit IRC05:30
*** itsuugo has joined #openstack-ansible05:31
*** markvoelker has quit IRC05:35
*** itsuugo has quit IRC05:36
*** itsuugo has joined #openstack-ansible05:36
*** itsuugo has quit IRC05:44
*** itsuugo has joined #openstack-ansible05:46
*** chhavi has quit IRC05:48
*** janki has joined #openstack-ansible05:51
*** chhavi has joined #openstack-ansible05:52
*** jamielennox is now known as jamielennox|away05:53
*** itsuugo has quit IRC05:54
*** itsuugo has joined #openstack-ansible05:54
*** itsuugo has quit IRC05:59
*** jamielennox|away is now known as jamielennox06:00
*** itsuugo has joined #openstack-ansible06:00
*** itsuugo has quit IRC06:12
*** jamielennox is now known as jamielennox|away06:13
*** itsuugo has joined #openstack-ansible06:13
*** itsuugo has quit IRC06:18
*** itsuugo has joined #openstack-ansible06:19
*** itsuugo has quit IRC06:24
*** itsuugo has joined #openstack-ansible06:25
*** jamielennox|away is now known as jamielennox06:30
*** fxpester has joined #openstack-ansible06:33
*** itsuugo has quit IRC06:36
*** itsuugo has joined #openstack-ansible06:37
*** itsuugo has quit IRC06:49
*** itsuugo has joined #openstack-ansible06:50
openstackgerritMerged openstack/openstack-ansible: Make the file name for user_secrets a variable  https://review.openstack.org/36815606:52
*** berendt has joined #openstack-ansible06:53
*** thorst_ has quit IRC06:58
*** thorst_ has joined #openstack-ansible06:59
*** pcaruana has joined #openstack-ansible07:02
*** oben has joined #openstack-ansible07:03
obenhi. how do we rebuild a failed infrastructure node? thanks!07:07
*** thorst_ has quit IRC07:07
*** yarkot has quit IRC07:11
*** shasha_tavil has quit IRC07:11
*** nishpatwa_ has quit IRC07:11
*** jascott1 has quit IRC07:11
*** smurke has quit IRC07:11
*** drifterza has joined #openstack-ansible07:12
*** jascott1 has joined #openstack-ansible07:14
*** mpotdar has joined #openstack-ansible07:17
*** thorst_ has joined #openstack-ansible07:18
*** sdake has joined #openstack-ansible07:19
*** sdake_ has quit IRC07:20
*** thorst_ has quit IRC07:22
*** shasha_tavil has joined #openstack-ansible07:27
*** thorst_ has joined #openstack-ansible07:29
*** markvoelker has joined #openstack-ansible07:31
*** thorst_ has quit IRC07:34
*** markvoelker has quit IRC07:36
*** itsuugo has quit IRC07:37
*** rgogunskiy has joined #openstack-ansible07:38
*** itsuugo has joined #openstack-ansible07:39
*** karimb has joined #openstack-ansible07:40
*** oben has quit IRC07:43
*** dragonmaster has joined #openstack-ansible07:45
*** itsuugo has quit IRC07:45
*** itsuugo has joined #openstack-ansible07:47
*** pmannidi has quit IRC07:48
*** openstackgerrit has quit IRC07:48
*** openstackgerrit has joined #openstack-ansible07:49
*** thorst_ has joined #openstack-ansible07:51
*** itsuugo has quit IRC07:56
*** itsuugo has joined #openstack-ansible07:57
*** chhavi has quit IRC08:00
*** itsuugo has quit IRC08:02
*** itsuugo has joined #openstack-ansible08:03
*** sdake has quit IRC08:10
*** itsuugo has quit IRC08:10
drifterzahello lall08:11
drifterza*all08:11
*** itsuugo has joined #openstack-ansible08:12
*** oben has joined #openstack-ansible08:19
*** electrofelix has joined #openstack-ansible08:22
*** karimb has quit IRC08:28
*** chhavi has joined #openstack-ansible08:29
*** thorst_ has quit IRC08:30
*** thorst_ has joined #openstack-ansible08:34
*** hblah has quit IRC08:35
*** asettle has joined #openstack-ansible08:36
*** dragonmaster has quit IRC08:42
*** dragonmaster has joined #openstack-ansible08:45
*** rgogunskiy has quit IRC08:52
*** itsuugo has quit IRC08:53
*** itsuugo has joined #openstack-ansible08:54
*** itsuugo has quit IRC08:59
*** oben has quit IRC08:59
*** dragonmaster has quit IRC08:59
*** itsuugo has joined #openstack-ansible09:00
*** dragonmaster has joined #openstack-ansible09:00
*** rgogunskiy has joined #openstack-ansible09:02
*** rgogunskiy has quit IRC09:14
*** karimb has joined #openstack-ansible09:15
*** asettle has quit IRC09:21
*** asettle has joined #openstack-ansible09:21
openstackgerritMerged openstack/openstack-ansible-ceph_client: fix basic support to pass centos install  https://review.openstack.org/36900409:24
*** markvoelker has joined #openstack-ansible09:25
*** asettle has quit IRC09:25
openstackgerritMerged openstack/openstack-ansible-os_zaqar: Ansible 2.1.1 role testing  https://review.openstack.org/35361709:27
*** asettle has joined #openstack-ansible09:27
*** markvoelker has quit IRC09:29
openstackgerritMerged openstack/openstack-ansible-os_swift: Filter Gnocchi traffic optionally  https://review.openstack.org/36627809:29
*** rgogunskiy has joined #openstack-ansible09:37
vnoginmorning guys )09:39
openstackgerritMerged openstack/openstack-ansible-os_keystone: Ansible 2.1.1 role testing  https://review.openstack.org/35360609:39
openstackgerritMerged openstack/openstack-ansible-tests: Remove unused hostname var from test playbooks  https://review.openstack.org/36882909:42
*** itsuugo has quit IRC09:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ceph_client: Add missing meta information  https://review.openstack.org/36929709:46
*** itsuugo has joined #openstack-ansible09:47
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_cinder: Correctly namespace the storage_address variable  https://review.openstack.org/36865409:49
odyssey4meandymccr all you would have had to do on that review is re-activate workflow09:51
odyssey4meI usually just add my +W to it, and gerrit picks it up.09:51
andymccrodyssey4me: ahh good to know. ive had a few where the depends-on seems to block it even with a recheck etc.09:51
openstackgerritMerged openstack/openstack-ansible-galera_server: Ansible 2.1.1 role testing  https://review.openstack.org/35441109:51
odyssey4mea recheck will do it too, unless the dependent patch has been backported and the backport has not yet merged09:51
odyssey4mebut a recheck will execute a full check again, which isn't great09:52
odyssey4meeasiest is simply to add +w, or if you had it there already then remove it and add it again09:52
odyssey4meevrardjp andymccr a quick review of https://review.openstack.org/369297 would be nice to get it done09:53
openstackgerritMerged openstack/openstack-ansible-os_cinder: Correctly namespace the storage_address variable  https://review.openstack.org/36865409:55
openstackgerritMerged openstack/openstack-ansible-os_nova: Nova role should not default vars outside the nova namespace  https://review.openstack.org/36688109:58
openstackgerritMerged openstack/openstack-ansible-security: [Docs] Metadata cleanup  https://review.openstack.org/36895710:01
*** thorst_ has quit IRC10:03
*** thorst_ has joined #openstack-ansible10:06
*** itsuugo has quit IRC10:06
*** itsuugo has joined #openstack-ansible10:08
*** thorst_ has quit IRC10:10
*** permalac has joined #openstack-ansible10:17
*** johnmilton has quit IRC10:18
*** chhavi has quit IRC10:22
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible: [Docs] Add explanations about our bug triage process  https://review.openstack.org/36905310:24
evrardjpodyssey4me: ok10:25
evrardjpwell that was an easy one10:26
evrardjpthe lack of the two spaces after dependencies bothers me, but it's yaml, it works.10:27
evrardjp:p10:27
evrardjphttps://review.openstack.org/#/c/369297/1/meta/main.yml10:28
openstackgerritMerged openstack/openstack-ansible-ceph_client: Add missing meta information  https://review.openstack.org/36929710:28
*** janki has quit IRC10:30
*** chhavi has joined #openstack-ansible10:39
*** smatzek_ has joined #openstack-ansible10:41
*** rgogunskiy has quit IRC10:42
*** itsuugo has quit IRC10:43
*** itsuugo has joined #openstack-ansible10:44
*** gouthamr_ has joined #openstack-ansible10:46
*** spotz_zzz is now known as spotz10:49
*** permalac has quit IRC10:51
*** thorst_ has joined #openstack-ansible10:53
*** rgogunskiy has joined #openstack-ansible10:55
*** rgogunskiy has quit IRC10:56
Matiasmorning10:57
Matiashi drifterza, did you have a chance to test master?10:57
*** thorst_ has quit IRC10:58
*** itsuugo has quit IRC10:58
drifterzaI haven't yet sorry man :/10:59
*** itsuugo has joined #openstack-ansible10:59
*** thorst_ has joined #openstack-ansible10:59
drifterzaits on my todo list.10:59
*** thorst_ has quit IRC11:04
git-harryYup. I've raised this with Darren more than once, my interpretation of what he tells me is that he's happy with what his reports are doing. I don't think either of those you mention are 100% on upgrades. Not displaying upstream work on the board severely undermines what introducing Kanban has been attempting to do.11:08
*** itsuugo has quit IRC11:09
git-harryWhoops :P11:09
*** itsuugo has joined #openstack-ansible11:09
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Add check for swift_hash_path_ variables  https://review.openstack.org/36935311:15
*** schwicht has joined #openstack-ansible11:16
*** spotz is now known as spotz_zzz11:16
*** itsuugo has quit IRC11:22
*** itsuugo has joined #openstack-ansible11:23
*** gouthamr_ has quit IRC11:25
*** markvoelker has joined #openstack-ansible11:25
*** kylek3h has quit IRC11:27
*** chhavi has quit IRC11:29
*** markvoelker has quit IRC11:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Compress test execution logs  https://review.openstack.org/36788611:30
*** schwicht has quit IRC11:32
*** chhavi has joined #openstack-ansible11:33
*** thorst_ has joined #openstack-ansible11:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Add specific support for automatic compute RPC pinning  https://review.openstack.org/36775211:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova: Implement placement AUTH/DB  https://review.openstack.org/36774911:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests: Added role requirements file to the tests repo  https://review.openstack.org/36234911:37
*** thorst_ has quit IRC11:38
odyssey4meandymccr evrardjp would you be able to quickly review https://review.openstack.org/367864 ?11:40
odyssey4mecloudnull it'd be great if you could revisit https://review.openstack.org/36302211:40
*** thorst_ has joined #openstack-ansible11:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515511:41
*** Attilla has joined #openstack-ansible11:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum: Add basic functional tests to role  https://review.openstack.org/35515511:42
Attilla<Attilla> Morning. I keep running into an issue when trying to deploy Openstack-Ansible in a lab environment. I can reproduce the issue, but I'm unable to find anyone that has the same issue. Since moest of the Ansible code was provided by Rackspace, I was wondering if someone here could shed some light on it.11:43
Attillahttps://gist.github.com/anonymous/82c187dd45918b954bc39f1bda82a4af11:43
*** Fenuks has quit IRC11:43
AttillaI keep running into the same keystone authorisation failure, but it is unclear to me why this is happening.11:43
AttillaI was referred to this channel, so I copy pasted my question ;-)11:46
*** Fenuks has joined #openstack-ansible11:47
*** itsuugo has quit IRC11:48
*** itsuugo has joined #openstack-ansible11:49
*** retreved has joined #openstack-ansible11:50
*** kylek3h has joined #openstack-ansible11:52
odyssey4meandymccr it seems that the multi-region tests are working alright - are you keen on moving it to voting?11:52
*** asettle has quit IRC11:53
*** kylek3h has quit IRC11:54
*** asettle has joined #openstack-ansible11:54
*** kylek3h has joined #openstack-ansible11:54
*** afred312 has quit IRC11:54
*** asettle has quit IRC11:58
*** asettle has joined #openstack-ansible11:58
andymccrodyssey4me: sure - lets do it, if we run into failures for timeouts we can look at implementing some of the issues on that11:59
*** itsuugo has quit IRC11:59
*** itsuugo has joined #openstack-ansible12:00
odyssey4meAttilla it would appear that the auth is failing for Keystone - do you have an existing keystone, or multiple keystone domains? what version of OSA are you setting up?12:02
*** Fenuks has quit IRC12:06
*** schwicht has joined #openstack-ansible12:07
*** psilvad has joined #openstack-ansible12:10
*** markvoelker has joined #openstack-ansible12:11
*** psilvad has quit IRC12:15
*** schwicht has quit IRC12:17
odyssey4meandymccr https://review.openstack.org/362349 needs a revisit, CentOS is passing12:17
*** askb has quit IRC12:18
*** schwicht has joined #openstack-ansible12:19
*** psilvad has joined #openstack-ansible12:20
*** psilvad has quit IRC12:25
Attillaodyssey4me: I just followed the guide and setting up 1.3.2.012:26
odyssey4meAttilla there is no such version - please check the tag again?12:26
andymccrodyssey4me: looking now.12:26
Attillaodyssey4me: sorry 13.2.0 :-)12:26
odyssey4meAttilla could you perhaps share your openstack_user_config and user_variables.yml file via pastebin or something?12:26
Attillasure, one moment12:27
*** dmellado is now known as dmellado|lunch12:27
*** dmellado|lunch is now known as dmellado12:27
*** psilvad has joined #openstack-ansible12:28
Attillaodyssey4me: It is a pretty basic config I guess12:29
Attillahttps://gist.github.com/anonymous/606b08baf82ccb930591503c7d78f2e312:29
AttillaAnd I'm pretty new to the Openstack details, so I wouldn't even know if I have multiple keystond domains. But I guess it would be just 112:30
odyssey4meAttilla the lines below line 97, are those from /etc/openstack_deploy/user_variables.yml ?12:31
Attillaodyssey4me: yes, I put them in the same gist12:32
odyssey4meAttilla also, you've set internal_lb_vip_address: 172.30.10.10 - is that address bound onto infra1?12:32
*** hughmFLEXin has quit IRC12:32
AttillaIt is and reachable from all hosts12:33
*** dragonmaster has quit IRC12:33
*** permalac has joined #openstack-ansible12:33
*** retreved has quit IRC12:33
*** fxpester has quit IRC12:33
odyssey4mealright, you'll need to also set external_lb_vip_address to be an address which will serve the public endpoints12:33
mhaydenhappy tuesday12:33
*** hughmFLEXin has joined #openstack-ansible12:33
odyssey4meeither a DNS name which is resolvable, or a DNS address which can be reached by the clients you'll be serving12:33
odyssey4meAttilla also note that the default affinity is 1, so you don't need to set all those affinities12:35
Attillaodyssey4me: I just copied that from the aio config12:35
AttillaSo I need to add that in the user_variables?12:36
odyssey4meAttilla yep, the AIO is a very special case deployment12:36
odyssey4menope - those need to be in your openstack_user_config12:36
*** chhavi has quit IRC12:38
*** johnmilton has joined #openstack-ansible12:39
*** itsuugo has quit IRC12:42
*** itsuugo has joined #openstack-ansible12:43
*** schwicht has quit IRC12:46
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Compress test execution logs  https://review.openstack.org/36786412:48
*** woodard has joined #openstack-ansible12:49
*** woodard has quit IRC12:51
*** woodard has joined #openstack-ansible12:51
*** klamath has joined #openstack-ansible12:53
*** klamath has quit IRC12:53
evrardjppalendae: are you there?12:53
*** klamath has joined #openstack-ansible12:53
evrardjpwhat do you think of this?12:53
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/143704512:53
openstackLaunchpad bug 1437045 in openstack-ansible "Extend repo vars documentation" [Wishlist,Triaged] - Assigned to Nolan Brubaker (nolan-brubaker)12:54
*** Jeffrey4l_ has quit IRC12:55
*** berendt has quit IRC12:55
*** Jeffrey4l_ has joined #openstack-ansible12:57
*** kstev has joined #openstack-ansible12:58
*** schwicht has joined #openstack-ansible13:04
*** sdake_ has joined #openstack-ansible13:04
*** sdake_ is now known as sdake13:10
*** klamath has quit IRC13:11
*** klamath has joined #openstack-ansible13:11
*** kjw3 has quit IRC13:14
Matiasdrifterza: are you deploying ceilometer with HA?13:15
MatiasI suspect the unstability might be related to HA13:15
Matiasthe ceilometer-pipe-meter_source:meter_sink-*.sample queues have no consumers13:15
MatiasI suspect it is not being able to coordinate and assign the correct numbers (where I put the *) to each collector node13:16
Matiasstevelle: are you on? do you have some light to shed on this? are the ceilometer-pipe-meter_source:meter_sink-*.sample queues supposed to be consumed by the collector?13:17
*** jheroux has joined #openstack-ansible13:18
odyssey4meMatias automagically may also be able to assist when he's on13:18
Matiasodyssey4me: thanks :D13:19
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Add check for swift_hash_path_ variables  https://review.openstack.org/36935313:20
*** catlook has joined #openstack-ansible13:21
catlookJesse are you around?13:21
catlookodyssey4me?13:22
odyssey4mecatlook yes?13:22
catlookhaving trouble with last step of your prep instructsion for ansible install guide test13:23
openstackgerritMerged openstack/openstack-ansible-tests: Added role requirements file to the tests repo  https://review.openstack.org/36234913:24
catlooki created boostrap-hosts.yml and inventory.ini files in teh tests directory, inout my hosts, set full permissions on both filesand run the following command:13:24
odyssey4mecatlook if you read the intructions you'll notice that I asked for those files to be created in the home directory, not the tests directory - then you execute them from the tests directory13:25
catlookroot@infra1:/opt/openstack-ansible/tests# ansible-playbook -i /opt/openstack-ansible/tests/inventory.ini /opt/openstack-ansible/tests/bootstrap-hosts.yml ERROR! the playbook: /opt/openstack-ansible/tests/bootstrap-hosts.yml could not be found13:25
odyssey4methe file location is specificially stated as ~/<filename>13:25
catlooki never saw where to put them..i'll try that.  thanks13:25
odyssey4methen the execution references the home directory again13:25
catlookright...i changed the execution and full pathed...obviously i failed to read the manual!! bad cat!!13:26
catlookStill can't find it :(13:27
catlookroot@infra1:/opt/openstack-ansible/tests# ansible-playbook -i ~/inventory.ini ~/bootstrap-hosts.yml13:28
catlookERROR! the playbook: /root/bootstrap-hosts.yml could not be found13:28
*** catlook has quit IRC13:28
*** catlook has joined #openstack-ansible13:29
catlookok...i put them in root...what should home dir be?13:29
odyssey4mecatlook did you actually create the playbook?13:30
odyssey4mecatlook if you're running as root, which you should be, that's where they should be13:30
catlookI follwed all the uncommented lines in your setup procedure13:30
odyssey4mecatlook look below the setup procedure and you'll see the playbook and inventory: https://gist.github.com/odyssey4me/863e84a0f6271712c6d48980cffb958d13:31
catlookso i hope so...i'm new to ansible though, so i could easily have mussed something...sorry to be a pain13:31
*** TxGirlGeek has joined #openstack-ansible13:31
catlooki ran bootstrap-ansible.sh13:31
catlookdoes that do it?13:31
*** smatzek_ has quit IRC13:32
odyssey4mecatlook nope13:33
odyssey4meI've updated the instructions to try to be more clear.13:33
odyssey4methis is the part you're missing: https://gist.github.com/odyssey4me/863e84a0f6271712c6d48980cffb958d#file-0-setup-procedure-sh-L55-L6313:33
catlookthx..i'll try it out13:37
*** kjw3 has joined #openstack-ansible13:37
*** jperry has joined #openstack-ansible13:37
catlookeven after i moved the two files to root, and executed ansible-playbook -i ~/inventory.ini ~/bootstrap-hosts.yml from tests dir, it still can't find the file.  Do you have time to join me on vidyo.?  might be easier if you can see what i have, JESSE.13:40
catlookdang caps.13:40
odyssey4mecatlook do those files exist in the home directory?13:41
odyssey4mecan you pastebin/gist the contents of them?13:41
catlookyes and updated with my server ips13:42
*** catlook has quit IRC13:42
*** hughmFLEXin has quit IRC13:42
odyssey4meand can you pastebin/gist a full log of what you're executing on your screen and what the output is13:42
*** gouthamr has joined #openstack-ansible13:43
*** catlook has joined #openstack-ansible13:43
catlookmy client keeps kicking me out...sorry... yes files are in root, copied from you gist and updated with my servers13:43
odyssey4mecatlook are the file names correct?13:44
catlookyes13:44
catlook-rwxrwxrwx  1 root root  243 Sep 12 18:04 boostrap-hosts.yml*13:44
catlook-rwxrwxrwx  1 root root  192 Sep 12 18:08 inventory.ini*13:44
catlookcat inventory.ini13:44
odyssey4meplease use pastebin, or gist - don't paste stuff into IRC13:44
catlookthe asterix at end is not part of name13:45
catlookwow...let me google patebin..never heard of it13:45
odyssey4mehttp://pastebin.com/13:45
odyssey4meor http://paste.openstack.org/13:45
catlookso, yes...names are correct and in root13:45
catlookthanks, looking at pastebin now13:46
odyssey4meok, then if you execute 'ansible-playbook --version' does it work?13:46
catlookone moment13:46
catlooksays 2.1.1.013:47
catlookconfig file is blank13:48
catlooksearch path is default without overrides13:48
*** KLevenstein has joined #openstack-ansible13:51
catlookhere is paste of version: http://paste.openstack.org/show/573612/13:51
odyssey4meok, so ansible is installed correctly then13:52
catlookwhew...one thing good13:53
odyssey4meso execute the bootstrap-host playbook and pastebin the full output13:53
catlookaye aye13:53
Attillaodyssey4me: What would be the best way to test my keystone manually? BEcause the ansible module is unclear to me how to repeat that and debug it more.13:55
catlookhere is listing of root dir and execution of playbook: http://paste.openstack.org/show/573616/13:55
odyssey4meAttilla heat is executed after cinder and a bunch of other things, so it would seem that those have worked fine... but this is the first user that's being registered and added to a domain13:55
Attillaodyssey4me: exactly, but is there are a way to do it manually?13:56
Attillato verify it13:56
odyssey4meAttilla You can set 'debug:true' in user_variables.yml, re-execute the os-keystone-install.yml to ensure that keystone debug logging is enabled, then tail the logs to see whether you can spot the incoming API requests and what happens to them.13:57
AttillaBasically doing the tasks in /etc/ansible/roles/os_heat/tasks/heat_domain_setup.yml13:57
odyssey4meAttilla have you verified that haproxy is running?13:57
*** sdake has quit IRC13:58
Attillaodyssey4me: I haven't but it should, because it is also the repo server. Otherwise it couldn't even install other things.13:58
odyssey4meAttilla yes, you can execute the utility setup playbook and it'll setup the utility container with all the clients - then use the openstack client to try and do the same thing13:58
Attillaok, I'll have a look at that13:59
Attillathanks13:59
*** smatzek_ has joined #openstack-ansible13:59
*** karimb has quit IRC14:00
*** hughmFLEXin has joined #openstack-ansible14:01
*** karimb has joined #openstack-ansible14:03
catlookAny other suggestions for me?14:04
catlooki gave both files full permissions, is that ok?14:05
*** ametts has joined #openstack-ansible14:07
*** jperry has quit IRC14:11
*** jperry has joined #openstack-ansible14:12
*** sdake has joined #openstack-ansible14:12
openstackgerritMerged openstack/openstack-ansible-security: [Docs] Update configuration/controls docs  https://review.openstack.org/36902514:12
drifterzaodyssey4me, you around dude ?14:12
automagicallymorning all14:13
drifterzahi automagically14:13
automagicallyo/ drifterza14:13
*** michaelgugino has joined #openstack-ansible14:13
drifterzaSo my prometheus server/agent roles are done for now. They work pretty neat with OSA14:13
drifterzathat with grafana=bliss so far14:14
*** berendt has joined #openstack-ansible14:15
odyssey4medrifterza sounds awesome :) are you going to put them up onto ansible galaxy and put up a review for playbooks here?14:15
drifterzaalready done the ansible galaxy roles14:15
odyssey4mebrilliant14:15
drifterzaI would definitely love a review on the plays.14:16
odyssey4mewe'll have to hold off merging it until we have released newton, but you can put up a review meanwhile if you like14:16
drifterzaprometheus is graphing haproxy,mysqld and nodes in general14:16
drifterzathe haproxy and mysqld stuff is awesome14:17
*** dragonmaster has joined #openstack-ansible14:17
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-tests: Ansible 2.1.1 role testing  https://review.openstack.org/36903814:17
drifterzawhere can I put the review up ?14:17
automagicallysounds great drifterza14:17
automagicallyI’ve used Prometheus in the past and its pretty slick14:17
drifterzaautomagically, I'm going to work on the Alert Manager in the next few days14:18
drifterzaso people have an end to end monitoring system atleast14:18
automagicallyThe alert manager rule config was the least fun part of it IIRC14:18
automagicallyBut getting it installed is no big thing14:18
drifterzayeah, ill try do some plays around templating the alerts etc..14:19
drifterzaso its easier to understand I hope14:19
automagicallyThis was the role I was using (and contributing to) when I last played around with it: https://github.com/William-Yeh/ansible-prometheus14:19
catlookodyssey4me, any other advice?  Or do we just write it off?14:19
drifterzalol I wrote myne from scratch.14:20
drifterzaI should really stop doing that :P14:20
drifterzahttps://galaxy.ansible.com/drifterza/openstack-ansible-os_prometheus_agent/14:21
drifterzahttps://galaxy.ansible.com/drifterza/openstack-ansible-os_prometheus_server/14:21
drifterzaodyssey4me, would it be a new role or just ansible-galaxy to the ops role ?14:22
openstackgerritMatthew Thode proposed openstack/openstack-ansible: Make the file name for user_secrets a variable  https://review.openstack.org/36948414:22
*** catnyp has joined #openstack-ansible14:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948514:24
*** catlook has quit IRC14:24
*** jmckind has joined #openstack-ansible14:25
odyssey4mepersonally I think it'll be fine to add the the integrated role with a release note - thoughts jmccrory automagically cloudnull d34dh0r53 stevelle mattt hughsaunders andymccr mhayden evrardjp asettle rromans ?14:25
asettleodyssey4me: uhhhhhh what are we talking about?14:25
asettleSureeeee14:25
odyssey4mesee the above discussion about prometheus playbooks with drifterza14:26
evrardjpfirst, drifterza: that sounds awesome14:26
*** TxGirlGeek has quit IRC14:26
*** TxGirlGeek has joined #openstack-ansible14:27
odyssey4measettle prometheus is a monitoring system14:27
d34dh0r53I'm +1 on the integrated role/rel note14:28
*** TxGirlGeek has quit IRC14:28
automagicallyodyssey4me: Add the role to what?14:28
odyssey4medrifterza you should ;) that existing role looks like it has multiple contributors, is maintained and tested14:28
evrardjpautomagically: to arr14:29
automagicallyArr?14:29
odyssey4medrifterza you may actually want to consider rather trying it out and contributing there - if the author doesn't respond well to PR's then obviously that's a bad choice14:29
automagicallyLike a pirate ;)14:29
evrardjpansible-role-requirements14:29
*** nishpatwa007 has joined #openstack-ansible14:29
evrardjpsorry14:29
evrardjpARRRR14:29
odyssey4mewhat's a pirate's favourite letter?14:29
automagicallyYeah, honestly if we want to support/promote prometheus, I’d prefer relying on an upstream role14:30
evrardjpthe one in the sea?14:30
automagicallyThat role I referenced has been in developement for over a year with 5 contributors14:30
evrardjpautomagically: +114:30
odyssey4mehe be liking the ARRR but his first love be the SEA :p14:30
andymccryeah i agree, upstream role is better if possible14:30
evrardjpbut it doesn't mean we can't take the experience14:31
odyssey4meautomagically andymccr agreed, although drifterza is wanting to suggest his own upstream roles14:31
odyssey4mebut yeah, generally speaking I prefer a role set which already has a group around it14:31
odyssey4meand is well tested14:31
automagicallySounds like something that we should add to the meeting agenda for this week14:32
evrardjpis that thinkable to have a two phase work?14:32
automagicallyWhen everyone is around14:32
evrardjpsounds good automagically14:32
evrardjpI like the idea to have something at first, and it can be improved during the cycle to rely on another more tested role14:32
drifterzaif we have an integrated role, it would most likely get more dev around it than the latter repo14:33
drifterzaI would right gate tests etc. for it aswell if needed.14:33
drifterzaits up to you guys14:33
evrardjpwell we could use any upstream role14:33
evrardjplet me have a look before giving my opinion :p14:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948514:35
odyssey4medrifterza yes, but an integrated role does not mean that we have to host the repositories in the openstack infrastructure14:36
odyssey4meit just means that we implement our own integrations and tests for it14:36
odyssey4mefor example, a benefit would be that we include the appropriate groups in the dynamic inventory14:36
*** catnyp is now known as catlook14:36
catlookJesse?  how can i get the yml to work, please?14:37
evrardjpdear cloudnull, mattt, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, Sam-I-Am, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, automagically,14:38
evrardjpspotz, vdo, jmccrory, alextricity25, jasondotstar, KLevenstein, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397 :14:38
evrardjpthe osa bug triage will start in 1h30’. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage14:38
evrardjpThank you14:38
odyssey4mecatlook I'm afraid that somehow you've done something which is resulting in a very basic file system issue which I can't help you troubleshoot. This is something you'll have ot figure out yourself or find someone to be a second pair of eyes.14:39
drifterzaodyssey4me, if you could checkout the roles I posted, perhaps you could give me some feedback ? I would appreciate any14:39
odyssey4mecatlook the issue is not the yaml, it's that you've given the path and it can't find the file14:39
odyssey4medrifterza I won't be looking through any new roles until newton's out, but thanks - I'll make a note14:40
catlookok..thanks anyway14:40
*** catlook has quit IRC14:40
*** weezS has joined #openstack-ansible14:41
*** nishpatwa007 is now known as nishpatwa_14:41
qwangevrardjp: I'd like to participate in the bug triage regularly. How could I be involved?14:41
evrardjpwell I have what you need!14:42
asettleHere's one he prepared earlier14:43
* asettle pulls rabbit out of a hat14:43
evrardjp:)14:43
evrardjpfirst, it would be great to mark your interest by adding your name here:14:43
evrardjphttps://wiki.openstack.org/wiki/Meetings/openstack-ansible14:43
drifterzaokay cool thanks odyssey4me, the roles are there for anyone to use or not use :P14:43
evrardjpguys guys, can we merge https://review.openstack.org/#/c/369053/ this way I can show the documentation about the bug triage? :D14:44
evrardjpqwang: the page you may want to look at now is: http://docs.openstack.org/developer/openstack-ansible/developer-docs/contribute.html14:45
*** TxGirlGeek has joined #openstack-ansible14:45
qwangevrardjp: thank you very much. will follow the procedure to get started14:46
evrardjpit explains the contribution to openstack-ansible14:46
*** spedione|AWAY is now known as spedione14:48
automagicallyevrardjp: You’ve got my +214:48
automagicallyThanks for the doc!14:49
evrardjpthank you for the +2!14:49
evrardjpdrifterza I think for the role you can use plugins repo as dependency :p it would avoid you to have to ship the config_template14:50
evrardjpalso I didn't get why you restart the service twice14:50
*** hblah has joined #openstack-ansible14:50
drifterzayou mean in the main.yml14:51
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Add check for swift_hash_path_ variables  https://review.openstack.org/36935314:51
*** smurke has joined #openstack-ansible14:52
*** itsuugo has quit IRC14:53
*** itsuugo has joined #openstack-ansible14:54
*** ikalnitsky has joined #openstack-ansible14:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948514:56
openstackgerritMerged openstack/openstack-ansible: [Docs] Add explanations about our bug triage process  https://review.openstack.org/36905314:57
automagicallyCore reviews on https://review.openstack.org/#/c/369038/ much appreciated. This will need to merge before the role tests for Ansible 2.1.1 can pass14:59
Matiasdrifterza: are you deploying ceilometer with HA?15:00
*** tomjosekal has joined #openstack-ansible15:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948515:03
*** irtermite has joined #openstack-ansible15:04
*** galstrom_zzz is now known as galstrom15:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948515:05
*** v1k0d3n has quit IRC15:08
*** spedione is now known as spedione|AWAY15:08
odyssey4mejmccrory automagically cloudnull d34dh0r53 stevelle mattt hughsaunders andymccr mhayden evrardjp asettle rromans it looks like we've got issues with consistent test results for the os_nova, os_neutron roles, and os_glance is simply failing... we need attention on that, anyone got time to figure it out?15:08
*** fxpester has joined #openstack-ansible15:08
*** v1k0d3n has joined #openstack-ansible15:09
automagicallyI’m working on os_glance tests right now in fact15:09
odyssey4meawesome, thanks automagically15:09
odyssey4methere's a fair chance that something's changed upstream15:09
mhaydenodyssey4me: i'm stuck in meetings for a bit but i can look after 2pm CDT15:09
evrardjpwell that's cool, thanks15:09
automagicallyIndeed15:09
evrardjpprobably a deprecation ? :p15:09
evrardjpmaybe using the osadiffer would help15:09
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_glance: Ansible 2.1.1 role testing  https://review.openstack.org/35358915:10
*** stevelle has quit IRC15:10
*** Apsu has quit IRC15:10
*** stevelle has joined #openstack-ansible15:10
odyssey4mefor os_neutron and os_nova it would appear that there's a race condition of some sort because we get different results every time15:10
irtermiteAttilla: did you get what you needed earlier? Sorry I saw your question in another chan, but wasn't logged in here to get a buffer15:10
*** sigmavirus|awa has quit IRC15:11
*** jcannava has quit IRC15:11
*** jwagner has quit IRC15:12
*** omiday has quit IRC15:12
*** _sigmavirus24 has joined #openstack-ansible15:12
*** Apsu has joined #openstack-ansible15:12
*** jwagner has joined #openstack-ansible15:12
*** jcannava has joined #openstack-ansible15:12
andymccrodyssey4me: if i get some time i'll try take a look - tried a quick recreate and it worked ok for me on nova, so i'll need to recreate it successfully.15:12
*** psilvad has quit IRC15:13
d34dh0r53doubt I'll be able to look at it today, but if anyone needs reviews please ping me15:13
irtermitei need your review d34dh0r53!!!15:14
d34dh0r53:) you need more than a review15:15
irtermitethis is true15:15
*** jamesdenton has joined #openstack-ansible15:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_magnum: Remove duplicate default: magnum_service_project_name  https://review.openstack.org/36952015:16
drifterzaI dunno, my code seems better15:17
drifterzabut I'm biased15:17
*** omiday has joined #openstack-ansible15:18
odyssey4meodd, the linters failure for the inventory test doesn't make sense to me: https://review.openstack.org/36948515:20
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-openstack_hosts: Convert role testing to use Ansible 2.1.1  https://review.openstack.org/36952415:20
odyssey4meevrardjp would you mind taking a peek and seeing if you can spot the issue?15:22
evrardjpI'm in a meeting right now :/ what's the timeframe?15:22
*** itsuugo has quit IRC15:23
odyssey4meok, no worries - later is fine15:23
evrardjpfor which one? https://review.openstack.org/#/c/369524/ ?15:23
evrardjpoh ok15:24
palendaeodyssey4me, For those linter failures, you'll need to remove the '_all' groups15:24
*** itsuugo has joined #openstack-ansible15:24
odyssey4mepalendae oh, I thought you weren't around :)15:24
odyssey4methanks!15:24
palendaeI got in late15:24
palendaee.g., line 109 on test_inventory.py15:25
evrardjpwell yes apparently15:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948515:26
*** dragonmaster has quit IRC15:26
odyssey4menow to figure out why my playbook vars aren't being fed to the role properly15:26
*** dragonmaster has joined #openstack-ansible15:27
*** rk4n has joined #openstack-ansible15:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948515:29
*** gouthamr has quit IRC15:30
*** karimb has quit IRC15:31
*** chhavi has joined #openstack-ansible15:31
qwangHi odyssey4me. I'm right now testing deployment in a test environment and using your patches.15:32
*** dragonmaster has quit IRC15:32
qwangmy understanding is nova should be on compute host and the 3 swift partitions should be all on storage host. is that correct?15:33
odyssey4meqwang if you're using the multi-node bootstrap, then the default will implement all the partitions on all hosts15:33
odyssey4methat's so that it's flexible and you can assign any host to any role15:33
qwangi see. so that they are symmetric15:35
*** gouthamr has joined #openstack-ansible15:35
*** dragonmaster has joined #openstack-ansible15:35
qwanghow can i deploy in a test environment like in the doc? http://docs.openstack.org/developer/openstack-ansible/install-guide/overview-host-layout.html#test-environment15:36
*** karimb has joined #openstack-ansible15:38
odyssey4mew00t thanks palendae - linters has now passed15:38
palendaeCool15:38
odyssey4meqwang if the docs don't give you the right info, then we have a bug15:38
odyssey4meqwang hopefully you'd be able to patch the bug too :)15:38
*** dragonmaster has quit IRC15:39
odyssey4mecores - we have a quick and simple review to get done: https://review.openstack.org/36952015:40
qwangi'd happy too. I just want to make sure my understanding is correct15:40
odyssey4meqwang try it out first, then if it doesn't work out we can work through it15:40
qwangodyssey4me: okay. thanks. will do it15:41
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-openstack_hosts: Convert role testing to use Ansible 2.1.1  https://review.openstack.org/36952415:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948515:46
openstackgerritMerged openstack/openstack-ansible-tests: Ansible 2.1.1 role testing  https://review.openstack.org/36903815:46
*** galstrom is now known as galstrom_zzz15:47
*** hblah has quit IRC15:47
openstackgerritAndy McCrae proposed openstack/openstack-ansible-galera_server: Prevent galera_cluster_name from changing.  https://review.openstack.org/36954715:49
evrardjpthanks andymccr ^15:49
openstackgerritNish Patwa(IRC: nishpatwa) proposed openstack/openstack-ansible-ops: Updated the readme file to add missing commands.  https://review.openstack.org/36954815:52
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-openstack_hosts: Convert role testing to use Ansible 2.1.1  https://review.openstack.org/36952415:54
*** tomjosekal has quit IRC15:56
*** dragonmaster has joined #openstack-ansible15:56
*** adrian_otto has joined #openstack-ansible15:57
openstackgerritAndy McCrae proposed openstack/openstack-ansible-galera_server: Prevent galera_cluster_name from changing.  https://review.openstack.org/36954715:59
*** jmckind_ has joined #openstack-ansible16:00
evrardjphey guys16:01
*** jmckind has quit IRC16:01
evrardjpI'm super thrilled16:01
evrardjpbecause it's bug triage time!16:02
evrardjpBug triage cloudnull, mattt, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, Sam-I-Am, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, automagically,16:02
evrardjpspotz, vdo, jmccrory, alextricity25, jasondotstar, KLevenstein, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil39716:02
evrardjpHere is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage16:02
evrardjpfirst one is16:02
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/162266016:02
openstackLaunchpad bug 1622660 in openstack-ansible "[install-guide] Separate pages for each link in the document" [Undecided,New]16:02
asettleevrardjp: ah yeah, I agree with nishpatwa_16:02
asettleBasically, two small files that could easily be combined into the one file16:03
asettleso it's an inline page rather than having to click aroun16:03
odyssey4me+116:03
evrardjpI'm glad you're here16:03
evrardjpI don't know what you're talking about (yet)16:03
odyssey4menishpatwa_ could you perhaps submit a patch for that?16:03
asettleThanks bud <316:03
nishpatwa_Yes sure16:03
evrardjpcool16:03
nishpatwa_odyssey4me16:03
evrardjpconfirmed wishlist assigned to nishpatwa_16:04
asettleOn it16:04
*** dragonmaster has joined #openstack-ansible16:04
evrardjpnext is https://bugs.launchpad.net/openstack-ansible/+bug/162227516:04
openstackLaunchpad bug 1622275 in openstack-ansible "repo_build_wheel_selective: no breaks repo_build" [Undecided,New]16:04
evrardjpthanks asettle :)16:04
asettleHowever nishpatwa_ do not do the one for the target hosts, just the one for hte configure deploy :)16:04
evrardjphad someone the time to reproduce this one?16:04
nishpatwa_Okay Sure asettle. Yes Those files are pretty big though16:05
asettleYeah they are :)16:05
evrardjpodyssey4me: did you see this one?16:05
odyssey4meevrardjp the nuage bits there must be a regression16:05
odyssey4meevrardjp let me take on the task of reproducing16:05
evrardjpagreed, so I'll not classify this as wishlist16:06
evrardjpcool thanks odyssey4me!16:06
odyssey4menope, this is a bug16:06
evrardjpI'll assign to you, I'll not move it into confirmed 'though16:06
odyssey4meperhaps a medium priority I think16:06
evrardjpI'll leave it there for next time16:06
odyssey4mebut yeah, let me confirm it16:06
evrardjpI'll move that to medium and we can move to high if you see we can have higher problems down the line16:07
evrardjpcool thanks16:07
evrardjpnext one is16:07
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/162225116:07
openstackLaunchpad bug 1622251 in openstack-ansible "Regression: admin can't auth to gnocchi" [Undecided,New]16:07
odyssey4meif we do what's proposed there, we'll be diverging heavily from every single other way we consume the upstream paste files16:08
evrardjpodyssey4me: I was not sure about your comment16:08
evrardjpI agree odyssey4me16:08
evrardjpthis is why I find this thing interesting16:08
odyssey4mecurrently we consume them verbatim from upstream, with only minimal tweaks to support venvs16:08
odyssey4mebut I do agree that we would prefer keystone integration as a default in the integrated build16:09
odyssey4meone way to do this would be to provide documentation, but then our integrated build is horrible16:09
odyssey4meso perhaps we should implement a default conf override in group_vars for the integrated build16:10
stevelleI dislike that16:10
stevellenot a lot of options to like, however16:10
odyssey4meyep16:10
evrardjpodyssey4me: I thought the override was proposed16:10
*** galstrom_zzz is now known as galstrom16:11
evrardjpwell it makes sense to auto adapt for the gates16:11
odyssey4meanother option is perhaps to make the sources branch updater to an in-line edit every time, just like we do for rootwraps, etc16:11
evrardjpand it's setting a precedent because no one else did like that before16:11
evrardjp(the openstack way)16:11
odyssey4methat's probably the better way, even if it is a bit of a hack16:11
stevelleSo doesn't this also break the role tests?16:12
evrardjpwell does it hurt to not edit this?16:12
stevellewe install keystone in the role tests as well, and default paste now doesn't use it16:12
odyssey4meyeah, that was my next question - does it hurt to leave it as-is and allow deployers to choose to do it?16:12
stevelleUsing the upstream paste file leaves gnocchi broken-by-default. That's not acceptable to me.16:13
stevellebut a group_vars fix still leaves the role broken in stand-alone16:13
odyssey4mestevelle is it *broken*, or just insecure?16:13
michaelguginosounds like gnocchi is broken by default, by default.  How can they choose not to integrate with keystone by default?16:13
stevelleodyssey4me: $ gnocchi status  returns a not authorized16:13
odyssey4meif it's broken, then a patch to the gnocchi source is the best option16:14
evrardjpwell then we shouldn't care16:14
evrardjpgood16:14
evrardjplet's hope it's gonna be fixed there16:14
evrardjpstevelle do you mind if I tag you on this one?16:14
michaelguginoif it's an openstack project, it should be openstack-oriented first.  But, we don't call the shots over there.16:14
odyssey4mestevelle is that because our conf configures keystone and gnocchi's pipeline doesn't implement the auth?16:14
evrardjpThis way you can follow up?16:14
stevelleodyssey4me: yes16:14
*** rk4n has quit IRC16:15
odyssey4meah, so then we should configure the role not to do keystone by default... and we should adapt accordingly16:15
evrardjpodyssey4me: for me it makes sense that if we install gnocchi[keystone] we should adapt the config16:15
evrardjpand if we don't, then fine16:15
odyssey4megnocchi should ideally be installable both ways - with and without keystone16:16
michaelguginodeploying in non-secure no auth way by default seems like a bad idea.  We should not do that.16:16
stevelle+1 odyssey4me16:16
stevelleI'm agreed with michaelgugino also16:16
evrardjpmichaelgugino: that's probably true, so in integrated gate we should make sure we have gnocchi + keystone16:16
odyssey4mestevelle then perhaps an in-line edit of the paste file by the sources branch updater can make the paste file adapt accordingly16:17
evrardjpbut gnocchi standalone could be done differently in its own gates16:17
evrardjpodyssey4me: why not having a lineinfile in the role instead?16:17
michaelguginotemplate_override?16:17
odyssey4meevrardjp then we lose idempotence16:17
evrardjpit breaks idempotency16:17
*** weezS_ has joined #openstack-ansible16:17
evrardjpyes16:17
odyssey4memichaelgugino the override are deployer only configs16:17
*** chhavi has quit IRC16:17
stevelleI'll take some time tomorrow to try and bring this up with the EU folks for telemetry to see if we can have an upstream fix that uses keystone but I think this happened because they are sick and tired of keystone client libs breaking their gate16:18
odyssey4meok, stevelle if you can patch the role up again to make it right - but also work both ways - then I'll adapt the sources branch updater16:18
*** chhavi has joined #openstack-ansible16:19
*** galstrom is now known as galstrom_zzz16:19
odyssey4mesure, but for newton it's probably too late to get a fix in upstream, so we need a workaround that works for us16:19
evrardjpOk I move this to confirmed, and assign to stevelle16:19
stevellethe only way I can see to fix this in the role properly is to modify the paste file (which is was before the last sha bump) or specify an override in defaults but we can talk more later16:19
evrardjpyup we can still discuss in the patchset later, or in this chan :)16:20
evrardjpnext16:20
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/162161216:20
openstackLaunchpad bug 1621612 in openstack-ansible "lxc container service logs filling syslog" [Undecided,New]16:20
*** permalac has quit IRC16:20
*** weezS has quit IRC16:20
*** weezS_ is now known as weezS16:20
odyssey4mehmm, I think a recent patch by bjoernt may be helpful there16:21
odyssey4mebut yeah, we need confirmaiton of this issue16:22
*** drifterza has quit IRC16:22
odyssey4mehttps://review.openstack.org/#/c/367588/16:22
jmccrorysaw this firsthand. looked like error level logging for rabbit was written to both the rabbit log file and /var/log/syslog16:22
evrardjpyup I'm just on it16:22
jmccroryand with enough errors coming through, the container would run out of space16:23
Matiasstevelle: also, please don't forget CORS :D16:23
evrardjpso summary ?16:24
stevelleMatias: this is part of the problem with using default upstream paste files :(16:24
evrardjpis the fix from bjoern saving us here?16:24
*** psilvad has joined #openstack-ansible16:25
jmccroryduplicate logging, it's on rsyslog client side though16:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948516:26
*** rk4n has joined #openstack-ansible16:26
odyssey4meMatias stevelle I think the cors stuff is ideally an upstream patch, otherwise our deployers can do a config override16:27
evrardjpwell it doesn't seem the same issue to me, but one can amplify the other16:27
odyssey4meevrardjp yeah the server side patch won't make a difference16:27
openstackgerritAndy McCrae proposed openstack/openstack-ansible-galera_server: Prevent galera_cluster_name from changing.  https://review.openstack.org/36954716:27
evrardjpbut I have the feeling it's what should happen, right?16:27
openstackgerritAndy McCrae proposed openstack/openstack-ansible-galera_server: Prevent galera_cluster_name from changing.  https://review.openstack.org/36954716:28
evrardjpI mean we don't do monitoring (at least for now), so that kinda makes sense to me16:28
evrardjpI don't know what status to put there16:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Implement scenario capability for AIO  https://review.openstack.org/36948516:28
odyssey4mewell, the bug is that the events are leaking into syslog16:29
odyssey4mejmccrory has confirmed it16:30
odyssey4meso we need someone to fix it16:30
jmccroryprobably needs more info on cause or configurable option to actually do anything about it16:30
evrardjpwell thanks for explaining that to me odyssey4me16:30
openstackgerritAndy McCrae proposed openstack/openstack-ansible-galera_server: Prevent galera_cluster_name from changing.  https://review.openstack.org/36954716:30
odyssey4me:p16:30
evrardjpok thanks jmccrory for the confirmation and for classification of the importance16:31
Matiasstevelle: quick question, i don't want to disrupt the discussion: are you running ceilometer with HA / work partitioning? or single node? (trying to figure out why mine only works when it wants)16:31
stevelleansering in pm16:32
evrardjpsorry for the latency here16:33
openstackgerritAndy McCrae proposed openstack/openstack-ansible-galera_server: Prevent galera_cluster_name from changing.  https://review.openstack.org/36954716:33
evrardjpso next one is16:33
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/162095316:33
openstackLaunchpad bug 1620953 in openstack-ansible "MTU settings for neutron" [Undecided,New] - Assigned to satheeshprabhakaran.v (vsp661992)16:33
evrardjpI suppose we're gonna have a patch as a follow up :)16:34
odyssey4meneeds more info16:34
odyssey4mebut openstack already provides this, so I'm a little confused16:34
odyssey4meperhaps this is a module change?16:34
*** asettle has quit IRC16:35
*** asettle has joined #openstack-ansible16:35
*** galstrom_zzz is now known as galstrom16:35
evrardjpI don't know16:37
evrardjplet's just leave that as it is16:37
evrardjpincomplete16:37
*** psilvad has quit IRC16:37
evrardjpseems better16:37
evrardjpDoes someone wants to add something?16:37
*** BjoernT has joined #openstack-ansible16:38
evrardjpthen I guess we're good for today!16:39
odyssey4methanks evrardjp16:39
*** chhavi has quit IRC16:40
*** asettle has quit IRC16:41
*** psilvad has joined #openstack-ansible16:41
*** thorst_ has quit IRC16:43
*** markvoelker has quit IRC16:44
*** thorst_ has joined #openstack-ansible16:44
*** galstrom is now known as galstrom_zzz16:45
*** mgeezy has joined #openstack-ansible16:49
mgeezy wave @jamesdenton16:50
*** berendt has quit IRC16:52
*** karimb has quit IRC16:52
*** thorst_ has quit IRC16:52
*** hughmFLEXin has quit IRC16:53
*** kjw3 has quit IRC16:53
jamesdentonhey mgeezy16:53
*** hughmFLEXin has joined #openstack-ansible16:53
mgeezyhow goes it?16:54
jamesdentongood!16:54
hughmFLEXinmorning16:55
mgeezygood =)16:55
*** electrofelix has quit IRC16:55
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_aodh: Ansible 2.1.1 role testing  https://review.openstack.org/35356316:57
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-openstack_hosts: Convert role testing to use Ansible 2.1.1  https://review.openstack.org/36952416:58
*** thorst_ has joined #openstack-ansible16:59
*** pcaruana has quit IRC16:59
*** KLevenstein has quit IRC16:59
*** thorst_ has quit IRC17:00
odyssey4mestevelle if we omit https://github.com/openstack/openstack-ansible-os_gnocchi/blob/master/templates/gnocchi.conf.j2#L17-L39 will gnocchi work without keystone?17:02
*** xek has quit IRC17:03
evrardjphey odyssey4me, what was the goal of setting up the apt-cache on the repo nodes?17:03
stevelleodyssey4me: I was thinking about that. it needs testing17:03
evrardjpproxy all the requests and/or cache packages?17:03
*** rk4n has quit IRC17:04
evrardjpit sounds to me it's trying to cache stuff17:04
odyssey4meevrardjp yes, to cache the requests - it acts as an apt/yum proxy17:04
odyssey4meit is being tested in the gate17:04
odyssey4meit improves the isolation of apt installs - only the infra hosts and repo containers need access to the apt mirror17:05
odyssey4meand improves install performance as a result of the caching17:05
odyssey4meit doesn't make much difference to the AIO though17:06
odyssey4mestevelle if omitting https://github.com/openstack/openstack-ansible-os_gnocchi/blob/master/templates/gnocchi.conf.j2#L17-L39 will make gnocchi work without keystone, then I can put up a patch to make it work both ways17:08
stevellewill try it when that gets to the top of the list, prob later this week17:08
*** rk4n has joined #openstack-ansible17:08
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted now to address current performance problems, but should return to a working state within a few minutes17:09
stevelletoday is an upstream bugsmash day17:09
*** yarkot has joined #openstack-ansible17:14
*** itsuugo has quit IRC17:14
*** yarkot has quit IRC17:14
*** michaelgugino has quit IRC17:17
*** itsuugo has joined #openstack-ansible17:17
* palendae adds another bug to the pile as soon as gerrit's back up17:17
*** tomjosekal has joined #openstack-ansible17:17
evrardjp:p17:18
palendaeodyssey4me, cloudnull Do you guys remember where that review was that did a bunch of munging in Jinja to find the LXC hosts?17:19
palendaeI have a commit to add an 'lxc_hosts' group to the inventory and would like to reference it17:20
odyssey4mepalendae sure17:20
*** rk4n has quit IRC17:20
palendaeI think it was https://review.openstack.org/#/c/363395/17:20
odyssey4mehttps://github.com/openstack/openstack-ansible/blob/master/playbooks/common-plays/generate-lxc-container-hosts.yml17:20
odyssey4methat's the current version which resulted from I think 3 different reviews17:21
palendaeOk17:21
palendaeI'm going to submit my new functionality before completely replacing that17:21
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Add lxc_host 'magic' group to inventory.  https://review.openstack.org/36959917:22
*** kjw3 has joined #openstack-ansible17:22
*** xek has joined #openstack-ansible17:24
*** dragonmaster has quit IRC17:25
openstackgerritMerged openstack/openstack-ansible: Make the file name for user_secrets a variable  https://review.openstack.org/36948417:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi: Allow gnocchi to make use of keystone authentication  https://review.openstack.org/36960717:30
odyssey4mestevelle ^ not sure if that will do what's expected - feel free to adapt when you're ready17:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi: Allow gnocchi to make use of keystone authentication  https://review.openstack.org/36960717:31
mgeezyis the neutron l3 agent supposed to be installed in the aio build script?17:31
*** thorst_ has joined #openstack-ansible17:32
*** thorst_ has quit IRC17:33
odyssey4memgeezy yes, in the neutron_agent container17:33
*** thorst_ has joined #openstack-ansible17:34
*** rk4n has joined #openstack-ansible17:36
*** rk4n has quit IRC17:36
mgeezythanks @odyssey4me17:36
*** rk4n has joined #openstack-ansible17:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Ensure that gnocchi uses keystone authentication  https://review.openstack.org/36961017:38
odyssey4mestevelle ^ and the other piece to make sure it's activated17:38
stevelleodyssey4me: really quickly, isn't this all going to get auto-smashed when the paste ini is updated next?17:39
mgeezydoes the aio build script automatically make use of eth2 interface?  I've got a second NIC to provide to use for external network connectivity I'm trying to get hooked up in a lab17:40
odyssey4mestevelle nope, in the integrated gate I've updated the sources branch updater to ensure that when the updates are done, that api-paste config is also adjusted17:40
odyssey4memgeezy no, it uses eth0 by default17:40
*** thorst_ has quit IRC17:40
*** weezS has quit IRC17:41
odyssey4memgeezy you can change it though - just adjust the config after the AIO bootstrap, and before you execute the build17:41
odyssey4memgeezy or ensure that the default route is set on eth2, because that's how it figures it out: https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio#L1717:42
mgeezygotcha thanks much17:42
odyssey4methat's just for the public endpoints though17:42
mgeezyah17:42
mgeezyim looking for external connectivity17:42
mgeezy@jamesdenton was helping me try to diagnose some issues and i thought i might look into this method17:43
odyssey4mefor instances to get out, you'll have to adjust https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/templates/osa_interfaces.cfg.j2#L31-L32 once it's laid down (after the bootstrap) to set it to masquerade via eth217:44
odyssey4meI think17:44
odyssey4menot sure - I never try external access on an AIO17:44
odyssey4menote that the AIO is a testing tool and we do some deliberate nastiness to make it work - it's not something you should model a real environment from17:46
mrhillsmanyou said "nastiness" :)17:47
odyssey4merealistically for external access from instances you need to just make adjustments to the external network used - make sure it's setup right17:47
odyssey4mean AIO deliberately does not set it up the way it would be done in production because we're doing everything on one host17:47
odyssey4memrhillsman :) yeah, the AIO is pretty hinky17:48
odyssey4mebut it's been very useful17:48
mrhillsmanmay make sense for the aio - granted i have not deployed it - to use flat network?17:48
mgeezyyeah im figuring that out17:48
mgeezyi have built out another environment17:48
odyssey4memrhillsman yes, it already does17:48
mrhillsmani think the docs give some insight into that and based on odyssey4me suggestions probably best17:48
mrhillsmanoh cool17:49
odyssey4memrhillsman the AIO does not give external network isolation though17:49
odyssey4meit can't, given that it's all on one host :p17:49
mgeezybut i was looking for a quick and dirty solution for a lab environment that i could bootstrap for testing17:49
mrhillsmanthen you probably just need to masquerade as suggested17:49
mrhillsmanand should be able to test to your heart's desire17:49
mgeezycool.  i will try that, just getting some weird errors17:50
mgeezywhere my instances cant ping out17:50
openstackgerritPaulo Matias proposed openstack/openstack-ansible-repo_build: Drop privileges before running the git clone script  https://review.openstack.org/36628017:50
mgeezytime to re roll again =)17:52
*** yarkot has joined #openstack-ansible17:56
hughmFLEXinhow long does TASK [repo_build : Run clone process script] typically run for?17:59
cloudnullafternoons everyone!18:02
cloudnullfinally working on my computer... :)18:02
cloudnullhughmFLEXin: generally that depends on the speed of the network.18:03
hughmFLEXincloudnull: hey!18:03
hughmFLEXincloudnull: well that is unfortunate....ours is terrible during day time18:03
cloudnull:(18:03
cloudnullonce you have the repos you can mirror them elsewhere.18:03
hughmFLEXincloudnull: just an update, so turns out im a scrub and had a light bulb appear when i was mucking around the vlan issue18:04
cloudnulloh the ifup bits?18:04
cloudnullwhat caused that?18:04
cloudnullsomething we need to address?18:04
hughmFLEXincloudnull: "container_interface" doesn't matter, because "bridge_interface" is already tied to the vlans. Because I thought "container_interface" had to be same as the ones on the host, it was bugging out18:04
hughmFLEXinmaybe just better comments and documentation18:05
cloudnullodyssey4me: ima revisit https://review.openstack.org/36302218:05
cloudnullhughmFLEXin: if you have a snip that we should add to the docs it'd be great to get that in18:05
hughmFLEXinso i went back and renamed the container_interfaces back to eth1/2/3/10 whatever, without the vlan, and it finished just fine18:05
hughmFLEXinsure thing18:05
cloudnullwinning :)18:06
cloudnullwell we found the veth length issue in all that .18:06
* cloudnull finding the silver lining18:06
hughmFLEXinthough i do want to mention, yesterday before going home i ran the setup-infra, and it didnt' seem to setup anything, came back this morning and re-ran it, and its setting up a bunch of stuff18:06
hughmFLEXinits like a programming meme in the flesh...18:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_horizon: Configure Apache ports using lineinfile  https://review.openstack.org/36962118:11
odyssey4mecloudnull ^ you may like that for the all metal host18:11
*** weezS has joined #openstack-ansible18:13
*** poopcat has joined #openstack-ansible18:16
*** david-lyle has quit IRC18:23
*** poopcat has quit IRC18:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone: Configure Apache ports using lineinfile  https://review.openstack.org/36962518:24
*** david-lyle has joined #openstack-ansible18:26
*** mgeezy has quit IRC18:28
cloudnullohh!18:31
cloudnullodyssey4me: https://review.openstack.org/#/c/352024/ -- i did that a while back18:31
cloudnullhoping that we could soon enable an all onmetal scenario for the intergrated gate.18:32
cloudnullhughmFLEXin: lolol18:32
cloudnullgremlins18:32
stevelleMatias: so we need to bump ulimits for ceilometer?18:33
Matiasstevelle: https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/0399c19b56529bd19e2e8eb9dc70407ece979333/templates/rabbitmq-server.j2#L418:33
MatiasI think this is not working with systemd18:33
*** TxGirlGeek has quit IRC18:33
Matiashttps://github.com/openstack/openstack-ansible-rabbitmq_server/blob/75d8dac4d057c8c5e174e53376e1e1d71a718662/defaults/main.yml#L4918:33
Matiasdefault is 409618:33
Matiasmine is 102418:33
stevellegood catch, we need to fix that18:33
hughmFLEXincloudnull: if i forgot to define external_lb_vip_address, will it break anything18:33
stevelleMatias: you want to take a stab at a fix?18:34
Matiasyep18:34
MatiasI'll also try to decrease pipeline_processing_queues18:34
cloudnullMatias: looks like https://github.com/openstack/openstack-ansible-rabbitmq_server/blob/75d8dac4d057c8c5e174e53376e1e1d71a718662/templates/rabbitmq-server.j2 needs to have a systemd impl18:34
odyssey4mehughmFLEXin yes, the external address is used for the openstack public endpoints18:34
hughmFLEXinbleh18:34
cloudnullhughmFLEXin: what odyssey4me said18:35
MatiasI don't know if it makes sense to have pipeline_processing_queues > number of ceilometer-api containers18:35
cloudnullyou should be able to define it and carry on ,18:35
alextricity25cloudnull: heh. Just realized this is going to be a problem when running OSA inside LXD containers: https://github.com/openstack/openstack-ansible-openstack_hosts/blob/master/tasks/openstack_kernel_modules.yml18:35
Matiasit's only overhead for rabbit18:35
hughmFLEXinmaybe thats why im getting E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/xenial/main/binary-amd64/Packages  Unable to connect to 172.29.236.100:3142:18:35
cloudnullassuming you've not run the setup-openstack playbooks.18:35
hughmFLEXini haven't18:35
alextricity25cloudnull: Can't load modules in containers!18:35
cloudnullalextricity25: yea thats a thing18:35
stevelleMatias: I'd probably say it should align to sum # of vcpus in the containers18:35
cloudnullbut you should be able to execute that back on the physical host.18:36
cloudnulland then load the modules neede.d18:36
Matiasstevelle: ah, you are right18:36
*** pcaruana has joined #openstack-ansible18:36
alextricity25cloudnull: For sure. Are you saying just add a delegate_to there?18:36
*** KLevenstein has joined #openstack-ansible18:36
cloudnullyea18:36
cloudnullor change the host group from the playbook execution18:36
stevelleMatias: if you look at fixing rabbitmq ulimit for the ceilometer fix, please also apply the fix to memcached_server role18:36
stevellethat will have the same prob18:36
*** fxpester has quit IRC18:36
openstackgerritAdam Reznechek proposed openstack/openstack-ansible-os_nova: Update PowerVM driver documentation  https://review.openstack.org/36462718:37
Matiasgood catch18:37
alextricity25cloudnull: i'lll give it a go :) Thanks man18:37
*** poopcat has joined #openstack-ansible18:37
cloudnullhughmFLEXin: are you behind a proxy?18:37
cloudnullalextricity25: best of luck18:37
hughmFLEXincloudnull: no18:37
cloudnullits possible the archive.ubuntu.com is having a bad day18:37
*** thorst_ has joined #openstack-ansible18:38
Matiasdoes rabbit automatically adjusts the "Socket descriptors" limit to fit the available fds?18:38
odyssey4mecloudnull a quick review: https://review.openstack.org/36952018:38
* cloudnull lookin18:38
cloudnulldone18:38
Matiascloudnull: quick review: https://review.openstack.org/[0-9]+18:38
* cloudnull lookin18:38
hughmFLEXincan i comment out 00apt-cacher-proxy and let it pull direct18:38
Matias:P18:39
hughmFLEXinseems to not complain as much18:39
cloudnulloh, yea that's an issue18:39
cloudnullif the repo server isn't setup18:39
cloudnullthen the proxy will be broken18:39
cloudnulldo you have the repo server?18:39
cloudnullor had you gotten that far in the playbooks?18:40
Matiascloudnull: he destroyed his containers18:40
Matiasafter a preliminar install18:40
Matiasso the metal is still pointing to the cache server18:40
stevelleMatias: I believe it does adjust socket descriptors18:41
openstackgerritMerged openstack/openstack-ansible-os_magnum: Remove duplicate default: magnum_service_project_name  https://review.openstack.org/36952018:41
MatiashughmFLEXin: I forgot about that, yeah, you need to remove the 00apt-cacher-proxy stuff before rerunning18:41
Matiasbecause it will only work after repo container is redeployed18:41
*** smatzek_ is now known as smatzek18:42
hughmFLEXingotcha...18:42
hughmFLEXinisn't the repo container part of intra playbook18:42
hughmFLEXininfra*18:43
Matiasyes18:43
Matiasinfra calls repo-install which calls repo-server18:43
hughmFLEXinthat completed, except the failure on the 3 memcached containers18:43
*** yarkot has quit IRC18:44
*** thorst_ has quit IRC18:45
Matiasthat's strange, when I accidentally destroyed my repo container, I only was able to run setup-infra again after removing the 00apt-cacher-proxy stuff18:46
Matiasbecause it tried to do apt-get update all around18:47
*** sulo has quit IRC18:49
Matiasstevelle: galera will also need to be updated18:49
hughmFLEXinyea, ill muck around and and see if i can figure it out, bug you guys in a few hours if i end up rolling my face on keyboard18:49
stevelleMatias: yeah, my search missed that one. #lazy18:49
*** sulo has joined #openstack-ansible18:50
Matiashttps://ma.ttias.be/increase-open-files-limit-in-mariadb-on-centos-7-with-systemd/18:50
*** TxGirlGeek has joined #openstack-ansible18:50
Matiasso /etc/systemd/system/NAME.service.d/limits.conf should work, right?18:51
* Matias systemd newbie18:51
*** TxGirlGeek has quit IRC18:53
*** weezS has quit IRC18:53
*** weezS has joined #openstack-ansible18:56
*** weezS has quit IRC18:56
*** weezS has joined #openstack-ansible18:57
*** dragonmaster has joined #openstack-ansible18:58
MatiasMnesia('rabbit@controller-01-rabbit-mq-container-5a3742b5'): ** ERROR ** Mnesia on 'rabbit@controller-01-rabbit-mq-container-5a3742b5' could not connect to node(s) ['rabbit@controller-03-rabbit-mq-container-bb74d879']18:59
Matiaslol18:59
Matiasclient stole fds from the cluster18:59
*** rk4n has quit IRC19:05
*** psilvad has quit IRC19:05
*** dragonmaster has quit IRC19:11
hughmFLEXinMatias: ah now that i re-did the containers i see the same error now, is this the one you mean?19:11
hughmFLEXinfatal: [infra2_repo_container-d3018238]: FAILED! => {"failed": true, "msg": "the field 'args' has an invalid value, which appears to include a variable that is undefined. The error was: 'lxc_container_log_path' is undefined\n\nThe error appears to have been in '/opt/openstack-ansible/playbooks/common-tasks/os-lxc-container-setup.yml': line 93, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem19:11
hughmFLEXin.\n\nThe offending line appears to be:\n\n# TODO(odyssey4me): revisit this once the bug is fixed and released\n- name: Lxc container restart\n  ^ here\n"}19:11
*** dragonmaster has joined #openstack-ansible19:13
*** david-lyle has quit IRC19:16
*** adrian_otto has quit IRC19:16
*** dalees has quit IRC19:16
*** persia has quit IRC19:16
*** LanceHaig has quit IRC19:16
*** pjm6 has quit IRC19:16
*** messy has quit IRC19:16
*** coolj has quit IRC19:16
*** jlvillal has quit IRC19:16
*** yarkot1 has quit IRC19:16
*** toddnni has quit IRC19:16
*** mpjetta has quit IRC19:16
*** ggillies has quit IRC19:16
*** coreywright has quit IRC19:16
*** ametts has quit IRC19:16
*** hj-hpe has quit IRC19:16
*** csmart has quit IRC19:16
*** agireud has quit IRC19:16
*** prometheanfire has quit IRC19:16
*** luzC has quit IRC19:16
*** nategraf has quit IRC19:16
*** mattoliverau has quit IRC19:16
*** irtermite has quit IRC19:16
*** mattt has quit IRC19:16
*** Reyu has quit IRC19:16
*** smatzek has quit IRC19:17
*** schwicht has quit IRC19:17
*** mpotdar has quit IRC19:17
*** gus has quit IRC19:17
*** neillc has quit IRC19:17
*** meteorfox has quit IRC19:17
*** d34dh0r53 has quit IRC19:17
*** kysse has quit IRC19:17
*** fedruantine has quit IRC19:17
*** mubix has quit IRC19:17
*** mfisch has quit IRC19:17
*** mennie has quit IRC19:17
*** sunshinekitty has quit IRC19:17
*** odyssey4me has quit IRC19:17
*** jamielennox has quit IRC19:17
*** mhayden has quit IRC19:17
*** mrhillsman has quit IRC19:17
*** charz has quit IRC19:17
*** rickflare has quit IRC19:17
*** automagically has quit IRC19:17
*** logan- has quit IRC19:17
*** jperry has quit IRC19:17
*** jascott1 has quit IRC19:17
*** serverascode has quit IRC19:17
*** ZuZuD has quit IRC19:17
*** FrankZhang has quit IRC19:17
*** errr has quit IRC19:17
*** bgmccollum has quit IRC19:17
*** palendae has quit IRC19:17
*** adreznec has quit IRC19:17
*** spotz_zzz has quit IRC19:17
*** mgagne has quit IRC19:17
*** toan has quit IRC19:17
*** dragonmaster has quit IRC19:17
*** omiday has quit IRC19:17
*** woodard has quit IRC19:17
*** johnmilton has quit IRC19:17
*** nishpatwa_ has quit IRC19:17
*** winggundamth_ has quit IRC19:17
*** lkoranda has quit IRC19:17
*** darrenc has quit IRC19:17
*** pfb29 has quit IRC19:17
*** kong has quit IRC19:17
*** Adri2000 has quit IRC19:17
*** ChanServ has quit IRC19:17
*** jhesketh has quit IRC19:17
*** tomjosekal has quit IRC19:17
*** Apsu has quit IRC19:17
*** _sigmavirus24 has quit IRC19:17
*** klamath has quit IRC19:17
*** qwang has quit IRC19:17
*** cloudnull has quit IRC19:17
*** hwoarang has quit IRC19:17
*** ikalnitsky has quit IRC19:17
*** e-vad has quit IRC19:17
*** phschwartz has quit IRC19:17
*** mcarden has quit IRC19:17
*** poopcat has quit IRC19:17
*** jamesdenton has quit IRC19:17
*** jwitko has quit IRC19:17
*** evrardjp has quit IRC19:17
*** jmccrory has quit IRC19:17
*** tlbr has quit IRC19:17
*** hughmFLEXin has quit IRC19:17
*** smurke has quit IRC19:17
*** gfa has quit IRC19:17
*** arbrandes1 has quit IRC19:17
*** dolphm has quit IRC19:17
*** h1nch has quit IRC19:17
*** spedione|AWAY has quit IRC19:17
*** NachoDuck has quit IRC19:17
*** Jeffrey4l_ has quit IRC19:17
*** shasha_tavil has quit IRC19:17
*** vnogin has quit IRC19:17
*** brad[] has quit IRC19:18
*** ajo has quit IRC19:18
*** eglute has quit IRC19:18
*** alextricity25 has quit IRC19:18
*** erikmwilson has quit IRC19:18
*** xar- has quit IRC19:18
*** galstrom_zzz has quit IRC19:18
*** eon` has quit IRC19:18
*** jasondotstar has quit IRC19:18
*** BjoernT has quit IRC19:18
*** jcannava has quit IRC19:18
*** stevelle has quit IRC19:18
*** kstev has quit IRC19:18
*** npawelek has quit IRC19:18
*** andymccr has quit IRC19:18
*** bapalm has quit IRC19:18
*** afranc has quit IRC19:18
*** weezS has quit IRC19:18
*** itsuugo has quit IRC19:18
*** jmckind_ has quit IRC19:18
*** gouthamr has quit IRC19:18
*** jwagner has quit IRC19:18
*** aludwar has quit IRC19:18
*** arif-ali has quit IRC19:18
*** cjloader has quit IRC19:18
*** dmsimard has quit IRC19:18
*** grumpycatt has quit IRC19:18
*** _hanhart has quit IRC19:18
*** timrc has quit IRC19:18
*** jrosser has quit IRC19:18
*** mrda has quit IRC19:18
*** hughsaunders has quit IRC19:18
*** nwonknu has quit IRC19:18
*** sulo has quit IRC19:18
*** pcaruana has quit IRC19:18
*** jheroux has quit IRC19:18
*** kylek3h has quit IRC19:18
*** john51 has quit IRC19:18
*** furlongm has quit IRC19:18
*** haasn has quit IRC19:18
*** jimbaker has quit IRC19:18
*** raddaoui has quit IRC19:18
*** izaakk has quit IRC19:18
*** lbragstad has quit IRC19:18
*** homerp has quit IRC19:18
*** vdo has quit IRC19:18
*** rackertom has quit IRC19:18
*** maximov has quit IRC19:18
*** basilAB has quit IRC19:18
*** git-harry has quit IRC19:18
*** Oku_OS has quit IRC19:18
*** mancdaz has quit IRC19:18
*** pegmanm has quit IRC19:18
*** KLevenstein has quit IRC19:18
*** kjw3 has quit IRC19:18
*** openstackgerrit has quit IRC19:18
*** rromans has quit IRC19:18
*** mgariepy has quit IRC19:18
*** julian1 has quit IRC19:18
*** Matias has quit IRC19:18
*** portante has quit IRC19:18
*** bkreitch has quit IRC19:18
*** kencjohnston has quit IRC19:18
*** fignew has quit IRC19:18
*** antonym has quit IRC19:18
*** jduhamel has quit IRC19:18
*** ioni has quit IRC19:18
*** Jolrael has quit IRC19:18
*** jroll has quit IRC19:18
*** john51 has joined #openstack-ansible19:22
*** mancdaz has joined #openstack-ansible19:22
*** jmckind has joined #openstack-ansible19:22
*** git-harry has joined #openstack-ansible19:22
*** jwagner has joined #openstack-ansible19:22
*** stevelle has joined #openstack-ansible19:22
*** Oku_OS has joined #openstack-ansible19:22
*** basilAB has joined #openstack-ansible19:22
*** grumpycatt has joined #openstack-ansible19:22
*** ggillies has joined #openstack-ansible19:22
*** mpjetta has joined #openstack-ansible19:22
*** toddnni has joined #openstack-ansible19:22
*** yarkot1 has joined #openstack-ansible19:22
*** coreywright has joined #openstack-ansible19:22
*** jlvillal has joined #openstack-ansible19:22
*** coolj has joined #openstack-ansible19:22
*** messy has joined #openstack-ansible19:22
*** pjm6 has joined #openstack-ansible19:22
*** LanceHaig has joined #openstack-ansible19:22
*** persia has joined #openstack-ansible19:22
*** dalees has joined #openstack-ansible19:22
*** adrian_otto has joined #openstack-ansible19:22
*** timrc has joined #openstack-ansible19:22
*** ametts has joined #openstack-ansible19:22
*** haasn has joined #openstack-ansible19:22
*** jperry has joined #openstack-ansible19:22
*** pcaruana has joined #openstack-ansible19:22
*** phschwartz has joined #openstack-ansible19:22
*** e-vad has joined #openstack-ansible19:22
*** hwoarang has joined #openstack-ansible19:22
*** cloudnull has joined #openstack-ansible19:22
*** qwang has joined #openstack-ansible19:22
*** klamath has joined #openstack-ansible19:22
*** ikalnitsky has joined #openstack-ansible19:22
*** _sigmavirus24 has joined #openstack-ansible19:22
*** Apsu has joined #openstack-ansible19:22
*** Guest96370 has joined #openstack-ansible19:22
*** yarkot has joined #openstack-ansible19:22
*** vdo has joined #openstack-ansible19:22
*** alwaysatthenoc has joined #openstack-ansible19:22
*** spedione|AWAY has joined #openstack-ansible19:22
*** h1nch has joined #openstack-ansible19:22
*** dolphm has joined #openstack-ansible19:22
*** arbrandes1 has joined #openstack-ansible19:22
*** gfa has joined #openstack-ansible19:22
*** smurke has joined #openstack-ansible19:22
*** hughmFLEXin has joined #openstack-ansible19:22
*** orwell.freenode.net sets mode: +o cloudnull19:22
*** jimbaker has joined #openstack-ansible19:22
*** luzC has joined #openstack-ansible19:22
*** hj-hpe has joined #openstack-ansible19:22
*** arif-ali has joined #openstack-ansible19:22
*** david-lyle has joined #openstack-ansible19:22
*** aludwar has joined #openstack-ansible19:22
*** itsuugo has joined #openstack-ansible19:22
*** ChanServ has joined #openstack-ansible19:22
*** pfb29 has joined #openstack-ansible19:22
*** gouthamr has joined #openstack-ansible19:22
*** pegmanm has joined #openstack-ansible19:22
*** irtermite has joined #openstack-ansible19:22
*** jcannava has joined #openstack-ansible19:22
*** homerp_ has joined #openstack-ansible19:22
*** lbragstad has joined #openstack-ansible19:22
*** jascott1 has joined #openstack-ansible19:22
*** ZuZuD has joined #openstack-ansible19:22
*** FrankZhang has joined #openstack-ansible19:22
*** errr has joined #openstack-ansible19:22
*** bgmccollum has joined #openstack-ansible19:22
*** palendae has joined #openstack-ansible19:22
*** adreznec has joined #openstack-ansible19:22
*** spotz_zzz has joined #openstack-ansible19:22
*** mgagne has joined #openstack-ansible19:22
*** toan has joined #openstack-ansible19:22
*** Jeffrey4l_ has joined #openstack-ansible19:22
*** shasha_tavil has joined #openstack-ansible19:22
*** vnogin has joined #openstack-ansible19:22
*** eon` has joined #openstack-ansible19:22
*** brad[] has joined #openstack-ansible19:22
*** ajo has joined #openstack-ansible19:22
*** jasondotstar has joined #openstack-ansible19:22
*** alextricity25 has joined #openstack-ansible19:22
*** eglute has joined #openstack-ansible19:22
*** erikmwilson has joined #openstack-ansible19:22
*** xar- has joined #openstack-ansible19:22
*** galstrom_zzz has joined #openstack-ansible19:22
*** bapalm has joined #openstack-ansible19:22
*** furlongm has joined #openstack-ansible19:22
*** mrda has joined #openstack-ansible19:22
*** jhesketh has joined #openstack-ansible19:22
*** matt6434 has joined #openstack-ansible19:22
*** smatzek has joined #openstack-ansible19:22
*** schwicht has joined #openstack-ansible19:22
*** mpotdar has joined #openstack-ansible19:22
*** gus has joined #openstack-ansible19:22
*** orwell.freenode.net sets mode: +o ChanServ19:22
*** neillc has joined #openstack-ansible19:22
*** meteorfox has joined #openstack-ansible19:22
*** d34dh0r53 has joined #openstack-ansible19:22
*** kysse has joined #openstack-ansible19:22
*** fedruantine has joined #openstack-ansible19:22
*** mubix has joined #openstack-ansible19:22
*** mfisch has joined #openstack-ansible19:22
*** mennie has joined #openstack-ansible19:22
*** sunshinekitty has joined #openstack-ansible19:22
*** odyssey4me has joined #openstack-ansible19:22
*** jamielennox has joined #openstack-ansible19:22
*** mhayden has joined #openstack-ansible19:22
*** mrhillsman has joined #openstack-ansible19:22
*** automagically has joined #openstack-ansible19:22
*** charz has joined #openstack-ansible19:22
*** rickflare has joined #openstack-ansible19:22
*** logan- has joined #openstack-ansible19:22
*** mattt has joined #openstack-ansible19:23
*** npawelek has joined #openstack-ansible19:23
*** dmsimard has joined #openstack-ansible19:23
*** jheroux has joined #openstack-ansible19:23
*** cloader89 has joined #openstack-ansible19:23
*** KLevenstein has joined #openstack-ansible19:23
*** kjw3 has joined #openstack-ansible19:23
*** openstackgerrit has joined #openstack-ansible19:23
*** rromans has joined #openstack-ansible19:23
*** mgariepy has joined #openstack-ansible19:23
*** julian1 has joined #openstack-ansible19:23
*** Matias has joined #openstack-ansible19:23
*** portante has joined #openstack-ansible19:23
*** bkreitch has joined #openstack-ansible19:23
*** kencjohnston has joined #openstack-ansible19:23
*** fignew has joined #openstack-ansible19:23
*** antonym has joined #openstack-ansible19:23
*** jduhamel has joined #openstack-ansible19:23
*** Jolrael has joined #openstack-ansible19:23
*** ioni has joined #openstack-ansible19:23
*** jroll has joined #openstack-ansible19:23
*** afranc has joined #openstack-ansible19:23
*** jrosser has joined #openstack-ansible19:23
*** mcarden has joined #openstack-ansible19:23
*** luzC has quit IRC19:23
*** luzC has joined #openstack-ansible19:23
*** prometheanfire has joined #openstack-ansible19:23
*** Reyu has joined #openstack-ansible19:23
*** sulo has joined #openstack-ansible19:23
*** kylek3h has joined #openstack-ansible19:23
*** kstev has joined #openstack-ansible19:23
*** poopcat has joined #openstack-ansible19:23
*** jamesdenton has joined #openstack-ansible19:23
*** jwitko has joined #openstack-ansible19:23
*** evrardjp has joined #openstack-ansible19:23
*** jmccrory has joined #openstack-ansible19:23
*** tlbr has joined #openstack-ansible19:23
*** andymccr has joined #openstack-ansible19:23
*** dragonmaster has joined #openstack-ansible19:23
*** omiday has joined #openstack-ansible19:23
*** nishpatwa_ has joined #openstack-ansible19:23
*** woodard has joined #openstack-ansible19:23
*** johnmilton has joined #openstack-ansible19:23
*** winggundamth_ has joined #openstack-ansible19:23
*** darrenc has joined #openstack-ansible19:23
*** prometheanfire has quit IRC19:24
*** prometheanfire has joined #openstack-ansible19:24
*** nwonknu has joined #openstack-ansible19:24
*** jheroux has quit IRC19:24
*** jheroux has joined #openstack-ansible19:24
*** cloader89 is now known as cjloader19:24
*** weezS has joined #openstack-ansible19:24
*** kylek3h has quit IRC19:24
*** kylek3h has joined #openstack-ansible19:24
*** hughsaunders has joined #openstack-ansible19:24
*** mattt has quit IRC19:24
*** mattt has joined #openstack-ansible19:24
*** nategraf has joined #openstack-ansible19:24
*** agireud has joined #openstack-ansible19:24
*** john51 has quit IRC19:24
*** dragonmaster has quit IRC19:25
*** dmsimard has quit IRC19:25
*** finchd has joined #openstack-ansible19:25
*** dmsimard has joined #openstack-ansible19:26
*** lkoranda has joined #openstack-ansible19:26
*** john51 has joined #openstack-ansible19:27
*** _hanhart has joined #openstack-ansible19:27
*** jperry has quit IRC19:29
Matiasstevelle: gnocchi auto-magically started being feed after rabbitmq fd limit was increased19:35
*** jperry has joined #openstack-ansible19:35
stevelleMatias: excellent, as it should be19:35
Matiasanother issue which took days to solve thanks to unclear ceilometer logs :D19:35
stevellethe systemd part of that was a little obtuse to diagnose19:35
stevelleand yes, it's hard to see useful things in those logs. once you found and shared the error msg it helped a lot though19:36
*** dmsimard is now known as dmsimard|afk19:37
*** rackertom has joined #openstack-ansible19:37
Matiasstevelle: are you planning to send the CORS patch to gnocchi upstream?19:38
*** jperry has quit IRC19:39
MatiasConnections: 206019:40
Matiaswhen we get to double the infra, we will need to increase from 4096 to 8192 in order to be in the safe side19:40
*** karimb has joined #openstack-ansible19:42
Matiasstevelle: http://i.imgur.com/jbvF3tj.png19:43
*** thorst_ has joined #openstack-ansible19:43
stevelleMatias: I was going to start with trying to figure out why it was backed out of the default paste19:47
stevelleiirc it used to be there19:47
openstackgerritMatt Thompson proposed openstack/openstack-ansible: Use correct version when creating backup dir  https://review.openstack.org/36965019:49
*** thorst_ has quit IRC19:51
openstackgerritMatt Thompson proposed openstack/openstack-ansible: Use correct version when creating backup dir  https://review.openstack.org/36965019:52
*** serverascode has joined #openstack-ansible19:53
*** finchd has left #openstack-ansible19:54
*** asettle has joined #openstack-ansible19:59
*** adrian_otto has quit IRC20:00
*** kong has joined #openstack-ansible20:02
*** asettle has quit IRC20:02
*** asettle has joined #openstack-ansible20:02
*** NachoDuck has joined #openstack-ansible20:04
*** izaakk has joined #openstack-ansible20:07
*** ametts has quit IRC20:07
*** maximov_ has joined #openstack-ansible20:08
*** pcaruana has quit IRC20:11
*** tomjosekal has joined #openstack-ansible20:14
*** raddaoui has joined #openstack-ansible20:18
*** askb has joined #openstack-ansible20:21
openstackgerritNish Patwa(IRC: nishpatwa) proposed openstack/openstack-ansible: Merge separate pages for each link to a single page  https://review.openstack.org/36966520:25
hughmFLEXinMatias: does repo only get setup on 1 infra node on a 3 infra setup??20:27
*** Guest96370 is now known as Adri200020:28
*** Adri2000 has quit IRC20:28
*** Adri2000 has joined #openstack-ansible20:28
*** smatzek has quit IRC20:28
*** weezS has quit IRC20:34
*** asettle has quit IRC20:36
*** mattt has left #openstack-ansible20:42
*** mattt has joined #openstack-ansible20:42
*** thorst_ has joined #openstack-ansible20:48
*** weezS has joined #openstack-ansible20:53
*** asettle has joined #openstack-ansible20:55
*** thorst_ has quit IRC20:56
MatiashughmFLEXin: repo-build only runs in one of them because lsyncd replicates to the other nodes20:57
hughmFLEXinMatias: so im trying to debug this whole proxy thing, i see the repo cache ng on the repo container21:01
*** asettle has quit IRC21:02
hughmFLEXini also see all the packages in /var/www21:02
hughmFLEXinnmap doesn't show 3142 as an open port tho :-(21:03
*** SamYaple has joined #openstack-ansible21:03
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-tests: Address ansible_ssh_* var deprecation  https://review.openstack.org/36969721:05
*** asettle has joined #openstack-ansible21:05
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_sahara: Convert role testing to use Ansible 2.1.1  https://review.openstack.org/35361221:05
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: Ansible 2.1.1 role testing  https://review.openstack.org/35356121:08
*** jheroux has quit IRC21:09
*** woodard_ has joined #openstack-ansible21:09
*** woodard has quit IRC21:13
*** woodard_ has quit IRC21:14
cloudnullhughmFLEXin: sorry been in and out all day .21:14
cloudnulldid you get the repo-proxy bits worked out :)21:14
hughmFLEXinnp!21:14
mrdaMorning OSA21:15
cloudnullohai mrda21:15
mrdao/21:15
hughmFLEXini wasn't working so i just edited the common-task/proxy play to comment out the proxy bit21:15
hughmFLEXinhi mrda21:15
hughmFLEXinit*21:15
cloudnullhughmFLEXin: are you using haproxy ?21:15
cloudnulland was the port 3142 open there ?21:16
hughmFLEXinport was not open21:16
hughmFLEXindoes haproxy require me uncommenting it in user_variables.yml?21:16
cloudnullno.21:17
cloudnullit should be added in the base config21:17
cloudnullhttps://github.com/openstack/openstack-ansible/blob/master/playbooks/vars/configs/haproxy_config.yml#L50-L6221:17
cloudnullare you're containers running on an RFC1918 address?21:17
cloudnullbecause the cache has an ACL locking it down21:18
hughmFLEXinyou lost me at RFC1918 :-x21:18
cloudnullhttps://github.com/openstack/openstack-ansible/blob/master/playbooks/vars/configs/haproxy_config.yml#L60-L6221:19
cloudnull^ within those cidrs21:19
cloudnullalso you can set "repo_pkg_cache_enabled: false" in your user-variables.yml file to disable it21:20
hughmFLEXinyea looks like it, containers are running 10.0.3.xxx and 172.29.237.xxx21:21
*** Reyu has quit IRC21:21
hughmFLEXinwhich are both in range21:21
cloudnullok.21:21
*** Reyu has joined #openstack-ansible21:21
cloudnullassuming there were repo-containers in the inventory the haproxy playbook should have done the needful.21:22
cloudnullthe config should exist within /etc/haproxy/conf.d21:22
hughmFLEXinhmm is pip also cached?21:24
cloudnullpip is run from the repo servers21:25
cloudnullor rather, its pinned to the repo servers21:25
cloudnullwhich uses the loadbalancer ip21:26
cloudnull^ internal IP21:26
*** NachoDuck has quit IRC21:27
*** hughsaunders has quit IRC21:27
*** nwonknu has quit IRC21:27
*** sulo has quit IRC21:27
*** kylek3h has quit IRC21:27
*** kstev has quit IRC21:27
*** poopcat has quit IRC21:27
*** jamesdenton has quit IRC21:27
*** jwitko has quit IRC21:27
*** evrardjp has quit IRC21:27
*** jmccrory has quit IRC21:28
*** tlbr has quit IRC21:28
*** evrardjp has joined #openstack-ansible21:28
*** jmccrory_ has joined #openstack-ansible21:28
*** jwitko has joined #openstack-ansible21:28
*** kstev has joined #openstack-ansible21:28
*** poopcat has joined #openstack-ansible21:28
cloudnullso if the LB is down or otherwise unhappy it can cause lots of frustrating issues.21:28
*** kylek3h has joined #openstack-ansible21:28
*** hughsaunders has joined #openstack-ansible21:28
*** sdake_ has joined #openstack-ansible21:28
*** gouthamr has quit IRC21:28
hughmFLEXini think i found the issue...21:28
*** sulo has joined #openstack-ansible21:28
*** tlbr has joined #openstack-ansible21:29
hughmFLEXinthe example user_config doesn't have any mention of haproxy21:29
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Fix log path option  https://review.openstack.org/36764921:29
hughmFLEXinso i didn't specify haproxy hosts21:29
*** jperry has joined #openstack-ansible21:29
hughmFLEXinthe aio user_config does though21:29
*** jmccrory_ is now known as jmccrory21:29
cloudnulloh. that makes sense21:29
hughmFLEXinwell thats frustrating...21:29
cloudnullyea.21:29
*** sdake has quit IRC21:30
hughmFLEXintime to clean up and give it another go...21:30
openstackgerritMerged openstack/openstack-ansible-os_gnocchi: Allow gnocchi to make use of keystone authentication  https://review.openstack.org/36960721:30
cloudnullbummer.21:31
cloudnulllooks like http://docs.openstack.org/developer/openstack-ansible/install-guide/app-config-test.html21:31
cloudnullis the only docs21:31
cloudnullhttp://docs.openstack.org/developer/openstack-ansible/install-guide/app-config-prod.html21:31
cloudnull^ the prod example doesn't mention HAP21:32
cloudnullI guess there should be a blerb there about haproxy or .*"something" so folks know that a load balancer is required.21:32
*** matt6434 is now known as mattoliverau21:33
cloudnullasettle: IDK if you're around, but it'd be nice to add a note about HAP setup in the event no lb already exists in the app-config-prod.html doc21:33
*** severion has joined #openstack-ansible21:33
cloudnullor maybe just a section under http://docs.openstack.org/developer/openstack-ansible/install-guide/app-config-prod.html21:34
cloudnullrather http://docs.openstack.org/developer/openstack-ansible/install-guide/app-config-prod.html#environment-configuration21:34
*** v1k0d3n has quit IRC21:34
cloudnullrromans: -cc ^21:34
cloudnullhughmFLEXin: you should be able to add the hap config in21:34
cloudnulland just run that playbook21:34
cloudnullthen carry on21:34
asettlecloudnull: i'm always around21:34
asettleI never sleep21:34
asettleSLEEP IS FOR THE WEAK21:34
asettleBut I"m in meetings21:34
cloudnullgo to sleep :)21:35
cloudnullbut i approve of your "SLEEP IS FOR THE WEAK" comment21:35
asettlecloudnull: if you have a 'nice to add a note' - submit a bug :) tag it with [DOCS] at the beginning21:35
asettleWe need to track stuff going into the install guide21:35
*** NachoDuck has joined #openstack-ansible21:35
*** nwonknu has joined #openstack-ansible21:35
cloudnullasettle: LP bug inbound21:35
hughmFLEXinyea. ill file something on it later21:36
*** sdake_ is now known as sdake21:36
*** alwaysatthenoc has quit IRC21:37
asettlecloudnull: winner winner chicken dinner :D21:38
cloudnullhughmFLEXin: rromans: asettle: https://bugs.launchpad.net/openstack-ansible/+bug/162320421:41
openstackLaunchpad bug 1623204 in openstack-ansible "[DOCS] app-config-prod.html#environment-configuration should contain a section about HAproxy" [Undecided,New]21:41
hughmFLEXin:thumbsup21:41
asettleLooks good, I'll bring this to Jesse's attention tomorrow. He'll be in the office21:41
*** jperry has quit IRC21:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: [TESTING] all is_metal scenario  https://review.openstack.org/35202421:43
*** gouthamr has joined #openstack-ansible21:45
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-tests: Address ansible_ssh_* var deprecation  https://review.openstack.org/36969721:52
*** asettle has quit IRC21:53
*** thorst_ has joined #openstack-ansible21:53
*** thorst_ has quit IRC22:00
*** v1k0d3n has joined #openstack-ansible22:01
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-tests: Address ansible_ssh_* var deprecation  https://review.openstack.org/36969722:01
*** severion has quit IRC22:03
*** severion has joined #openstack-ansible22:04
openstackgerritSteve Lewis (stevelle) proposed openstack/openstack-ansible-os_glance: DNM: Testing role  https://review.openstack.org/36972622:06
*** severion has quit IRC22:06
*** v1k0d3n_ has joined #openstack-ansible22:06
*** v1k0d3n has quit IRC22:07
*** v1k0d3n_ has quit IRC22:07
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_server: Set permissions on the openstackgit directory  https://review.openstack.org/36899722:07
*** v1k0d3n has joined #openstack-ansible22:08
*** jmckind has quit IRC22:13
*** kylek3h has quit IRC22:15
openstackgerritPaulo Matias proposed openstack/openstack-ansible-rabbitmq_server: Adjust file descriptor limit when systemd is used  https://review.openstack.org/36972922:16
*** woodard has joined #openstack-ansible22:29
*** KLevenstein has quit IRC22:34
openstackgerritMichael Gugino proposed openstack/openstack-ansible-os_nova: Update docs for mixed lxd hypervisors  https://review.openstack.org/36509822:35
*** jwitko has quit IRC22:35
*** woodard has quit IRC22:36
*** itsuugo has quit IRC22:42
*** itsuugo has joined #openstack-ansible22:45
openstackgerritPaulo Matias proposed openstack/openstack-ansible-memcached_server: Adjust file descriptor limit when systemd is used  https://review.openstack.org/36974522:53
*** sdake_ has joined #openstack-ansible22:57
*** thorst_ has joined #openstack-ansible22:58
Matiasone more to go22:59
*** karimb has quit IRC23:00
*** sdake has quit IRC23:00
*** csmart has joined #openstack-ansible23:01
*** weezS has quit IRC23:01
*** hughmFLEXin has quit IRC23:03
*** hughmFLEXin has joined #openstack-ansible23:03
Matiaswill work on it in a couple hours23:03
hughmFLEXinugh just one thing after another23:03
hughmFLEXinMatias: mind taking a peek? https://gist.github.com/bbyhuy/8bb105f7150ec3fcd4f79597f7f3538d23:03
*** thorst_ has quit IRC23:06
*** dmsimard|afk is now known as dmsimard23:11
*** hblah has joined #openstack-ansible23:13
hughmFLEXinill just disable keepalived23:15
*** itsuugo has quit IRC23:20
*** kylek3h has joined #openstack-ansible23:20
*** kylek3h has quit IRC23:20
*** kylek3h has joined #openstack-ansible23:20
*** hughmFLEXin has quit IRC23:21
*** hughmFLEXin has joined #openstack-ansible23:22
*** itsuugo has joined #openstack-ansible23:22
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_server: Set permissions on the openstackgit directory  https://review.openstack.org/36899723:23
*** pmannidi has joined #openstack-ansible23:23
cloudnullMatias: ^23:23
cloudnullhughmFLEXin: re: the keyserver "keyserver.ubuntu.com" not available.23:23
*** adrian_otto has joined #openstack-ansible23:24
cloudnulldid you remove the apt-proxy bits ?23:24
*** kylek3h has quit IRC23:24
hughmFLEXinjust did23:24
cloudnullwell.. "No route to host" seems odd.23:24
hughmFLEXinits cool...im just gonna set keepalive and package cache both to false23:24
hughmFLEXinand see if it goes through23:24
cloudnullok23:25
cloudnullyea. give it a go.23:25
cloudnullI suspect the package cache should work now being that the loadbalancer is setup .23:25
stevellecloudnull: just FYI review 369726 shows that we have a broken glance role, which is giving 'broken pipe' consistently on image upload consistently23:25
cloudnullhughmFLEXin: just a question, did you intend to deploy newton(master)?23:26
hughmFLEXinwhatever is in the latest docs is what i'm following23:27
cloudnullit's great we're getting reports about issues but master isn't the most stable system at this point.23:27
hughmFLEXin:-(23:27
cloudnullits close to stable23:27
hughmFLEXinReplace TAG with the current stable release tag : 14.0.0.0b323:27
cloudnullbut newton(master) wont be released for a few weeks23:27
cloudnullthats the beta3 release of v14 (newton)23:28
hughmFLEXini guess another doc issue is in order :-P23:28
hughmFLEXinpoint to both stable and upstream tags23:28
cloudnullrromans: asettle: ^23:29
cloudnullthat might be a good thing to highlight on the master docs that it isn't considered stable.23:30
*** Jeffrey4l_ is now known as Jeffrey4l23:30
cloudnullhughmFLEXin: I was just asking and I for sure don't mean to disheartened you.23:30
hughmFLEXinoh np23:31
cloudnulland from the sound of it, it looks like your close to being up and running23:31
hughmFLEXinadding those two false flags to user_variables seems to have pushed it further than previously23:31
hughmFLEXinso lets hope it keeps going23:31
cloudnullgood stuff23:31
cloudnullstevelle: do we know what is breaking glance?23:31
stevellecloudnull: haven't figured it out yet, just getting solid repros now23:32
*** jwitko has joined #openstack-ansible23:32
cloudnullcurious if it's something in upstream glance .23:33
cloudnullbeing that the head of the os_glance role is tracking master glance it could be a recent change that is making things very unhappy23:33
*** klamath has quit IRC23:34
stevellecloudnull: fair guess that it is an upstream issue right now since no changes have gone into glance role in weeks23:36
*** rk4n has joined #openstack-ansible23:36
stevellenothing particular in the logs except warnings though23:36
*** klamath has joined #openstack-ansible23:37
cloudnullit also could be our lib ?23:37
cloudnullmaybe the API changed?23:37
hughmFLEXinso of the three setup plays....is setup_openstack.yml the most stable? :-D23:38
stevellecloudnull: v2 api should be default now, but our tests leave both enabled23:39
cloudnullhughmFLEXin: its the easist of the group :)23:39
cloudnullonce the infra is inplace openstack is simple. :p23:39
cloudnulli wonder if there is a possible conflict between v1/223:40
cloudnullconnection refused is interesting though .23:40
cloudnullthat may be something in swift23:40
*** rk4n has quit IRC23:40
cloudnulland because glance doesn't do logging well we may missing something.?23:41
hughmFLEXincloudnull: yay....23:41
cloudnullmore breakage?23:41
cloudnullor great success?23:42
*** woodard has joined #openstack-ansible23:43
*** itsuugo has quit IRC23:46
*** itsuugo has joined #openstack-ansible23:47
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-tests: Address ansible_ssh_* var deprecation  https://review.openstack.org/36969723:48
*** schwicht has quit IRC23:54
* cloudnull migrating home.23:58
cloudnullstevelle: if you find something and need help working on it let me know, i'm happy to lend a hand23:58
hughmFLEXinomfg it is still running23:58
hughmFLEXinno errors yet23:59
cloudnullW00T!23:59
hughmFLEXini need a drink23:59
hughmFLEXinthis is stressful23:59
cloudnull:(23:59
hughmFLEXinspoke too soon23:59
hughmFLEXinfatal: [infra3_utility_container-5a523191]: FAILED! => {"changed": false, "cmd": "/usr/local/bin/pip install -U gnocchiclient python-openstackclient python-ceilometerclient python-cinderclient python-glanceclient python-heatclient python-keystoneclient python-neutronclient python-novaclient python-ironicclient python-saharaclient python-swiftclient python-memcached pycrypto", "failed": true, "msg": "stdout: Ignoring indexes23:59
hughmFLEXin: https://pypi.python.org/simple\nCollecting gnocchiclient\n\n:stderr:   Could not find a version that satisfies the requirement gnocchiclient (from versions: )\nNo matching distribution found for gnocchiclient\n"}23:59
cloudnullwhich playbook was that?23:59
hughmFLEXinutility23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!