Wednesday, 2017-06-14

*** cathrich_ has joined #openstack-ansible00:08
*** cathrichardson has quit IRC00:08
*** TxGirlGeek has quit IRC00:13
*** fyu has joined #openstack-ansible00:30
*** thorst_afk has joined #openstack-ansible00:34
*** thorst_afk has quit IRC00:38
*** perniciouscaffei has quit IRC00:42
*** yolanda has joined #openstack-ansible00:46
*** hybridpollo has quit IRC00:48
*** thorst_afk has joined #openstack-ansible00:50
*** poopcat has quit IRC00:52
*** hybridpollo has joined #openstack-ansible00:56
*** dweaver` has joined #openstack-ansible00:59
*** lucasxu has joined #openstack-ansible01:00
*** dweaver has quit IRC01:00
*** ivveh has quit IRC01:00
*** ivveh has joined #openstack-ansible01:01
*** lucasxu has quit IRC01:01
*** thorst_afk has quit IRC01:01
*** dxiri has quit IRC01:03
*** poopcat has joined #openstack-ansible01:04
*** piliman974 has joined #openstack-ansible01:05
*** esberglu has joined #openstack-ansible01:08
*** dxiri has joined #openstack-ansible01:08
*** cNilesh has joined #openstack-ansible01:12
*** esberglu has quit IRC01:12
*** cpuga_ has quit IRC01:12
*** cpuga has joined #openstack-ansible01:13
*** ianychoi has joined #openstack-ansible01:14
*** acormier has joined #openstack-ansible01:15
*** yolanda has quit IRC01:16
*** acormier_ has joined #openstack-ansible01:17
*** cpuga has quit IRC01:17
*** acormier has quit IRC01:19
*** dxiri has quit IRC01:33
*** dxiri has joined #openstack-ansible01:34
*** SerenaFeng has joined #openstack-ansible01:40
*** dxiri has quit IRC01:47
*** dxiri has joined #openstack-ansible01:54
*** thorst_afk has joined #openstack-ansible02:02
*** piliman974 has quit IRC02:04
*** SerenaFeng has quit IRC02:06
*** thorst_afk has quit IRC02:06
*** nwonknu has quit IRC02:12
*** dxiri has quit IRC02:13
*** acormier_ has quit IRC02:15
*** acormier has joined #openstack-ansible02:15
*** nwonknu has joined #openstack-ansible02:15
*** nwonknu is now known as Guest1880102:16
*** acormier has quit IRC02:19
*** dxiri has joined #openstack-ansible02:20
*** cpuga has joined #openstack-ansible02:24
*** poopcat has quit IRC02:24
*** esberglu has joined #openstack-ansible02:24
*** dxiri has quit IRC02:24
*** acormier has joined #openstack-ansible02:26
*** poopcat has joined #openstack-ansible02:29
*** cathrich_ has quit IRC02:43
*** acormier has quit IRC02:49
*** japestinho has joined #openstack-ansible02:52
*** thorst_afk has joined #openstack-ansible02:56
*** SerenaFeng has joined #openstack-ansible02:58
*** SerenaFeng has quit IRC03:01
*** acormier has joined #openstack-ansible03:02
*** finchd has quit IRC03:08
*** fyu has quit IRC03:11
*** fyu has joined #openstack-ansible03:12
*** thorst_afk has quit IRC03:16
*** acormier has quit IRC03:17
*** acormier has joined #openstack-ansible03:18
*** Sense8 has joined #openstack-ansible03:22
*** ivve has joined #openstack-ansible03:31
cloudnullevenings03:35
*** acormier_ has joined #openstack-ansible03:39
*** acormier has quit IRC03:42
*** chhavi has joined #openstack-ansible03:59
*** poopcat has quit IRC04:06
*** gouthamr_ has joined #openstack-ansible04:06
*** winggundamth has joined #openstack-ansible04:08
*** gkadam has joined #openstack-ansible04:08
*** gouthamr has quit IRC04:09
*** thorst_afk has joined #openstack-ansible04:13
*** esberglu has quit IRC04:23
*** acormier_ has quit IRC04:26
*** hybridpollo has quit IRC04:28
*** EmilienM has quit IRC04:30
*** EmilienM has joined #openstack-ansible04:38
*** cuongnv has joined #openstack-ansible04:42
*** galstrom_zzz is now known as galstrom04:46
*** thorst_afk has quit IRC04:48
*** mikal has quit IRC04:48
*** galstrom is now known as galstrom_zzz04:49
*** mikal has joined #openstack-ansible04:50
*** japestinho has quit IRC05:02
*** udesale has joined #openstack-ansible05:19
*** gouthamr_ has quit IRC05:29
*** Sense8 has quit IRC05:33
*** abhishek_k has quit IRC05:35
*** armaan has joined #openstack-ansible05:43
*** adreznec has quit IRC05:43
*** adreznec has joined #openstack-ansible05:43
*** ghs39ghsggf has joined #openstack-ansible05:45
*** ghs39ghsggf has left #openstack-ansible05:45
*** tobberydberg has joined #openstack-ansible05:50
*** cuongnv has quit IRC05:50
*** Amit82 has joined #openstack-ansible05:59
Amit82Hi All06:01
Amit82I am trying Auto scaling in OpenStack Newton06:01
Amit82 And I am facing this error in Aodh Notifier: http://paste.openstack.org/show/612496/06:01
Amit82Any clue?06:01
Amit82I have configure Aodh, Ceilometer with MongoDB06:01
*** SerenaFeng has joined #openstack-ansible06:02
*** markus_z has joined #openstack-ansible06:11
*** chhavi has quit IRC06:13
*** tobberydberg has quit IRC06:13
*** tobberydberg has joined #openstack-ansible06:14
*** Oku_OS-away is now known as Oku_OS06:14
*** tobberydberg has quit IRC06:15
*** tobberydberg has joined #openstack-ansible06:15
*** galstrom_zzz is now known as galstrom06:18
*** winggundamth has quit IRC06:18
*** SerenaFeng has quit IRC06:20
*** ricardoas has quit IRC06:21
*** markus_z has quit IRC06:22
*** tobberydberg has quit IRC06:22
*** tobberydberg has joined #openstack-ansible06:22
*** markus_z has joined #openstack-ansible06:23
*** tobberydberg has quit IRC06:27
*** tobberydberg has joined #openstack-ansible06:27
*** tobberydberg has quit IRC06:28
*** tobberydberg has joined #openstack-ansible06:29
*** manheim_ has joined #openstack-ansible06:33
*** manheim_ has quit IRC06:38
*** manheim_ has joined #openstack-ansible06:38
hwoaranggood day. it appears that tests still fail because of https://bugs.launchpad.net/openstack-ansible/+bug/1697531 even though the fix has been merged06:40
openstackLaunchpad bug 1697531 in openstack-ansible "Galera server fail to start on CentOS." [High,In progress] - Assigned to Major Hayden (rackerhacker)06:40
hwoarangfor example http://logs.openstack.org/34/468034/2/check/gate-openstack-ansible-tests-ansible-func-centos-7/f7bc1fa/console.html06:40
*** manheim_ has quit IRC06:42
*** cNilesh has quit IRC06:44
*** cNilesh has joined #openstack-ansible06:45
*** thorst_afk has joined #openstack-ansible06:46
*** galstrom is now known as galstrom_zzz06:50
*** thorst_afk has quit IRC06:50
*** galstrom_zzz is now known as galstrom06:52
Amit82how can we start openstack service endpoints on http rather than https06:56
Amit82is there any configuration option for this while deploying OpenStack06:56
*** manheim_ has joined #openstack-ansible06:56
Amit82?06:56
*** jiteka has joined #openstack-ansible06:58
*** jiteka has quit IRC06:59
*** manheim_ has quit IRC06:59
*** manheim__ has joined #openstack-ansible06:59
*** MrC_ has joined #openstack-ansible07:00
*** manheim__ has quit IRC07:02
*** manheim_ has joined #openstack-ansible07:03
*** manheim_ has quit IRC07:03
*** manheim_ has joined #openstack-ansible07:03
neithseems like lxc mount entries are missing the starting slash07:05
neithlxc.mount.entry = /openstack/backup/log1_rsyslog_container-5874a2b0 var/backup none bind 0 007:05
neithdoesn't seem expected07:05
*** manheim_ has quit IRC07:10
*** tobberydberg has quit IRC07:11
*** tobberydberg has joined #openstack-ansible07:11
*** tobberydberg has quit IRC07:13
*** tobberydberg has joined #openstack-ansible07:14
*** cpuga has quit IRC07:15
*** SerenaFeng has joined #openstack-ansible07:16
*** manheim_ has joined #openstack-ansible07:16
neithnevermind, I understood the doc07:23
odyssey4mehwoarang yeah, I'm busy working on it07:29
hwoarangah ok07:29
*** armaan has quit IRC07:29
odyssey4meAmit82 yes, all you need to do is set 'openstack_service_publicuri_proto: http' in your user_variables.yml file before deployment07:30
odyssey4meneith yes, that's confusing and caught us in the early days, but that is correct formatting :)07:31
*** armaan has joined #openstack-ansible07:31
neithodyssey4me: I'm fighting to understand why I cant share files through the mount listed above07:32
odyssey4meneith what do you mean by 'share files' ?07:33
neithodyssey4me: if I create a file in /openstack/backup/log1_rsyslog_container-5874a2b0 on the host I cant see it in the container @ /var/backup07:33
*** vnogin has joined #openstack-ansible07:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Copy tempest subunit result files to log folder  https://review.openstack.org/44935207:37
odyssey4meneith hmm, but if you put one there from inside the container, can you see it on the host?07:38
*** SerenaFeng has quit IRC07:38
openstackgerritChenjun Shen proposed openstack/openstack-ansible-haproxy_server master: Replace hard coded timeout values with variables  https://review.openstack.org/47220007:39
openstackgerritChenjun Shen proposed openstack/openstack-ansible-haproxy_server master: Replace hard coded timeout values with variables  https://review.openstack.org/47220007:40
neithodyssey4me: not either07:40
*** vnogin has quit IRC07:41
*** shardy has joined #openstack-ansible07:43
odyssey4meneith is this one of the default bind mounts, or an extra one you've added?07:43
neithodyssey4me: the default07:44
odyssey4mehmm, odd - and have you verified that it's not a permissions issue?07:44
odyssey4mechmod the directory/file to make it visible to everyone07:45
*** thorst_afk has joined #openstack-ansible07:46
*** thorst_afk has quit IRC07:51
*** vnogin has joined #openstack-ansible07:58
*** tobberyd_ has joined #openstack-ansible08:00
*** tobberydberg has quit IRC08:03
*** cshen has joined #openstack-ansible08:06
*** galstrom is now known as galstrom_zzz08:09
*** yolanda_ has joined #openstack-ansible08:09
*** cpuga has joined #openstack-ansible08:16
Amit82odyssey4me: thanks08:17
*** cpuga has quit IRC08:21
*** winggundamth has joined #openstack-ansible08:28
*** tobberydberg has joined #openstack-ansible08:29
evrardjphello08:29
*** tobberyd_ has quit IRC08:31
*** pbandark has joined #openstack-ansible08:31
evrardjpodyssey4me: I've seen the backport of the fix of galera08:31
evrardjpfor centos08:31
evrardjphowever: https://review.openstack.org/#/c/473368/08:31
evrardjpthis morning failed08:31
odyssey4meevrardjp the workaround is not working08:32
evrardjpok08:32
odyssey4meit's installing the lower version of lxc correctly, but mariadb is still failing08:32
odyssey4meI'm busy trying to figure out what's going on. If you can also spend some time looking into it I'd appreciate it - another set of eyes is useful.08:32
evrardjpoh :(08:32
evrardjpsure08:33
odyssey4meright now I'm trying to see whether it's failing before or after the upgrade08:33
odyssey4meand also testing whether the newer version of mariadb works08:33
evrardjpspinning up a machine and doing galera tests08:38
*** electrofelix has joined #openstack-ansible08:40
*** ianychoi has quit IRC08:43
Amit82Hi, I want to set "rest_notifier_ssl_verify: False" in aodh.conf08:47
markus_zIs there a simple config to switch off the usage of all containers? I only found a way to do it on every service with "is_metal: true".08:47
*** thorst_afk has joined #openstack-ansible08:47
Amit82Should I set this in user_variables.yml and re-run the playbooks?08:47
odyssey4memarkus_z there is no single switch, no - note that haproxy will interfere with all the services unless you have haproxy on a dedicated host08:49
odyssey4meAmit82 yes, as with all settings08:49
evrardjpmarkus_z: you're doing experimental things there :p but yes is_metal the thing. Maybe it's possible to override that with user_ * variables but I doubt it.08:49
markus_zodyssey4me: ah, thanks for the heads-up with haproxy.08:51
*** thorst_afk has quit IRC08:52
markus_zevrardjp: yeah, it's a test I'm not super happy with. We have a little challenges to fit the setup within our HW network setup.08:52
odyssey4memarkus_z there really isn't that much point putting everything on metal - it'll actually cause more pain than gain08:53
markus_zodyssey4me: That's what I'm afraid of, yes.08:53
markus_zodyssey4me: The backstory is (private) network related, probably too complicated to explain here.08:56
*** armaan has quit IRC08:56
*** manheim_ has quit IRC08:57
*** manheim has joined #openstack-ansible08:57
*** coolj has quit IRC08:59
*** markvoelker has quit IRC09:01
*** manheim has quit IRC09:01
*** tobberyd_ has joined #openstack-ansible09:01
odyssey4meevrardjp ok, so if I create a container and install the packages manually, it still breaks09:02
*** tobberydberg has quit IRC09:05
*** coolj has joined #openstack-ansible09:09
*** coolj has quit IRC09:10
*** coolj has joined #openstack-ansible09:12
*** coolj has quit IRC09:12
*** manheim_ has joined #openstack-ansible09:14
*** coolj has joined #openstack-ansible09:15
*** tobberyd_ has quit IRC09:18
*** manheim_ has quit IRC09:18
*** tobberydberg has joined #openstack-ansible09:19
*** tobberydberg has quit IRC09:19
*** tobberydberg has joined #openstack-ansible09:19
*** gkadam is now known as gkadam-afk09:20
evrardjpmarkus_z: it doesn't seem impossible to do ANY kind of network with openstack-ansible09:23
evrardjpodyssey4me: so my test without the upgrade worked09:23
odyssey4meevrardjp oh really? that's weird - I've been testing without the upgrades manually and it's not working09:24
odyssey4memaybe I'm missing something?09:24
evrardjpwell09:24
evrardjpweirdly working09:24
odyssey4meI do think that perhaps we should split the upgrade into its own job though09:25
evrardjpthe mysql is running09:25
evrardjpbut doing systemctl complains about init09:25
evrardjpwell that's super weird09:26
evrardjpso let me rephrase what I said09:26
evrardjp   Loaded: loaded (/etc/rc.d/init.d/mysql; bad; vendor preset: disabled)09:26
evrardjp   Active: failed (Result: exit-code) since Wed 2017-06-14 09:17:25 UTC; 9min ago09:26
evrardjpafter the first part of the upgrade job (so old code deployed)09:27
evrardjpbut mysql is working fine09:27
evrardjpand the systemctl on container 2 and 3 is fine09:27
Amit82odyssey4me: I ran os-aodh-install.yml playbook and os-ceilometer-install.yml playbooks after adding "rest_notifier_ssl_verify: False" in user_variables.yml09:27
Amit82but after the playbooks are ran successfully, I am checking aodh.conf then it is not containing "rest_notifier_ssl_verify: False"09:28
evrardjpodyssey4me: and I have lxc 2.0.809:28
evrardjpnow I am doing the upgrade.09:28
odyssey4meAmit82 ah, you're not using the conf override properly09:28
Amit82any idea what can be the reason?09:28
Amit82ok, how to use it properly?09:29
odyssey4meAmit82 see https://docs.openstack.org/project-deploy-guide/openstack-ansible/newton/app-advanced-config-override.html#overriding-conf-files09:29
odyssey4meyou'll need to apply the use of the conf override for anything we don't have a var for09:29
odyssey4methe aodh.conf override is https://github.com/openstack/openstack-ansible-os_aodh/blob/master/defaults/main.yml#L16109:29
odyssey4meevrardjp odd, because as you'll see in https://github.com/lxc/lxc/issues/1623 I'm not having any luck at all09:30
evrardjpodyssey4me: so keep in mind there is maybe something busted with the 1 first node of the cluster, in all the cases, in the systemctl status. There could be a red-herring09:30
Amit82odyssey4me: thanks, I am trying09:33
evrardjpodyssey4me: the upgrade part failed09:34
evrardjphowever, weirdly mysql is running on my container 2 and 309:36
evrardjpand a restart is working perfectly fine on my container 209:37
odyssey4meevrardjp in my testing I have been ignoring the cluster stuff and just tried to get it going on a single node09:39
evrardjpI even stopped the container and restarted09:40
odyssey4meall I've been doing is getting lxc-container-create to give me the containers... then doing all the config inside manually09:40
evrardjpexcept the first one that's busted before the upgrade, all the others are working perfectly fine09:40
odyssey4mewhat version are they running?09:40
evrardjpof what?09:40
odyssey4memariadb09:40
odyssey4meis it 10.0 or 10.1 ?09:41
evrardjpmysql  Ver 15.1 Distrib 10.0.31-MariaDB, for Linux (x86_64) using readline 5.109:41
odyssey4meok, so that's the pre-upgrade state09:41
evrardjpyeah the upgrade failed09:41
evrardjpit looks to me it's a galera thing09:41
odyssey4metry removing these so that it only does a 10.1 build: https://github.com/openstack/openstack-ansible-galera_server/blob/master/tests/test.yml#L22-L2909:41
odyssey4melemme try and install 10.0 and see if I get success like you do09:42
evrardjpodyssey4me: I just removed these lines to see the upgrade and it failed, but didn't restart from scratch09:42
evrardjplet me do it09:42
odyssey4me10.0 starts just fine with lxc 2.0.609:44
odyssey4melemme try with lxc 2.0.809:44
evrardjpI'm with 2.0.809:44
odyssey4meah, 10.0 does not use systemd09:45
evrardjpit shows up using systemct but there are indeed init things going on09:45
evrardjpI didn't check what the unit file is09:45
odyssey4meyeah, so I suspect that 10.0 doesn't use the 'PrivateDevices=true' setting09:46
odyssey4meso 10.0 running is not useful diagnostically09:46
odyssey4meand the issue is not necessarily upgrade related, but instead it's related to 10.1 using systemd properly09:47
odyssey4meI just find it a bit curious that this all worked just fine not long ago, but now it's not working at all - even with the older lxc version09:47
*** thorst_afk has joined #openstack-ansible09:48
odyssey4meI'm running the functional test without the previous version install for both versions of LXC now09:49
*** ianychoi has joined #openstack-ansible09:49
*** yolanda_ has quit IRC09:55
*** thorst_afk has quit IRC10:07
*** cuongnv has joined #openstack-ansible10:08
*** stuartgr has joined #openstack-ansible10:16
*** piliman974 has joined #openstack-ansible10:22
*** armaan has joined #openstack-ansible10:32
*** cNilesh has quit IRC10:37
*** cNilesh has joined #openstack-ansible10:37
*** Amit82 has quit IRC10:38
*** cNilesh has quit IRC10:40
*** cNilesh has joined #openstack-ansible10:40
*** cNilesh has quit IRC10:47
*** winggundamth has quit IRC10:48
*** Amit82 has joined #openstack-ansible10:50
Amit82Is it sufficient to run setup-openstack.yml playbook after setting "openstack_service_publicuri_proto: http" in user_variables.yml?10:50
Amit82or I need to run setup-hosts.yml, setup-infrastructure.yml as well?10:51
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: defaults: main: Set default host disk size to 16G  https://review.openstack.org/47415010:52
odyssey4meAmit82 just openstack I think10:53
odyssey4menot sure if it will work on an existing deployment though - you'll have to try it and see10:53
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Fix race condition regression  https://review.openstack.org/47415411:00
evrardjpodyssey4me: ^ this is a serious regression that will need backport11:01
*** markvoelker has joined #openstack-ansible11:01
*** Amit82 has quit IRC11:02
*** thorst_afk has joined #openstack-ansible11:04
*** udesale has quit IRC11:05
*** thorst_afk has quit IRC11:09
odyssey4meevrardjp ah, nice catch that!11:12
odyssey4meevrardjp oh bummer, that problem made it into the last releases so for the backports you'll have to do a release note11:14
*** Amit82 has joined #openstack-ansible11:17
Amit82To fix this issue: https://bugs.launchpad.net/openstack-ansible/+bug/169525811:17
openstackLaunchpad bug 1695258 in openstack-ansible "OSA Newton 14.2.4: Aodh evaluator showing MissingAuthPlugin error" [Low,Confirmed]11:17
Amit82where to make changes so that contents of aodh.conf are same as aodh_workaround.conf attached in the bug11:18
*** cpuga has joined #openstack-ansible11:18
*** vnogin has quit IRC11:19
*** vnogin has joined #openstack-ansible11:20
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: DNM - Testing lxc-attach with clear environments  https://review.openstack.org/47181411:20
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: DNM - Testing lxc-attach with clear environments  https://review.openstack.org/47181411:20
odyssey4meAmit82 it looks like that needs a template patch11:20
*** cpuga has quit IRC11:22
*** vnogin has quit IRC11:26
*** lostRhino has joined #openstack-ansible11:27
odyssey4meAmit82 you can use a config override for the conf file to set it correctly11:27
*** piliman974 has quit IRC11:28
Amit82odyssey4me: can you guide how to do it?11:30
Amit82can a temporary fix be achieved through user_variables.yml, if correct one is cumbersome?11:32
*** vnogin has joined #openstack-ansible11:35
*** markvoelker has quit IRC11:36
odyssey4meAmit82 use the same conf override approach I shared with you earlier11:37
odyssey4methat approach can be used to set *anything* in the conf file11:37
Amit82but how to delete lines like "os_auth_url" with "auth_url"?11:39
lostRhinogoog morning11:40
lostRhinogood*11:40
lostRhinoWe are trying to perform a bootstrap-ansible with an offline/disconnected rack - and the process is failing when it is trying to setup the virtualenvs,  and I’m getting the following error, http://paste.openstack.org/show/612532/,11:40
lostRhino, the problem is that he url that it states it fails on - doesn’t even exist in pypi - there is no package listing under the simple index.  So how would we get past this error?  Is this a pip version issue with the virtualenv?  any help would be highly and greatly appreciated11:40
*** acormier has joined #openstack-ansible11:41
*** SerenaFeng has joined #openstack-ansible11:42
*** thorst_afk has joined #openstack-ansible11:42
*** SerenaFeng has quit IRC11:44
*** gkadam-afk is now known as gkadam11:45
*** acormier has quit IRC11:47
*** coolj has quit IRC11:50
*** coolj has joined #openstack-ansible11:50
lostRhinoupdaed paste - to have full error output at the end11:52
lostRhinohttp://paste.openstack.org/show/612536/11:52
*** thorst_afk has quit IRC11:53
*** markvoelker has joined #openstack-ansible11:53
*** vnogin has quit IRC11:54
*** qcrivera has joined #openstack-ansible11:56
*** markvoelker has quit IRC11:59
*** markvoelker has joined #openstack-ansible12:02
*** vnogin has joined #openstack-ansible12:03
*** dxiri has joined #openstack-ansible12:03
*** dxiri has quit IRC12:03
*** dxiri has joined #openstack-ansible12:04
*** cmart has joined #openstack-ansible12:06
odyssey4meAmit82 the lines have moved - they don't need to be deleted, they just need to be changed to the right value12:10
mgariepygood morning everyone12:10
*** manheim has joined #openstack-ansible12:11
odyssey4melostRhino do you have a pypi mirror internally?12:11
odyssey4mea full mirror I mean?12:11
odyssey4meincluding the simple index?12:11
lostRhinoyes12:11
lostRhinoIve added extra indexes of the wheel mirrors - just incase12:12
odyssey4meis that error happening when this command is executed? https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L10812:13
odyssey4meor this one? https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L11912:13
lostRhinoyessir12:13
odyssey4meor this one? https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L12512:13
lostRhinoits the first one on the virtualenv creation12:13
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-rabbitmq_server master: DNM - Testing 474150  https://review.openstack.org/47418112:13
odyssey4mehmm, ok12:14
odyssey4meI'm guessing that URL comes from some sort of known pre-hash or cache12:14
odyssey4meare you overriding the default index for any other pip install tasks?12:14
odyssey4meit's just this one that's going to pypi instead of your internal thing12:15
Amit82odyssey4me: on a separate note, running setup-openstack.yml again after adding "openstack_service_publicuri_proto: http" in user_variables.yml,12:15
Amit82now two public service endpoints are there for each service12:15
lostRhinoit is? — it’s says it cant find the internal user/pypi/simple/pkg-resources12:16
mhaydenmorning12:17
odyssey4meAmit82 yes, you'll need to manually remove the old one12:17
lostRhinomorning …12:17
*** acormier has joined #openstack-ansible12:17
odyssey4memhayden thanks for registering that upstream issue - I did more digging this morning with no joy, and just got more confused12:18
mhaydenodyssey4me / mgariepy / evrardjp: i was told by someone in #systemd that the /dev/ptmx bind mount issue has been fixed in recent versions12:18
odyssey4methen had to move on to other work12:18
odyssey4meoh, and then there's that12:18
odyssey4meso now what?12:18
mhaydenwell, if that's the case, then we'd need to lodge a bug with Red Hat to get the fix backported, then wait for it to reach CentOS12:19
odyssey4medo we drop an override into the container to elevate security based on the systemd version? sounds like a horrible workaround to me12:19
mhaydenbut systemd is in the critical path, so that requires a lot of testing and things on their end12:19
mhaydenwell, there's no reason to bind mount /dev/ptmx in the container itself, except to appease a poorly written AppArmor policy12:19
mhaydenthat's the whole reason why the symlink was pulled and replaced with a bind mount12:20
odyssey4melostRhino you could try using https://virtualenv.pypa.io/en/stable/userguide/#the-extra-search-dir-option ?12:20
odyssey4meyou can add it to the VIRTUALENV_OPTIONS env var12:20
mhaydenodyssey4me: i'm inclined to drop PrivateDevices=True from the MariaDB service file *IF* MariaDB is running within a container12:20
odyssey4memhayden except that apparmor is not involved here at all12:20
mhaydenbecause we already have plenty of isolation around the container itself12:21
mhaydenodyssey4me: right12:21
odyssey4memhayden but doesn't that actually reduce the security posture?12:21
mhaydenthe code that was put into LXC tries a bind mound, and if it's successful, it skips the symlink process12:21
mhaydenthere's no configurable option to specify which one you want12:21
mhaydenodyssey4me: if you're running MariaDB on a bare host and you remove PrivateDevices, it reduces security12:22
mhaydenbut we have compensating controls (the container namespaces + SELinux)12:22
mhaydeni'd propose we remove PrivateDevices=true on CentOS *IF* MariaDB is in a container12:22
lostRhinoodyssey4me - which directory do you want me to point to?12:22
odyssey4mehmm, ok so then we need to have a default var that enables this change - and in the integrated repo we set that var based on is_metal12:22
odyssey4melostRhino offhand I have no idea - the hosts's distribution/system directory for python stuff?12:23
lostRhinook - running12:23
lostRhinofailed - I just dont get why its trying to find “pkg_resources” there is no package named that ….12:24
lostRhinowould using virtualenv 15.01 be an issue?12:29
*** acormier has quit IRC12:29
odyssey4melostRhino no idea, honestly - and I'm not in a position to test at the moment12:29
*** dxiri_ has joined #openstack-ansible12:30
*** schwicht has joined #openstack-ansible12:30
*** dxiri has quit IRC12:30
odyssey4meevrardjp did you see the question in https://review.openstack.org/#/c/472146/1/playbooks/repo-build.yml ?12:34
*** vnogin has quit IRC12:34
evrardjpboth work12:35
*** dxiri_ has quit IRC12:35
evrardjpI will comment12:35
*** dxiri has joined #openstack-ansible12:36
*** schwicht has quit IRC12:37
evrardjpodyssey4me: could you ping ppl on the channel for the next weeks to take over the bug triage duties?12:39
odyssey4memhayden so would we want to set this globally, or set it per service?12:39
odyssey4meevrardjp you're on holiday?12:40
*** schwicht has joined #openstack-ansible12:40
evrardjpyes12:40
odyssey4meoh ok, from when? are you in the meeting tomorrow - because we could ask for help then?12:41
*** acormier has joined #openstack-ansible12:41
*** acormier has quit IRC12:41
*** jamesden_ has joined #openstack-ansible12:41
*** acormier has joined #openstack-ansible12:42
odyssey4memhayden in other words, should we implement it as part of the container prep in lxc-container-create... or should we implement it as part of the mariadb/memcache/whatever setup?12:42
evrardjpTomorrow I will be available and working. I'll add this to the agenda12:42
odyssey4meok good, thanks12:43
odyssey4memhayden thinking about it, I guess we'd have to do it as part of the mariadb/whatever setup12:43
*** gouthamr has joined #openstack-ansible12:44
*** jamesdenton has quit IRC12:44
mhaydenindeed -- want to me to put a patch in there?12:45
odyssey4memgariepy already has something going: https://review.openstack.org/#/c/473879/512:46
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/ocata: Fix ansible-hardening references in tox/playbook  https://review.openstack.org/47383112:46
*** acormier has quit IRC12:46
evrardjpmhayden: could you vote on this? https://review.openstack.org/#/c/474154/ it's important12:46
odyssey4memhayden I'd suggest updating that one. I don't think he'll mind.12:46
mhaydenodyssey4me: added a comment to that one12:47
mhaydenevrardjp: looking12:47
mgariepyno I don't mind.12:47
evrardjpthanks mhayden12:48
mgariepyI need to upgrade my cloud so I won't be available this morning.12:48
lostRhinoodyssey4me - doing a “pip install --upgrade virtualenv” - has gotten me past THAT error - thanks for your help (new error to work on … :D)12:51
*** dxiri has quit IRC12:51
odyssey4melostRhino :)12:52
mhaydenmgariepy: i'll try to get a look at it12:52
*** dxiri has joined #openstack-ansible12:56
mgariepythanks mhayden12:56
*** armaan has quit IRC12:56
*** armaan has joined #openstack-ansible12:56
*** schwicht has quit IRC12:58
*** vnogin has joined #openstack-ansible13:00
*** manheim has quit IRC13:08
*** vnogin has quit IRC13:10
*** manheim has joined #openstack-ansible13:10
*** schwicht has joined #openstack-ansible13:10
*** vnogin has joined #openstack-ansible13:11
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47387913:13
mhaydenodyssey4me / mgariepy: my humble attempt ^^13:14
*** lucasxu has joined #openstack-ansible13:15
mgariepyif that works, we should do the same for memcached role :D13:15
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47387913:15
*** klamath has joined #openstack-ansible13:16
odyssey4memhayden one nit, otherwise fantastic13:16
*** dxiri has quit IRC13:16
*** klamath has quit IRC13:16
mhaydenOOOOOOOOOOOOOOOOOOOOOOOOORLY13:16
odyssey4memhayden oh, one more thing - you'll need to set that var to true in the test vars13:17
*** gkadam has quit IRC13:17
*** klamath has joined #openstack-ansible13:17
odyssey4mejust do it in https://github.com/openstack/openstack-ansible-galera_server/blob/master/tests/group_vars/all_containers.yml13:17
mhaydenoh, the default isn't good enough for that?13:17
*** kylek3h has joined #openstack-ansible13:17
odyssey4meor https://github.com/openstack/openstack-ansible-galera_server/blob/master/tests/galera_server-overrides.yml13:17
odyssey4meoh I see13:18
*** dxiri has joined #openstack-ansible13:18
*** openstackgerrit has quit IRC13:18
odyssey4meI would expect we default it to false, then turn it on is is_metal is true13:18
odyssey4me(which we do in the group_vars)13:18
mhaydenoh, i think i see what you're saying13:18
odyssey4meie a more secure default13:18
*** Amit82 has quit IRC13:18
*** qcrivera has quit IRC13:19
odyssey4mein case someone is using this on bare metal without our group vars13:19
*** cpuga has joined #openstack-ansible13:20
*** dxiri has quit IRC13:20
*** openstackgerrit has joined #openstack-ansible13:21
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47387913:21
*** dxiri has joined #openstack-ansible13:21
mhaydenoof, didn't adjust the commit msg13:21
evrardjpI didn't follow the whole thing, did you do something in openstack-ansible yet?13:22
*** jwitko_ has joined #openstack-ansible13:22
evrardjpto map the var when is_metal?13:22
odyssey4meevrardjp no, not yet13:22
odyssey4mefor now we'll just see if it passes13:22
*** esberglu has joined #openstack-ansible13:22
odyssey4mealthough with a depends-on I guess the cross-repo testing will take effect if a patch is done to openstack-ansible :)13:23
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47387913:23
mhaydenokay, that should be sane there13:23
*** cpuga has quit IRC13:24
odyssey4memhayden shall we revert the lxc pin?13:25
mhaydenfor sure ;)13:25
evrardjpreviewed13:26
*** jwitko_ has quit IRC13:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/ocata: Revert "Use LXC v2.0.6 on CentOS"  https://review.openstack.org/47419813:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Revert "Use LXC v2.0.6 on CentOS"  https://review.openstack.org/47419913:26
*** jwitko_ has joined #openstack-ansible13:26
*** dmsimard has joined #openstack-ansible13:27
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Replace hard coded timeout values with variables  https://review.openstack.org/47220013:35
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/ocata: Revert "Use LXC v2.0.6 on CentOS"  https://review.openstack.org/47419813:37
*** dxiri has quit IRC13:38
*** dxiri has joined #openstack-ansible13:43
*** jamesden_ has quit IRC13:45
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47387913:47
*** smatzek has joined #openstack-ansible13:49
odyssey4memhayden either add the template file, or leave content as the source ;)13:49
*** dxiri has quit IRC13:49
*** vnogin has quit IRC13:50
*** jamesdenton has joined #openstack-ansible13:50
*** vnogin has joined #openstack-ansible13:51
*** dxiri has joined #openstack-ansible13:54
*** cjloader has joined #openstack-ansible13:56
*** cpuga has joined #openstack-ansible14:00
*** cjloader has quit IRC14:01
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Copy tempest subunit result files to log folder  https://review.openstack.org/44935214:01
mhaydenodyssey4me: well darnit14:01
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47387914:02
*** dxiri has quit IRC14:04
evrardjpodyssey4me: mhayden: is this only gonna happen ever for galera on centos, or should we expect the same issues with ubuntu in the future?14:04
*** cpuga has quit IRC14:04
mhaydenevrardjp: haven't seen it yet on ubuntu14:04
mhaydennot entirely sure why -- the bug was fixed in systemd 23014:04
mhaydensystemd/systemd#325414:05
*** cpuga has joined #openstack-ansible14:05
*** dxiri has joined #openstack-ansible14:06
odyssey4meevrardjp I tested on ubuntu and it works fine there right now - we can always remove the conditional later14:06
odyssey4meI'm not sure if the suse distribution has an issue with this - perhaps we should restrict this to centos/rhel only?14:07
*** MrC_ has quit IRC14:09
mhaydenodyssey4me: it's like that in the conditional check14:10
mhaydenhttps://review.openstack.org/#/c/473879/11/tasks/galera_post_install.yml14:10
*** qcrivera has joined #openstack-ansible14:10
*** dmsimard has quit IRC14:10
odyssey4memhayden oh yes, suse is zypper14:11
evrardjpwell my point is still valid, if we think we need to use this for all distro, because it's a sensible thing to do, then just merge with previous task14:13
evrardjpor, alternatively, make this a vars/ depending on the distro14:13
evrardjp(which mean another var if we want the override for the is metal...)14:13
odyssey4meevrardjp it's a reduction in the security posture, so I'd rather we only did it where we *have* to.14:15
odyssey4mewe do have other layers of protection, but still - the more the better14:15
evrardjpon that I agree14:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: DO NOT MERGE - test setting nova back to master  https://review.openstack.org/46994114:17
openstackgerritMerged openstack/openstack-ansible master: Fix race condition regression  https://review.openstack.org/47415414:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/ocata: Copy tempest subunit result files to log folder  https://review.openstack.org/47421414:21
*** manheim has quit IRC14:21
strattaobeen beating my head trying to figure out what the process is to get my custom client installed. If I have python-fooclient in my git repo, where to I tell openstack-ansible to use it?14:21
*** manheim has joined #openstack-ansible14:22
strattaoI can’t see where the other python-whateverclients are getting pulled down and installed in the utility container.14:23
evrardjpstrattao: we are using a special variable name14:24
evrardjplet me give you an example14:24
evrardjphttps://github.com/openstack/openstack-ansible-os_neutron/blob/master/vars/main.yml#L48-L6014:25
evrardjpif in your role you have _pip_packages, the packages will be listed in the repo build process14:25
evrardjpso they will be built and usable14:25
evrardjpthen it's just a question of where do you install the appropriate clients14:25
*** dxiri has quit IRC14:26
evrardjpfor example for utility we do this: https://github.com/openstack/openstack-ansible/blob/master/playbooks/utility-install.yml#L66-L7614:26
*** manheim has quit IRC14:26
odyssey4meyeah, except that list is unfortunately not picked up by the repo build process14:29
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/ocata: Fix race condition regression  https://review.openstack.org/47422314:29
strattaoevrardjp: thanks, I’m overriding the utility_pip_packages in my user_foo_variables.yml file to include my python-fooclient, but I’m still struggling to figure out where to tell the repo build process where my fooclient repo lives14:29
odyssey4meif you create any arbitrary _pip_packages list in user_variables.yml then it should get picked up and built in the repo14:30
odyssey4mestrattao ah14:30
*** dxiri has joined #openstack-ansible14:30
*** lostRhino has left #openstack-ansible14:30
odyssey4meis the package available via pypi, or some sort of pypi internal thing?14:30
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/ocata: Fix race condition regression  https://review.openstack.org/47422314:30
odyssey4meor is it a git repo?14:30
strattaoodyssey4me: yeah, it’s an internal repo14:31
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/newton: Fix race condition regression  https://review.openstack.org/47422614:31
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/newton: Fix race condition regression  https://review.openstack.org/47422614:31
odyssey4mea git repo? ok, then you'll need to add stuff like this into a user_*.yaml file in /etc/openstack_deploy https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/repo_packages/projectcalico.yml14:31
odyssey4methe git repo url, the install branch for a pinned sha or branch name14:32
odyssey4methen the project group you can have as 'all' or leave out (it will default to all)14:32
odyssey4meyou can then run the py_pkgs lookup to verify that it's being picked up - or just run repo_build and look at the lookup output14:33
strattaook, I think that gives me enough to keep poking around. thanks for your help!14:35
odyssey4mesure thing :)14:35
*** ricardoas has joined #openstack-ansible14:39
openstackgerritNolan Brubaker proposed openstack/openstack-ansible master: [WIP] Implement rolling upgrades for glance  https://review.openstack.org/47423114:39
*** woodard has joined #openstack-ansible14:39
*** woodard has quit IRC14:39
*** woodard has joined #openstack-ansible14:40
palendaeodyssey4me: Did cinder happen to change over to Alembic during Newton, Ocata, and Pike?14:42
palendaeLooks like Glance changed theirs during Ocata =\ https://docs.openstack.org/developer/glance/db.html14:43
odyssey4mepalendae fun14:44
odyssey4methat means we'll have to implement different playbooks for each branch14:45
palendaeYep14:45
palendaeOr at least master/Ocata and Newton14:45
odyssey4meand no, it doesn't seem like cinder has changed much since mitaka14:45
cloudnullanyone around to review this https://review.openstack.org/#/c/473573/14:45
*** galstrom_zzz is now known as galstrom14:45
odyssey4meit does also mean that we may have a zero down time master major upgrade process, but older branches will have down time - but for a major that's ok14:46
palendaeYeah14:46
cloudnullIMO getting current stable hipe erlang for both cent and ubuntu would be great .14:46
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Revert "Use LXC v2.0.6 on CentOS"  https://review.openstack.org/47419914:46
*** galstrom is now known as galstrom_zzz14:46
*** cjloader_ has joined #openstack-ansible14:46
mgariepymhayden, http://paste.openstack.org/show/612557/ on newton.14:47
odyssey4mefor the moment let's get master done, then worry about the backports once they're merged14:47
mgariepyseems like testing for a config file isn't really a good test to see if  the service is there :D haha14:47
odyssey4memgariepy yeah, newton may require the use of the systemd module because they're not using action plugins there14:48
palendaeodyssey4me: Yeah, will focus on that14:48
mgariepymhayden, how do I skip this one tag ?14:49
odyssey4memgariepy --skip-tag <tag>14:49
mgariepycan't I just put something in my user_var ?14:49
mhaydenmgariepy: --skip-tag V-3865614:51
*** dxiri has quit IRC14:52
mgariepyhmm I guess the second time it won't be an issue since the config file will not change..14:54
*** piliman974 has joined #openstack-ansible14:54
*** dxiri has joined #openstack-ansible14:55
*** tobberyd_ has joined #openstack-ansible15:01
*** vnogin has quit IRC15:03
*** vnogin has joined #openstack-ansible15:03
*** tobberydberg has quit IRC15:04
*** manheim has joined #openstack-ansible15:06
*** tobberyd_ has quit IRC15:06
*** manheim has quit IRC15:07
*** phalmos has joined #openstack-ansible15:08
*** dcdamien has joined #openstack-ansible15:12
*** banhgao has joined #openstack-ansible15:14
*** dxiri has quit IRC15:14
*** dxiri has joined #openstack-ansible15:20
*** manheim has joined #openstack-ansible15:21
dcdamienHello folks. Have anybody here deployed OSAD with Galera cluster without issues? I'm actually testing deployment of Ocata but it always fail on Galera part. It always install mariadb on first node then starts it and fails bacause of wsrep can't connect to second node. Second node doesn't even have mariadb installed.15:23
dcdamienPLAY RECAP ********************************************************************* infra1_galera_container-7efa2654 : ok=71   changed=8    unreachable=0    failed=1 infra2_galera_container-d875dd3a : ok=6    changed=0    unreachable=0    failed=015:23
odyssey4medcdamien are you using your own playbook?15:23
*** yolanda_ has joined #openstack-ansible15:23
dcdamienIt is ok=71 vs. ok=6 on the second node15:23
odyssey4meand what OS is it?15:23
dcdamiennope, this is galera-install.yml from openstack-ansible15:24
dcdamienUbuntu 16.0415:24
odyssey4methe playbook we have runs in serial, so if the first fails then it will not continue - that's why the second hasn't done much15:24
odyssey4mesomething went wrong on the first15:24
dcdamienLooks like it tries to start mariadb and it can't connect to the second node because it is not yet deployed :>15:26
dcdamien2017-06-14 16:58:23 140645110229248 [Warning] WSREP: (e9d9be06, 'tcp://0.0.0.0:4567') address 'tcp://192.168.180.59:4567' points to own listening address, blacklisting 2017-06-14 16:58:26 140645110229248 [Note] WSREP: (e9d9be06, 'tcp://0.0.0.0:4567') connection to peer e9d9be06 with addr tcp://192.168.180.59:4567 timed out, no messages seen in PT3S 2017-06-14 16:58:26 140645110229248 [Warning] WSREP: no nodes coming from p15:26
*** ArchiFleKs has quit IRC15:26
openstackgerritMerged openstack/openstack-ansible-galera_server master: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47387915:27
dcdamienJust before mariadb exits: WSREP: gcs/src/gcs.cpp:gcs_open():1404: Failed to open channel 'openstack_galera_cluster' at 'gcomm://192.168.180.59,192.168.180.13': -110 (Connection timed out)15:29
evrardjpI'm betting a generic error with the network configuration.15:30
dcdamienIs is possible for galera to start if the second cluster member is not listening?15:30
dcdamien(yet)15:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47425115:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: Added log link tasks so the role can run on metal  https://review.openstack.org/44987415:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: vars: main: Split percona packages from the galera server ones.  https://review.openstack.org/47094415:31
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server stable/ocata: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47425115:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: tasks: galera_upgrade_post: Retry if starting the MariaDB service failed  https://review.openstack.org/47094515:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: Sync test files with the openstack-ansible-tests repository  https://review.openstack.org/47094615:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: tasks: Set Restart option for systemd service file  https://review.openstack.org/47094715:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: Add support for the openSUSE Leap distributions  https://review.openstack.org/44524815:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: Dynamically include upgrade_check task files  https://review.openstack.org/47114815:33
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Install specific version of Erlang from ESL  https://review.openstack.org/47357315:33
*** dxiri has quit IRC15:34
dcdamiengalera container on the second node (with mariadb not yet deployed) is reachable from first one15:34
*** ArchiFleKs has joined #openstack-ansible15:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron master: Normalise distro package installation  https://review.openstack.org/47226115:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Ensure that services restart in a particular order  https://review.openstack.org/47268915:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Implement data migrations for rolling upgrades  https://review.openstack.org/47040815:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer master: Switch to Cryptography over pycrypto  https://review.openstack.org/47165215:35
banhgaoHello everyone! I'm quite new to OpenStack and I'm trying to configure a testing environment starting from the All-in-one quickstart guide. I have a running setup, however I cannot find how to create an external network in order to expose the VM instances on the host physical interface. Is it possible to specify the network creation in the neutron playbook configuration or do I have to create the network manually?15:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_gnocchi master: Switch to Cryptography over pycrypto  https://review.openstack.org/47165815:35
*** dmsimard has joined #openstack-ansible15:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Switch to Cryptography over pycrypto  https://review.openstack.org/47165715:36
mhaydenevrardjp: if you want to chime in on https://review.openstack.org/#/c/474251/15:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Add reload support to init file  https://review.openstack.org/47353715:37
evrardjpok15:38
*** tobberydberg has joined #openstack-ansible15:41
odyssey4mebanhgao you can opt to run the os-tempest-install playbook which will create a default prject, user and some network things - or create them manually yourself15:44
*** tobberydberg has quit IRC15:45
*** ArchiFleKs has quit IRC15:46
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Install specific version of Erlang from ESL  https://review.openstack.org/47357315:49
*** galstrom_zzz is now known as galstrom15:52
banhgaothanks odyssey4me, I'll try it15:54
*** dxiri has joined #openstack-ansible15:55
*** ArchiFleKs has joined #openstack-ansible15:56
*** fyu has quit IRC16:04
dcdamienAs I know first mariadb cluster member should be started with --wsrep-new-cluster option but looks like galera playbook is not passing this option16:04
*** dxiri has quit IRC16:05
*** Oku_OS is now known as Oku_OS-away16:08
strattaoodyssey4me: I see my python-fooclient code in the repo container, but I can’t do a pip install python-fooclient… any insight into what I’m missing?16:09
dcdamienWhen I get failed container on the first node then start mysql manually with --wsrep-new-cluster and then run galera-install.yml playbook limited to container on the second node it works16:10
*** dxiri has joined #openstack-ansible16:11
*** vnogin has quit IRC16:18
*** dxiri has quit IRC16:18
dcdamien@odyssey4me any ideas?16:20
neithis it save to destroy all rabbitmq container and rebuild them?16:21
neithsafe16:21
*** banhgao has left #openstack-ansible16:21
odyssey4mestrattao so it's there - is it in your current os-releases tag folder?16:22
odyssey4meneith as long as you're happy to lose rpc transactions in progress, yes16:23
neithodyssey4me: ok thks16:23
odyssey4medcdamien we test in our test systems a cluster of three, and we (Rackspace) have additional test systems which are verifying that it all works too across multiple nodes... so I'm a little confused about what's going on in your env16:24
*** vnogin has joined #openstack-ansible16:24
strattaoodyssey4me: no, I don’t see it in my os-releases tag folder. I see the code only in /repo/openstackgit/16:28
palendaeodyssey4me: In https://review.openstack.org/#/c/469955/25/playbooks/common-tasks/restart-service.yml, you set 'section: "{{ service_name}}"' and reference ansible_local['openstack_ansible']['cinder']; however, I don't see anywhere referencing the cinder section except when disabling migrations16:28
*** SerenaFeng has joined #openstack-ansible16:28
odyssey4mepalendae see the dependant os_cinder patches16:29
palendaeAhh16:29
odyssey4mestrattao hmm, can you share the relevant user_variables settings and the resulting *.txt files in your os-releases folder?16:29
odyssey4mevia pastebin/gist or something16:29
*** dxiri has joined #openstack-ansible16:31
strattaoI don’t see any txt files in the os-releases folder… only the wheels… I assume I’m looking in the wrong place then...16:32
*** dcdamien has quit IRC16:34
openstackgerritNolan Brubaker proposed openstack/openstack-ansible master: [WIP] Implement rolling upgrades for glance  https://review.openstack.org/47423116:34
*** dxiri has quit IRC16:35
*** phalmos has quit IRC16:35
*** phalmos has joined #openstack-ansible16:39
*** yolanda_ has quit IRC16:40
*** yolanda_ has joined #openstack-ansible16:40
openstackgerritMerged openstack/openstack-ansible stable/ocata: Fix race condition regression  https://review.openstack.org/47422316:43
*** lucasxu has quit IRC16:43
*** yolanda_ has quit IRC16:43
*** yolanda_ has joined #openstack-ansible16:43
*** SerenaFeng has quit IRC16:44
*** vnogin has quit IRC16:46
neithi'm trying log in the rabbitmq http server to check statistics but using the login monitoring with the password in user_secret just fail !16:48
neiththough the cluster is up16:48
neithand healthy16:48
*** dxiri has joined #openstack-ansible16:57
*** vnogin has joined #openstack-ansible16:58
*** rstarmer has joined #openstack-ansible17:02
*** vnogin has quit IRC17:02
openstackgerritMerged openstack/openstack-ansible stable/newton: Fix race condition regression  https://review.openstack.org/47422617:04
*** markus_z has quit IRC17:05
*** rstarmer has quit IRC17:07
*** manheim has quit IRC17:08
*** electrofelix has quit IRC17:09
*** manheim has joined #openstack-ansible17:15
*** phalmos_ has joined #openstack-ansible17:15
*** cuongnv has quit IRC17:17
flaviodsrodyssey4me I have found the problem in https://review.openstack.org/#/c/468407/ and fixed it, should I submit another patch? one of the reviewers stated that I should not do that, however if I do submit another patch it won't pass on the tests, am I missing something?17:17
*** phalmos has quit IRC17:18
openstackgerritMerged openstack/openstack-ansible-galera_server master: Dynamically include upgrade_check task files  https://review.openstack.org/47114817:18
*** manheim has quit IRC17:19
*** galstrom is now known as galstrom_zzz17:23
*** armaan has quit IRC17:23
*** shardy has quit IRC17:24
*** rstarmer has joined #openstack-ansible17:26
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Install specific version of Erlang from ESL  https://review.openstack.org/47357317:27
*** dxiri has quit IRC17:29
*** pcaruana has quit IRC17:29
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Install specific version of Erlang from ESL  https://review.openstack.org/47357317:29
*** dxiri has joined #openstack-ansible17:31
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-os_glance master: Implement db sync and restart facts for upgrades  https://review.openstack.org/47429917:31
openstackgerritNolan Brubaker proposed openstack/openstack-ansible master: [WIP] Implement rolling upgrades for glance  https://review.openstack.org/47423117:32
*** galstrom_zzz is now known as galstrom17:32
kylek3hcloudnull: You around?17:33
cloudnullyup17:33
kylek3hgot time for a question?17:33
*** rstarmer has quit IRC17:34
*** rstarmer has joined #openstack-ansible17:35
*** lostRhino has joined #openstack-ansible17:36
*** lostRhino has left #openstack-ansible17:36
kylek3hcloudnull: I was trying to use the conf file override support and ran into an issue with dnsmasq.  It's conf file doesn't have section headers so parsing the conf file blows up.17:36
*** rstarmer has quit IRC17:37
cloudnullkylek3h: is this something we're already enabling os something new?17:38
cloudnull**or17:38
kylek3hexisting.17:38
*** lucasxu has joined #openstack-ansible17:38
cloudnullyou have a link to an example?17:39
kylek3hhere's the mitaka link to doc on it: https://docs.openstack.org/developer/openstack-ansible/mitaka/install-guide/configure-openstack.html17:39
kylek3hunder the neutron section it says dnsmasq is supported:  neutron_dnsmasq_neutron_conf_overrides17:39
kylek3hand there is a task that attempts it.17:40
kylek3hhttp://paste.openstack.org/show/612577/17:40
kylek3hbut I'm using newton, btw...17:40
kylek3hI can write a bug...just wondered if you've run into it before or know of any work arounds.17:41
*** electrofelix has joined #openstack-ansible17:46
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server master: Install specific version of Erlang from ESL  https://review.openstack.org/47357317:47
*** galstrom is now known as galstrom_zzz17:47
strattaoodyssey4me: thanks for your help - I think the issue was that no projects had my python-fooclient as a requirement, so it was never being built. On a side note, is there an easy way I can specify which repos I want build when I do openstack-ansible repo-build.yml?17:48
*** schwicht has quit IRC17:49
odyssey4mestrattao so if you have the git_repo vars in user_variables, and the egg name is in a _pip_packages var in user_variables, then it should build17:49
odyssey4meif it doesn't, then it'd be good to know17:49
*** dxiri has quit IRC17:54
strattaoodyssey4me so I want to do something like openstack-ansible repo-build.yml —limit python-fooclient but I get a “skipping: no hosts matched”17:57
*** stuartgr has quit IRC17:57
strattaoer, sorry - ERROR! Specified --limit does not match any hosts17:57
*** dxiri has joined #openstack-ansible17:59
strattaodunno if what I’m trying to do is even possible though18:00
*** schwicht has joined #openstack-ansible18:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Dynamically include upgrade_check task files  https://review.openstack.org/47431018:09
*** yolanda__ has joined #openstack-ansible18:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Dynamically include upgrade_check task files  https://review.openstack.org/47431018:10
*** yolanda_ has quit IRC18:10
*** galstrom_zzz is now known as galstrom18:18
*** dxiri has quit IRC18:19
*** rromans has quit IRC18:29
*** electrofelix has quit IRC18:29
openstackgerritMerged openstack/openstack-ansible-galera_server stable/ocata: Disable PrivateDevices for Galera on CentOS 7  https://review.openstack.org/47425118:32
*** dxiri has joined #openstack-ansible18:33
mhaydenyay!18:37
mgariepygood job mhayden and odyssey4me :)18:38
mhaydenmgariepy: now to make the patch for the integrated repo :/18:38
mgariepyand memcached18:38
mgariepycan this be set for all services in systemd ?18:39
mgariepyor it needs to be set per service >/18:39
mgariepy?18:39
*** vnogin has joined #openstack-ansible18:39
mhaydenso far per service18:40
*** dxiri has quit IRC18:41
openstackgerritCharles Farquhar proposed openstack/openstack-ansible-os_swift master: Add support for swift3 middleware  https://review.openstack.org/37441618:41
*** tobberydberg has joined #openstack-ansible18:46
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/ocata: Set PrivateDevices=false for Galera  https://review.openstack.org/47431418:46
mhaydenodyssey4me / mgariepy: feel free to throw stones at https://review.openstack.org/#/c/474314/18:47
odyssey4memgariepy yeah, considering that it's a reduction in security posture - let's go with a per-service implementation for now18:47
EmilienModyssey4me: hey18:47
odyssey4memhayden add a release note indicating that the var mentioned in the role release note is automatically set based on whether the service is in a container or not18:48
EmilienModyssey4me: I'm doing a little bit of research to compare how Kolla and OpenStack Ansible generate config files18:48
*** tobberydberg has quit IRC18:48
EmilienModyssey4me: i was wondering what are the diff, if you both use templates18:48
*** tobberydberg has joined #openstack-ansible18:49
*** tobberydberg has quit IRC18:49
*** tobberydberg has joined #openstack-ansible18:49
odyssey4memhayden also, master first18:49
mhaydencrap, did i put it in ocata?18:50
mhayden:|18:50
* mhayden goes for coffee18:50
*** galstrom is now known as galstrom_zzz18:50
odyssey4meEmilienM for policy.json, api-paste.ini we currently fetch them from the git source... we're working on doing the same for rootwrap. For the .conf files we template them. We have an ansible module that accepts an arbitrary dict to allow any setting to be added to any of them, and also allow a complete file override for most of them.18:51
odyssey4meEmilienM https://docs.openstack.org/project-deploy-guide/openstack-ansible/draft/app-advanced-config-override.html18:52
odyssey4methat prevents us needing to have some sort of variable for every possible openstack setting18:52
odyssey4methe .conf is templated because it containers most of the glue18:53
*** dxiri has joined #openstack-ansible18:53
odyssey4methe policy.json and api-paste are not templated any more because they were taken verbatim from upstream anyway18:53
EmilienModyssey4me: perfect, it helps me to understand thanks18:54
odyssey4medoes that make much sense? it's been a long day for me18:54
EmilienModyssey4me: do you think how different is it from Kolla?18:54
EmilienModyssey4me: no it's excellent, thanks18:54
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Set PrivateDevices=false for Galera  https://review.openstack.org/47431618:54
odyssey4meEmilienM it's been a long while since I looked at kolla's config implementation, but I think for config files they do a merge of anything a deployer provides into their template18:55
odyssey4meit's similar to ours, but only covers the ini files I think18:55
odyssey4metheir approach is to use a user-space config file, merged over their template18:56
EmilienModyssey4me: is config_template standard in Ansible?18:56
mhaydenodyssey4me: okay, i've put this in the right place now18:56
mhaydenhttps://review.openstack.org/47431618:56
EmilienModyssey4me: or did you write this plugin yourself?18:56
odyssey4meEmilienM no - we tried to upstream it, but they felt it duplicated too much of their code and suggested an implementaiton which for us would not perform at scale18:57
odyssey4meEmilienM the ceph-ansible project uses it though, for the same reasons18:57
EmilienMok I see18:57
EmilienMit confirms what I thought18:57
EmilienMthanks again18:57
EmilienModyssey4me: you going to Denver?18:58
odyssey4meI'm sure that we'd be happy to work out some sort of collective set of plugins if there's interest from other parties.18:58
odyssey4meOur plugins repo is already separate, but is currently very specific to our needs. We could split some things out and figure out some sort of openstack shared plugins things if there's desire for it.18:58
EmilienModyssey4me: where is the code for https://github.com/openstack/openstack-ansible-plugins/blob/master/library/config_template ?18:59
odyssey4meDenver - no idea at this time. :/18:59
odyssey4meEmilienM it's in https://github.com/openstack/openstack-ansible-plugins18:59
EmilienMwhere exactly?18:59
odyssey4meit's an action plugin, so it's partly in the library folder and partly in the action folder18:59
EmilienMah I see18:59
odyssey4methe code is here: https://github.com/openstack/openstack-ansible-plugins/tree/master/action19:00
odyssey4methe stub is here: https://github.com/openstack/openstack-ansible-plugins/blob/master/library/config_template19:00
odyssey4meit adds a layer on top of the standard ansible template module19:00
odyssey4mewe've been using it since kilo and it's really saved our bacon19:01
EmilienMgotcha19:01
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-os_glance master: Implement db sync and restart facts for upgrades  https://review.openstack.org/47429919:02
*** dxiri_ has joined #openstack-ansible19:06
*** dxiri has quit IRC19:06
*** ricardoas has quit IRC19:09
openstackgerritMajor Hayden proposed openstack/monitorstack master: Require 99% test coverage or higher  https://review.openstack.org/47432319:09
mhaydencloudnull: ^^19:09
*** armaan has joined #openstack-ansible19:13
*** dxiri_ has quit IRC19:19
palendaeDang19:20
palendaeStrict19:20
*** vnogin has quit IRC19:20
*** eaxiom has joined #openstack-ansible19:20
eaxiomhi all19:21
eaxiomI am trying to install openstack using openstack ansible  on bare metal servers . I have one compute node and one controller /network node.  There are two nics installed on both servers..19:22
*** vnogin has joined #openstack-ansible19:23
mgariepygalera upgrade is kinda bumpy..19:26
mgariepygenerating 4000 traceback and counting ...19:27
*** dxiri has joined #openstack-ansible19:31
odyssey4memgariepy what're you upgrading from and to?19:36
odyssey4meeaxiom ok, and? we have a sample config for your scenario - appendix a, then use networking from b19:36
mgariepymitaka to newton.19:37
odyssey4memgariepy ah, a bumpy ride indeed19:37
mgariepy13.3.6 to 14.2.419:37
odyssey4meif you can push patches for things that need fixing, that'd be appreciated19:37
mgariepywell i'm not quite sure what need to be fixed..19:39
odyssey4meat least we have n->o and o->p testing done periodically, but that still doesn't give coverage of everything, and does depend on people looking at the logs and doing something about it19:39
openstackgerritMerged openstack/monitorstack master: Require 99% test coverage or higher  https://review.openstack.org/47432319:39
mgariepyfor galera I guess it would be better to upgrade, ![0] first, then maybe try to move connection to the other nodes ..19:40
mgariepybut I'm really not sure how it should be done.. or how long would it take.19:41
mgariepyanyway it's much better than some other project.. and way better than doing it by hand. :D19:43
eaxiomodyssey4me: sorry for the incomplete communication.. let me have a look at the appendix a and networking B19:43
*** galstrom_zzz is now known as galstrom19:43
odyssey4memgariepy our role does upgrades as a functional test, but obviously it doesn't have much data to work with19:44
odyssey4meif there's something to improve there, we should19:45
mgariepyyeah.19:45
mgariepyI know :)19:45
odyssey4meanyway, my brain is turning to mush - time for me to allow it to do so on the couch19:47
odyssey4meg'night all19:47
odyssey4megood luck with that upgrade mgariepy - hope it goes smoothly19:47
mgariepyyeah it will.19:48
mgariepyworst case i have the knowledge to debug the thing ;D19:48
mgariepyor I can find support over here hehe19:48
*** cpuga has quit IRC19:49
*** dxiri has quit IRC19:49
*** cpuga has joined #openstack-ansible19:49
*** dxiri has joined #openstack-ansible19:50
eaxiomi am not using any separate network for storage.. Is it still important to use a cidr in the openstack_user_config.yml ?   storage: 172.29.244.0/2219:53
*** tobberydberg has quit IRC20:09
*** tobberydberg has joined #openstack-ansible20:09
*** hybridpollo has joined #openstack-ansible20:13
*** tobberydberg has quit IRC20:14
*** tobberydberg has joined #openstack-ansible20:16
*** tobberydberg has quit IRC20:16
*** tobberydberg has joined #openstack-ansible20:17
*** piliman974 has quit IRC20:20
*** dxiri has quit IRC20:21
*** tobberydberg has quit IRC20:21
*** hybridpollo has quit IRC20:21
*** dxiri has joined #openstack-ansible20:21
*** piliman974 has joined #openstack-ansible20:22
*** smatzek has quit IRC20:22
openstackgerritNolan Brubaker proposed openstack/openstack-ansible master: [WIP] Implement rolling upgrades for glance  https://review.openstack.org/47423120:23
*** dxiri has quit IRC20:26
*** rromans has joined #openstack-ansible20:26
*** dxiri has joined #openstack-ansible20:26
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-os_glance master: Implement db sync and restart facts for upgrades  https://review.openstack.org/47429920:28
openstackgerritMerged openstack/monitorstack master: [Docs] Fix path to example config file  https://review.openstack.org/47397920:28
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-os_glance master: Implement db sync and restart facts for upgrades  https://review.openstack.org/47429920:34
*** hybridpollo has joined #openstack-ansible20:35
openstackgerritNolan Brubaker proposed openstack/openstack-ansible-os_glance master: Implement db sync and restart facts for upgrades  https://review.openstack.org/47429920:38
*** armaan has quit IRC20:40
*** cjloader_ has quit IRC20:43
*** cjloader_ has joined #openstack-ansible20:43
*** gouthamr has quit IRC20:45
*** armaan has joined #openstack-ansible20:46
*** cjloader_ has quit IRC20:48
*** pbandark has quit IRC20:48
*** armaan has quit IRC20:50
*** dxiri has quit IRC20:50
*** jwitko__ has joined #openstack-ansible20:50
*** dxiri has joined #openstack-ansible20:50
*** armaan has joined #openstack-ansible20:53
*** jwitko_ has quit IRC20:54
*** dmsimard has quit IRC20:56
*** woodard has quit IRC21:04
*** lucasxu has quit IRC21:06
*** dxiri has quit IRC21:08
*** dxiri has joined #openstack-ansible21:08
*** gouthamr has joined #openstack-ansible21:11
*** qcrivera has quit IRC21:16
*** kylek3h has quit IRC21:16
*** piliman974 has quit IRC21:19
openstackgerritMerged openstack/openstack-ansible-galera_server stable/ocata: Dynamically include upgrade_check task files  https://review.openstack.org/47431021:22
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Install specific version of Erlang from ESL  https://review.openstack.org/47357321:25
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-rabbitmq_server stable/ocata: Install specific version of Erlang from ESL  https://review.openstack.org/47436221:29
*** schwicht has quit IRC21:30
*** esberglu has quit IRC21:31
*** dmsimard has joined #openstack-ansible21:33
*** dxiri has quit IRC21:38
*** dxiri has joined #openstack-ansible21:43
*** dxiri has quit IRC21:53
*** dxiri has joined #openstack-ansible21:54
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common SystemD init role  https://review.openstack.org/46617921:54
openstackgerritJimmy McCrory proposed openstack/monitorstack master: Verify https connections by default  https://review.openstack.org/47436621:56
*** klamath has quit IRC21:57
*** schwicht has joined #openstack-ansible22:00
*** woodard has joined #openstack-ansible22:01
*** woodard has quit IRC22:02
*** woodard has joined #openstack-ansible22:02
*** yolanda__ has quit IRC22:07
*** yolanda__ has joined #openstack-ansible22:15
*** dxiri has quit IRC22:15
*** yolanda__ is now known as yolanda22:15
*** cmart has quit IRC22:19
*** dxiri has joined #openstack-ansible22:19
*** yolanda has quit IRC22:23
*** jamesdenton has quit IRC22:24
*** schwicht has quit IRC22:31
*** schwicht has joined #openstack-ansible22:33
*** vnogin has quit IRC22:33
*** schwicht has quit IRC22:36
*** dxiri has quit IRC22:40
*** dxiri has joined #openstack-ansible22:41
*** esberglu has joined #openstack-ansible22:43
*** esberglu has quit IRC22:48
*** cpuga has quit IRC22:48
*** dxiri has quit IRC22:51
*** dxiri has joined #openstack-ansible22:56
*** galstrom is now known as galstrom_zzz23:00
*** dxiri has quit IRC23:02
*** dxiri has joined #openstack-ansible23:03
openstackgerritJimmy McCrory proposed openstack/monitorstack master: Verify https connections by default  https://review.openstack.org/47436623:08
*** eaxiom has quit IRC23:21
*** dxiri has quit IRC23:24
*** dxiri has joined #openstack-ansible23:24
*** armaan has quit IRC23:25
*** armaan has joined #openstack-ansible23:25
*** dxiri has quit IRC23:28
*** manheim has joined #openstack-ansible23:35
*** galstrom_zzz is now known as galstrom23:35
*** manheim has quit IRC23:40
*** bauruine has quit IRC23:40
*** manheim has joined #openstack-ansible23:41
*** bauruine has joined #openstack-ansible23:46
*** galstrom is now known as galstrom_zzz23:47
*** dxiri has joined #openstack-ansible23:51
*** manheim has quit IRC23:55
*** dxiri has quit IRC23:56
openstackgerritJimmy McCrory proposed openstack/monitorstack master: Remove inline comments from example config  https://review.openstack.org/47439223:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!