Wednesday, 2017-09-06

*** agrebennikov has quit IRC00:15
*** thorst has joined #openstack-ansible00:20
*** thorst has quit IRC00:23
*** dxiri_ has quit IRC00:31
*** dxiri has joined #openstack-ansible00:31
*** thorst has joined #openstack-ansible00:32
*** esberglu has joined #openstack-ansible00:34
*** woodard_ has joined #openstack-ansible00:36
*** woodard has quit IRC00:36
*** dxiri has quit IRC00:36
*** esberglu has quit IRC00:38
*** gouthamr has quit IRC00:45
*** dave-mccowan has quit IRC00:49
*** gouthamr has joined #openstack-ansible00:49
*** thorst has quit IRC01:06
*** dxiri has joined #openstack-ansible01:07
*** mwynne has joined #openstack-ansible01:10
*** thorst has joined #openstack-ansible01:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Create an LXC create template for machinectl  https://review.openstack.org/50105401:24
*** thorst has quit IRC01:25
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Create an LXC create template for machinectl  https://review.openstack.org/50105401:35
*** thorst has joined #openstack-ansible01:39
*** thorst has quit IRC01:39
mhaydenandymccr: it seems to work okay on centos 7 ocata01:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Modify role to better use machinectl  https://review.openstack.org/50105901:43
*** markvoelker has joined #openstack-ansible01:43
*** vikrant has joined #openstack-ansible01:48
cloudnullmhayden: andymccr: anyone else ^ feel like trying something new? I'd greatly appreciate the feedback01:50
*** dxiri has quit IRC01:55
*** dxiri has joined #openstack-ansible01:56
*** dxiri has quit IRC02:00
*** galstrom_zzz is now known as galstrom02:03
*** thorst has joined #openstack-ansible02:07
*** thorst has quit IRC02:07
*** thorst has joined #openstack-ansible02:07
*** vikrant has quit IRC02:08
*** thorst has quit IRC02:12
*** markvoelker has quit IRC02:18
*** esberglu has joined #openstack-ansible02:22
*** exodusftw has joined #openstack-ansible02:23
*** esberglu has quit IRC02:26
*** thorst has joined #openstack-ansible02:34
*** thorst has quit IRC02:34
*** galstrom is now known as galstrom_zzz02:53
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: [TEST] Disable lxc-net on CentOS  https://review.openstack.org/50108502:58
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: [DNM] Testing integrated repo with machinectl template  https://review.openstack.org/50109003:07
*** galstrom_zzz is now known as galstrom03:10
*** markvoelker has joined #openstack-ansible03:15
*** gkadam has joined #openstack-ansible03:16
*** galstrom is now known as galstrom_zzz03:18
cloudnullevenings03:24
openstackgerritLogan V proposed openstack/openstack-ansible-lxc_container_create master: Fix the bind mount options to match integrated repo  https://review.openstack.org/45690503:32
*** hybridpollo has quit IRC03:43
*** gouthamr has quit IRC03:46
*** udesale has joined #openstack-ansible03:46
*** markvoelker has quit IRC03:48
cloudnullwe've a couple of specs here: https://review.openstack.org/#/q/project:openstack/openstack-ansible-specs+status:open  - if folks have a moment to read through them it'd be appreciated03:52
*** dxiri has joined #openstack-ansible03:56
*** dxiri has quit IRC03:57
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation  https://review.openstack.org/49637603:58
*** epalper has joined #openstack-ansible04:00
*** hybridpollo has joined #openstack-ansible04:06
*** esberglu has joined #openstack-ansible04:10
*** hybridpollo has quit IRC04:13
*** hybridpollo has joined #openstack-ansible04:13
*** esberglu has quit IRC04:14
*** dxiri has joined #openstack-ansible04:17
*** mwynne has quit IRC04:21
*** dxiri has quit IRC04:22
*** thorst has joined #openstack-ansible04:26
*** thorst has quit IRC04:31
*** hybridpollo has quit IRC04:32
*** dxiri has joined #openstack-ansible04:33
*** dxiri has quit IRC04:37
*** markvoelker has joined #openstack-ansible04:45
*** dxiri has joined #openstack-ansible04:45
*** dxiri has quit IRC04:49
*** dxiri has joined #openstack-ansible05:04
*** dxiri has quit IRC05:08
*** dxiri has joined #openstack-ansible05:18
*** markvoelker has quit IRC05:18
*** dxiri has quit IRC05:22
*** pcaruana has joined #openstack-ansible05:27
*** dxiri has joined #openstack-ansible05:32
*** dxiri has quit IRC05:37
*** a0x3e8 has joined #openstack-ansible05:38
*** a0x3e8 has quit IRC05:40
*** dxiri has joined #openstack-ansible05:51
*** udesale__ has joined #openstack-ansible05:53
*** dxiri has quit IRC05:55
*** udesale has quit IRC05:56
*** esberglu has joined #openstack-ansible05:58
*** eumel8 has quit IRC06:00
*** armaan has joined #openstack-ansible06:00
*** esberglu has quit IRC06:03
*** drifterza has joined #openstack-ansible06:04
*** dxiri has joined #openstack-ansible06:05
*** dxiri has quit IRC06:09
*** dxiri has joined #openstack-ansible06:19
*** dxiri has quit IRC06:24
*** thorst has joined #openstack-ansible06:27
*** udesale__ has quit IRC06:28
*** thorst has quit IRC06:32
*** dxiri has joined #openstack-ansible06:33
*** eumel8 has joined #openstack-ansible06:36
*** dxiri has quit IRC06:38
*** dxiri has joined #openstack-ansible06:47
*** zcourts has joined #openstack-ansible06:48
epalperhi, i see the following error in TASK [os_neutron : Copy common neutron config]06:48
epalperfatal: [controller00_neutron_server_container-481df7a2]: FAILED! => {06:49
epalper    "failed": true,06:49
epalper    "msg": "No section: 'ml2_odl' Try being more explicit with your overridedata. Sections are case sensitive."06:49
epalper}06:49
epalperactually user_variables.yml has ml2_odl under neutron_opendaylight_conf_ini_overrides06:49
*** dxiri has quit IRC06:52
epalperI have tried to have ml2_odl section (like below) in neutron.conf.j2, but it doesn't help06:53
epalper{% if neutron_plugin_type == 'ml2.opendaylight' %}06:53
epalper# Opendaylight06:53
epalper[ml2_odl]06:53
epalperusername = admin06:53
epalperpassword = admin06:53
epalper{% endif %}06:53
*** udesale has joined #openstack-ansible06:55
epalperThe content of /etc/openstack_deploy/user_variables.yml is https://paste.ubuntu.com/25471824/06:56
*** udesale__ has joined #openstack-ansible06:57
*** udesale__ has quit IRC06:58
*** udesale__ has joined #openstack-ansible06:59
*** udesale has quit IRC07:00
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: scripts: scripts-library.sh: Fix tracepath logging  https://review.openstack.org/50112507:03
*** dxiri has joined #openstack-ansible07:06
*** udesale__ has quit IRC07:09
*** udesale__ has joined #openstack-ansible07:10
*** dxiri has quit IRC07:10
*** udesale__ has quit IRC07:15
*** udesale has joined #openstack-ansible07:15
*** markvoelker has joined #openstack-ansible07:15
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Disable lxc-net on CentOS  https://review.openstack.org/50099507:17
*** dxiri has joined #openstack-ansible07:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/ocata: Backport /etc collection from pike  https://review.openstack.org/50090107:21
*** shardy has joined #openstack-ansible07:22
*** dxiri has quit IRC07:25
*** shardy is now known as shardy_afk07:26
*** armaan has quit IRC07:26
epalperjamesdenton: is the above issue due to https://github.com/busterswt/openstack-ansible-plugins/blob/master/action/_v2_config_template.py#304 ?07:27
*** pbandark has joined #openstack-ansible07:28
openstackgerritMerged openstack/openstack-ansible-pip_install stable/pike: vars: SUSE: Switch openSUSE repository to Pike release  https://review.openstack.org/50093307:29
*** dxiri has joined #openstack-ansible07:35
*** dxiri has quit IRC07:39
*** zcourts has quit IRC07:45
*** esberglu has joined #openstack-ansible07:46
*** armaan has joined #openstack-ansible07:48
*** markvoelker has quit IRC07:49
*** dxiri has joined #openstack-ansible07:49
*** esberglu has quit IRC07:50
*** dxiri has quit IRC07:53
openstackgerritMerged openstack/openstack-ansible-os_tacker stable/pike: Updated from OpenStack Ansible Tests  https://review.openstack.org/50092307:54
*** shardy_afk is now known as shardy07:55
hwoarangodyssey4me: mhayden i am looking at https://review.openstack.org/#/c/500981/ and i am curious why CentOS installs RDO in both openstack_hosts and pip_install both ubuntu and suse don't07:55
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/ocata: Increase RabbitMQ's ulimit to 65536  https://review.openstack.org/50091407:56
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/newton: Increase RabbitMQ's ulimit to 65536  https://review.openstack.org/50091507:56
hwoaranghaving the Pike repos installed in the openstack_hosts role makes more sense I believe.07:56
odyssey4mehwoarang openstack_hosts only touches hosts, not containers07:57
odyssey4mepip_install touches many places07:57
hwoarangah07:57
hwoarangtrue07:57
odyssey4mewe ended up doing repo setup in pip_install due to a situation we hit where we tried doing it all over the place and needed to consolidate07:57
hwoarangso centos shouldn't do it in openstack_hosts?07:58
odyssey4mewell, IIRC it needs it there for some reason07:58
hwoarangok then07:58
*** udesale has quit IRC07:58
odyssey4meI can't remember why - I think our repo management needs an overhaul07:58
odyssey4mewe do it too many times in too many places, and that slows everything down07:59
hwoarangyeah it's one of the places i noticed we waste time in AIO07:59
*** udesale has joined #openstack-ansible07:59
hwoarangsuse barely manages to finish in ~2h before the timeout hits us07:59
hwoarangso was looking for ways to cut down useless stuff07:59
odyssey4meyeah, if we built the roles to only use distro packages - then set the repositories we like to use in a role and play specifically for that purpose we could target it better and do it once08:00
odyssey4mewell, I guess we could just do it in a play - no need for a role08:00
* hwoarang will add a topic for PTG if there isn't one already08:01
odyssey4mecool - bring any thoughts to the PTG regarding what you think could be optimised, or done very differently08:01
odyssey4meit'd be nice to have your thought given that you're a fresh mind on the project without too much history08:02
hwoaranggood good08:02
*** dxiri has joined #openstack-ansible08:03
*** shardy_ has joined #openstack-ansible08:04
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: tasks: lxc_net: Disable the lxc-net service on SUSE  https://review.openstack.org/50115008:07
*** shardy has quit IRC08:07
*** dxiri has quit IRC08:08
*** dxiri has joined #openstack-ansible08:22
*** dxiri has quit IRC08:26
*** vnogin has joined #openstack-ansible08:27
*** thorst has joined #openstack-ansible08:28
*** thorst has quit IRC08:33
*** shardy_ is now known as shardy08:35
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/pike: Increase RabbitMQ's ulimit to 65536  https://review.openstack.org/50091308:36
*** dxiri has joined #openstack-ansible08:36
*** dxiri has quit IRC08:36
*** markvoelker has joined #openstack-ansible08:46
*** vnogin has quit IRC08:59
*** randy__ has left #openstack-ansible09:07
*** vnogin has joined #openstack-ansible09:10
openstackgerritMerged openstack/openstack-ansible-os_glance stable/pike: Update paste, policy and rootwrap configurations 2017-09-04  https://review.openstack.org/50055909:14
*** openstackgerrit has quit IRC09:18
*** markvoelker has quit IRC09:19
*** eumel8 has quit IRC09:26
*** yifei has quit IRC09:35
*** armaan has quit IRC09:35
*** armaan has joined #openstack-ansible09:36
*** jafeha has joined #openstack-ansible09:38
*** openstackgerrit has joined #openstack-ansible09:53
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible master: Remove python3 usage in bootstrap-ansible.sh  https://review.openstack.org/50119209:53
*** openstackgerrit has quit IRC10:03
*** openstackgerrit has joined #openstack-ansible10:13
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation  https://review.openstack.org/49637610:13
*** vnogin has quit IRC10:16
*** markvoelker has joined #openstack-ansible10:17
hwoarangmhayden: thats for you https://bugs.launchpad.net/openstack-ansible/+bug/171259610:21
openstackLaunchpad bug 1712596 in openstack-ansible "RabbitMQ versionlock doesn't overwrite previous locks" [Medium,In progress]10:21
*** jafeha has quit IRC10:24
*** thorst has joined #openstack-ansible10:29
*** jafeha has joined #openstack-ansible10:30
*** vnogin has joined #openstack-ansible10:30
jafehahey everybody, we're currently running osa rc1 for testing purposes and having some problems with neutron fwaas. we've enabled it just like the documentation suggests by adding the plugin the neutron_plugin_base and deploying neutron. i'm quite sure this worked before but i cannot create any policies, stating an error, that "the resource cannot be found". has anyone any suggestions on this?10:30
admin0hi all. i have a build failing on install UCA .. pastebin => https://pastebin.com/a0YTkNMH  .. anyone else having the same issue or knows the solution (stable/ocata branch)10:33
*** thorst has quit IRC10:34
*** stuartgr has joined #openstack-ansible10:35
*** fellypefca-afk has quit IRC10:39
*** fellypefca-afk has joined #openstack-ansible10:40
*** yifei has joined #openstack-ansible10:41
hwoarangadmin0: what distro is this? sounds like ansible_lsb doesn't have all the required attributes10:43
admin0hwoarang,  ubuntu 16.0410:44
hwoaranghmm strange10:45
admin0hwoarang, i am a very tiny dev and mostly ops .. so what does that mean :D10:45
*** yifei has quit IRC10:46
admin0right now, i deleted the facts and running it again .. setup-openstack with the -limit on just to container10:46
hwoarangit looks like the ansible version in the ocata branch doesn't populate the same ansible_lsb dictionary like in the later versions but that's just a rough guess10:47
*** armaan has quit IRC10:48
*** armaan has joined #openstack-ansible10:49
*** markvoelker has quit IRC10:49
*** udesale has quit IRC10:50
admin0deleting the facts seems to have helped .. i did not got that error .. running it on all again to see if i get hit again10:50
*** jafeha has quit IRC11:05
*** jafeha has joined #openstack-ansible11:06
fdegirhi folks11:12
fdegirwe have a new blueprint for osa which is up for review11:12
fdegirhttps://review.openstack.org/#/c/499066/11:12
evrardjp_hello fdegir11:13
evrardjp_I will have a look11:13
fdegirthanks evrardjp_11:16
spotzOk last time I'll be saying this I guess.... andymccr update the agenda11:29
andymccrspotz: haha yeah sure is ;D only thats tomorrow11:31
spotzandymccr: dammit! I'm even up and dressed already for my riding lesson11:31
andymccri guess labor day threw you off a bit :)11:32
spotzandymccr: yeah kinda has. Ok I'm off to go ride see you guys in a few hours:)11:33
andymccrenjoy spotz!11:33
openstackgerritMerged openstack/openstack-ansible-tests stable/ocata: Backport /etc collection from pike  https://review.openstack.org/50090111:33
fellypefca-afkGood morning everyone :)11:36
fellypefca-afkHey andymccr opensuse-423 is broken? :/11:37
hwoarangfellypefca-afk: opensuse mirrors are having issues11:37
hwoarangit's know and under investigation :)11:38
fellypefca-afkOh :/ ok hwoarang, thanks11:38
fellypefca-afkCan I open a Pike backport for this patch https://review.openstack.org/#/c/500928/ or it's better wait until the opensuse mirrors are ok?11:39
*** dave-mccowan has joined #openstack-ansible11:39
*** jafeha has quit IRC11:40
andymccrhmm that might be a bug since i dont think we have opensuse for ironic - hwoarang could confirm. the issue seems to be a vars file isnt found for opensuse which would suggest its not there.11:41
*** fellypefca-afk is now known as fellypefca11:44
*** yifei has joined #openstack-ansible11:44
fellypefcaandymccr oh, ok11:44
andymccrfellypefca: usually we wouldnt backport until its merged11:44
andymccri think this is an exception though11:44
andymccrthe bug is clear and needs a fix, plus we're close to release - we'll have to make sure the master patch gets merged once we iron out this suse bits.11:45
*** markvoelker has joined #openstack-ansible11:46
hwoaranglet me check11:47
hwoarangah yes ironic is ubuntu only11:47
hwoarangmy bad for not dropping that job for project config11:47
hwoarangandymccr: i will send a patch and get it in asap11:47
*** smatzek has joined #openstack-ansible11:47
andymccrhwoarang: no big drama. thanks for looking at it - fellypefca in the meantime, lets make this an exception so you can go ahead and make the backport. we can resolve master later11:48
*** smatzek has quit IRC11:49
*** smatzek has joined #openstack-ansible11:49
*** kristaps_ has quit IRC11:49
fellypefcaandymccr hwoarang thanks for all the support :) you guys are great.11:50
*** kylek3h has quit IRC11:52
*** kylek3h has joined #openstack-ansible11:53
*** kylek3h has quit IRC11:57
hwoarangim fairly sure i may have broken some other gates too but we shall see12:00
andymccrhahah hwoarang if its on master now is not such a terrible time for it since there is not too much focus, plus thats evrardjp_ problem :P12:02
hwoaranglol12:04
evrardjp_lol12:04
evrardjp_fair point12:04
*** mrtenio has joined #openstack-ansible12:06
openstackgerritSaulo-Aislan proposed openstack/openstack-ansible-os_ironic stable/pike: Add libxml2-dev on ironic api distro packages  https://review.openstack.org/50124312:06
*** udesale has joined #openstack-ansible12:07
fellypefcaandymccr, evrardjp_ ^ the backport :)12:07
*** kylek3h has joined #openstack-ansible12:09
taskeroh my goodness -- my repo container finally built last night.12:09
tasker( for those following my troubles )12:09
*** kylek3h has quit IRC12:10
mgariepymorning everyone12:11
*** thorst has joined #openstack-ansible12:11
*** thorst has quit IRC12:12
*** thorst has joined #openstack-ansible12:13
openstackgerritSaulo-Aislan proposed openstack/openstack-ansible-os_ironic stable/pike: Add libxml2-dev on ironic api distro packages  https://review.openstack.org/50124312:16
*** markvoelker has quit IRC12:20
*** armaan has quit IRC12:20
*** armaan has joined #openstack-ansible12:21
logan-o/12:22
*** vnogin has quit IRC12:22
logan-https://review.openstack.org/#/c/500575 please if anyone has a moment12:22
mgariepylooks good to me :)12:23
mgariepyeven passed centos check :)12:24
*** yifei has quit IRC12:25
logan-:P12:27
*** markvoelker has joined #openstack-ansible12:28
odyssey4melogan- where does the value for 'conductor_host' come from?12:28
odyssey4meoh, there's a loop in the include IIRC12:28
logan-https://github.com/openstack/openstack-ansible-os_nova/blob/648142d56f26d6d911a0c6124268b9c117e16442/tasks/main.yml#L13912:28
logan-yup12:28
*** vnogin has joined #openstack-ansible12:29
*** sauloaislan has joined #openstack-ansible12:29
sauloaislanMorning12:29
fellypefcaGood morning sauloaislan12:32
evrardjp_morning everyone12:33
taskergood morning12:33
evrardjp_hwoarang: didn't you put up a patch to fix http://logs.openstack.org/50/500850/1/check/gate-openstack-ansible-openstack-ansible-aio-opensuse-423-nv/9fe7cf4/console.html#_2017-09-05_15_04_52_412042 ?12:34
evrardjp_maybe my brain is fooling me12:34
*** evrardjp_ has quit IRC12:35
hwoaranghmm12:35
*** evrardjp has joined #openstack-ansible12:35
hwoarangi was missing a package in the container12:35
evrardjpoh so this was fixed today?12:36
evrardjpMy bad12:36
hwoarangclearly that was not enough12:36
hwoarangno should have been fixed weeks ago12:36
evrardjpah12:36
hwoarangwhat branch  is this?12:36
evrardjpso my brain remembered well12:36
evrardjppike12:36
hwoaranghmm maybe i forgot to backport12:36
hwoarangone sec12:36
hwoarangevrardjp: a-r-r in AIO/pike is older so it does not have the fix for lxc_hosts role12:38
hwoarangwe should get it on the next bump12:38
*** epalper has quit IRC12:39
hwoarangie here https://review.openstack.org/#/c/500569/12:40
*** kylek3h has joined #openstack-ansible12:40
*** dxiri has joined #openstack-ansible12:45
*** woodard_ has quit IRC12:54
*** woodard has joined #openstack-ansible12:55
andymccrahh what is that error12:55
*** udesale has quit IRC12:56
evrardjphaving a look at it12:56
evrardjpthe module failure?12:56
openstackgerritLogan V proposed openstack/openstack-ansible master: Pin ceph apt packages in playbook  https://review.openstack.org/50124912:57
*** gkadam has quit IRC12:59
andymccryeh.13:01
* andymccr goes to build an aio13:01
andymccrcry it was all working - just quite slowly.13:01
evrardjplooking if shade wasn't bumped13:02
evrardjpsadly it looks like we don't show which version of shade we are using13:02
evrardjpshade-1.23.0-py2-none-any.whl13:04
evrardjpUploaded on 2017-09-0613:05
andymccris shade not pinned in reqs?13:06
evrardjpI guess that shade doesn't belong to upper constraints?13:07
evrardjpshade>=1.17.013:07
*** armaan has quit IRC13:07
andymccrit is13:07
evrardjp(still investigating)13:07
fellypefcaThe opensuse-423 is broken for Pike too, right? :/13:07
andymccroh it is in master13:08
evrardjpyeah it should be 1.22.213:08
andymccrfellypefca: ahh if its gating on pike too that means we have a job error in infra, it shoudlnt be running at all. we'll have to fix that :(13:08
andymccrevrardjp: there is no pin on pike though13:08
evrardjpyes13:08
evrardjpit should be 1.22.2 pinned I meant13:08
fellypefcaandymccr yeah :/ I just got a -1 from jenkins in the backport too https://review.openstack.org/#/c/501243/ :/13:09
andymccrnot in upper-constraints for pike though :(13:09
andymccrfellypefca: ok - well hopefully we can get that fixed up. I'll make sure that fix goes in the release though13:09
evrardjpyes, that's what I am checking13:09
andymccrevrardjp: yeah it was added recently, so not sure what the solution there is.13:09
andymccrhmm13:09
hwoarangfellypefca: yes, no mirrors no party13:10
*** lucasxu has joined #openstack-ansible13:10
lbragstadevrardjp: o/ about the policy in code goal13:11
andymccrhwoarang: its more the patch to stop suse gating against ironic, and some others i think13:11
lbragstadevrardjp: if openstack ansible modifies any of the policy files during deployment, those policies can be included in the policy file13:11
lbragstadevrardjp: otherwise - if openstack ansible just runs with the default policies, they can be omitted13:12
hwoarangandymccr: waiting for second +2 for infra to merge it13:12
hwoarang:/13:12
lbragstadevrardjp: but override-able like you said13:12
andymccrhwoarang: no worries - i'll add a +1 in case!13:13
fellypefcaandymccr hwoarang yeah, thanks o/13:13
*** gouthamr has joined #openstack-ansible13:14
openstackgerritLogan V proposed openstack/openstack-ansible master: Set ceph_mons in group_vars  https://review.openstack.org/47032313:14
*** smatzek has quit IRC13:16
*** esberglu has joined #openstack-ansible13:24
*** yifei has joined #openstack-ansible13:25
*** thegreenhundred has joined #openstack-ansible13:30
*** vnogin has quit IRC13:32
taskerwhen trying to build the galera container, pip fails with "No matching distribution found for mysql_python==1.2.5" (from requirements_absolute_requirements.txt). perhaps the package being sought is MySQL-python?13:34
taskerhmm. attempts to use "pip search mysql_python" seem inconsistent. let me see if I can zero in on this.13:37
taskernevermind. ignore me.13:39
*** vnogin has joined #openstack-ansible13:39
*** vnogin has quit IRC13:41
*** vnogin has joined #openstack-ansible13:42
andymccrtasker: you got it fixed up?13:42
taskersort of / not really ?13:42
taskerI'm in the container now looking around.13:42
taskerI can do "pip install mysql_python" on my workstation. but the container is being picky about it.13:43
andymccrtasker: can you pip install anything from that container?13:44
andymccrperhaps the repo server isnt setup properly, or the VIP pointing to the repo server.13:44
andymccrwhich means when it tries to connect to get the pip packages it cant so it fails.13:44
taskerwhat's the package name for the openstack client?13:45
tasker"openstackclient" .. c'mon, think eric!13:45
mhaydenandymccr: yeah, i did a bunch of testing last night and it would be a good idea to disable/mask lxc-net on centos13:46
andymccrmhayden: ok cool. lets make it so then!13:46
taskerno, I cannot install anything via pip.13:47
taskerI do see in the pip.conf that it points at the haproxy/repo-container13:47
taskerlooking at haproxy now.13:47
admin0anyone using live migration ( in local storage ) in OSA install ? when i set the libvirt to listen , it fails at unable to get ca-cert13:47
admin0anyone seen/solve this before ?13:47
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/pike: Suppress curl warning w/shell module  https://review.openstack.org/50126013:48
andymccrtasker: ok cool - yeah that sounds like the issue then.13:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/ocata: Suppress curl warning w/shell module  https://review.openstack.org/50126113:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/newton: Suppress curl warning w/shell module  https://review.openstack.org/50126213:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/pike: Suppress rsync warnings w/command  https://review.openstack.org/50126313:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/ocata: Suppress rsync warnings w/command  https://review.openstack.org/50126413:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/newton: Suppress rsync warnings w/command  https://review.openstack.org/50126513:48
logan-admin0: maybe addressed here: https://bugs.launchpad.net/openstack-ansible/+bug/166943613:49
openstackLaunchpad bug 1669436 in openstack-ansible "nova_libvirtd_listen_tcp won't actually work" [Medium,Fix released] - Assigned to Major Hayden (rackerhacker)13:49
mhaydenhwoarang: i can backport your SUSE change along with the Centos one for lxc-net13:50
hwoarangmhayden: yes please :)13:51
andymccrdo it13:53
evrardjplbragstad: well yes, if someone has a file with json or whatever the future will be, this should be included as a policy override13:54
evrardjpwe are supporting that for keystone, so if every project is following keystone's ideas, then we are good.13:54
matttis there a pattern to have ansible install a required python module and then use it in the same ansible run?  talking about python-netaddr here13:56
matttthe case i'm running into is that ansible installs it and then tries to use it but thinks it's not installed13:56
logan-mattt: i doubt it :/13:57
matttlogan-: ok, i'll move the installation to a bootstrap script :-/13:57
logan-yeah13:57
logan-or a requirements file if that's where you're installing ansible13:57
*** yifei has quit IRC13:59
*** woodard has quit IRC13:59
lbragstadevrardjp: yeah - the goal is exactly like what keystone and nova have already done13:59
evrardjpok13:59
evrardjpcool13:59
lbragstadevrardjp: just applied consistently across openstack projects that expose policy in some way13:59
evrardjpIf nova followed, we are fine.13:59
evrardjp:D13:59
lbragstadand protect it with the policy.json/oslo.policy pattern some how13:59
lbragstad:)13:59
lbragstadnova was actually the first to do it13:59
taskergrr .. the VIP for my haproxy moved!14:03
taskerthough it moved the various back-end servers are apparently still reporting down.14:04
taskerhowever, using `hatop` I can't see the state of the repo servers14:04
taskerit's repeatable, one execution of "wget http://hproxy:8181/os-releases/14.2.7/ubuntu-16.04-x86_64/requirements_absolute_requirements.txt works and the next is 404. the next works, the next is 404. and this repeats.14:06
taskerfrom within the container.14:07
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Cleaning up lxc-net tasks  https://review.openstack.org/50127314:07
taskerexternal to the whole cluster, I don't get any 40414:07
evrardjptasker, check that all your containers are in sync14:08
evrardjprepo containers14:08
mhaydenevrardjp / hwoarang: https://review.openstack.org/50127314:08
evrardjpif not force a sync (restartyng lsyncd for example)14:08
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Use RDO Pike repository  https://review.openstack.org/50098114:11
*** galstrom_zzz is now known as galstrom14:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts stable/pike: Disable lxc-net on CentOS  https://review.openstack.org/50127514:15
taskerneither repo-1 nor repo-3 have a configuration file for lsyncd14:15
taskeris it a push or a pull style synch?14:15
taskerrepo-2 has a config and lsyncd is running14:15
taskerlooks to a push. i did a restart and repo-1 is now populated with data.14:18
taskeras is repo-314:18
taskerevrardjp: thanks for the pointer!14:18
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts stable/ocata: Disable lxc-net on CentOS  https://review.openstack.org/50127714:18
*** smatzek has joined #openstack-ansible14:19
taskerwgets of the requirements file are now working 100%.14:19
taskerand I can install the python-openstackclient via pip14:19
andymccrtasker: what os are you using?14:19
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts stable/newton: Disable lxc-net on CentOS  https://review.openstack.org/50127914:20
taskerI'm on newton/trusty moving to newton/xenial following https://etherpad.openstack.org/p/osa-newton-xenial-upgrade14:22
taskerso, both?14:22
*** weezS has joined #openstack-ansible14:23
andymccrtasker: ahh ok - cool. just checking we had a bug report around lsync not working properly on centos, but i thought that was fixed14:23
mgariepyonly restarting lsyncd should be enough to start the sync.14:24
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Preserve /etc in job results  https://review.openstack.org/50084214:24
mhaydenhwoarang: did something bad happen in OpenSUSE land ? http://logs.openstack.org/80/500980/1/gate/gate-openstack-ansible-pip_install-ansible-func-opensuse-423/b3f514e/console.html#_2017-09-06_14_02_01_01606814:24
hwoarangmhayden: yeah mirrorbrain is offline14:25
hwoarang:(14:25
hwoarangstill in progress to restore it14:26
admin0https://docs.openstack.org/project-deploy-guide/openstack-ansible/draft/app-advanced-config-override.html - there is no direct override for libvirtd.conf ??14:26
admin0the file is ansible managed..  listen_tls = 1 (=>0) , listen_tcp = 0 (1) and auth_tcp = "sasl" => (none)14:28
mhaydenadmin0: you might be right -- i can't find one for that file14:28
mhaydenthat would be a good feature to add14:28
*** drifterza has quit IRC14:28
mgariepycloudnull, are you around ?14:28
admin0this will enable live migration without shared storage14:28
mhaydenhwoarang: sending good thoughts your way14:29
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Use OS pkgs, not pip  https://review.openstack.org/49960114:30
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: [TEST] Use OS pkgs, not pip  https://review.openstack.org/49973514:30
admin0do i open a bug report, if file says  # Ansible managed, provide a way to override it, or open a feature request ( to enable possibility of live migration on shared storage ) ?14:30
admin0sorry ..  to enable possibility of live migration on NON shared storage14:31
mhaydenadmin0: open up a feature request -- it would be nice to use config_template to override it14:31
mhaydenwe could do that in the same way we handle the nova.conf right now14:31
mhaydenit would be fairly easy to implement14:31
admin0enable_live_migration = true/false is also OK :)14:31
*** agrebennikov has joined #openstack-ansible14:32
admin0i doubt people would not want to have live migration, so that can be the default as well,14:32
logan-i think we try to enable ssh tunneled live migration by default which should not require the libvirt listener, tls config, etc14:32
mgariepycloudnull, evrardjp how is new leap release tagged ? Can 14.2.8 be easily created here: http://rpc-repo.rackspace.com/venvs/leap-bundles/ ?14:32
logan-maybe that is broken?14:32
admin0umm... i just know how to open bugs via launchpad .. how/where do I ask for a new feature ?14:35
*** vnogin has quit IRC14:37
*** liliars has joined #openstack-ansible14:39
*** vnogin has joined #openstack-ansible14:40
admin0i will open it as a bug and word it as a feature request :D14:40
cloudnullmgariepy: I am available now .14:42
openstackgerritMerged openstack/openstack-ansible master: SHA Bump on master  https://review.openstack.org/50057414:44
mgariepycloudnull, can you create 14.2.8 for leap upgrade ?14:45
mgariepyor can I do it ?14:45
cloudnullI think evrardjp and odyssey4me will need to kick that off for the rpc-repo?14:45
cloudnullI can go try and get that done though14:45
odyssey4me@cloudnull I have no idea how those bundles are made or stored.14:46
cloudnullok. i'll go look into what is needed to make it go.14:47
openstackgerritMatt Thompson proposed openstack/openstack-ansible-ops master: Install netaddr before running site.yml  https://review.openstack.org/50129514:47
mgariepy14.2.7 is too buggy for me..14:48
andymccrmgariepy: a new release?14:50
evrardjpmgariepy: why? these are just used for migrations14:51
evrardjpshould be alright14:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-specs master: [WIP] Spec: Python Build/Install Process Simplification  https://review.openstack.org/50129614:52
evrardjpodyssey4me: <314:52
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/49789614:52
mgariepywell this is the tag that are used to checkout the /opt/openstack-ansible repo as well..14:53
mgariepyunless I missread the code..14:53
admin0https://bugs.launchpad.net/openstack-ansible/+bug/171541614:54
openstackLaunchpad bug 1715416 in openstack-ansible "libvirtd override" [Undecided,New]14:54
*** japestinho has quit IRC14:55
evrardjpmgariepy: in RPC we have a wrapper to avoid these kind of things.14:56
odyssey4meevrardjp I've tried to compile a bunch of our discussion into https://review.openstack.org/501296 - please read/comment... if anyone else wishes to read/comment/question please feel free - it's a WIP, but I'm hoping we can make our lives simpler in Queens14:56
mgariepy# readlink /opt/openstack-ansible14:56
evrardjpyes I've seen the spec I will read that14:56
mgariepy-/opt/leap42/openstack-ansible-14.2.714:57
evrardjpyeah that is a fair assumption14:57
*** shardy has quit IRC14:58
evrardjpyou could trick the re-deploy if need be14:58
evrardjpor alternatively, you can define your own hash14:58
evrardjphttps://github.com/openstack/openstack-ansible-ops/blob/master/leap-upgrades/lib/vars.sh#L2614:59
evrardjpif you define your own hash you'd need a few packages to BUILD the venv14:59
evrardjpbut generally it should work14:59
evrardjpit's been tested under kilo14:59
evrardjpnot yet well under L14:59
mgariepyha,15:00
mgariepydidn't saw that15:01
*** marst has joined #openstack-ansible15:01
mgariepycool then i'll git that a go..15:01
mgariepygit/give...15:05
taskerin task "Drop mariadb config(s)" (at /etc/ansible/roles/galera_server/tasks/galera_post_install.yml:39), on a fresh galera_container, I get 'FAILED! => {"failed": true, "msg": "'dict object' has no attribute 'ansible_processor_vcpus'"}'. successive runs will fail at "Check for cluster state failure".15:07
taskerrunning 'galera-install.yaml'15:07
taskerwith a limit15:08
taskerI haven't run it with 'galera_ignore_cluster_state' set yet. going to try now.15:10
*** shardy has joined #openstack-ansible15:12
taskerwith 'galera_ignore_cluster_state=true' the playbook continues to fail at "Drop mariadb config(s)" with "'dict object' has no attribute 'ansible_processor_vcpus'"15:16
evrardjpdo you have that fact?15:17
taskerit's not in /etc/ansible/facts.d on either the staging host or the galera container. where else might it be?15:18
*** chyka has joined #openstack-ansible15:19
*** chyka has quit IRC15:21
*** chyka has joined #openstack-ansible15:21
taskerit is in /etc//etc/openstack_deploy/ansible_facts/controller-2_galera_container (on the staging host) as: "ansible_processor_vcpus": 1615:23
taskers/\/etc\///15:24
*** dxiri has quit IRC15:38
*** eumel8 has joined #openstack-ansible15:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: DNM Rollback shade version  https://review.openstack.org/50132315:54
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: DNM Rollback shade version  https://review.openstack.org/50132315:54
andymccrevrardjp: i think we will need that15:56
evrardjpoh could some ppl vote on https://review.openstack.org/#/c/494438/ ?15:56
evrardjpandymccr: ?15:56
evrardjpLet's hope requirements will react to my patch :)15:56
andymccrahh you put one in15:56
evrardjpif that, we can bump requirements15:57
evrardjpyes15:57
evrardjpNow it's just a question of versions15:57
*** vnogin has quit IRC15:58
*** lucasxu has quit IRC16:00
*** vnogin has joined #openstack-ansible16:01
evrardjphwoarang: you have an infra review I can vote on?16:06
*** dave-mccowan has quit IRC16:17
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation  https://review.openstack.org/49637616:26
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Upgrade to RabbitMQ 3.6.11  https://review.openstack.org/49680116:26
*** dxiri has joined #openstack-ansible16:35
*** dave-mccowan has joined #openstack-ansible16:38
*** lucasxu has joined #openstack-ansible16:47
*** vnogin has quit IRC16:47
*** dave-mccowan has quit IRC16:56
*** dave-mccowan has joined #openstack-ansible16:56
*** shardy has quit IRC17:01
taskerI'm stuck at "'dict object' has no attribute 'ansible_processor_vcpus'" for playbook galera-install. I'm not sure how to proceed. evrardjp asked if i had that fact, and I managed to find a reference to it in the file /etc/openstack_deploy/ansible_facts/controller-2_galera_container on the staging host.17:08
taskerbut I don't know enough of the ansible objects to determine a course of action.17:08
taskerI could use a pointer if anyone knows what might be going happening.17:09
admin0tasker: i had this issue once17:11
admin0let me recall17:11
admin0i think if irc has logs,you can search in the logs17:11
admin0are you on master branch ?17:11
taskerno .. 14.2.717:13
*** kristian__ has joined #openstack-ansible17:15
taskerrunning again with '-vvv' hoping to get more info17:16
*** cjloader_ has joined #openstack-ansible17:19
taskerI couldn't find anything useful or similar about ansible_processor_vcpus in the irc logs at eavesdrop.openstack.org17:20
taskerlikewise from the output of "-vvv"17:21
andymccrtasker, that var should be part of ansible itself, so it wouldnt be an osa change - you'll need to figure out why your host isnt getting that var. you could start by trying "ansible -m setup all | grep proc" form inside the playbooks dir - although you may want to adjust the grepto get better info out17:23
taskerandymccr: I'll take a look.17:23
*** vnogin has joined #openstack-ansible17:27
*** woodard has joined #openstack-ansible17:30
*** vnogin has quit IRC17:31
*** kristia__ has joined #openstack-ansible17:32
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation  https://review.openstack.org/49637617:34
fellypefcaandymccr hey, any place that I can take a look on the status of the opensuse-423 bug fix?17:35
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation  https://review.openstack.org/49637617:35
mhaydenoh man, i'm the worst at bash today17:36
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Upgrade to RabbitMQ 3.6.11  https://review.openstack.org/49680117:36
*** kristian__ has quit IRC17:36
mhaydenhwoarang: still wrestling with mirrors?17:37
taskerumm, here's a twist. I ran that command that andymccr suggested and I parsed the output. "ansible_processor_vcpus" is present in every host -- including the galera container.17:45
taskerwould "--limit" get in the way?17:45
taskerI've run into this before. I figured out it was a matter of ordering in one of the roles / playbooks. perhaps again?17:51
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ceph_client master: Make the ceph mon test more robust  https://review.openstack.org/50136417:52
evrardjpmhayden: and others ? ^17:52
spotz*sniffle and others....*17:53
evrardjphe was the last one to talk on the chan :p17:53
spotzCourse I don't know what day it is...17:53
spotzuh huh. Oh and good reports back on the Irish pub I put in the etherpad for you guys17:53
evrardjptasker: mmm17:54
evrardjpspotz: yeah I saw it was proposed on another etherpad too :p17:54
evrardjpmust be the place to be17:54
evrardjp:)17:54
spotzyeah it started with the WoO group:)17:54
evrardjpahah17:55
evrardjp3 groups then! good :)17:55
spotzMost likely or hopefully on different nights:)17:55
*** poopcat has joined #openstack-ansible17:58
*** albertcard1 has joined #openstack-ansible18:03
*** poopcat has quit IRC18:05
taskerin /opt/openstack-ansible/playbooks/inventory/group_vars/galera_all.yaml, I have "galera_client_drop_config_file: true". maybe set this to false? what else does that variable manage?18:06
taskerI'm thinking that if I set that to "false", then the "drop mariadb config(s)" task won't run.18:06
taskerthough, that doesn't solve the problem of why the object doesn't have the key it's looking for.18:07
taskerI want to print out the "object" right before it runs that task. what's the name that object is bound to?18:10
*** weezS has quit IRC18:11
*** stuartgr has quit IRC18:11
evrardjpno, you shouldn't have to edit the group variables18:12
evrardjpthe dict object here is probably your hostvars[inventory_hostname]18:13
evrardjpbut could you try to run without the --limit to see if it works fine?18:13
andymccrtasker: check your /etc/openstack_deploy/ansible_facts for the host and see it is in there, if not you could try removing that file, it will get regenerated18:13
evrardjptasker: ^18:13
evrardjptasker: if you do what andymccr said, it will even be easier to debug, because you'll see if this var appears after your next run18:15
taskerI have - it's there.18:15
evrardjpbut I think running without the limit18:15
evrardjptasker: after a re-run AND having cleaned the facts?18:15
taskerdid not clean facts.18:15
evrardjplet's start with that18:15
taskerjust move off /etc/opnestack_deploy/ansible_facts?18:16
evrardjpempty its content (yes you can move the folder contents if you want)18:16
evrardjpthen re-run the playbook without --limit18:16
evrardjpthen see18:16
*** vnogin has joined #openstack-ansible18:18
evrardjpI'm off for today18:18
taskerok. thanks for your help.18:18
evrardjpSee you tomorrow folks!18:18
evrardjpsorry I can't help more than that tasker18:18
taskerany help is better than me staring at the screen.  . )18:19
taskerthe new host files in that directory do contain "ansible_processor_vcpus".18:19
andymccrtasker: ok and the task is still not running because it says that var doesnt exist?18:20
taskerstill waiting for output.18:20
taskeroh hea!! it proceeded.18:21
*** thorst has quit IRC18:22
taskerok -- so what was the magic sauce? if the fact file contained the item before deletion and failed, and "ansible -m setup" had the key and it failed, and then after deleting the file the new one had the key and it passed, what actually happened?18:23
*** thorst has joined #openstack-ansible18:23
taskerthe other difference was I didn't use `--limit` this time.18:25
taskermaybe that was getting in my way?18:25
taskereven the etherpad notes that I'm following recommended not using --limit but I tried it anyway. I probably should've started there.18:26
taskers/following/supposed to be following/18:26
*** thorst has quit IRC18:27
*** thorst has joined #openstack-ansible18:29
*** RandomTech has joined #openstack-ansible18:30
*** IRC-Source_77448 has joined #openstack-ansible18:31
andymccrtasker im not too sure, thats odd you could try with limit and see if it still fails?18:32
andymccrnow that you know it works without limit18:32
andymccralthough it shouldnt since i think that value is only used on its own deploy so it shouldnt care about non-limited hosts18:32
andymccri think setup might recreate your facts18:32
*** thorst has quit IRC18:33
hwoarangmhayden: haven't seen any updates regarding mirrors yet :/18:35
hwoarangmhayden: all i can check right now is https://status.opensuse.org/18:35
hwoarangpage is being updated on regular basis so at least they are still working on it18:35
IRC-Source_77448andymccr: can you suggest if the routed env config will work with ocata too ? ref - https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-pod.html18:38
RandomTechhello, I will be helping set up a openstack cluster with ansible soon. Is anyone here able to help me figure out the prerequisite networking requirements?18:40
*** chhavi has joined #openstack-ansible18:43
*** mrtenio has quit IRC18:43
RandomTechFrom what i understand I simply have to create Br-18:43
*** IRC-Source_77448 has quit IRC18:44
RandomTechFrom what i understand I simply have to create br-mgt, br-storage, br-xvlan, and br-vlan on each blade and bond them to a port18:44
RandomTechis that correct?18:45
jmccrorytasker andymccr : just catching up on scrollback, but this template loops through vars of all galera nodes. https://github.com/openstack/openstack-ansible-galera_server/blob/master/templates/my.cnf.j2#L2-L718:46
*** thorst has joined #openstack-ansible18:46
jmccroryso it's failing either because of the limit to one node, ansible may not attempt to load facts from the other nodes in that case so they wouldn't be available18:46
jmccroryor facts for the other nodes could've just been missing entirely18:46
mhaydenhwoarang: can we use a different mirror perhaps?18:46
*** cjloade__ has joined #openstack-ansible18:47
hwoarangyeah we could apply a workaround in /etc/hosts18:47
hwoarangfor both host and containers18:47
hwoarangi guess..18:47
mhaydenhwoarang: are there openstack opensuse mirrors yet?18:47
hwoarangoes openstack have full mirrors for distros?18:48
hwoarangie mirror all rpms and debs?18:48
hwoarangi didn't know that18:48
mhaydenlet me check and see18:49
mhaydenhwoarang: example -> http://mirror.kna1.citycloud.openstack.org/18:49
*** BjoernT has joined #openstack-ansible18:49
mhaydenhttp://mirror.kna1.citycloud.openstack.org/opensuse/distribution/leap/42.3/repo/18:49
*** cjloader_ has quit IRC18:50
mhaydendoes that have the right stuff that you need?18:50
hwoaranglets see18:50
mhaydenhwoarang: if you, you could do something like this -> https://github.com/openstack/openstack-ansible-pip_install/commit/3500a26919b5f420c15b80323fff7928e05054b918:50
hwoarangseems about right18:50
mhaydenhwoarang: https://github.com/openstack/openstack-ansible-tests/commit/afb957d0bc588d54dc8bbee3b58074175b52d2eb18:51
mhayden^^ discovery18:51
mhaydenthen the pip_install one is a good example of how to use the fact18:51
hwoarangi could do that but the problem is that i am also using repositories which are not mirrored by openstack18:51
mhaydendarn18:52
hwoarang:(18:52
RandomTechFrom what i understand I simply have to create br-mgt, br-storage, br-xvlan, and br-vlan on each blade and then put in the anisible playbook which port to bond them all to. Is that correct?18:52
mhaydenRandomTech: essentially, yes18:52
mhaydenbr-storage is optional, of course18:52
*** weezS has joined #openstack-ansible18:52
taskerI'm running in to this error now: "FATAL: The innobackupex version is 1.5.1. Needs xtrabackup-2.3.5 or higher to perform SST". I'm aware that this error isn't directly due to OSA, but I've seen this before and the solution was to install the higher version of "percon-xtrabackup-24".18:53
taskerI think this was a change to the upstream mariadb and wonder if OSA is aware of this or if it's entirely external to OSA.18:53
mhaydenRandomTech: here's an example from mine -> https://gist.github.com/major/adfdc78bc1da1c9602558c5eb693b1e718:53
mhaydenmine is fairly simple -- management + vxlan + vlan18:53
BjoernTyou likely ran into https://review.openstack.org/#/c/497182/18:54
BjoernTwhere xtrabackup needs to be 2.3.9 now18:54
mhaydenRandomTech: this might also help -> https://major.io/2017/04/13/openstack-ansible-on-centos-7-with-systemd-networkd/18:54
*** esberglu has quit IRC18:55
taskerBjoernT: great. thanks for the link.18:55
BjoernTcorrection 2.3.5 not 2.3.918:55
*** esberglu has joined #openstack-ansible18:55
mhaydenhwoarang: oh, dang, i see -- lots of the other mirror sites are broken as well18:56
RandomTechThank you, A group of me and 2 other people have been tasked with setting up a openstack cluster with ansible. I was having difficulty figuring out what all needed set up network wise before i deployed though.18:56
mhaydenhwoarang: how about http://anorien.csc.warwick.ac.uk/mirrors/download.opensuse.org/repositories/Cloud:/OpenStack:/Pike/openSUSE_Leap_42.3/18:57
mhaydenRandomTech: ah, networking is the toughest part18:57
mhaydenso if that's where you're stuck, you're in good company ;)18:57
mhaydenRandomTech: deploying on Xenial? CentOS?18:57
RandomTechI see, expecially when im the only one in the group certified in computer networking. and my cert definately did not go over openstack deployment :p18:58
RandomTechxenial preferably18:58
mhaydenhaha18:58
mhaydenone thing that helped me was to build an all-in-one deployment and look at how the networks were configured there18:58
mhaydenthat gave me an idea of how i wanted to configure my own18:58
*** esberglu has quit IRC19:00
*** vnogin has quit IRC19:01
RandomTechi sadly dont have a decent computer to do a test environment on. i just have a bunch of blades in a rack.19:02
RandomTechand ive been trying to figure out what all i need to do to make this work19:02
mhaydenRandomTech: ah okay... sometimes i spin up a vm somewhere, run the aio, have a gander, and delete it19:03
RandomTechif i could a would19:03
RandomTechi would*19:03
RandomTechwe i think i get how to set up the bridges, but how exactly do i need to setup the intial network for the deployer to talk to the host? thats what im not sure about19:04
*** esberglu has joined #openstack-ansible19:06
RandomTechmhayden: So do i just put the interface for the deployer and the targets on the same static network before deploying. then it deals with bonding and the other ports?19:10
mhaydenso the actual configuration of the base network interfaces is left up to you to do19:11
hwoarangmhayden: that mirror appears to be in a better state but opensuse/infra says that they changed the dns to point to backup mirror so we may not have to do that19:11
mhaydenfor example, you could bond eth0/eth1 and add the bond0 to br-mgmt19:11
mhaydenthen hand br-mgmt off to openstack-ansible19:11
mhaydenhwoarang: ah okay19:11
*** fellypefca is now known as fellypefca-afk19:12
*** fellypefca-afk has quit IRC19:13
hwoarangi dont know if i can do much today19:15
hwoarangi will keep an eye on it and if it's not fixed early EU time then I will think of workarounds19:15
taskercan someone shed some light on why the output of the command `ansible galera_container -m shell -a "mysql -h localhost -e 'show status like \"%wsrep_cluster_%\";'"` shows the same wsrep_cluster_state_uuid and "Primary" for wsrep_cluster_status?19:16
RandomTechso i just need to edit a config file somewhere saying what ip it should use to accsess each host?19:16
*** albertcard1 is now known as poopcat19:16
taskeris that all three are configured the exact same? or that they're identifying the node that is actually primary ( without giving any status of itself )?19:16
mgariepytasker what is the cluster_size ?19:17
tasker319:17
mgariepyshould be good then,19:17
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation  https://review.openstack.org/49637619:17
taskerdo you have any insight into what the output is telling me?19:17
*** hybridpollo has joined #openstack-ansible19:17
mhaydenRandomTech: well, you need to tell OSA which hosts should be doing what19:18
mhaydenand what roles they play in the cloud19:18
mhaydenRandomTech: let me just paste my whole config19:18
RandomTechas far as i know there all identical19:19
mhaydenRandomTech: here's my whole config -> https://gist.github.com/major/adfdc78bc1da1c9602558c5eb693b1e719:19
mgariepytasker https://docs.openstack.org/openstack-ansible/latest/admin/maintenance-tasks/galera.html19:19
mhaydeni have four nodes, all are hypervisors19:19
mhaydenbut they also have some openstack services running on them19:19
mhaydenas well as rabbitmq/galera/memcached19:20
*** chhavi has quit IRC19:20
mhaydendoes that help?19:20
mgariepytasker, you want the 3 nodes to be primary, and sharing the same uuid. so they are part of the same cluster.19:20
mhaydenthe 192.168.250.xxx addresses you see there are the IP assigned to the primary ethernet interface on each host19:20
taskerthanks! that and the link help it make sense.19:21
RandomTechso i can tell it to use the same blade for multiple things?19:21
RandomTechlike how hydrogen is both log and compute19:22
mhaydenRandomTech: absolutely! :)19:22
mhaydeni call it 'cheap', but marketing calls it HYPERCONVERGED ;)19:22
mhaydenso my 'argon' host is running repo servers, rabbitmq/galera, openstack services, and VMs19:22
RandomTechokay that sounds good. we may be able to make each blade a node then and tell each ones the roles we would like to take19:23
mhaydencompute_hosts group is for hypervisors19:23
*** hybridpollo has quit IRC19:23
mhaydenRandomTech: if you want to maximize your real estate for virtual machines, going hyperconverged helps19:23
mhaydenfor best perf + stability, keep your infrastructure nodes and compute nodes separated19:23
RandomTechwell currently i have 3 interfaces on each blade 2 1GB and a 10GB19:24
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Upgrade to RabbitMQ 3.6.11  https://review.openstack.org/49680119:24
mhaydenah okay, i have four on each of mine19:24
mhaydenbut you could do this cloud with just one if you want19:24
mhaydenyou would need some vlans, though19:24
RandomTechim okay with vlans19:24
mhaydenfor example, the hypervisor could sit on the native VLAN for its primary IP19:25
mhaydenthen br-vxlan could go on VLAN 1019:25
mhaydenbr-mgmt could go on VLAN 2019:25
RandomTechjust need to figure out what all i need as we will be setting up new networks for everything but the public connection19:25
mhaydenand br-vlan could just be a raw connection that allows VMs to hop on other vlans19:25
mhaydenin my environment, i put br-mgmt on vlan 10, br-vxlan on vlan 11, and br-vlan is just a raw bridge that isn't on a vlan19:26
mhaydenthen i make a neutron network on br-vlan with vlan 100, 101, 102... and so on as vms need those19:26
mhaydenbr-storage would benefit from the 10Gb network19:27
mhaydenif you don't have VXLAN offloading on your network cards, your VXLAN throughput might be limited to 1Gb19:27
mhaydenam i right on that cloudnull ?19:27
*** hybridpollo has joined #openstack-ansible19:27
mhaydenagain -- the hardest part is figuring out WHAT you want to do... getting the bits in place with the OS and OpenStack-Ansible is the much easier part ;)19:28
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-specs master: Hyperconverged Containers  https://review.openstack.org/49988619:29
RandomTechwell we know we want to use the 10GB for the storage backend so that they can transfer data quickly19:30
mhaydentotally agree with you there19:30
mhayden10Gb keeps Ceph/Cinder/SAN/DAS happier ;)19:30
RandomTechand apparently i was slightly wrong on the interface count. each blade has a 10GB and 3 1GB one of wich is used for ipmi19:31
RandomTechalong with enough switches to connect everything at max speed19:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Run gate playbooks in parallel  https://review.openstack.org/49774219:32
cloudnullmhayden: ++19:33
*** pcaruana has quit IRC19:34
cloudnullvxlan throughput is miserable w/out offloading capabilities19:34
openstackgerritJustin Shepherd proposed openstack/openstack-ansible master: Adding guards around tracepath/tracepath6 commands  https://review.openstack.org/50139319:36
openstackgerritLogan V proposed openstack/openstack-ansible master: Add the ansible-ceph-defaults role  https://review.openstack.org/49047619:39
RandomTechmhayden i agree that this would be so much easier with a vm19:42
*** lbragstad has quit IRC19:43
*** pbandark has quit IRC19:43
openstackgerritMatt Thompson proposed openstack/openstack-ansible-ops master: Wait for guest capabilities to appear  https://review.openstack.org/50139719:44
*** lbragstad has joined #openstack-ansible19:45
mhaydenwait a minute here19:47
mhaydengalstrom is dropping patches?19:47
mhaydencloudnull: is galstrom taking your place whilst you're on vacation?19:47
andymccrwhat19:48
andymccrinstant -W -219:48
mhaydenandymccr: don't worry, i got a -1 on it19:49
andymccrmhayden: this is why you are core!19:49
taskeris there a better way to regenerate the inventory facts ( /etc/openstack_deploy/ansible_facts ) than running a whole playbook ( for example, setup-hosts )?19:57
BjoernTyes20:04
BjoernTjust by cerating a stub playbook20:04
BjoernTcreating20:04
BjoernTwith one task to just gather facts20:05
taskerand making sure to reference "all_hosts"?20:05
*** kristian__ has joined #openstack-ansible20:05
BjoernThost: hosts for example, if all_hosts extists thats fine too20:05
taskergotcha. thanks!20:05
RandomTechcan i have multiple bridge using the same vlan?20:07
*** cjloade__ has quit IRC20:07
BjoernTthat sounds like creating a L2 loop for me20:07
*** kristian__ has quit IRC20:07
*** cjloader_ has joined #openstack-ansible20:07
BjoernTbut if the bridges are unterminated on one side theoretically yes20:07
BjoernTI did that for SRIOV20:08
BjoernTand vlan separation20:08
*** liliars has quit IRC20:08
*** kristia__ has quit IRC20:08
RandomTechim just trying to figure out how i want to set up my cluster as each of my blades has 3 interface 1 of which will be used for just storage20:09
RandomTechi am open to sugestions as this is being built from the ground up20:10
*** dave-mccowan has quit IRC20:11
*** cjloader_ has quit IRC20:12
BjoernTwell that depends on requirements. Ideally you separate on network level already but you're not forced to even have multiple networks other than the container network and one network neutron. Storage network was optional afaik20:12
BjoernTwe added a lot inside the documentation at https://docs.openstack.org/project-deploy-guide/openstack-ansible/draft/overview-network-arch.html20:12
BjoernTfor testing purposes you can encapsulate all bridges inside vxlan if you don't want to mess with vlans at all on host side20:13
BjoernTbut that limits network access for floating ips and so on20:13
RandomTechi believe we will use static ip where able. and we will be beuilding deploying this cluster onto 5 blades20:14
RandomTechwill be deploying*20:14
RandomTechweve bascically been thrown into deploying an openstack cluster on 5 blades with no experience setting out openstack20:17
RandomTechon the target host do we need to bond the bridges to interfaces or will ansible take care of that as long as we set all the ip correctly?20:20
*** cjloader_ has joined #openstack-ansible20:25
*** cjloader_ has quit IRC20:25
*** cjloader_ has joined #openstack-ansible20:26
*** smatzek has quit IRC20:29
RandomTechmhayden: do you mind if i share that config file with the people im working with as an example?20:30
mhaydenRandomTech: go for it! :)20:30
RandomTechthank you20:30
mhaydenit's all RFC1918 addresses anyway ;)20:30
RandomTechwait are ceph and cinder mutually exclusive? im having trouble figuring out the relation between them20:31
mhaydenthat environment runs on 4 x E3-1230's handling 50-60K pps @ 40mbit, so it's a good start ;)20:32
mhaydenRandomTech: cinder can manage ceph for you -> https://docs.openstack.org/openstack-ansible-os_cinder/latest/configure-cinder.html#configuring-cinder-to-use-ceph20:32
admin0RandomTech, ceph is an underlying storage system .. like nfs, isci, lvm etc ... while cinder is a system that provides a block storage to openstack which can use any underlying storage .. so they are NOT the same or mutually exclusive20:36
RandomTechsounds good to me20:36
RandomTechthis is definately a learning experience for me and the main reason im working on it is because i got a certification in networking20:37
RandomTechthanks for all the help guys20:38
openstackgerritMerged openstack/openstack-ansible-ops master: Wait for guest capabilities to appear  https://review.openstack.org/50139720:39
*** dave-mccowan has joined #openstack-ansible20:39
openstackgerritMerged openstack/openstack-ansible-ops master: Install netaddr before running site.yml  https://review.openstack.org/50129520:40
*** lucasxu has quit IRC20:42
*** vnogin has joined #openstack-ansible20:47
*** chyka has quit IRC20:54
*** chyka_ has joined #openstack-ansible20:54
openstackgerritJustin Shepherd proposed openstack/openstack-ansible master: Adding guards around tracepath/tracepath6 commands  https://review.openstack.org/50139320:57
*** RandomTech has quit IRC20:59
*** chyka_ has quit IRC21:00
*** dave-mcc_ has joined #openstack-ansible21:02
*** dave-mccowan has quit IRC21:05
*** chyka has joined #openstack-ansible21:05
*** chyka has quit IRC21:06
*** chyka has joined #openstack-ansible21:09
*** chyka_ has joined #openstack-ansible21:13
*** chyka has quit IRC21:14
*** gouthamr has quit IRC21:15
*** chyka_ has quit IRC21:19
*** chyka has joined #openstack-ansible21:23
*** yolanda has quit IRC21:26
*** yolanda has joined #openstack-ansible21:26
*** zcourts has joined #openstack-ansible21:32
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation  https://review.openstack.org/49637621:34
*** eumel8 has quit IRC21:34
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Add release note for RabbitMQ ulimit  https://review.openstack.org/50146021:36
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server stable/pike: Add release note for RabbitMQ ulimit  https://review.openstack.org/50146121:37
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server stable/ocata: Add release note for RabbitMQ ulimit  https://review.openstack.org/50146221:37
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server stable/newton: Add release note for RabbitMQ ulimit  https://review.openstack.org/50146321:37
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Upgrade to RabbitMQ 3.6.11  https://review.openstack.org/49680121:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Save the rsyslog containers  https://review.openstack.org/50146421:38
cloudnullany cores around that might want to give that a deuce ^21:39
* mhayden ganders21:39
*** cjloade__ has joined #openstack-ansible21:43
*** cjloader_ has quit IRC21:46
*** cjloade__ has quit IRC21:48
spotzcloudnull: gandered21:49
taskerall: my galera and rabbit clusters are up, healthy, and have all data that existed prior to my upgrade attempts.21:52
taskerthank you all very much for your helps!21:53
taskerthe war is not over, but this has been a stellar victory21:53
*** dave-mcc_ has quit IRC21:57
*** chyka has quit IRC22:02
*** weezS has quit IRC22:05
*** BjoernT has quit IRC22:05
*** weezS has joined #openstack-ansible22:06
*** weezS has quit IRC22:10
*** galstrom is now known as galstrom_zzz22:12
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-plugins master: Python3 compatibility for config_template overrides  https://review.openstack.org/50148422:18
*** kylek3h has quit IRC22:18
*** vnogin has quit IRC22:19
*** benjamin___ has joined #openstack-ansible22:24
*** zcourts_ has joined #openstack-ansible22:25
*** zcourts has quit IRC22:29
*** benjamin___ is now known as beinir22:33
*** hybridpollo has quit IRC22:42
*** gouthamr has joined #openstack-ansible22:52
*** thegreenhundred has quit IRC22:55
*** zcourts has joined #openstack-ansible22:59
*** zcourts_ has quit IRC23:03
*** hybridpollo has joined #openstack-ansible23:04
openstackgerritMerged openstack/openstack-ansible-ops master: Save the rsyslog containers  https://review.openstack.org/50146423:10
*** marst has quit IRC23:11
*** zcourts_ has joined #openstack-ansible23:11
*** hybridpollo has quit IRC23:12
*** zcourts has quit IRC23:14
*** zcourts has joined #openstack-ansible23:15
*** zcourts_ has quit IRC23:18
*** kylek3h has joined #openstack-ansible23:23
*** hybridpollo has joined #openstack-ansible23:26
*** kylek3h has quit IRC23:29

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!