Thursday, 2017-08-31

*** weezS has quit IRC00:00
*** yifei has joined #openstack-ansible00:00
*** thegreenhundred has joined #openstack-ansible00:14
*** rstarmer has joined #openstack-ansible00:17
*** chyka has joined #openstack-ansible00:22
*** chyka has quit IRC00:27
*** markvoelker_ has quit IRC00:27
*** markvoelker has joined #openstack-ansible00:28
*** markvoelker has quit IRC00:28
*** dxiri has quit IRC00:29
*** dxiri has joined #openstack-ansible00:29
*** thorst_afk has joined #openstack-ansible00:31
*** dxiri has quit IRC00:34
*** hw_wutianwei has joined #openstack-ansible00:35
*** zcourts_ has joined #openstack-ansible00:37
*** zcourts has quit IRC00:37
*** markvoelker has joined #openstack-ansible00:44
*** markvoelker has quit IRC00:48
*** mudpuppy has quit IRC01:00
*** spotz has quit IRC01:00
openstackgerritlidong proposed openstack/openstack-ansible-tests master: Update links in bindep  https://review.openstack.org/49940501:10
openstackgerritlidong proposed openstack/openstack-ansible-os_watcher master: Fix a typo  https://review.openstack.org/49940601:16
*** woodard has joined #openstack-ansible01:17
*** woodard has quit IRC01:20
*** woodard has joined #openstack-ansible01:20
*** woodard_ has joined #openstack-ansible01:21
*** woodard has quit IRC01:21
*** woodard_ has quit IRC01:21
openstackgerritMerged openstack/openstack-ansible stable/pike: Update role SHA's for online migration fixes  https://review.openstack.org/49924601:24
openstackgerritMerged openstack/openstack-ansible stable/pike: Update documentation redirects  https://review.openstack.org/49905901:24
openstackgerritMerged openstack/openstack-ansible stable/ocata: Update documentation redirects  https://review.openstack.org/49906401:24
*** mudpuppy has joined #openstack-ansible01:35
*** spotz has joined #openstack-ansible01:35
*** thorst_afk has quit IRC01:41
*** markvoelker has joined #openstack-ansible01:44
*** askb has quit IRC01:53
*** woodard has joined #openstack-ansible01:59
*** thorst_afk has joined #openstack-ansible02:00
*** woodard has quit IRC02:00
*** markvoelker has quit IRC02:18
*** drifterza1 has joined #openstack-ansible02:23
*** drifterza has quit IRC02:25
*** jafeha has quit IRC02:37
*** dxiri has joined #openstack-ansible02:41
*** woodard has joined #openstack-ansible02:44
openstackgerritlidong proposed openstack/openstack-ansible-os_neutron master: Update links in README  https://review.openstack.org/49942102:44
*** woodard has quit IRC02:45
*** dxiri has quit IRC02:45
*** thorst_afk has quit IRC02:45
*** thorst_afk has joined #openstack-ansible02:46
*** thorst_afk has quit IRC02:50
*** woodard has joined #openstack-ansible02:52
*** gtrxcb has joined #openstack-ansible02:54
*** woodard has quit IRC03:01
*** woodard has joined #openstack-ansible03:05
*** huxinhui_ has joined #openstack-ansible03:09
*** markvoelker has joined #openstack-ansible03:15
*** woodard has quit IRC03:28
*** udesale has joined #openstack-ansible03:37
openstackgerritMerged openstack/openstack-ansible master: Fix LXC container start order  https://review.openstack.org/49772103:39
*** gkadam_ has joined #openstack-ansible03:40
*** thorst_afk has joined #openstack-ansible03:47
*** markvoelker has quit IRC03:48
*** gouthamr has quit IRC03:49
*** thorst_afk has quit IRC03:51
*** chyka has joined #openstack-ansible03:57
*** chyka has quit IRC04:01
*** germs has quit IRC04:06
*** albertcard1 has quit IRC04:06
*** Donckers has quit IRC04:11
*** chhavi has joined #openstack-ansible04:16
*** aludwar has quit IRC04:21
*** rstarmer has quit IRC04:31
*** rstarmer has joined #openstack-ansible04:36
*** markvoelker has joined #openstack-ansible04:45
*** thorst_afk has joined #openstack-ansible04:47
*** drifterza1 has quit IRC04:51
*** thorst_afk has quit IRC04:52
*** rstarmer has quit IRC04:54
*** rstarmer has joined #openstack-ansible04:55
*** ianychoi__ has joined #openstack-ansible05:12
*** ianychoi_ has quit IRC05:16
*** markvoelker has quit IRC05:19
*** markvoelker has joined #openstack-ansible05:24
*** markvoelker_ has joined #openstack-ansible05:25
*** a0x3e8 has joined #openstack-ansible05:28
*** markvoelker has quit IRC05:29
*** a0x3e8 has quit IRC05:39
*** markvoelker_ has quit IRC05:48
*** thorst_afk has joined #openstack-ansible05:48
*** thorst_afk has quit IRC05:53
*** drifterza has joined #openstack-ansible06:09
*** Oku_OS-away is now known as Oku_OS06:10
*** pcaruana has joined #openstack-ansible06:22
*** mbuil has joined #openstack-ansible06:44
*** thorst_afk has joined #openstack-ansible06:49
*** thorst_afk has quit IRC06:54
*** DanyC has joined #openstack-ansible06:58
*** coolkil has joined #openstack-ansible06:59
*** DanyC has quit IRC07:02
*** rstarmer has quit IRC07:03
*** rstarmer has joined #openstack-ansible07:05
admin0a simple  time openstack endpoint list   is taking 3m 36seconds in average to return data .. what could cause the slowness ? the cpu load etc all looks fine .. could it be dns related ?07:19
*** rstarmer has quit IRC07:19
*** rstarmer has joined #openstack-ansible07:21
MasterofJOKersadmin0, could be. e.g. if you have an IPv6 address configured in DNS, but your service doesn't actually listen to it you might run into timeouts before switching to IPv407:22
*** gtrxcb has quit IRC07:22
MasterofJOKersespecially nice, if the firewall defaults to dropping packages07:23
MasterofJOKerscould still be package loss or really slow disk, though07:24
MasterofJOKersor otherwise db blocked by other transactions07:25
*** sxc731 has joined #openstack-ansible07:32
*** DanyC has joined #openstack-ansible07:33
openstackgerritChris Beukers proposed openstack/openstack-ansible master: Adding serial console support  https://review.openstack.org/49948707:41
openstackgerritChris Beukers proposed openstack/openstack-ansible-os_nova master: Adding serial console support  https://review.openstack.org/47984407:44
*** thorst_afk has joined #openstack-ansible07:50
*** thorst_afk has quit IRC07:55
hwoaranggood morning08:01
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: L3 Support for ODL deployments  https://review.openstack.org/49745808:08
DimGRkalhmera08:14
*** openstackgerrit has quit IRC08:17
*** openstackgerrit has joined #openstack-ansible08:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: Vagrantfile: Increase VM memory size to 12G  https://review.openstack.org/49949908:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: Vagrantfile: Add openSUSE support  https://review.openstack.org/49950008:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: scripts: scripts-library.sh: Hide 'which' command output  https://review.openstack.org/49950108:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: scripts: scripts-library.sh: Do not use the '-m' option on tracepath  https://review.openstack.org/49950208:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: scripts: scripts-library.sh: Add support for openSUSE  https://review.openstack.org/49950308:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: scripts: bootstrap-ansible: Add required packages on openSUSE Leap  https://review.openstack.org/49950408:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: tests: bootstrap-host: Use btrfs tools to determine available disk space  https://review.openstack.org/49950508:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: tests: bootstrap-host: Add SUSE variables file  https://review.openstack.org/49950608:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: tests: bootstrap-host: Add ability to configure networking on SUSE  https://review.openstack.org/49950708:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: tests: bootstrap-aio: Add sftp subsystem option for SUSE  https://review.openstack.org/49950808:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: tests: bootstrap-host: Refresh repositories on SUSE  https://review.openstack.org/49950908:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: group_vars: all: Replace spaces with underscores in distro repository  https://review.openstack.org/49951008:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: playbooks: utility-install.yml: Update package cache on openSUSE  https://review.openstack.org/49951108:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: playbooks: os-swift-install: Use correct group name on openSUSE  https://review.openstack.org/49951208:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: playbooks: os-lxc-container-setup: Force kill a container on openSUSE if it takes too long to stop  https://review.openstack.org/49951308:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: tests: bootstrap-host: Add SUSE support in the RedHat network scripts  https://review.openstack.org/49951408:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible stable/pike: Declare openSUSE Leap 42.X support as WIP  https://review.openstack.org/49951508:22
*** maybebuggy has quit IRC08:34
*** a0x3e8 has joined #openstack-ansible08:46
a0x3e8hello. I have problem deploying openstack-ansible on 3 servers using " 3 physical ethernet ports!" I want to use a seperated interface for each of: management, provider and storage services. I replaced vlans on ansible palybook with normal ethernet interfaces but my instances can not access outside world!08:48
a0x3e8simply: network is not working.08:48
a0x3e8here is my openstack-user-config.yml08:49
a0x3e8https://thepasteb.in/p/Wnhzm0KLY7gtV08:50
a0x3e8what did I do wrong here?08:50
*** thorst_afk has joined #openstack-ansible08:51
*** m3rl1n has joined #openstack-ansible08:52
*** ivveh has joined #openstack-ansible08:53
*** thorst_afk has quit IRC08:55
coolkila0x3e8: your instances cant access the outside world? or nothing can reach the outside world?08:59
coolkilis there conectivity between containers?09:00
*** mrch has joined #openstack-ansible09:02
*** openstackgerrit has quit IRC09:03
coolkilbtw why did you define br-vlan twice?09:03
*** electrofelix has joined #openstack-ansible09:06
*** vnogin has joined #openstack-ansible09:08
a0x3e8coolkil: yes there is connectivity between containers09:18
a0x3e8coolkil: I did like the example in the manual.09:20
a0x3e8coolkil: is my configuration valid? I am not really a network guy...09:20
*** chyka has joined #openstack-ansible09:21
a0x3e8coolkil: these are my complete configurations on all nodes: ( I asked the same thing in stackoverflow! ) https://stackoverflow.com/questions/45975017/openstack-deployed-with-ansible-network-not-working09:23
*** drifterza has quit IRC09:23
*** chyka has quit IRC09:25
coolkila0x3e8: you dont have conectivity from the outside you say. but when you are logged in throug the spice console you can access the outside world?09:27
coolkildid you add a security group wich allows acces from the outside and did you add a floating ip address?09:27
*** openstackgerrit has joined #openstack-ansible09:28
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ops master: Ensure the user_secrets file is updated  https://review.openstack.org/49953709:28
odyssey4meandymccr evrardjp https://review.openstack.org/49924409:31
*** vnogin has quit IRC09:32
*** vnogin has joined #openstack-ansible09:33
*** drifterza has joined #openstack-ansible09:33
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ops master: Ensure the user_secrets file is updated  https://review.openstack.org/49953709:34
*** m3rl1n has quit IRC09:36
a0x3e8coolkil: I can ping some IPs like 10.1.10.59 which is my management ip address! this is odd.09:36
a0x3e8coolkil: I can ping the instance from another! but none of them are accessible from outside!09:38
coolkilseems like your network is up.09:38
*** maybebuggy has joined #openstack-ansible09:39
coolkilyou just did not configure security groups and floating ip addresses09:39
admin0good morning all09:40
*** m3rl1n has joined #openstack-ansible09:40
a0x3e8coolkil: did you check my configs? I want to be sure they are correct09:40
*** drifterza has quit IRC09:41
openstackgerritMerged openstack/openstack-ansible-ops master: Ensure the user_secrets file is updated  https://review.openstack.org/49953709:44
*** drifterza has joined #openstack-ansible09:44
admin0my stack is extremely slow ..  ..  from the util server, a openstack endpoint list  takes 3m 50 seconds09:45
admin0i do not see load in the cpu or anything out of the ordinary09:45
*** hw_wutianwei has quit IRC09:47
evrardjpdns resolving?09:47
coolkila0x3e8: seems alright. besides if you can ping from within the instance to the outside world you got a working network setup for as far as i can tell09:48
a0x3e8coolkil: I can not ping outside world. I can only ping from instance to instance and two unrelated ip addresses which should not be visible in instances.09:50
a0x3e8coolkil:  ansible has created security group by default. shouldnt I use that?09:50
coolkilyes but that security group blocks all traffic originating from the outside world.09:51
*** thorst_afk has joined #openstack-ansible09:51
*** chyka has joined #openstack-ansible09:52
*** yifei has quit IRC09:54
admin0evrardjp, dns seems OK09:55
*** thorst_afk has quit IRC09:56
*** chyka has quit IRC09:56
a0x3e8coolkil: ok.. so I think I was doing it wrong since now! I will check with new information. thanks dude.09:58
admin0can ipv6 or reverse dns play a role ?09:58
coolkilwell you interfaces file seems weird to me09:58
coolkila0x3e8:09:58
coolkilyou defined some of your bridges twice09:59
coolkila0x3e8: https://pastebin.com/huEjH1VX this is my openstack_user_config.yml (this network setup works for me i route all my external traffic of openstack through vlan 201)10:03
*** stuartgr has joined #openstack-ansible10:05
a0x3e8coolkil: thanks a lot.. I just wanted to gain performance in networking by using 3 physical network interfaces.10:05
coolkilyea that is a good idea10:06
a0x3e8coolkil: my interfaces are 1G. so if I wanted to use one interface for everything, this would make the whole thing slow. will binding one interface and use it like the example in manual do the same?10:07
coolkildepends on how you bind them together...10:08
coolkilbut the setup you have now is also a posibility10:08
odyssey4meandymccr evrardjp here's the unbound issue fixer: https://review.openstack.org/#/c/493739/ and the original breaker is https://review.openstack.org/#/c/490706/10:09
a0x3e8coolkil: can you please send be /etc/network/interfaces of your nodes?10:09
odyssey4melogan- has a legitimate concern about the fixer, so I propose that for pike at least we revert the breaker10:09
coolkilthis is the interfaces file for the managment node https://pastebin.com/SZ4dxgwj10:10
coolkilcan send you the rest later right now it is time for lunchXD10:10
m3rl1n@a0x3e8 I think u can use interface bonding to ensure make sure you get more bandwidth10:10
odyssey4meandymccr evrardjp bug ref https://bugs.launchpad.net/openstack-ansible/+bug/171134910:10
openstackLaunchpad bug 1711349 in openstack-ansible "CentOS/Pike - resolvconf - No file was found when using with_first_found." [High,In progress] - Assigned to Kevin Carter (kevin-carter)10:10
m3rl1nI dont know they will work only for fail over or if you can config them to split traffic10:11
a0x3e8coolkil: thank you very much for your time and help.10:11
a0x3e8m3rl1n: bonding can be used for increasing bandwidth but I prefer using seperated ifaces. bonding can be a little tricky sometimes10:13
m3rl1nOk, thanks for the info... just out interest though... performance wise what is the best network virtulization choice for the stack.10:14
m3rl1nOn our infra we have liberty connected directly to VLANs with virtualization which provide much better performance than ocata on SDN10:16
m3rl1nbut I wonder about if that can be optimised in anyway10:16
*** sxc731 has quit IRC10:19
a0x3e8m3rl1n: I am not really a network guy. so I can not really say anything about that.10:19
m3rl1nOk, no probs :(10:26
m3rl1nIt was just an attempt to try start a discussion lol, but I guess this channel more suited to specific open stack related things10:27
*** udesale has quit IRC10:27
*** szaher has quit IRC10:41
*** szaher has joined #openstack-ansible10:46
a0x3e8m3rl1n: well. this is an IRC channel. there are people who are experienced more than others, each in their own field of work/study. there are people that will guide you really well but you need to be patient.10:46
coolkila0x3e8: do you need the compute interfaces too?10:51
*** vnogin has quit IRC10:52
*** thorst_afk has joined #openstack-ansible10:52
m3rl1nThanks :D I look forward to being apart of the community10:53
coolkila0x3e8 https://pastebin.com/NxF4VRAn this is compute10:55
*** thorst_afk has quit IRC10:57
*** vnogin has joined #openstack-ansible10:59
*** vnogin has quit IRC10:59
*** vnogin has joined #openstack-ansible11:01
coolkila0x3e8: be aware that i implemented trove. trove requires the br-dbaas bridge if you dont implement trove you dont need it11:02
openstackgerritMerged openstack/openstack-ansible stable/ocata: Update role SHA's for online migration fixes  https://review.openstack.org/49924411:03
*** chyka has joined #openstack-ansible11:08
openstackgerritAndy McCrae proposed openstack/openstack-ansible master: Use /var/lib rather than /tmp  https://review.openstack.org/49955711:09
*** chyka has quit IRC11:13
admin0m3rl1n, vlan is still faster, but if you have more than say 4000 networks, you cannot scale out11:14
admin0which brings to vxlan .. which scales up, but is a bit slower11:14
bhujaya0x3e8: Well , there cloud be multiple issues . VM , Security rule , Creation of provider network , Configuration of Bridge interface and Physical switch  configuration where external network is connected . To isolate I suggested  1) create a provider network  , external type with gateway IP pointing to your provider network . 2) create a router and connect it with this provider external network . Note the11:15
bhujayrouters interface ip and try to ping from  provider net . Cloud you test this ?11:15
admin0and with vxlan, you cannot break out ( as in plug in other network devices into your VPC ) unless the device understands vxlan11:15
bhujayunless there is a provider network set up done that is connected to physical net you cant  reach outside  from VM or vice versa11:17
*** dave-mccowan has joined #openstack-ansible11:18
*** thorst_afk has joined #openstack-ansible11:40
a0x3e8coolkil: thanks.11:42
*** a0x3e8 has quit IRC11:43
spotzandymccr or evrardjp - Don't forget agenda:)11:43
*** smatzek has joined #openstack-ansible11:50
*** thegreenhundred has quit IRC11:55
*** holmsten has joined #openstack-ansible11:59
*** vnogin has quit IRC12:02
andymccrmgariepy: mhayden: do we still have issues with centos repos? I thought we figured all that out, but ikeep running into problems just trying to build AIOs etc. Ceph is failing on some repo builds too12:07
*** jbadiapa has quit IRC12:09
openstackgerritMerged openstack/openstack-ansible stable/pike: ansible-role-requirements: Bump version for the 'bird' role  https://review.openstack.org/49532912:10
*** vnogin has joined #openstack-ansible12:10
*** vnogin has quit IRC12:11
*** yifei has joined #openstack-ansible12:12
*** vnogin has joined #openstack-ansible12:12
*** sxc731 has joined #openstack-ansible12:13
*** vnogin has quit IRC12:14
*** kylek3h has quit IRC12:15
*** huxinhui_ has quit IRC12:18
*** vnogin has joined #openstack-ansible12:19
*** vnogin has quit IRC12:19
*** vnogin has joined #openstack-ansible12:21
*** vnogin has quit IRC12:22
*** vnogin has joined #openstack-ansible12:23
*** vnogin has quit IRC12:25
*** jbadiapa has joined #openstack-ansible12:26
mhaydenandymccr: what are we seeing now? i've seen some funky stuff around failing to retrieve repomd.xml a few times12:28
andymccrmhayden: i saw a rabbitmq repo 504 and stuff, trying some more tests - but struggling a bit to get the centos things to go!12:29
andymccralso: for ceph we get http://logs.openstack.org/periodic/periodic-openstack-ansible-deploy-ceph-pike-centos-7/4e273fc/console.html#_2017-08-31_07_18_30_26239112:29
mhaydenoh was it erlang-solutions?12:29
mhaydenthey had downtime again12:29
* mhayden added monitoring for them12:29
andymccrmhayden: fair enough that could've been a one off i saw will try again (doing so now actually!)12:30
andymccrceph one is consistent though12:30
mhaydenyeah, erlang-solutions had downtime this morning12:30
mhaydenthey started flapping, then threw 50X errors, then flapped, then came back12:30
mhaydenandymccr: can you point me to some logs on the ceph failures?12:30
andymccrmhayden: http://logs.openstack.org/periodic/periodic-openstack-ansible-deploy-ceph-pike-centos-7/4e273fc/console.html#_2017-08-31_07_18_30_262391 sample from pike12:31
andymccrbut theyre failing all the way down!12:31
andymccrother than that and upgrades i think we are almost all passing on periodicals which is awesome12:31
* mhayden is still training on ceph but he will gander12:32
*** sxc731 has quit IRC12:33
andymccrmhayden: its repo yum install probs :( so not so much ceph really12:33
*** vnogin has joined #openstack-ansible12:33
*** woodard has joined #openstack-ansible12:34
*** woodard has quit IRC12:34
*** vnogin has quit IRC12:34
*** woodard has joined #openstack-ansible12:35
*** vnogin has joined #openstack-ansible12:35
*** vnogin has quit IRC12:36
*** vnogin has joined #openstack-ansible12:38
*** thegreenhundred has joined #openstack-ansible12:38
*** vnogin has quit IRC12:39
*** vnogin has joined #openstack-ansible12:39
*** gkadam_ has quit IRC12:40
*** vnogin has quit IRC12:40
*** vnogin has joined #openstack-ansible12:42
*** smatzek has quit IRC12:42
*** yifei has quit IRC12:44
openstackgerritMerged openstack/openstack-ansible stable/pike: Vagrantfile: Increase VM memory size to 12G  https://review.openstack.org/49949912:45
openstackgerritMerged openstack/openstack-ansible stable/pike: Vagrantfile: Add openSUSE support  https://review.openstack.org/49950012:46
*** kylek3h has joined #openstack-ansible12:46
*** kylek3h_ has joined #openstack-ansible12:47
*** esberglu has joined #openstack-ansible12:49
*** kylek3h has quit IRC12:50
*** yifei has joined #openstack-ansible12:53
*** dave-mccowan has quit IRC12:57
*** sxc731 has joined #openstack-ansible12:59
*** udesale has joined #openstack-ansible13:00
*** yifei has quit IRC13:00
mhaydenoh weird, this is the unpacking issue again13:03
*** smatzek has joined #openstack-ansible13:03
mhaydenmgariepy brought this up yesterday13:03
mhaydenlet me see if i can retrieve that pkg manually from that openstack mirror and see what i get13:03
mgariepyhey13:04
mgariepymornign13:04
mhaydenoh wait, there's no /etc logs in here13:04
odyssey4meandymccr https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/tasks/lxc_net.yml13:07
*** dave-mcc_ has joined #openstack-ansible13:09
mhaydenif i manually unpack the RPM from that mirror, andymccr, all is well13:10
*** sxc731 has quit IRC13:10
andymccrmhayden:  hmm will try get the AIO running so i can mess about a bit with it13:10
mhaydenandymccr: i wonder if there's a conflict with the urllib3 installd via pip13:12
mhaydenfrom what i'm reading, it seems like rpm throws that error when something is in the way that prevents it from laying those files down13:13
mgariepyhmm,. that's possible, with RPM when a file is present on disk the pkg do not overwrite it..13:14
andymccrdamnit RPM!13:14
mgariepywe should drop centos..13:14
mgariepy :P13:14
*** udesale has quit IRC13:15
andymccrhaha - i think the regular aio's are buliding13:15
andymccrjust ceph rn13:15
odyssey4methere must be some sort of CLI option to either overwrite or not13:17
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Update to MariaDB 10.2  https://review.openstack.org/49930013:18
*** gouthamr has joined #openstack-ansible13:18
odyssey4mealthough, I'm inclined to suggest that we move towards never pip installing on hosts and only ever using venvs, then using the distro versions of pip/virtualenv on the host and only ever use packages on hosts with virtualenvs for our special needs13:18
*** ianychoi__ is now known as ianychoi13:20
mgariepyyep setup-hosts install urllib3 via pip.13:20
mgariepyhttp://logs.openstack.org/periodic/periodic-openstack-ansible-deploy-ceph-pike-centos-7/4e273fc/logs/ara/result/08de0315-3751-4509-a8d1-08c29f4c3302/13:20
mhaydenhmm we could change that13:25
mhaydenyeah, it's in the pip_install role :/13:26
*** m3rl1n has quit IRC13:29
odyssey4meurllib is needed for ansible to operate13:29
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: [wip] adding multiple ovs manager  https://review.openstack.org/49658013:30
*** yifei has joined #openstack-ansible13:30
*** sxc731 has joined #openstack-ansible13:31
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: [WIP] Use OS pkgs, not pip  https://review.openstack.org/49960113:37
openstackgerritAndy McCrae proposed openstack/openstack-ansible master: Use /var/lib rather than /tmp  https://review.openstack.org/49955713:37
*** andreas_s has joined #openstack-ansible13:39
*** smatzek has quit IRC13:39
firebatMorning guys... if I can't ping an lxc container via one of its provider IPs what kind've things do I have wrong in my network setting?13:45
firebatI.e. I can't ping my neutron agent on the external provider network IP it has, and subsequently the routers I make in that network don't give access to the internet13:46
odyssey4mefirebat have you allowed ICMP access from outside - by default it is denied13:54
*** sxc731 has quit IRC13:54
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use a dynamic group to deploy unbound  https://review.openstack.org/49373913:56
firebatodyssey4me Nope I haven't good call13:57
andymccrlogan-: ^ can you check that one out? Want to try get this stuff fixed up for pre-release so we can upgrade jobs working again :)13:57
*** mrch has quit IRC13:58
*** Donckers has joined #openstack-ansible13:58
*** vnogin has quit IRC13:59
*** smatzek has joined #openstack-ansible13:59
*** rstarmer has quit IRC14:05
*** cristicalin has joined #openstack-ansible14:05
openstackgerritAndy McCrae proposed openstack/openstack-ansible-lxc_hosts master: For CentOS ensure lxc-net is started and enabled  https://review.openstack.org/49960914:07
*** marst has joined #openstack-ansible14:08
andymccrmhayden: cloudnull ^ thoughts? That worked for me in my builds, but it doesnt seem to be impacting the gate (not sure why)14:09
*** vnogin has joined #openstack-ansible14:10
andymccrwithout that, lxc-net isnt started and so any dns resolutions on the base container prep fail when installing packages14:10
*** SerenaFeng has joined #openstack-ansible14:10
*** maybebuggy has quit IRC14:11
*** SerenaFeng has quit IRC14:11
*** yifei has quit IRC14:12
*** yifei has joined #openstack-ansible14:12
neithI'm still struggling with my 14.04->16.04 update, When playing the task "Create OpenStack-Ansible requirement wheels" it fails, the directory /Var/www/repo//ubuntu-14.04-x86_64 is missing a lot of files! I can see they are symlinks put the source files are not there obviously, I can't locate in the play where it should be populated. any clue?14:13
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Fix a typo  https://review.openstack.org/49940614:14
*** drifterza has quit IRC14:14
*** dxiri has joined #openstack-ansible14:15
admin0my debug shows a visible timeout of 5-6 seconds when its in this step: GET call to None for http://my-int.xxx.cloud:5000/v3  - and after 4-5 seconds it goes through .. making everything to a crawl .. what could be the possible causes that this step is slow14:31
*** sxc731 has joined #openstack-ansible14:37
*** jvidal has quit IRC14:37
*** galstrom_zzz is now known as galstrom14:38
*** jvidal has joined #openstack-ansible14:51
admin0solved ... it was a (crappy) dns forwarder :(14:53
evrardjptold you14:53
admin0had to get to the bottom (strace ) :D14:53
evrardjp;)14:53
admin0ok .. out for a movie "american made" :14:54
admin0have a great evening14:54
*** mbuil has quit IRC14:56
*** vnogin has quit IRC14:59
spotzseeya admin015:01
spotzGreetings my fellow OSAers! •cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccoll15:01
spotzum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen15:01
spotz Friendly reminder we will be meeting in 1 hour in #openstack-meeting-4 Agenda is available at https://wiki.openstack.org/wiki/Meetings/openstack-ansible#Agenda_for_next_meeting15:01
*** DanyC has quit IRC15:04
xgerman_hi, wonder what’s going on with this opendaylight role in neutron. The os-octavia gate is bombing…15:08
*** cristicalin has quit IRC15:08
*** mbuil has joined #openstack-ansible15:09
*** cristicalin has joined #openstack-ansible15:10
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use a dynamic group to deploy unbound  https://review.openstack.org/49373915:13
openstackgerritMerged openstack/openstack-ansible-tests master: Update links in bindep  https://review.openstack.org/49940515:13
*** cristicalin has quit IRC15:13
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49963815:15
*** weezS has joined #openstack-ansible15:15
*** Oku_OS is now known as Oku_OS-away15:16
*** jwitko has quit IRC15:16
*** jwitko has joined #openstack-ansible15:17
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use a dynamic group to deploy unbound  https://review.openstack.org/49373915:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49963915:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964015:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964115:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964215:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49725215:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964315:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964415:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964515:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964615:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ops master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964715:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964815:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49964915:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965015:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965115:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965215:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965315:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965415:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_freezer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/47656815:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965515:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965615:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965715:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965815:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49965915:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966015:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966115:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966215:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca-agent master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966315:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49727515:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966415:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49727715:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966515:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966615:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49728015:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49728115:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966715:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966815:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49966915:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967015:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967115:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967215:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967315:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967415:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967515:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967615:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49967715:20
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49729315:20
prometheanfire.15:20
*** andreas_s has quit IRC15:22
*** yifei has quit IRC15:23
*** vnogin has joined #openstack-ansible15:25
*** coolkil has quit IRC15:30
*** chyka has joined #openstack-ansible15:30
*** pcaruana has quit IRC15:32
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-specs master: Cleanup openstack_user_config  https://review.openstack.org/49968615:33
*** drifterza has joined #openstack-ansible15:38
spotzandymccr: evrardjp: - don't forget the agenda!15:42
evrardjpyup15:42
evrardjpI have nothing to add15:42
andymccrspotz: i checked it up and updated, but i thinkt here isnt any diff15:42
andymccrnothing new to add :)15:42
spotzandymccr: I wasn't sure if evrardjp should take over the release section15:43
andymccrspotz: wow trying to kick me out so soon?!15:43
andymccrspotz: after PTG :D when we do our final release15:43
*** jwitko has left #openstack-ansible15:43
*** vikrant has joined #openstack-ansible15:43
spotzandymccr: okie, I knew jungleboyj had started leading cinder so wasn't sure if it was 'time'15:44
andymccrspotz: yeah they released this week :)15:44
spotzandymccr: :)15:44
andymccri get an extra 2 weeks to be the venerable dictator15:44
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-specs master: (WIP) Blueprint for Congress integration with OSA.  https://review.openstack.org/49906615:48
evrardjphaha15:48
evrardjpyou get all you want, I am (trying to be) a friendly person.15:49
cloudnullodyssey4me: https://review.openstack.org/#/c/493739/  -- is pike busted without that patch ?15:49
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible stable/pike: Use a dynamic group to deploy unbound  https://review.openstack.org/49969115:50
odyssey4mecloudnull yep, without that or it needs the previous one reverted15:50
cloudnullok15:50
odyssey4mecloudnull oddly enough, though, we don't see it in CI15:50
cloudnullI cherry-picked it just to see if it passes.15:51
odyssey4mewell - we see it in periodics15:51
cloudnullif I need to rebase it i will15:51
odyssey4meas per the bug15:51
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-specs master: Cleanup openstack_user_config  https://review.openstack.org/49968615:51
*** DanyC has joined #openstack-ansible15:55
*** DanyC has quit IRC15:58
*** DanyC has joined #openstack-ansible15:58
spotzMEETING!!!!!!16:02
*** holmsten has quit IRC16:07
openstackgerritMerged openstack/openstack-ansible master: Correct zuul-cloner cloning of pinned SHA's  https://review.openstack.org/49924716:09
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Enable verbose logging when fetching roles via git-clone  https://review.openstack.org/49878716:14
*** esberglu has quit IRC16:30
*** arif-ali has left #openstack-ansible16:33
*** jvidal has quit IRC16:39
*** sxc731 has quit IRC16:40
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: Revert "Modify unbound to JIT install clients"  https://review.openstack.org/49971116:41
*** jwitko has joined #openstack-ansible16:41
hwoarangspotz: hello :) Am i correct to assume that you maintain this document? https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/16:46
spotzhwoarang: I am the fixer of grammar so yes:)16:46
hwoarangi am looking to add the openSUSE bits but i am having troubles finding the correct place to do it16:47
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: docs: contributor: Add openSUSE Leap references  https://review.openstack.org/49971916:47
openstackgerritJimmy McCrory proposed openstack/openstack-ansible master: Remove remaining service_name properties  https://review.openstack.org/49972216:52
*** jvidal has joined #openstack-ansible16:55
spotzhwoarang: Are we calling it openSUSE or SUSE?16:57
hwoarangwell openSUSE is the open SUSE ;p16:57
spotzhwoarang: hehehe openSUSE it will be then!16:57
hwoarangbut since the guide says CentOS then maybe openSUSE. I presume whatever applies to CentOS also applies to RHEL16:58
hwoarangit's somewhat similar for suse too16:58
spotzhwoarang: In theory. Any kernel you want specified?16:58
cloudnullhwoarang: sles and leap are faily close these days no?16:59
hwoarangcloudnull: that's correct16:59
hwoarangspotz: latest openSUSE releases are based on 4.4.X16:59
spotzAnd that's what we're requiring?16:59
* cloudnull on tumbleweed 4.12!!16:59
hwoarangseems to work fine16:59
hwoarangspotz: but these are not vanilla 4.4.X. They have a shitload of backports17:00
spotzok so Leap 42.X and kernel 4.4.X17:00
hwoarangyeah sounds about right17:00
*** rstarmer has joined #openstack-ansible17:00
*** dave-mcc_ is now known as dave-mccowan17:01
openstackgerritAmy Marrich (spotz) proposed openstack/openstack-ansible master: [DOC} Add openSUSE to Software requirements  https://review.openstack.org/49973017:03
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Use OS pkgs, not pip  https://review.openstack.org/49960117:04
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: [TEST] Use OS pkgs, not pip  https://review.openstack.org/49973517:05
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: docs: contributor: Add openSUSE Leap references  https://review.openstack.org/49971917:06
hwoarangspotz: oh i see where the deployment guide is now. i can add the remaining pieces if necessary17:07
*** esberglu has joined #openstack-ansible17:12
spotzhwoarang: Ok or let me know17:12
hwoarangyeah it seems straightforward17:15
*** stuartgr has quit IRC17:16
*** esberglu has quit IRC17:16
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DOC] Add openSUSE Leap references  https://review.openstack.org/49971917:17
jwitkoHi I'm trying to use OSA to deploy openstack to my 1985 Nintendo Entertainment System.  I keep getting a strange error, I took a screenshot here if anyone can help https://i.ytimg.com/vi/rJKhzlCrdRE/maxresdefault.jpg17:19
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server master: Increase default maximum connection count to 3,200  https://review.openstack.org/49974017:19
*** esberglu has joined #openstack-ansible17:20
spotz**faints**17:20
cloudnulljwitko: LOLOL17:24
spotzI blame you cloudnull17:25
jwitkocloudnull, Any idea what the issue is ?17:26
cloudnullyou gotta blow into the cartridge.17:27
jwitkoi figured it out17:27
jwitkowas using the IP of my SEGA Genesis17:27
*** mbuil has quit IRC17:27
*** germs has joined #openstack-ansible17:27
jwitkoThanks as always guys!17:27
cloudnullthat'll get you everytime17:27
spotzheheh17:27
DimGRcloudnull hi17:32
*** sxc731 has joined #openstack-ansible17:36
*** vnogin has quit IRC17:42
*** vnogin has joined #openstack-ansible17:42
*** dxiri_ has joined #openstack-ansible17:44
*** dxiri has quit IRC17:48
openstackgerritMerged openstack/openstack-ansible stable/pike: Remove python3 usage in bootstrap-ansible.sh  https://review.openstack.org/49886317:49
*** drifterza has quit IRC17:54
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: [DOC] Add openSUSE Leap references  https://review.openstack.org/49971917:56
*** vnogin has quit IRC17:57
*** electrofelix has quit IRC17:59
*** vikrant has quit IRC18:00
logan-o/18:01
evrardjpjwitko: that's due to a recent Sonic mania.18:02
prometheanfireI'm not getting it until they remove the drm on it18:03
prometheanfireI want it though :|18:03
*** dave-mccowan has quit IRC18:07
*** dave-mccowan has joined #openstack-ansible18:14
*** brad[]` has quit IRC18:20
evrardjphaha it's great18:21
*** zcourts has joined #openstack-ansible18:28
*** jwitko has quit IRC18:29
*** zcourts_ has quit IRC18:31
*** jwitko has joined #openstack-ansible18:35
*** chhavi has quit IRC18:36
*** jwitko_ has joined #openstack-ansible18:41
*** jwitko_ has quit IRC18:41
*** jwitko has quit IRC18:56
taskerregarding my troubles with spice. whatever it is -- i think it's actually my normal work-a-day browser. I tried it in Firefox and I can log into the instance's console.18:57
*** jwitko has joined #openstack-ansible18:58
taskermaybe it has something to do with "Connected to wss://haproxy:6082/"18:58
taskerwhat is the "wss://" protocol?18:59
*** jwitko has quit IRC19:00
*** jwitko has joined #openstack-ansible19:00
odyssey4metasker web sockets19:02
evrardjpover ssl19:02
odyssey4meif you're using self-signed certs, some browsers will prevent the console inclusion in the interface19:02
odyssey4meyou may see a shield in chrome IIRC19:02
odyssey4meif you click on it, it tells you that there was a naughty iframe IIRC19:03
taskerfirefox did much the same.19:03
taskerok. sounds like the last thing I need to slay is the self-signed cert that OSA pushed out. overall, my new newton cluster (upgraded from mitaka) is working splendidly.19:05
taskerI gotta say, OSA made this a snap. the only troubles I came across were caused by my silly, custom configurations.19:06
evrardjpahah great to hear19:06
odyssey4mebetter to push patches upstream where possible to minimise your tech debt for the next one ;)19:06
evrardjphowever I think your experience should be shared to a broader audience if you can... If you come at the PTG19:06
evrardjpfor example19:06
evrardjpor in the docs19:07
evrardjpor anything!19:07
*** brad[] has joined #openstack-ansible19:21
firebatI had to reset one of my infra nodes, and I hosed this task: lxc_hosts : Prepare cached image setup commands19:22
firebatCan't figure out how to correct what I've done... of note though I had to move /var/lib/lxc to a different root directory via a symlink (probably a horrible idea)19:23
firebatThis is a piece of the error: https://pastebin.com/WmiAaqTY19:26
*** randomtech has joined #openstack-ansible19:38
*** brad[] has quit IRC19:38
randomtechhello. does anyone know what bridges have to be set up before i deploy openstack ansible19:38
evrardjprandomtech: should be in the documentation19:39
evrardjphttps://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/overview-network-arch.html19:39
evrardjpor https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/targethosts-networkconfig.html19:40
evrardjpWe have many sources in the docs!19:40
randomtechim trying to figure otu if i need to configure things such as br-mgmt before i use openstack anisible, or if it can do it for me19:42
*** sxc731 has quit IRC19:42
evrardjpAre you trying to prototype this?19:43
evrardjpOr a real deploy?19:43
evrardjpif it's just a prototype, we have an all in one that configures everything and does everything for you19:43
randomtechwe will be setting up a openstack cluster on a rack soon and are trying to figure out what we need to set up bbeforehand19:43
evrardjpelse, just do it :)19:43
randomtechas the documentation does noot seem to be the clearest19:44
evrardjppatches welcome :)19:44
randomtechim not sure if your answering my question19:45
evrardjpif you want a real cluster, you should probably configure your networking yourself, to match your needs19:48
evrardjpwe can't assume the network interfaces or bridge connectivity for you19:48
evrardjpwhat I pasted is what's required19:48
evrardjpand what's optional but recommended19:48
evrardjpwhat I think is generally best for a rack, is that you configure all of the nodes the same19:48
evrardjpeasier :p19:48
evrardjp(with different ips of course!)19:49
openstackgerritMerged openstack/openstack-ansible master: [DOC] Add openSUSE Leap references  https://review.openstack.org/49971919:51
evrardjprandomtech: does that help?19:53
evrardjpif you think the doc isn't clear or that there is room for improvement, you may wish to file a bug19:53
*** randomtech has quit IRC19:55
*** zcourts_ has joined #openstack-ansible19:56
chykahey there, is there any way to update mtu for container interfaces post-install? after setting mtu in openstack_user_variables.yml and destroying/recreating containers, it still uses the old mtu19:58
*** zcourts has quit IRC19:59
chykaah nvm, removing ansible_facts does the trick20:04
*** vnogin has joined #openstack-ansible20:05
*** brad[] has joined #openstack-ansible20:06
*** smatzek has quit IRC20:08
firebatAm I crazy can you not mount to partitions in /etc/fstab?20:09
*** cristicalin has joined #openstack-ansible20:09
admin0back :) enjoyed the movie20:11
jwitkofirebat, thats a confusing question20:13
jwitkocan you rephrase?20:14
*** drifterza has joined #openstack-ansible20:21
*** drifterza has quit IRC20:21
*** DanyC has quit IRC20:25
taskerI'm under the impression that the containers built by OSA use a container image based on the OS that OSA is staged from. is that right? can that be overridden?20:28
*** vnogin has quit IRC20:29
neithguys, I keep rebuilding one galera container but it fails to rejoin the cluster20:30
neithno matter how many times I rebuild and delete container data and restart mysql service20:31
neithany clue?20:31
*** esberglu has quit IRC20:31
*** esberglu has joined #openstack-ansible20:31
taskercheck the version of percona-xtrabackup.20:34
taskera recent update to mariadb requires the "percona-xtrabackup-24" package instead of "-22"20:35
*** esberglu has quit IRC20:36
taskerneith: I'm guessing that you're probably stuck at "wating for mysql service to start" (or something similar to that)?20:39
neithtasker: i'm trying to restart it manually20:39
neithchecking the package20:40
chykahmm removing ansible_facts didn't do it.  There are options in openstack_user_variables.yml to set the container interface MTU, it works if i add a new group to the network in there, but not for previously deployed ones20:40
neithtrying20:41
neithtasker: how do I get this version? is there any package pinning for that?20:42
taskerthat I don't know. I do know that it can be done while the playbook is running. when it hangs at "starting mysql", log in, stop the service, upgrade the package, and start it. the playbook will then continue.20:43
tasker*log in from another terminal20:43
tasker<- not an OSA developer; just another user.20:44
neithtasker: well I cant find this package in the repo20:44
neithi'll dig20:44
*** esberglu has joined #openstack-ansible20:44
taskerah. well. double check the /var/log/mysql_logs/galera_server_error.log and make sure that it's actually xtrabackup that's causing the problem.20:46
neithtasker: its not20:46
taskerthen my resolution will not help.  . /20:46
neithit seems like the node is evicted from the cluster right after the data ar synced20:46
firebatjwitko Hey figured it out sorry my partition was corrupted21:00
firebatOne thing I can't get past is this script: cache-prep-commands.sh it keeps failing on me. I reverted my earlier symlink bs and mounted /var/lib/lxc and /openstack to new drives so they'd not run out of space on me, but I'm still getting an error on this21:01
*** yusef has joined #openstack-ansible21:04
*** askb has joined #openstack-ansible21:04
*** thorst_afk has quit IRC21:08
*** askb has quit IRC21:09
*** askb has joined #openstack-ansible21:10
taskernow that my cluster is at newton I need to bring my operating system up to xenial. will I need to re-run the playbooks once the underlying OS's are upgraded? because even my containers are still trusty.21:16
taskerif I rebuild the containers to xenial -- do I lose my old cluster?21:16
*** dave-mccowan has quit IRC21:20
neithtasker:https://etherpad.openstack.org/p/osa-newton-xenial-upgrade21:26
*** esberglu has quit IRC21:31
taskerhey, look at that! thanks, neith.21:31
neithtasker: I advice you to try it out on a non production context21:31
taskerthat's what this is.  . )21:31
neithI'm doing the sam thing currently and i'm struggling with several issues21:32
*** thorst_afk has joined #openstack-ansible21:34
*** thorst_afk has quit IRC21:36
taskerI'm confused about the ordering there -- do I upgrade the compute hosts in-between the infrastructure hosts? or do I upgrade them after all of the infrastructure is done?21:37
*** mbuil has joined #openstack-ansible21:38
*** thorst_afk has joined #openstack-ansible21:39
*** mbuil has quit IRC21:39
*** Donckers has quit IRC21:43
neithyes in between21:43
neithas soon as you updated 1 infra21:44
neithyou have a mixed control plane21:44
openstackgerritMerged openstack/openstack-ansible stable/pike: Revert "Modify unbound to JIT install clients"  https://review.openstack.org/49971121:46
taskeryes - but couldn't all my hypervisors wait until after all of the control-plane is done?21:46
*** kylek3h_ has quit IRC21:48
openstackgerritMerged openstack/openstack-ansible master: [DOC} Add openSUSE to Software requirements  https://review.openstack.org/49973021:49
taskeroh i see.21:53
taskerdo the first infrastructure host, then _all_ of the hypervisors, and then the remaining infrastructure.21:54
taskerthere are better words to describe why, but I don't know them. but I'm beginning to grasp why I need to.21:55
*** galstrom is now known as galstrom_zzz22:04
*** gouthamr has quit IRC22:08
neithtasker: ask to OSA devs, I dont know more22:15
neithtasker: by the way you were right regarding xtrabackup22:15
*** cristicalin has quit IRC22:19
taskerneith: thanks! I'm glad that was able to get you going.22:20
neithtasker: I missed them the first time  cause mariadb is so  verbose22:21
*** vnogin has joined #openstack-ansible22:29
*** marc_ab has quit IRC22:31
*** vnogin has quit IRC22:34
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: For CentOS ensure lxc-net is started and enabled  https://review.openstack.org/49960922:36
*** thegreenhundred has quit IRC22:38
*** aludwar has joined #openstack-ansible22:38
cloudnulleenings22:45
cloudnull**evenings22:46
taskerhello22:49
taskerconceivably, couldn't I do the control-plane in any order?22:59
cloudnulltalking about host upgrades?23:00
taskeryeah23:00
cloudnulllike doing infra 3 first then 1 then 2 ?23:00
cloudnullif so, yes23:00
taskeryeah. ok.23:01
taskerso long as I do the _all_ of the hypervisors after the first one?23:01
cloudnullyou could do the first two23:01
cloudnullthen hypervisors23:01
cloudnullyou just need to leave 1 infra node up to support your old os23:02
taskerthat's what I thought you were going to say.23:02
cloudnullso you could fully re-kick the first two infra hosts (so long as they were not the ones holding your inventory)23:03
cloudnulland then upgrade hypervisors23:03
taskerand the host os of the deployment / staging host needs to be xenial in order for the containers to be built at xenial, right?23:04
cloudnullno the deployment host (where the playbooks are run) can be anything you want.23:04
cloudnullthe containers use whatever the underlying host os is where the dpeloyment is being run23:05
taskeroh!23:05
taskerthat's so simple!23:05
cloudnullso  you can run the playbooks from your mac.23:05
taskerno wonder it didn't make sense.23:05
cloudnullif infra1 = xenial, infra2 = cent7, infra3 = suse the various hosts would have containers to match their env23:06
taskernow it all makes sense. this is what I get for being a dev trying to do ops. I'm over analyzing the situation.23:07
cloudnulli t happens to the best of us :)23:08
*** vnogin has joined #openstack-ansible23:13
*** vnogin has quit IRC23:27
*** thorst_afk has quit IRC23:39
*** marc_ab has joined #openstack-ansible23:40
*** chyka has quit IRC23:42
DimGRHI23:46
DimGRWELCOME to DevOps tasker23:47
DimGR:P23:47
taskeram I going to need a new business card, now?23:49
*** marst has quit IRC23:57
*** weezS has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!