Thursday, 2017-08-17

*** thorst has joined #openstack-ansible00:01
*** thorst has quit IRC00:02
*** yifei has joined #openstack-ansible00:11
*** lucasxu has joined #openstack-ansible00:18
*** lucasxu has quit IRC00:19
*** TxGirlGeek has quit IRC00:31
cloudnullitsgottabered whats up?00:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: Update paste, policy and rootwrap configurations 2017-08-15  https://review.openstack.org/49379900:36
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use a dynamic group to deploy unbound  https://review.openstack.org/49373900:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Added an ALL is_metal scenario  https://review.openstack.org/44937200:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add breakout groups for hypervisor types  https://review.openstack.org/47472100:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097600:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update the playbook serial settings  https://review.openstack.org/49370800:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_tempest master: typo fix  https://review.openstack.org/49237500:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add support for OpenDaylight deployment in neutron  https://review.openstack.org/48013100:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add the ansible-ceph-defaults role  https://review.openstack.org/49047600:46
*** thorst has joined #openstack-ansible01:03
*** chyka has joined #openstack-ansible01:06
*** thorst has quit IRC01:08
*** craigs has quit IRC01:08
*** chyka has joined #openstack-ansible01:09
*** esberglu has joined #openstack-ansible01:20
*** chyka has quit IRC01:32
*** thorst has joined #openstack-ansible01:38
*** thorst has quit IRC01:39
*** jamesden_ is now known as jamesdenton01:41
*** thorst has joined #openstack-ansible01:42
*** esberglu has quit IRC01:52
*** schwicht has quit IRC02:16
*** thorst has quit IRC02:20
openstackgerritMerged openstack/openstack-ansible master: Use correct dnf.conf path for proxy  https://review.openstack.org/49308702:48
openstackgerritLogan V proposed openstack/openstack-ansible master: Add the ansible-ceph-defaults role  https://review.openstack.org/49047602:52
openstackgerritMerged openstack/openstack-ansible-os_tempest master: typo fix  https://review.openstack.org/49237503:00
*** thorst has joined #openstack-ansible03:20
*** gouthamr has quit IRC03:24
*** thorst has quit IRC03:25
*** gkadam has joined #openstack-ansible03:58
*** gkadam_ has joined #openstack-ansible04:01
*** gkadam has quit IRC04:03
*** poopcat has quit IRC04:03
*** larry1085 has quit IRC04:03
*** larry1085 has joined #openstack-ansible04:03
*** vishwana_ has quit IRC04:04
*** vishwanathj has joined #openstack-ansible04:04
*** gkadam_ is now known as gkadam04:04
*** germs2 has quit IRC04:11
*** udesale has joined #openstack-ansible04:15
*** thorst has joined #openstack-ansible04:22
*** hybridpollo has quit IRC04:25
*** thorst has quit IRC04:26
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Disable IPv6 where the lxb agent runs  https://review.openstack.org/49437204:32
*** jafeha has quit IRC04:42
*** openstack has quit IRC04:42
*** openstack has joined #openstack-ansible04:46
*** neillc has joined #openstack-ansible04:46
*** dgonzalez has joined #openstack-ansible04:47
*** EmilienM has joined #openstack-ansible04:47
*** seba has joined #openstack-ansible04:47
*** mattt1 has joined #openstack-ansible04:47
*** kevinbenton has joined #openstack-ansible04:47
*** hwoarang has joined #openstack-ansible04:48
*** hwoarang has quit IRC04:48
*** hwoarang has joined #openstack-ansible04:48
*** sc68cal has joined #openstack-ansible04:48
*** luzC has joined #openstack-ansible04:48
*** penguintamer has joined #openstack-ansible04:48
*** charz has joined #openstack-ansible04:48
*** clayton has joined #openstack-ansible04:49
*** csmart has joined #openstack-ansible04:49
*** ianw has joined #openstack-ansible04:49
*** zerick has joined #openstack-ansible04:49
*** jhesketh has joined #openstack-ansible04:49
*** hughsaunders has joined #openstack-ansible04:49
*** adreznec has joined #openstack-ansible04:49
*** Jeffrey4l has joined #openstack-ansible04:49
*** Tahvok has joined #openstack-ansible04:50
*** madorn has joined #openstack-ansible04:50
*** vishwanathj has joined #openstack-ansible04:50
*** prometheanfire has joined #openstack-ansible04:50
*** lkoranda has joined #openstack-ansible04:50
*** Bico_Fino has joined #openstack-ansible04:51
*** admin0 has joined #openstack-ansible04:52
*** aludwar has joined #openstack-ansible04:53
*** cinerama has joined #openstack-ansible04:54
prometheanfirehello to the survivors04:54
*** arbrandes has joined #openstack-ansible04:55
*** raginbajin has joined #openstack-ansible04:55
*** nwonknu has joined #openstack-ansible04:55
*** openstackgerrit has joined #openstack-ansible05:00
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49054805:00
prometheanfirealso, official congrats evrardjp05:01
*** szaher has joined #openstack-ansible05:04
*** markvoelker has quit IRC05:07
*** evrardjp[m] has joined #openstack-ansible05:19
*** thorst has joined #openstack-ansible05:22
hwoarangcongrats evrardjp05:23
*** chyka has joined #openstack-ansible05:24
*** thorst has quit IRC05:27
*** chyka has quit IRC05:28
*** udesale has joined #openstack-ansible05:34
*** tobberydberg has joined #openstack-ansible05:37
*** tobberydberg has quit IRC05:39
cloudnullprometheanfire: survivors ?05:39
cloudnullalso  congrats evrardjp!05:39
*** tobberydberg has joined #openstack-ansible05:39
*** udesale__ has joined #openstack-ansible05:43
*** udesale has quit IRC05:45
cloudnulladmin0: <cloudnbox2_nova_conductor_container-c06e86da> Task "DEBUG" has been omitted from the job because the conditional "[u'nova_virt_type is not defined']" was evaluated as "False"05:48
*** dmsimard|off has quit IRC05:48
cloudnullthats the issue you had with kvm the other day05:48
*** dmsimard has joined #openstack-ansible05:48
cloudnullit would seem that the virt detect does not work the way we think it should any longer.05:49
cloudnullhttp://paste.openstack.org/show/618627/05:49
*** dmsimard is now known as dmsimard|off05:49
cloudnullas soon as that fact is generally set the rest of the virt detect tasks skip05:50
cloudnullwhich results in only qemu being set05:50
cloudnullshould nova_virt_type be undefined from the beginning05:50
cloudnullhere's the debug output in virt detect http://paste.openstack.org/show/618628/05:51
*** tobberydberg has quit IRC05:51
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Correct nova virt type detection  https://review.openstack.org/49438105:58
cloudnulladmin0: ^ and there's the fix05:58
cloudnullthat's a big one issue and needs to go back to ocata.05:59
cloudnullIMHO06:00
*** brad[] has joined #openstack-ansible06:03
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Correct Ansible deprecation warning  https://review.openstack.org/49438406:04
*** markvoelker has joined #openstack-ansible06:08
prometheanfirecloudnull: 23:42 [Freenode] -!- You are banned from this server- Spam is off topic on freenode. Email kline@freenode.net if in error  (2017/8/17 04.42)06:13
prometheanfirecloudnull: freenode kicked a TON of people on accident06:14
cloudnulloh06:14
cloudnullhahha06:14
*** Guest88062 is now known as ioni06:14
*** ioni has joined #openstack-ansible06:15
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Add always tag where it's needed  https://review.openstack.org/49438606:15
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update the playbook serial settings  https://review.openstack.org/49370806:17
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Modify LXC container create to JIT create  https://review.openstack.org/49097606:17
*** mardim has joined #openstack-ansible06:17
*** tobberydberg has joined #openstack-ansible06:21
*** tobberydberg has quit IRC06:21
*** tobberydberg has joined #openstack-ansible06:22
*** ianychoi has quit IRC06:23
*** thorst has joined #openstack-ansible06:23
*** ianychoi has joined #openstack-ansible06:26
*** thorst has quit IRC06:28
*** mbuil has joined #openstack-ansible06:31
*** drifterza has joined #openstack-ansible06:39
*** andries has joined #openstack-ansible06:40
*** udesale has joined #openstack-ansible06:40
*** udesale__ has quit IRC06:42
*** markvoelker has quit IRC06:42
*** pcaruana has joined #openstack-ansible06:42
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Update paste, policy and rootwrap configurations 2017-08-15  https://review.openstack.org/49379906:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Test containerised cinder-volume  https://review.openstack.org/48354106:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Add subunit output to ARA reporting  https://review.openstack.org/49148906:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Revert "Reduce container counts for cinder, ironic and trove"  https://review.openstack.org/47182206:48
* hwoarang prays for mirrors to start working properly06:54
*** jvidal has joined #openstack-ansible06:55
*** Jeffrey4l has quit IRC06:56
*** Jeffrey4l has joined #openstack-ansible06:57
*** hw_wutianwei has joined #openstack-ansible06:58
*** shardy has joined #openstack-ansible07:03
*** markus_z has joined #openstack-ansible07:04
*** Dinesh_Bhor has quit IRC07:11
evrardjpgood morning everyone!07:16
*** tobberydberg has quit IRC07:16
*** jbadiapa_ has joined #openstack-ansible07:17
*** Dinesh_Bhor has joined #openstack-ansible07:18
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: tasks: neutron_install: Fix virtualenv-tools issue on openSUSE  https://review.openstack.org/49440807:20
evrardjpIt's bug squash day.07:23
evrardjpFor bug squash records, could you simply write on this page: https://etherpad.openstack.org/p/osa-bugsquash-pike the one you're tackling? Keep in mind you have to do the usual business in your patches, it's just for a easier counting afterwards...07:24
*** thorst has joined #openstack-ansible07:24
*** gkadam has joined #openstack-ansible07:26
*** thorst has quit IRC07:29
*** lbragstad has quit IRC07:33
*** lbragstad_ has joined #openstack-ansible07:33
*** armaan has joined #openstack-ansible07:34
*** shardy is now known as shardy_afk07:34
*** mrch has joined #openstack-ansible07:39
*** markvoelker has joined #openstack-ansible07:40
*** sxc731 has joined #openstack-ansible07:42
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create master: Ensure that sysctl can be applied on containers  https://review.openstack.org/49441907:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create master: Ensure that sysctl can be applied on containers  https://review.openstack.org/49441907:48
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create master: [WIP] Ensure that sysctl can be applied on containers  https://review.openstack.org/49441907:49
openstackgerritManuel Buil proposed openstack/openstack-ansible master: Add tacker installation  https://review.openstack.org/48525907:52
*** markus_z has quit IRC07:53
*** mpranjic has joined #openstack-ansible08:00
odyssey4me_o/ evrardjp08:02
odyssey4me_andymccr with rc1's roles pinned, are we going to branch immediately? I ask because now we're getting master tested without the new changes in roles08:03
odyssey4me_I suppose there's a trade-off between branching now and doing a bunch of backporting in the next few weeks... or holding off branching and having to deal with fallout later.08:03
odyssey4me_That said, upstream has branched, mostly, so perhaps we should so that we have the right things testing the right things instead of roles testing master and we're trying to solidify pike..08:04
evrardjpprobably best to branch? We are used to backport anyway rn :)08:05
evrardjpodyssey4me_: could you check my comments here and give me your opinion, please? https://review.openstack.org/#/c/493708/808:06
*** tobberydberg__ has joined #openstack-ansible08:09
*** HarryHuang has joined #openstack-ansible08:09
*** markus_z has joined #openstack-ansible08:09
*** yifei has joined #openstack-ansible08:09
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create master: [WIP] Ensure that sysctl can be applied on containers  https://review.openstack.org/49441908:10
armaanodyssey4me_: I fixed that upgrade error last night by creating a /etc/openstack_deploy.NEWTON directory manually.08:11
*** tobberydberg__ has quit IRC08:12
*** markvoelker has quit IRC08:12
armaanodyssey4me_: I have a question about this commit of yours, https://github.com/openstack/openstack-ansible-repo_build/commit/f1c900663aae0ea40508282f52ac02667e10f5a208:12
armaanodyssey4me_: Could this commit fix this error http://paste.openstack.org/show/618639/?08:13
odyssey4me_armaan that's what it was done to protect against, yes08:15
armaanodyssey4me_: awesome, thanks08:15
armaan:)08:15
*** odyssey4me_ is now known as odyssey4me08:15
odyssey4meevrardjp check the comment history08:16
*** pbandark has joined #openstack-ansible08:17
*** openstackgerrit has quit IRC08:17
*** pbandark has quit IRC08:18
*** shardy_afk is now known as shardy08:20
*** thorst has joined #openstack-ansible08:25
*** gokhan has quit IRC08:28
*** jrosser_ has joined #openstack-ansible08:28
*** markus_z has quit IRC08:28
odyssey4meevrardjp reviewed08:29
*** thorst has quit IRC08:30
*** openstackgerrit has joined #openstack-ansible08:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: AIO: Use common pip cache for host & containers  https://review.openstack.org/49212708:30
*** jrosser_ is now known as jrosser08:30
*** gokhan has joined #openstack-ansible08:30
*** jrosser has quit IRC08:31
*** armaan_ has joined #openstack-ansible08:35
*** dave_ has joined #openstack-ansible08:36
dave_Hello08:36
evrardjpthanks odyssey4me08:36
*** logan- has quit IRC08:37
dave_Want to bring up a openstack environment, using an existing already deployed/managed ceph cluster as the storage though is it just a case of defining ceph_mons in user_variables and a few other things?08:39
*** armaan has quit IRC08:39
*** d9k has quit IRC08:40
*** d9k has joined #openstack-ansible08:41
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-rsyslog_client master: [WIP] Test postrotate works  https://review.openstack.org/49443808:41
*** pbandark has joined #openstack-ansible08:43
*** markus_z has joined #openstack-ansible08:44
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create master: [WIP] Ensure that sysctl can be applied on containers  https://review.openstack.org/49441908:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift stable/ocata: Updated from OpenStack Ansible Tests  https://review.openstack.org/49444408:50
openstackgerritMerged openstack/openstack-ansible-os_nova master: Correct nova virt type detection  https://review.openstack.org/49438108:50
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift stable/ocata: Fix ordering of swift3 in middleware pipeline  https://review.openstack.org/48999608:50
*** sxc731 has quit IRC08:53
*** armaan has joined #openstack-ansible08:54
*** armaan_ has quit IRC08:56
*** pbandark has quit IRC09:01
*** pbandark has joined #openstack-ansible09:03
*** fxpester has joined #openstack-ansible09:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Test containerised cinder-volume  https://review.openstack.org/48354109:08
*** markvoelker has joined #openstack-ansible09:10
*** sxc731 has joined #openstack-ansible09:10
openstackgerritPraveen N proposed openstack/openstack-ansible master: trivialfix  https://review.openstack.org/49445009:15
*** chyka has joined #openstack-ansible09:15
odyssey4medave_ yes, pretty much09:17
*** chyka has quit IRC09:20
openstackgerritPraveen N proposed openstack/openstack-ansible master: trivialfix  https://review.openstack.org/49445009:22
dave_odyssey4me: thanks, will have a crack09:23
*** thorst has joined #openstack-ansible09:26
dave_hmmm bummer, {"failed": true, "msg": "'ceph_mon_host' is undefined"}09:28
openstackgerritMerged openstack/openstack-ansible-os_nova master: Correct Ansible deprecation warning  https://review.openstack.org/49438409:28
dave_oh i see09:29
odyssey4medave_ there are a bunch of references to config that needs to be done in https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/user_variables.yml09:29
dave_found a bug09:29
dave_[ceph_client : Set ceph_mon_host to an online monitor host] should really be the one to bomb out when no monitor hosts are selected09:30
dave_i say "bug"09:30
dave_just makes it easier to see wtf is wrong09:30
*** thorst has quit IRC09:30
odyssey4memaybe, not sure - I've not used the ceph functionality myself09:30
odyssey4meregister a bug if you think there is one09:30
dave_now just need to work out my networking and why my glance container can't reach any monitor host09:32
*** gkadam is now known as gkadam-afk09:32
*** jrosser has joined #openstack-ansible09:32
*** yifei has quit IRC09:33
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/ocata: Correct Ansible deprecation warning  https://review.openstack.org/49445709:34
*** markvoelker has quit IRC09:43
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49054309:50
openstackgerritJuan Vidal Allende proposed openstack/openstack-ansible-os_neutron master: Add option to deploy OpenDaylight SDN Controller  https://review.openstack.org/48012809:52
armaanfolks, is there any way at all to disable the inventory generator? In other words, is there any way that OSA can use external address assignment, as from a DHCP/DNS server?09:52
*** electrofelix has joined #openstack-ansible09:53
evrardjparmaan: if not, we should probably make the static IP optional.09:54
evrardjparmaan: have you looked at the role for that?09:54
evrardjp(also, what's your use case?)09:54
armaanevrardjp: not yet, I want MAAS DHCP/DNS server to handle ip address assignment.09:55
armaanevrardjp: I have another question. Is it fair to assume we *must always* have separate `container` and `tunnel` networks, i.e. there is absolutely no way that those can be the same?09:56
armaanevrardjp: I mean, is something in the playbooks that enforces that `container` and `tunnel` *must* map to two separate bridges?09:56
evrardjpI guess you could theoretically change a lot of things to make it work. But the question is why?09:56
evrardjpwell IP assignment is one09:57
admin0armaan, i use MaaS with OSA as well, but MAAS just assigns dhcp ips for mgmt ..09:57
admin0the rest is done manually09:57
admin0which makes more sense09:57
evrardjpadmin0: I suppose you mean hosts mgmt09:57
admin0yes09:57
admin0the non bridges IP09:57
evrardjparmaan: you could technically try that, but there will be variables you'll need to override. And you are probably setting yourself in a different unknown path, for a reason I have yet to understand :)09:59
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-rsyslog_client master: [WIP] Test postrotate works  https://review.openstack.org/49443810:01
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests master: [DNM] Run neutron in parallel  https://review.openstack.org/49446110:02
evrardjphaha logrotate is busted and we never saw it coming \o/10:03
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_neutron master: Update paste, policy and rootwrap configurations 2017-08-15  https://review.openstack.org/49380110:03
*** h1nch has quit IRC10:11
*** h1nch has joined #openstack-ansible10:12
armaanevrardjp: I asked because i have a production environment which is using the same network for management and data --not deployed using OSA btw.10:13
evrardjpoh brownfield10:13
evrardjpinteresting10:13
armaanevrardjp: I am moving it under OSA management and then upgrading it from mitaka to newton.10:13
evrardjpwhy would you want to mix traffic ? It's dangerous10:14
armaanI did not deploy that environment.10:14
armaan:)10:14
evrardjp:)10:14
*** dgonzalez has quit IRC10:14
evrardjpI'd keep the existing network for tunnel network, and use a new network for container mgmt10:14
evrardjpthis way you set yourself up for better practices10:15
evrardjpyou'd have to ensure that we don't mess up with your existing network for tunnel network, which won't be easy, depending on the size of the net you have available.10:15
armaanevrardjp: btw i have found 3 bugs so far while trying to upgrade mitaka to newton. I am using this doc https://docs.openstack.org/openstack-ansible/newton/upgrade-guide/manual-upgrade.html10:15
evrardjpoh10:15
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: tasks: neutron_install: Fix virtualenv-tools issue on openSUSE  https://review.openstack.org/49440810:16
evrardjpgo ahead, file them :)10:16
evrardjptoday is bug squash day.10:16
armaanevrardjp: that sounds like a good advice, thanks!10:16
*** dgonzalez has joined #openstack-ansible10:16
armaanevrardjp: cool, i will. :)10:17
*** udesale has quit IRC10:18
evrardjparmaan: you are heading for a bad experience, and a different path than many others. Just for you to know.10:18
evrardjpI'd be more enclined myself to kill what I have and migrate to fresh, but that's because I am lazy :p10:19
armaanevrardjp: i am used to that. Infact -- that is my job10:19
evrardjphaha.10:19
openstackgerritPraveen N proposed openstack/openstack-ansible master: trivialfix  https://review.openstack.org/49445010:19
armaanevrardjp: last week i migrated gre,vlan networks from openvswitch to vxlan,vlan with linuxbridge :P10:20
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Allow Keepalived to red haproxy pid file  https://review.openstack.org/49446810:21
evrardjparmaan: what's your experience? (I guess I should ask which version of kernel you are running)10:21
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Allow Keepalived to read haproxy pid file  https://review.openstack.org/49446810:22
armaanevrardjp: haha, more than 4.5 years in fixing openstack environments.10:25
*** thorst has joined #openstack-ansible10:27
*** stuartgr has joined #openstack-ansible10:28
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create master: [WIP] Ensure that sysctl can be applied on containers  https://review.openstack.org/49441910:30
*** thorst has quit IRC10:31
*** markvoelker has joined #openstack-ansible10:40
*** mmm_cn has joined #openstack-ansible10:48
mmm_cnI have an issue with package installation in my galera container. Task: "pip_install : Install pip packages".  The request goes to the repo containers, but the data it requests does not exist there. (404 error). I'm trying to figure out why the repo containers data are not being properly set. Can anyone point me to what role/tasks that sets up the repo containers?10:51
mmm_cnThe file it fails on is: http://<myhostnamehere>:8181/os-releases/14.2.8/ubuntu-16.04-x86_64/requirements_absolute_requirements.txt10:51
mmm_cnIn the repo containers there the os-releases/14.2.8 folders exist, but has no subfolder or data.10:52
evrardjpmmm_cn: how many repo do you have, and are you sure they are well synced?10:54
evrardjprestarting lsyncd on the master node should force a resync.10:54
*** markus_z has quit IRC10:58
mmm_cnevrardjp: I have 3 repo containers. This is a new installation that stops during installation with the galera package failure mentioned above. None of the 3 repo containers have any data in `/var/www/repo/os-releases/14.2.8/`11:00
*** schwicht has joined #openstack-ansible11:00
*** shardy is now known as shardy_lunch11:01
mmm_cnCan't see any prior errors during the ansible run that would explain why there is no data being set. That is why I wondered if anyone could point me to the role/task where that data is supposed to be fetched to the repo containers.11:01
admin0mmm_cn, after setup-hosts, run haprox-install.yml playbook .. most of the time this step fails due to dns/proxy url issues11:02
admin0or urn haproxy-install , then return it again .11:02
mmm_cnHaproxy installation looks to be correct, the haproxy responds and sends request to the repo containers, but the repo containers respond with 404 since the data is not there.11:04
evrardjpmmm_cn: you can check if your haproxy is correct indeed, but here I think it's a repo build that wasn't properly build.11:04
evrardjpmmm_cn: could you re-run the repo build?11:04
mmm_cnevrardjp: Sure I will try it. Running repo-build.yml now.11:05
openstackgerritMerged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49054811:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: tasks: swift_install: Fix virtualenv-tools issue on openSUSE  https://review.openstack.org/49374711:09
*** sxc731 has quit IRC11:10
*** markus_z has joined #openstack-ansible11:13
*** markvoelker has quit IRC11:13
armaanodyssey4me evrardjp: Filed three bugs concerning mitaka->newton upgrade process. [1] https://bugs.launchpad.net/openstack-ansible/+bug/171134011:13
openstackLaunchpad bug 1711340 in openstack-ansible "wheel build fails during upgrade" [Undecided,New]11:14
armaan[2] https://bugs.launchpad.net/openstack-ansible/+bug/171133511:14
openstackLaunchpad bug 1711335 in openstack-ansible "Playbook fails to create required directory" [Undecided,New]11:14
armaan[3] https://bugs.launchpad.net/openstack-ansible/+bug/171134111:14
openstackLaunchpad bug 1711341 in openstack-ansible "Client Error: Not Found for url" [Undecided,New]11:14
*** eoseq has joined #openstack-ansible11:14
mmm_cnevrardjp: I do see repo containers being populated with data that was previously missing. The run has not yet finished but it appears to at least improve since earlier I had nothing in there. A bit weird since the setup-infrastructure.yml should have included and run this before the error that I got. I must have missed some output or something in the prior run. Thanks a lot for pointing me in the right direction.11:15
evrardjpmmm_cn: no worries!11:15
evrardjpthanks armaan11:15
evrardjpodyssey4me: have you seen this one? https://bugs.launchpad.net/openstack-ansible/+bug/1711340 I think you had this as backport, right?11:16
openstackLaunchpad bug 1711340 in openstack-ansible "wheel build fails during upgrade" [Undecided,New]11:16
odyssey4meevrardjp looking11:17
evrardjparmaan: valuable input there.11:17
armaanevrardjp: :)11:17
mbuilgates are finally working :). If somebody has a bit of time, it would be great if you could review my patch --> https://review.openstack.org/#/c/485259/11:18
odyssey4meevrardjp armaan it's already ported back and will be in the next newton release: https://review.openstack.org/#/q/I605280fb3ccd0f12b32bb572b064b9b04109934b11:18
evrardjparmaan: I have the impression you have the same issue with the repo build that didn't finish to populate11:18
armaanevrardjp: i think so, yes.11:18
evrardjpodyssey4me: yeah that's what I thought too11:18
jamesdentonHey evrardjp - Have you seen any issues with config or init file overrides resulting in the following error? :: http://paste.openstack.org/show/618662/11:19
evrardjparmaan: what version of N are you running?11:19
armaani guess same as what mmm_cn is seeing11:19
armaanevrardjp: I am upgrading miataka to 14.2.711:19
evrardjpjamesdenton: yes, since the plugin change of prometheanfire :p11:19
jamesdentonlovely :P11:19
evrardjpjamesdenton: I think that there is work to revert it11:20
evrardjpwhich branch?11:20
jamesdentonmaster11:20
evrardjpmmm11:20
evrardjpwe definitely need more tests there.11:20
evrardjpcould you file a bug, this way I will tackle it?11:20
jamesdentonsure thing11:20
jamesdentonbug day!11:21
*** markvoelker has joined #openstack-ansible11:21
evrardjpyeah :)11:21
odyssey4mejamesdenton evrardjp that's been reverted11:21
evrardjpanyone can fix them too :)11:21
odyssey4meand prometheanfire's issue was newton only11:21
jamesdentonodyssey4me oh? Like in the last 24 hrs or so?11:21
evrardjpyeah but it seems that we have the other way around odyssey4me11:21
odyssey4meif there's an issue for master/ocata then that's new11:21
openstackgerritMerged openstack/openstack-ansible-os_cinder master: tasks: cinder_install: Fix virtualenv-tools issue on openSUSE  https://review.openstack.org/49357811:21
evrardjpyeah, now it's str instead of bin, vs the other way around IIRC11:22
odyssey4meevrardjp see https://github.com/openstack/openstack-ansible-plugins/commits/stable/newton11:22
odyssey4methere are unfortunately still no tests to validate/verify the issues noticed11:22
armaanodyssey4me: roger, thanks!11:23
evrardjpodyssey4me: yes that's why a bug need to be filled, and we can have a test case, and all that jazz :)11:23
odyssey4meevrardjp that's why there is a bug already ;)11:23
odyssey4meprometheanfire is meant to have been doing that, it's assigned to him11:23
odyssey4mebut jamesdenton are you seeing this on newton or later?11:24
evrardjpmaster11:24
jamesdentonright, master11:24
evrardjpso it's probably something else11:24
evrardjpbut same kind of scope11:24
odyssey4meah, in that case we need a new bug11:24
evrardjpIf it's a duplicate I will mark it, but we need proper investigation11:24
evrardjpyup11:24
*** schwicht has quit IRC11:25
evrardjpodyssey4me: did you see issues recently with lxc_hosts : Ensure image has been pre-staged11:25
odyssey4meevrardjp nope, not me11:25
jamesdentonworking on the bug now11:25
*** schwicht has joined #openstack-ansible11:26
*** yifei has joined #openstack-ansible11:27
*** thorst has joined #openstack-ansible11:27
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_container_create master: Ensure that sysctl can be applied on containers  https://review.openstack.org/49441911:27
jamesdentonevrardjp odyssey4me https://bugs.launchpad.net/openstack-ansible/+bug/171134711:29
openstackLaunchpad bug 1711347 in openstack-ansible "Config file override mechanism broken" [Undecided,New]11:29
odyssey4meanother new bug: https://bugs.launchpad.net/openstack-ansible/+bug/171134911:31
openstackLaunchpad bug 1711349 in openstack-ansible "CentOS/Pike - resolvconf - No file was found when using with_first_found." [Undecided,New]11:31
*** yifei has quit IRC11:31
*** cshen has joined #openstack-ansible11:32
jamesdentonIsn't that related to https://review.openstack.org/49373911:32
*** thorst has quit IRC11:32
TahvokHey guys!11:32
TahvokCould someone tell me what I'm missing to get this to return 'true'? {% if neutron_services['neutron-server']['group'] in group_names %}11:32
*** yifei has joined #openstack-ansible11:32
TahvokIt's part of 'neutron.conf': https://github.com/openstack/openstack-ansible-os_neutron/blob/master/templates/neutron.conf.j211:32
TahvokAll I want is to enable 'allow_overlapping_ips'11:33
jamesdentonTahvok Are you setting the override in user_variables.yml? Or how are you trying to enable that?11:35
Tahvokjamesdenton: that's my quesion, how do I enable it?11:35
jamesdentonIt's enabled by default in the template, and only gets applied to the neutron-server container's copy of neutron.conf11:36
*** brad[] has quit IRC11:36
TahvokWell, it does not work in my case. I'm looking in the neutron.conf inside the container, and non of this settings are there11:37
jamesdentonDid you get an error during the run of the playbook?11:37
*** brad[] has joined #openstack-ansible11:38
TahvokOk, sorry about that, I've realized that I've been looking into the 'agent' container, and not the server11:39
TahvokEverything is ok now11:40
jamesdentonok cool11:40
TahvokI'm just having trouble setting up openvswitch, so I'm looking into all the configs, making sure I haven't missed anything11:40
TahvokThe problem is, that as soon as I add br-vxlan bridge to br-provider ovs bridge on the compute hosts - you can't reach the compute hosts, and they can't reach you over the vxlan's vlan id11:41
jamesdentonI don't think there's any need to connect those bridges11:42
TahvokNow the thing is, that everything worked when I was setting up the environment manually (ubuntu install) - before I moved to ansible11:42
Tahvokjamesdenton: how come? The tunnel won't work without it11:43
TahvokThat's the guide I worked with before ansible (the one that worked fine): https://docs.openstack.org/ocata/networking-guide/deploy-ovs-selfservice.html11:44
jamesdentonbr-tun and br-int are connected11:44
TahvokSo I'm trying to make the same thing with user_variables, and manually setting up bridges11:44
jamesdentonbr-int is also connected to the provider bridge11:44
jamesdentonnow, br-tun may need to be connected to br-vxlan, but i don't recall exactly11:44
*** thorst has joined #openstack-ansible11:45
dave_woop managed to get it working it looks like11:46
dave_odyssey4me: thanks for the help!11:46
odyssey4medave_ excellent - happy to hear so :)11:46
hwoaranghas anyone seen an AIO failures similar to this: fatal: [aio1]: FAILED! => {"failed": true, "msg": "Timeout (7s) waiting for privilege escalation prompt: "}11:49
hwoarangi've seen that in TASK [os_nova : Get UUID of new Nova Cell] and TASK [os_nova : Perform a cell_v2 discover]11:49
odyssey4mehwoarang I think palendae might have mentioned it at some point.11:49
odyssey4menot on that task, on another one11:50
hwoaranghmm11:50
hwoarangadding timeout = 30s didn't seem to help much11:55
*** shardy_lunch is now known as shardy11:57
*** sxc731 has joined #openstack-ansible11:57
*** sauloaislan has joined #openstack-ansible12:02
sauloaislanMorning!!12:03
*** yifei has quit IRC12:03
*** markus_z has quit IRC12:07
armaanodyssey4me evrardjp: could you please suggest a workaround for this one? https://bugs.launchpad.net/openstack-ansible/+bug/171134112:10
openstackLaunchpad bug 1711341 in openstack-ansible "Client Error: Not Found for url" [Undecided,New]12:10
evrardjparmaan: re-running the repo-build?12:14
armaanevrardjp: I did re-run repo-install.yml which also executes the repo-build playbook but still same issue.12:16
armaanevrardjp: Do i need to clear facts as well?12:16
odyssey4mearmaan if you curl http://172.29.236.10:8181/os-releases/14.2.7/ubuntu-14.04-x86_64/requirements_absolute_requirements.txt does it return a positive result?12:19
odyssey4meif you do it several times, does it always work?12:19
evrardjpreplace 10 by 10012:19
evrardjpprobably12:19
odyssey4meevrardjp ?12:20
*** markus_z has joined #openstack-ansible12:21
evrardjpisn't it  http://172.29.236.100:8181 by default instead of  http://172.29.236.10:8181 ?12:21
evrardjpmorning sauloaislan12:21
odyssey4meevrardjp the IP would depend on the environment setup - specifically the internal vip used on the LB12:21
odyssey4meif it's an AIO, then yes - .100 is right12:22
evrardjpI 100% agree :p12:22
armaanodyssey4me evrardjp: http://paste.openstack.org/show/618669/12:22
*** woodard has quit IRC12:22
evrardjpthat is weird12:22
odyssey4menot weird at all12:23
odyssey4methat means that the repo build has not run properly12:23
*** woodard has joined #openstack-ansible12:23
evrardjphe said it just ran properly12:23
odyssey4meapparently not, because there's not resulting data12:23
odyssey4mearmaan hmm, the path you're deploying from is likely an issue12:24
odyssey4mehang on a sec12:24
odyssey4mehttps://github.com/openstack/openstack-ansible/blob/14.2.7/playbooks/repo-build.yml#L13212:25
odyssey4meok, so it has that stuff, so it should be ok - but I see a few things12:25
odyssey4me1. your path is not standard, and there are things that rely on you operating from /opt/openstack-ansible12:25
odyssey4me2. oh, I though you might not be running as root12:25
odyssey4mearmaan can you output the results of running the repo-build playbook?12:26
openstackgerritAndy McCrae proposed openstack/openstack-ansible master: Update existing container_networks  https://review.openstack.org/49451512:27
evrardjpfor those working at squashing bugs today, please enter the competition here:12:27
evrardjphttps://etherpad.openstack.org/p/osa-bugsquash-pike12:27
evrardjpput your bug and your name. For the bounties.12:28
armaanodyssey4me: sure, give me few mins.12:29
armaanodyssey4me: http://paste.openstack.org/show/618671/12:32
sauloaislanevrardjp andymccr odyssey4me: I'm still having Swift ring problem, can anyone help me? Excuse the insistence. http://paste.openstack.org/show/618550/  http://paste.openstack.org/show/618551/12:34
*** mgariepy has joined #openstack-ansible12:34
openstackgerritMerged openstack/openstack-ansible master: Improve proxy vars in user_variables.yml  https://review.openstack.org/49179112:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Improve proxy vars in user_variables.yml  https://review.openstack.org/49452212:35
*** firebat has joined #openstack-ansible12:36
*** chyka has joined #openstack-ansible12:36
firebatHey guys I worked on this late last night, and can't get past it. During setup-hosts on my infra node this keeps happening: 22940463_eth10 is already a member of a bridge; can't enslave it to bridge br-vxlan12:36
firebatI can't figure out how to fix it. Worked on my configs, cleaned things up, double checked everything. Even removed the veth pair I manually made on that link out of desperation12:37
*** chyka has quit IRC12:41
mhaydenhappy thursday12:42
mgariepygood morning everyone12:42
openstackgerritMarc Gariépy (mgariepy) proposed openstack/ansible-hardening stable/ocata: Change default prohibit root sshd password auth  https://review.openstack.org/49452312:43
openstackgerritMarc Gariépy (mgariepy) proposed openstack/ansible-hardening stable/newton: Change default prohibit root sshd password auth  https://review.openstack.org/49452412:43
*** hw_wutianwei has quit IRC12:44
*** yifei has joined #openstack-ansible12:45
*** heroux has joined #openstack-ansible12:46
eoseqhi12:51
eoseqwhat am I doing wrong? I want to recreate containers which I've already deleted and I get: http://paste.openstack.org/show/618675/12:52
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ops master: Prevent Ceph containers delete in leapfrog  https://review.openstack.org/49452812:53
evrardjphey mhayden12:53
mhaydenOY12:53
mhaydenoh wait isn't this bug smash day?12:54
evrardjpsauloaislan: I have no expertise in swift rings12:54
evrardjpyes.12:54
evrardjp:D12:54
evrardjpmhayden: https://etherpad.openstack.org/p/osa-bugsquash-pike12:54
mhaydenif you like it then you gotta put a ring on it12:54
mhaydenthat's what andymccr taught me about swift12:54
evrardjphaha. Such a good taylor.12:54
evrardjpBecause my taylor is rich, so he can offer rings.12:55
evrardjpmhayden: the more hardest bugs you smash, the more points you win, the more likely you'd win the bug squash!12:56
mhaydenevrardjp: your selinux patch makes my eyes leak12:56
mhaydenso proud12:56
evrardjp?12:56
evrardjphaha.12:56
evrardjphwoarang: are you there?12:57
hwoarangevrardjp: yep12:57
evrardjpfor your remark on https://review.openstack.org/#/c/494419/ , are you sure this works inside containers?12:58
evrardjpif it works under containers, I should make this optional per distro.12:58
sauloaislanevrardjp mhayden: ok thanks, I'll waiting andymccr12:58
andymccrsauloaislan: im really not sure what is going on there, the key sync is not running against your aio host so the rsync fails12:59
hwoarangevrardjp: not i am not sure if it works there...12:59
andymccrsauloaislan: is this just cloned from master/stable branch, and is it just run with no changes as an AIO?12:59
armaanevrardjp: say i want to install neutron agents and server on physical machines and this config in env.d/neutron should be enough? http://paste.openstack.org/show/618677/12:59
evrardjphwoarang: that's the problem we had for centos/ubuntu. It's pretty much lxc dependant, so I think you're gonna have the same issue. But worth trying without it.13:00
evrardjparmaan: it should be more than necessary13:00
hwoarangi'm ok with using it everywhere i just thought to point that out since i remembered there was a systemd service for sysctl13:00
evrardjpcontainer_skel: neutron_agents_container: properties: is_metal: true, same for neutron_server_container.13:01
sauloaislanandymccr: Yes, master and no changes13:01
andymccrsauloaislan: and thats on initial deploy?13:01
evrardjphwoarang: let's keep it as is, if it's fixed somewhere in the future we could skip it.13:02
evrardjparmaan: see above.13:02
sauloaislanandymccr: Yes13:02
evrardjparmaan: also, "1 Comment Collapse" should definitely not be in your file, so I assume copy pasting issue :D13:02
*** schwicht has quit IRC13:02
sauloaislanandymccr: I've had this error before and resolved with this patch. https://github.com/openstack/openstack-ansible-os_swift/commit/176452bebf7e1ceabd2cf72a89c558c0fc7f142013:03
armaanevrardjp: hah! thanks :)13:04
*** vishwanathj has quit IRC13:05
*** vishwanathj has joined #openstack-ansible13:06
*** esberglu has joined #openstack-ansible13:07
andymccrsauloaislan: can you paste your os-swift-install.yml playbook?13:08
*** SerenaFeng has joined #openstack-ansible13:09
evrardjparmaan: it doesn't hurt to fully define it though.13:09
evrardjparmaan: also we used to need a fully definition depending on your branch, so you may mark this in your file, start with large file, with TODO(Ocata): Remove all this to keep only the necessary.13:10
firebatCan I delete openstack_inventory.json if I'm redeploying?13:10
*** SerenaFeng has quit IRC13:10
evrardjpfirebat: your host would still have everything on them13:10
sauloaislanandymccr: No now, but later13:10
andymccrsauloaislan: ok13:11
evrardjpfirebat: if you are redeploying including the host nodes, yeah, you could.13:11
*** lucasxu has joined #openstack-ansible13:11
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-rsyslog_client master: [WIP] Test postrotate works  https://review.openstack.org/49443813:11
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Compile SELinux module via async  https://review.openstack.org/49431613:12
firebatI was posting earlier somehow my deploy things eth10 exists, and is already paired to a bridge when it's not. Also in /etc/openstack_deploy my openstack_user_config.yml seems to be getting changed... that's where I'm supposed to store my config through right?13:12
armaanevrardjp: roger that!13:12
*** arbrandes1 has joined #openstack-ansible13:13
*** pwiltsey has joined #openstack-ansible13:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: [WIP] Try the single esl-erlang package  https://review.openstack.org/49432413:15
evrardjpfirebat: if your openstack_user_config changes, you should probably ask your colleagues why they are toying with you :p13:15
*** udesale has joined #openstack-ansible13:16
evrardjpfirebat: or check that you aren't using aio that generates all of that.13:16
*** arbrandes has quit IRC13:16
armaanevrardjp odyssey4me: repo-build.yml playbook run http://paste.openstack.org/show/618671/ ? Do you want me get more output?13:16
firebatevrardjp: Oh snap how would I know if I'm using AIO? I'm just running openstack-ansible setup-* playbooks13:17
evrardjpis good.13:17
evrardjpfirebat:13:17
evrardjpif you are using bootstrap-aio.sh script that would be bad for your configs.13:17
odyssey4mearmaan I need it from beginning to end please13:17
firebatAhh ok cool deal13:17
*** pwiltsey has quit IRC13:17
firebatodyssey4me: Got a second to take a look at a pastebin for me, and explain to me how and why I am stupid?13:18
evrardjpfirebat: we don't edit the openstack_user_config. That's user level stuff.13:18
armaanodyssey4me: roger that13:18
mhaydenso the python 2.7 perf problem in xenial got a response yesterday evening -> https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/1638695/comments/2113:18
openstackLaunchpad bug 1638695 in python2.7 (Ubuntu) "Python 2.7.12 performance regression" [High,Confirmed]13:18
firebatevrardjp: Oh my I may have messed this up bad then... I was following the deployment guide... when you say user level stuff are you referring to me int hat sense?13:19
firebatWhat files should I be touching to modify the deployment to fit my needs, tell the deploy which nodes do which, etc.?13:19
evrardjpyeah, there is no automatic change of that file in our setup-* playbooks13:19
evrardjpfirebat: /etc/openstack_deploy/ ==> openstack_user_config / conf.d / env.d / user variables / user secrets are definitely your "userspace"13:20
evrardjpfollowing the deployment guide should be enough13:21
firebatOk cool deal yeah I'm not off base like I thought then13:21
firebatIs there any way that the openstack_inventory.json could be messing up lxc veth pair creation?13:22
*** sxc731 has quit IRC13:22
evrardjpfirebat: I am not sure what the issue is13:23
firebatYeah sorry I'll paste it when it comes up doing another deploy13:23
sauloaislanandymccr: http://paste.openstack.org/show/618550/ and http://paste.openstack.org/show/618551/13:23
evrardjpmhayden: good, it goes forward. Too bad we are close to have 18.04 now... :p13:25
*** yifei has quit IRC13:27
*** yifei has joined #openstack-ansible13:27
odyssey4memhayden so there is now an assessment of the problem, what happens next?13:29
*** sxc731 has joined #openstack-ansible13:31
firebatHmm the error is gone after deleting openstack_inventory.json13:33
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Compile SELinux module via async  https://review.openstack.org/49431613:35
firebatI'm both happy and entirely confused13:35
*** drifterza has quit IRC13:36
*** sxc731 has quit IRC13:39
openstackgerritStuart Grace proposed openstack/openstack-ansible-ops master: Pass deployment_environment_variables to OSA  https://review.openstack.org/49187513:40
openstackgerritJuan Vidal Allende proposed openstack/openstack-ansible-os_neutron master: Add option to deploy OpenDaylight SDN Controller  https://review.openstack.org/48012813:41
*** lbragstad_ is now known as lbragstad13:42
andymccrsauloaislan: no i mean like "cat os-swift-install.yml" and just that output :)13:43
openstackgerritMerged openstack/openstack-ansible master: Add subunit output to ARA reporting  https://review.openstack.org/49148913:44
openstackgerritMerged openstack/openstack-ansible-os_swift master: tasks: swift_install: Fix virtualenv-tools issue on openSUSE  https://review.openstack.org/49374713:45
*** yifei has quit IRC13:45
evrardjpwoot odyssey4me13:45
evrardjpsubunit output to ARA merged!13:45
evrardjpfirebat: it's generally a bad idea to delete your inventory... It means you'll generate all new containers etc. I hope you deleted yours before.13:46
firebatYeah I deleted the containers, but when I went to make new containers I was getting a weird error on generating eth10 veth pair. Anyway I would try and change my user_config and run it, and get this error even after deleting containers. I deleted that file (backed up), and it got past with my new config13:47
firebatI think the issue is I'm trying to super change around the networking13:47
evrardjpfirebat: we are flexible technically. But you need to follow what we've done for you13:48
sauloaislanandymccr: Sorry my mistake, Here http://paste.openstack.org/show/618687/13:51
hwoarangandymccr: if branching for stable/pike happens this week does that mean that I have until tomorrow to submit patches for opensuse in AIO? or is it too late already?13:51
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-rsyslog_client master: Test postrotate works  https://review.openstack.org/49443813:55
andymccrhwoarang: it is - but no, if its a gate improvement open for that to be backported13:58
odyssey4meevrardjp :)13:59
andymccrhwoarang: you'd just need to PR to master and then backport to stable/pike once its up - also make sure thats before the 16th of sept.13:59
hwoarangohhh ok13:59
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: [WIP] Try the single esl-erlang package  https://review.openstack.org/49432414:00
*** mrch has quit IRC14:02
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rsyslog_client master: Use systemctl to restart rsyslog  https://review.openstack.org/49457014:06
openstackgerritMerged openstack/openstack-ansible-os_nova stable/ocata: Correct Ansible deprecation warning  https://review.openstack.org/49445714:07
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rsyslog_client stable/ocata: Update postrotate script  https://review.openstack.org/49457114:09
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rsyslog_client stable/ocata: Update postrotate script  https://review.openstack.org/49457114:09
*** sxc731 has joined #openstack-ansible14:11
openstackgerritStuart Grace proposed openstack/openstack-ansible-ops master: Add setup of OpenStack with flavors, images, etc  https://review.openstack.org/49186714:13
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: General improvements  https://review.openstack.org/49457614:16
armaanodyssey4me: The repo-build playbook run was too lengthy for pastebin so i uploaded the file and shared the link you...14:17
evrardjpmhayden: I blocked the rsyslog client14:17
evrardjpmhayden: also you are fixing the same shit as I am fixing :p14:18
mhaydenah okay14:18
mhaydenare you working that?14:18
evrardjpyeah14:18
evrardjphttps://review.openstack.org/#/c/494438/14:18
mhaydenokay, i assigned https://bugs.launchpad.net/openstack-ansible/+bug/1709291 to you since it's related14:19
openstackLaunchpad bug 1709291 in openstack-ansible "rsyslog_server: /var/log/log-storage is not synchronized" [Medium,Confirmed] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard)14:19
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-rsyslog_client master: Test postrotate works  https://review.openstack.org/49443814:19
evrardjpI was busy with the client14:19
evrardjpthis bug:14:19
evrardjphttps://bugs.launchpad.net/openstack-ansible/+bug/169987514:20
openstackLaunchpad bug 1699875 in openstack-ansible "rsyslog client postrotate script contains invalid command" [High,In progress] - Assigned to Jean-Philippe Evrard (jean-philippe-evrard)14:20
evrardjpyou can still do the server14:20
evrardjpif you were busy with the server14:20
evrardjpoh but that's a client bug too14:21
evrardjpok14:21
evrardjpmhayden: do you think that can count for two bugs?14:21
evrardjpI'd say yes.14:21
mhaydenagreed14:21
mhaydenlogrotate is the problem14:21
evrardjpyes.14:21
mhaydenjamesdenton: i'm taking a looksee at https://bugs.launchpad.net/openstack-ansible/+bug/167763214:22
openstackLaunchpad bug 1677632 in openstack-ansible "QoS agent extension not loaded when QoS is enabled" [Low,Confirmed]14:22
evrardjpWill mark both bugs in the same fix.14:22
mhaydenjamesdenton: so i assume the qos extension needs to be present (if enabled) whether you're using sriov or not14:22
mhaydenevrardjp: yay!14:22
jamesdentondamn thats old14:22
mhaydenYEAH BOY14:22
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-rsyslog_client master: Test postrotate works  https://review.openstack.org/49443814:22
mhaydenjamesdenton: OSA bug smash day, good sir14:22
evrardjpmhayden: don't forget to write your bugs somewhere if you want the reward!14:23
mhaydenlawl14:23
jamesdentonmhayden I wish i had more details from that time. But from what i recall it was not being added to the extensions list properly14:24
mhaydenjamesdenton: got it, makes sense when i look at the template14:24
jamesdentoncool14:24
mhaydeni'll try to make a patchety and see what i can do14:24
*** weezS has joined #openstack-ansible14:34
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update the playbook serial settings  https://review.openstack.org/49370814:35
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Barbican doesn't handle having HEAD  https://review.openstack.org/49458314:38
spotzandymccr: don't forget agenda:)14:38
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_neutron master: Ensure QoS extension is enabled  https://review.openstack.org/49458414:39
mhaydenjamesdenton: ^^14:39
*** jbadiapa_ has quit IRC14:45
mhaydenhttp://osa-grafana.mhtx.net/dashboard/db/openstack-ansible-launchpad-stats?refresh=1m&orgId=1&from=now-24h&to=now14:48
mhaydenbugs moving!14:48
openstackgerritMerged openstack/openstack-ansible-os_neutron master: tasks: neutron_install: Fix virtualenv-tools issue on openSUSE  https://review.openstack.org/49374514:50
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Correct the "dns_domain" option by default  https://review.openstack.org/49458814:50
jamesdentonevrardjp Updated https://bugs.launchpad.net/openstack-ansible/+bug/1711347. Switch StringIO for BytesIO which got the override mechanism working, but likely broke backwards compatibility.14:57
openstackLaunchpad bug 1711347 in openstack-ansible "Config file override mechanism broken" [Undecided,New]14:57
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Re-add the lbaasv2 example to the default vars  https://review.openstack.org/49459414:58
evrardjpjamesdenton: I will have lots of fun with this one I guess.14:58
jamesdentononly good times ahead14:58
spotzGreetings my fellow OSAers! •cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccoll14:59
spotzum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen14:59
spotz Friendly reminder we will be meeting in 1 hour in #openstack-meeting-4 Agenda is available at https://wiki.openstack.org/wiki/Meetings/openstack-ansible#Agenda_for_next_meeting14:59
*** udesale has quit IRC15:00
*** drifterza has joined #openstack-ansible15:00
*** weezS has quit IRC15:02
*** TxGirlGeek has joined #openstack-ansible15:04
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Collect /etc from host & containers  https://review.openstack.org/49460015:06
mhaydencan i just mark anything that mentions 'ceilometer' as wontfix? ;)15:09
odyssey4memhayden nope, because osmeone might15:09
odyssey4me*someone*15:10
mhaydenodyssey4me: i was kidding ;)15:10
odyssey4meperhaps 'Florida Man' ?15:10
cloudnullhas anyone seen "  Need to apply migrations from neutron-lbaas contract branch. This will require all Neutron server instances to be shutdown before proceeding with the upgrade." ?15:10
mhaydenevrardjp: looking at https://bugs.launchpad.net/openstack-ansible/+bug/1633070 but i'm not sure what specifically ought to be done15:10
openstackLaunchpad bug 1633070 in openstack-ansible "keepalived deploy should be smarter" [Wishlist,Confirmed]15:10
cloudnullrunning the neutron playbook15:10
mhaydencloudnull: that's a first for me15:10
mhaydenperhaps xgerman_ might know?15:10
cloudnullexecutes has_offline_migrations15:10
cloudnullwhich kicks out that error15:10
odyssey4mecloudnull nice, but we do migrations with the servers offline anyway15:11
cloudnulland halts15:11
openstackgerritMerged openstack/openstack-ansible master: Allow Keepalived to read haproxy pid file  https://review.openstack.org/49446815:11
odyssey4mecloudnull looks like we need a better conditional here: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/neutron_db_setup.yml#L4115:11
cloudnullhttps://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/neutron_db_setup.yml#L31-L4115:11
cloudnulli think so15:12
mhaydenevrardjp: can i backport https://review.openstack.org/494468 for ya?15:12
* mhayden has an ocata env to test it on ;)15:12
cloudnullyea. im testing with ocata15:12
evrardjpyeah you can15:13
cloudnullwhat's the desired state there?15:13
cloudnulldo we really want it to die in a fire when there are offline migrations required?15:13
cloudnullcan we just removed https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/neutron_db_setup.yml#L39-L41?15:14
cloudnullseems like we're just checking we have any15:14
cloudnulland doing the right things later.15:14
odyssey4mecloudnull nope, the has_offline_migrations check determines whether there are migrations, then we set a flag to do them15:15
evrardjpmhayden: https://bugs.launchpad.net/openstack-ansible/+bug/1633070 that pretty much needs a spec.15:15
openstackLaunchpad bug 1633070 in openstack-ansible "keepalived deploy should be smarter" [Wishlist,Incomplete]15:15
odyssey4meunfortunately if there are migrations is exits with a non-zero exit code15:15
mhaydenevrardjp: hah okay15:15
evrardjpI will write that down to my spec list for the ptg.15:15
*** agrebennikov has joined #openstack-ansible15:15
odyssey4mecloudnull we have to set the flag because if the flag is set we have to shut down neutron_server before doing them15:16
cloudnull++15:16
cloudnullbut can we removed that failed_when ?15:16
cloudnulljust failed when: fals e15:16
cloudnulland set the flag accordingly ?15:16
evrardjpmhayden: for https://review.openstack.org/#/c/494468/ could you test on your machine? Because I don't have anything to test in my gates for that.15:16
odyssey4mewell, perhaps - but then how do we detect a legit failure15:16
mhaydenevrardjp: can do15:17
odyssey4meperhaps change the condition to something like 'Need to apply migrations' not in _offline_migrations_check.stdout ?15:17
odyssey4methat's a little more generic and hopefully a catch-all15:17
odyssey4methat also then needs to be added here: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/neutron_db_setup.yml#L5115:17
*** woodard has quit IRC15:17
evrardjpodyssey4me: are you talking about the lbaas/vpnaas bug?15:17
mhaydenevrardjp: might need to bump the sha for the keepalived role -- ocata has a version of it without the new stuff15:18
mhaydenwithout the haproxy_pid_file addition, i mean15:18
evrardjpI am not sure it's been a while it's been there15:18
mhaydeni'll test that too15:18
odyssey4meevrardjp nope - something cloudnull picked up, but it might relate15:18
evrardjpI think I bumped it15:18
cloudnullthats the stdout of the command http://paste.openstack.org/show/618697/15:18
evrardjpcloudnull: https://bugs.launchpad.net/openstack-ansible/+bug/170542015:18
openstackLaunchpad bug 1705420 in openstack-ansible "os-neutron-install.yml fails during LBaaS v2 deployment" [Low,Confirmed]15:18
odyssey4mecloudnull yeah, so I think 'Need to apply migrations' not in _offline_migrations_check.stdout will work for all requirements15:19
evrardjpodyssey4me: ^15:19
odyssey4methe one there was a standard no-plugin result15:19
odyssey4methat's all I had to work with at the time15:19
cloudnullso in this case all I did was enable lbaasv2 in an existing deployment15:19
evrardjpshiiit mhayden is winning at the bug smash15:19
evrardjpvirtually15:19
mhaydenhaha most of mine are cleanups of stuff over 300 days old15:20
evrardjphaha15:20
cloudnullevrardjp: ++ looks like one in the same15:20
cloudnullodyssey4me:  so you want the task to fail when that string is in stdout15:21
odyssey4mecloudnull when that string is NOT in stdout15:21
odyssey4mebecause then it's an unknown condition15:21
firebatHave you guys ever had a policy fail to copy to an lxc container?15:21
odyssey4mecloudnull  so we just remove ' from neutron contract branch' from both those conditionals15:21
odyssey4mecloudnull I can push a patch if you like, then you can test & review15:22
cloudnullwouldn't that string not be in stdout when no offline migrations were present?15:22
cloudnulllike in the standard confi g15:22
cloudnullw/ just router and metering15:23
odyssey4mecloudnull then the other condition would fail, because the RC would be 015:23
odyssey4mecloudnull https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/neutron_db_setup.yml#L4015:23
cloudnullbut when you run that command and we have offline migrations the rc is 115:24
cloudnullso it always fails15:24
*** mw_ has joined #openstack-ansible15:24
odyssey4mecloudnull ok, let me be clearer15:25
cloudnullthis looks like a logic bomb15:25
odyssey4meif you run neutron-db-manage has_offline_migrations and there are no migrations, the RC == 0, so the check will just end up OK15:25
*** sxc731 has quit IRC15:25
odyssey4meif you do have migrations, then the RC == 1 and there's output to stdout which contains 'Need to apply migrations'15:25
odyssey4meif the RC == 1 and there is some other stdout message, then that task has actually failed15:26
odyssey4methis could be due to a smissing venv or some other issue15:26
mhaydenevrardjp: ah, can you tag a release of ansible-keepalived?15:27
mhayden3.0.1 doesn't include the selinux stuff15:27
mhaydenor i can use the sha in osa15:27
mhaydeneither way15:27
cloudnulltesting now15:28
evrardjpmhayden: let me tag that quick15:29
mhaydenWOOT15:29
evrardjpthere is probably a reason I didn't tag though15:29
evrardjplet me check first, before promising stuff.15:29
mhaydenhaha15:29
evrardjpyes 3.0.1 seems tagged.15:29
evrardjpit's not there?15:30
mhayden3.0.1 was on Jun 6, but my patch went in during July15:30
mhaydenhttps://github.com/evrardjp/ansible-keepalived/commit/8e215fa795a870858870f91d4fcaec128243f05a15:30
*** pwiltsey has joined #openstack-ansible15:30
evrardjplet me do a quick diff15:30
* mhayden holds15:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Disable IPv6 where the lxb agent runs  https://review.openstack.org/49437215:31
*** logan- has joined #openstack-ansible15:31
mhaydenit works if i manually wedge in master15:31
*** pwiltsey has quit IRC15:31
mhayden(in ocata)15:31
mhaydenso we've got that going for us15:32
evrardjpyeah I'll tag 8e215fa795a870858870f91d4fcaec128243f05a as 3.0.215:32
mhaydenhooray!15:33
evrardjpand master 3.0.315:33
mhaydena tag for you and a tag for you EVERYBODY GETS A TAG15:33
evrardjpI haven't properly tested with different versions of python for 3.0.3 so I can't say yet if we should bump.15:33
evrardjpin ocata15:33
evrardjpto 3.0.315:33
evrardjpwhat was ocata version?15:33
*** pwiltsey has joined #openstack-ansible15:33
mhaydenocata has 3.0.115:33
mhaydenas does pike15:33
evrardjpyeah 3.0.2 seems reasonable15:34
*** mpranjic has quit IRC15:34
mhaydenwoot15:34
evrardjppushed15:37
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Bump ansible-keepalived to 3.0.3  https://review.openstack.org/49461015:37
spotzI guess I should work on at least one of my bugs today huh?:)15:37
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Simplify the string check for offline db migrations  https://review.openstack.org/49461115:38
evrardjpmhayden: sorry I thought that master was unpinned.15:38
cloudnullodyssey4me: works like a champ15:39
odyssey4mecloudnull awesome, LGTM15:39
odyssey4mewe'll need to port that back once it merges15:40
*** logan- has quit IRC15:40
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/ocata: Allow Keepalived to read haproxy pid file  https://review.openstack.org/49461215:40
*** jvidal has quit IRC15:40
*** logan- has joined #openstack-ansible15:40
openstackgerritByron McCollum proposed openstack/openstack-ansible master: Bootstrap Ansible fails if partial keypair exists  https://review.openstack.org/49461315:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron stable/ocata: Simplify the string check for offline db migrations  https://review.openstack.org/49461415:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron stable/newton: Simplify the string check for offline db migrations  https://review.openstack.org/49461515:42
cloudnullyou guys gave it the duce so i cherry-picked it :)15:43
bgmccollumalmost forgot how to submit a patch.........almost.15:43
cloudnulllol15:43
*** mpranjic has joined #openstack-ansible15:45
mhaydencloudnull:  on https://review.openstack.org/494372, won't that harm folks who are running v6 in neutron networks?15:45
*** TxGirlGeek has quit IRC15:45
cloudnullnope15:45
mpranjichello o/15:45
cloudnullits only there for folks running v6 on the infra15:45
cloudnulllike me :)15:45
*** nollide has joined #openstack-ansible15:45
cloudnullmpranjic: o/15:45
mhaydencloudnull: but that setting kills ipv6 for the whole container15:46
mhaydenor rather, on the host15:46
*** vakuznet has joined #openstack-ansible15:46
mpranjiclooking at the review ...15:47
cloudnullit does15:47
mhaydencloudnull: if i run that on one of my unused hypervisors, it kills v6 for the entire host15:47
cloudnullbut if you had v6 running in a vm that'd be passing through the bridge15:47
cloudnullv6 would not be addressable on the host, correct.15:48
mhaydenbut i have DHCPv6 running on my neutron agents15:48
cloudnullbut your not running v6 on that host are you ?15:49
mhaydenmy host has v6 addresses assigned15:49
cloudnulland this is a compute host?15:49
*** chyka has joined #openstack-ansible15:50
mhaydenyeah15:50
cloudnulland is neutron_agent running in a container15:50
mhaydenright15:50
mhaydenthis is ocata15:50
mhaydenon cent 715:50
cloudnullmine too15:50
cloudnulloh15:50
cloudnullnot cent15:50
mhaydenORLY15:50
mhaydenwhat's the error?15:50
cloudnullhttp://paste.openstack.org/show/618624/15:51
* mhayden ganders15:51
mhaydeninteresting failure15:51
*** sxc731 has joined #openstack-ansible15:51
mpranjicdamn, these errors ar formated so badly :/15:51
cloudnull++15:52
*** mmm_cn has quit IRC15:52
mhaydenis this the agent trying to learn about itself?15:52
mhaydenor is it setting up a network?15:52
mhaydenhttps://github.com/openstack/neutron/blob/7c1e21a3f35e80e176dfc025eb6f4a0024cb137c/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py#L37815:54
cloudnullI had the error when creating networks15:54
cloudnullthe ports would never go active15:54
*** udesale has joined #openstack-ansible15:55
mhaydengandering at https://bugs.launchpad.net/neutron/+bug/166232415:55
openstackLaunchpad bug 1662324 in neutron "linux bridge agent disables ipv6 before adding an ipv6 address" [Undecided,Fix released] - Assigned to Brian Haley (brian-haley)15:55
mhaydenlooks like the fix merged in march15:56
spotz5 minute warning - cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, J15:56
spotzRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen15:56
odyssey4melol @ evrardjp https://review.openstack.org/49458315:57
mhaydenodyssey4me: i LOL'd as well15:57
mhaydenthen i felt bad15:57
prometheanfirehi15:57
mhaydenbut then d34dh0r53 said i should keep LOLing15:57
cloudnullhahahahaha15:57
*** udesale has quit IRC15:58
asettlehHahhahah oh no15:58
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Barbican doesn't handle HEAD requests properly  https://review.openstack.org/49458315:58
* mhayden helps evrardjp15:58
*** udesale has joined #openstack-ansible15:58
asettlemhayden: party pooper15:58
* mhayden is a helper15:58
odyssey4memhayden not sure that's much better15:58
mhaydenasettle: that's my job!15:58
mhaydenodyssey4me: ugh15:58
asettlemhayden: he's fucking wetting himself rn15:59
andymccrmhayden: is that what parenthood is like?15:59
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Fix Barbican's health checks  https://review.openstack.org/49458315:59
evrardjpwhat's wrong?15:59
* mhayden makes a HR-approved commit message15:59
*** markus_z has quit IRC15:59
asettleHhahahhahahahaa15:59
cloudnullmhayden: https://github.com/openstack/neutron/blob/stable/ocata/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py#L317-L34016:00
evrardjpoh.16:00
mhaydenodyssey4me: please explain in person to evrardjp16:00
odyssey4melol16:00
asettleevrardjp: ahhhh yeahhhh16:00
evrardjpoh I see.16:00
evrardjpCommit message.16:00
cloudnulllooks like the method in ocata is quite a bit different than master16:00
mhaydenevrardjp: i've got your back, sir16:00
evrardjphaha.16:01
evrardjpHR valid wording sounds good.16:01
evrardjpLess funny though ;)16:01
mhaydentrue16:01
cloudnullmhayden: actually looks like the entire signature of that method has changed.16:01
cloudnullso maybe this is just an ocata specific issue16:01
mhaydenpossibly :/16:01
mhaydeni wonder if there's a chance of backporting that fix16:02
d34dh0r53Barbican can't GET HEAD16:02
openstackgerritMerged openstack/openstack-ansible-ops master: Prevent Ceph containers delete in leapfrog  https://review.openstack.org/49452816:02
*** woodard has joined #openstack-ansible16:02
*** shardy has quit IRC16:02
*** woodard has quit IRC16:02
cloudnullmhayden: i would suspect not.16:02
cloudnullitd have to be a series of cherry-picks16:03
odyssey4mehttps://static.fjcdn.com/pictures/Wargle_a83681_1389193.jpg16:03
odyssey4meyou're welcome16:03
*** woodard has joined #openstack-ansible16:03
firebatHey guys i'm getting an error I can't track down in setup-openstack.yml when the os_neutron role is running: dict object has no attribute network_types... Anyone know what's going on here?16:04
*** rromans has joined #openstack-ansible16:04
*** rromans has quit IRC16:04
*** rromans has joined #openstack-ansible16:04
*** rromans has quit IRC16:05
firebatDid my .j2 files get corrupted somehow? I can't figure out why only this one thing is failing16:05
*** lvdombrkr has joined #openstack-ansible16:07
*** woodard has quit IRC16:07
*** woodard has joined #openstack-ansible16:08
cloudnullfirebat: do you have a full stacktrace for the error we could see?16:09
firebatI'll run it in verbose, and see if that helps me figure out what's going on as well16:10
*** dave_ has quit IRC16:12
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Alphabetize the copy_from_host list  https://review.openstack.org/49462616:12
jamesdentonfirebat sounds like a possible misconfiguration of openstack_user_config16:13
firebatYeah I was thinking so too just wanted to make sure16:14
*** TxGirlGeek has joined #openstack-ansible16:15
*** mbuil has quit IRC16:22
*** TxGirlGeek has quit IRC16:23
*** schliep has joined #openstack-ansible16:24
*** rromans has joined #openstack-ansible16:27
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add playbook to archive all running containers  https://review.openstack.org/49463616:28
*** udesale__ has joined #openstack-ansible16:29
*** udesale has quit IRC16:29
*** udesale__ has quit IRC16:30
*** udesale has joined #openstack-ansible16:30
*** TxGirlGeek has joined #openstack-ansible16:32
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Fail if TLS + TCP are enabled for libvirtd  https://review.openstack.org/49463716:33
*** germs has joined #openstack-ansible16:35
*** germs1 has joined #openstack-ansible16:37
*** germs has quit IRC16:39
sxc731Hi team, just wondering if there's a way to prevent the pip_install role from seemingly randomly re-installing PIP when re-running install-openstack.yml as it's very time consuming?  Why is this even happening (the containers in question already have "pip 9.0.1 from /usr/local/lib/python2.7/dist-packages (python 2.7)")?  I must be doing smth wrong??16:40
openstackgerritMajor Hayden proposed openstack/openstack-ansible-memcached_server master: Add automatic restart for memcached  https://review.openstack.org/49464016:43
sxc731TASK [pip_install : Install PIP] has been running for a mere 49 minutes!! On the containers I see a stuck process that runs "python /opt/get-pip.py pip==9.0.1 setuptools==33.1.1 wheel==0.29.0"16:44
cloudnullsxc731: that sounds like a bug16:44
cloudnullwhat release is this ?16:45
sxc731cloudnull: this is 15.1.7.  What's bizarre is that I've been running it for a couple of weeks  and it seems to do this randomly with random container groups on subsequent invocations16:46
openstackgerritweezer su proposed openstack/openstack-ansible-ops master: Add Tmux configuration on infra1  https://review.openstack.org/49464116:46
sxc731Any evidence I can collect?16:47
cloudnullthat script get-pip should just install when those versions are different from the pinned version16:48
cloudnullso once it runs it should largely skip16:49
cloudnullhowever maybe we need a test task before hand in the pip install role?16:49
cloudnullodyssey4me: ^16:49
cloudnull?16:49
odyssey4mecloudnull it's not as idempotent as I'd like16:50
odyssey4meunfortunately we always do the install, and rely on pip to work out whether it's already installed or not16:50
*** udesale has quit IRC16:50
odyssey4methe list we give it is just a list of packages - the versions come from constraints16:51
odyssey4meso doing a pip freeze, then comparing versions of what would be installed versus what is installedd is not that simple16:51
sxc731odyssey4me: couldn't it check an existing pkg by running "pip --version"?  That seems too easy, right?  Are these pip versions so volatile that the checks need to be super-stringent?16:52
odyssey4mebut perhaps that could be done16:52
odyssey4mesxc731 yes, it's important to be at the right versions16:53
odyssey4meotherwise a build today and a build tomorrow look different, and differences are the enemy of stability16:53
*** germs has joined #openstack-ansible16:54
sxc731Understood.  So there are micro-versions that a tag like '9.0.1' doesn't capture?16:55
odyssey4mesxc731 it's not just pip that we install16:55
odyssey4mewe do pip, setuptools and wheel - then other packages to make TLS connections work right16:55
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add playbook to archive all running containers  https://review.openstack.org/49463616:59
*** germs has left #openstack-ansible17:00
sxc731odyssey4me: ok thank you for your help.  I guess I'm going to have to hit ctrl+c as it's been running "[pip_install : Install PIP]" for over an hour now.  The previous install on these containers had 25-Jul as timestamps so maybe something did change inbetween....17:01
odyssey4mesxc731 yeah, it shouldn't take that long - something must be wrong with the tcp connectivity or something there17:01
odyssey4meon an existing install, especially a re-run of playbooks, nothing should change - so something must have gone wonky with connectivity17:02
sxc731odyssey4me: actually it just went through, elapsed time: 1:45:28.882 - 0:46:43.483 ... bizarre!  I did try some pings from the affected containers and they were going through just fine... Oh well...17:03
sxc731now I'm on "pip_install : Install pip packages"... joy17:04
openstackgerritAmy Marrich (spotz) proposed openstack/openstack-ansible master: Add tip for destroying containers  https://review.openstack.org/49464617:08
openstackgerritJimmy McCrory proposed openstack/openstack-ansible master: Fix import of osa_toolkit in inventory-manage.py  https://review.openstack.org/49464917:21
evrardjphey, jmccrory is in the game for rewards!17:23
jmccroryhah didn't know there were prizes17:24
evrardjphaha17:24
evrardjpYou're right the satisfaction of fixing bugs and making the world better is enough. <Cancelling order>17:25
*** SamYaple has joined #openstack-ansible17:25
jmccroryaww17:25
odyssey4meok, I'm out for the evening - have a good one, chat again tomorrow!17:26
jamesdentoncheers17:26
*** TxGirlGeek has quit IRC17:27
*** TxGirlGeek has joined #openstack-ansible17:30
evrardjpgood night odyssey4me see you tomorrow@17:31
*** stuartgr has quit IRC17:33
*** sxc731 has quit IRC17:38
spotznight odyssey4me17:41
spotzCan I get a prize for reviews? I signed up to go to an OPenStack meetup tonight but don't feel like driving up to Austin:(17:41
spotzI'll do reviews instead:)17:42
openstackgerritByron McCollum proposed openstack/openstack-ansible master: Bootstrap Ansible fails if partial keypair exists  https://review.openstack.org/49461317:47
*** nollide has quit IRC17:50
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: ansible-role-requirements: Bump sha for lxc_container_create role  https://review.openstack.org/49465617:53
*** TxGirlGeek has quit IRC18:02
*** esberglu has quit IRC18:13
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: ansible-role-requirements: Bump sha for os_neutron role  https://review.openstack.org/49466418:13
*** esberglu has joined #openstack-ansible18:14
*** schwicht has joined #openstack-ansible18:15
*** chyka_ has joined #openstack-ansible18:15
sauloaislanandymccr:   My OSA not run the task os_swift : Copy the swift_rings.py file18:16
sauloaislanandymccr: In swift_rings.yml include: swift_rings_check.yml when: inventory_hostname == groups['swift_hosts'][0]18:17
*** esberglu has quit IRC18:18
*** chyka has quit IRC18:18
* mhayden is back and full of tacos18:24
*** esberglu has joined #openstack-ansible18:24
openstackgerritMajor Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Add automatic restart for RabbitMQ  https://review.openstack.org/49466818:28
*** electrofelix has quit IRC18:30
jamesdentonI am jealous of your tacos, mhayden18:34
*** qcrivera has joined #openstack-ansible18:36
*** weezS has joined #openstack-ansible18:39
*** ajaaya has joined #openstack-ansible18:39
*** ajaaya has quit IRC18:42
spotzmhayden Did you bring enough for everyone?18:46
*** ajaaya has joined #openstack-ansible18:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Prevent dnsmasq from reading hosts file  https://review.openstack.org/49467518:49
mhaydenjamesdenton: come on back to texas! :)18:49
*** drifterza has quit IRC18:49
jamesdentonI'm enjoying my mild summer, thank you very much.18:50
ajaayait's only 100F in San Antonio...18:52
ajaaya100ish..18:52
mhaydenhah18:54
mhaydencurrently 95F18:54
mhaydenwe'll see where that will go18:54
*** chyka_ has quit IRC18:54
ajaayaI miss coming to Castle!18:54
*** chyka has joined #openstack-ansible18:55
*** nollide has joined #openstack-ansible18:56
jamesdentona balmy 78F here18:56
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Collect /etc from host & containers  https://review.openstack.org/49460018:58
mhaydencloudnull: is your domain patch helping with https://bugs.launchpad.net/openstack-ansible/+bug/1670874 ?19:02
openstackLaunchpad bug 1670874 in openstack-ansible "Validating domain name in FQDN and openstack_domain variable" [Low,Confirmed]19:02
mhaydenor something entirely different19:02
*** chyka_ has joined #openstack-ansible19:02
*** schwicht has quit IRC19:02
andymccrhow is the smash going?!19:04
*** armaan has quit IRC19:05
*** chyka has quit IRC19:05
*** armaan has joined #openstack-ansible19:09
prometheanfiresmashingly?19:10
spotzhehe19:20
cloudnullmhayden: no, that pr is specific for instances19:21
cloudnulland port fqdn19:22
mhaydenalrighty19:23
cloudnullmhayden: did you ever figure anything out on the ipv6 neutron-agents container thing-a-me?19:27
mhaydennot really19:27
mhaydengot caught up in some other business19:27
*** armaan has quit IRC19:29
cloudnullnp19:30
cloudnullhttp://paste.openstack.org/show/618717/19:30
cloudnullre: my dns patch19:31
cloudnullthat's what I was after19:31
cloudnullenabling dns in neutron19:31
cloudnullso now I can use hostnames within instances over a tenant network19:32
cloudnullall without designate19:32
*** rodolof has joined #openstack-ansible19:32
*** gkadam-afk has quit IRC19:35
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_keystone master: Add extra headers for Keystone  https://review.openstack.org/49468719:45
ajaayaI am having problems deploying Openstack following this guide - https://docs.openstack.org/project-deploy-guide/openstack-ansible/ocata/ Is this the right place to ask for assistance?19:49
ajaayaI'm able to ping all my containers `ansible -m ping all` but install hangs on "TASK [lxc_container_create : Wait for ssh to be available] *********************"19:50
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Add option to deploy OpenDaylight SDN Controller  https://review.openstack.org/48012819:51
mhaydenbug counts looking better! http://i.imgur.com/M7FM6dS.png19:56
*** qcrivera has quit IRC20:02
*** marst has joined #openstack-ansible20:04
*** TxGirlGeek has joined #openstack-ansible20:14
openstackgerritAndy McCrae proposed openstack/openstack-ansible master: Update existing container_networks  https://review.openstack.org/49451520:16
openstackgerritMerged openstack/openstack-ansible-ops master: Add Tmux configuration on infra1  https://review.openstack.org/49464120:21
openstackgerritMerged openstack/openstack-ansible-ops master: Add playbook to archive all running containers  https://review.openstack.org/49463620:21
*** pbandark has quit IRC20:28
ajaayalol I guess..I will try harder20:37
cloudnullajaaya: sorry20:40
cloudnullwas not paying attention20:40
ajaayanp20:41
cloudnullare  you able to ssh to the containers?20:41
cloudnullmulti-node deployment?20:41
ajaayayes, simple 3 node setup20:41
ajaayaI have three VLANs: 10.4.0.0/22 for mgmt, 10.5.0.0/22 for vxlan, 10.6.0.0/22 for storage20:41
ajaayaI am not able to ssh..no :(20:42
cloudnulland its just hanging?20:42
ajaayayes20:42
cloudnulltcpdump on the target host show anything interesting?20:42
cloudnullcan you ssh from the host to a local container?20:43
ajaayalemme see20:43
cloudnullalso can you lxc-attach to a container and then ssh to some other container20:46
cloudnulland are you getting a signature ?20:46
ajaayahttps://pastebin.com/FHR4X5Qk << route table information20:46
ajaayaIt seems like I don't have the route to hop onto another container20:47
cloudnullcan you sssh to an IP within one of those containers on teh management network ?20:48
ajaayabut I have the route correct - https://pastebin.com/hmmhKUEi20:48
cloudnullroute 10.4.0.0/24 ?20:48
ajaayayeah20:48
ajaayaoh wow20:49
ajaayaafter I re-ran with lxc-containers-destroy.yml and lxc-containers-create.yml20:50
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible master: ansible-role-requirements: Bump sha for os_keystone role  https://review.openstack.org/49470320:51
ajaayanow my containers have 10.0.3.x IPs..20:51
*** pwiltsey has quit IRC20:52
ajaayaI am able to ssh into the containers on each node but not between nodes20:53
*** heroux has quit IRC20:53
ajaayaDo you need a copy of my /etc/openstack_deploy/openstack_user_config.yml?20:53
ajaaya@cloudnull ^^20:54
evrardjphey20:54
evrardjpso we'll leave mhayden as winner of the day?20:54
*** vakuznet has quit IRC21:00
*** lucasxu has quit IRC21:01
*** woodard_ has joined #openstack-ansible21:02
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/newton: Simplify the string check for offline db migrations  https://review.openstack.org/49461521:03
*** woodard has quit IRC21:05
cloudnullajaaya: the 10,0.3.x addresses are normally used by the lxcbr0 interface and are scoped to only the one host21:05
cloudnullall of the other interfaces should provide intra cluster communication21:06
ajaayaok21:06
ajaayaI think I am doing something wrong then definitely21:06
*** woodard_ has quit IRC21:06
ajaayaI placed my containers in the same network as br-mgmt I configured on the hosts21:07
ajaayacidr_networks:21:07
ajaaya  container: 10.4.0.0/2221:07
ajaaya  tunnel: 10.5.0.0/2221:07
ajaaya  storage: 10.6.0.0/2221:07
ajaayaoops,sorry for flooding21:07
cloudnullthe container network is a /24 so that should be ok as is21:07
cloudnulls/container/lxcbr0/21:07
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_nova master: Correct tag for nova_compute_kvm_install tasks  https://review.openstack.org/49470421:08
cloudnullcan you paste the rest of the user_config ?21:08
ajaayahttps://pastebin.com/it6J5f7421:08
cloudnullthat all looks good to me21:10
cloudnullwhen you attach to the various containers do you see extra interface  files under /etc/network/interfaces.d/ ?21:11
* cloudnull assuming this is ubuntu21:11
ajaayait's centos721:11
ajaayawhen I ran this step `openstack-ansible setup-hosts.yml` it failed on step `wiring veth...`21:11
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Add automatic restart for memcached  https://review.openstack.org/49464021:12
cloudnulland all of the bridges21:12
cloudnullbr-vlan br-tun ect exist?21:12
ajaayayes, they are configured on each of the hosts21:12
ajaayado you need a copy of network configuration from host?21:12
cloudnullcan you rerun the lxc-container-create.yml play ?21:12
ajaayakk21:13
cloudnulland paste the stderr21:13
ajaaya+1!21:13
ajaayathanks for helping me btw21:13
cloudnullnp. happy to21:14
*** schliep has quit IRC21:15
openstackgerritMerged openstack/openstack-ansible-os_nova master: Fail if TLS + TCP are enabled for libvirtd  https://review.openstack.org/49463721:16
spotzcloudnull: Hey what's a good repo to clone to get alook at the overrides in main.yml?21:18
cloudnullspotz: in the roles?21:19
spotzcloudnull: yeah21:19
cloudnullhttps://github.com/openstack/openstack-ansible-openstack_hosts21:19
cloudnulldefaults/main.yml21:20
*** mw_ has quit IRC21:20
spotzcloudnull:  thanks!21:20
spotzJust want to make sure I word the doc change right21:21
*** mw_ has joined #openstack-ansible21:21
cloudnull++21:22
ajaaya@cloudnull it looks like a bit more positive this time... crossing fingers21:23
openstackgerritweezer su proposed openstack/openstack-ansible stable/newton: Add rally_all variable file into os_rally-install.yml  https://review.openstack.org/49471721:23
*** germs1 is now known as germs21:27
ajaaya@cloudnull I see some items skipping because it's not able to connect to conatiners in other nodes - https://pastebin.com/gPFy63gm21:36
ajaayabut, nothing errored yet completely21:36
*** mw_ has quit IRC21:37
*** mw_ has joined #openstack-ansible21:37
*** mw_ has quit IRC21:41
*** mw_ has joined #openstack-ansible21:41
cloudnullskipping is generally ok21:42
*** oanson has quit IRC21:42
*** oanson has joined #openstack-ansible21:44
ajaayaah errors!21:45
ajaayahttps://pastebin.com/60sb2Wc321:45
ajaayaah, `fi\ncan't get info No such device\nbridge br-tun does not exist!`21:46
ajaayadoes that need to exist on all nodes?21:46
*** esberglu has quit IRC21:47
ajaayathis is my hostlist - https://pastebin.com/cBks5DD021:50
ajaayaIt's back to "hung" state at `TASK [lxc_container_create : Wait for ssh to be available] *********************`21:51
ajaayaI will review network configurations on hosts/ containers again21:52
ajaayaI think this is a route issue21:53
*** rodolof has quit IRC21:53
*** esberglu has joined #openstack-ansible21:54
ajaaya10.4.0.1 dev eth0  FAILED, yeah :(21:57
*** thorst has quit IRC22:00
*** ajaaya has left #openstack-ansible22:00
cloudnullajaaya: yes, the bridges have to exist on all nodes where the containers will exist.22:00
cloudnulland plugin22:00
cloudnullthe networks are group based22:00
cloudnullso take a look at the user_config22:01
cloudnullyour br-tun network entry has a "group_binds" list22:01
cloudnullthat bridge has to be on all hosts where that group is present.22:01
openstackgerritAmy Marrich (spotz) proposed openstack/openstack-ansible master: [DOCS] Add reference to Tunable Overrides  https://review.openstack.org/49472522:03
spotzHappy Birthday mhayden!!!!!!!!!!:)22:04
*** mw_ has quit IRC22:10
*** thorst has joined #openstack-ansible22:11
*** mw_ has joined #openstack-ansible22:11
*** mw_ has quit IRC22:11
evrardjp:)22:11
*** mw_ has joined #openstack-ansible22:11
*** mw_ has quit IRC22:11
*** mwynne has joined #openstack-ansible22:13
*** mwynne has quit IRC22:14
*** mwynne has joined #openstack-ansible22:15
*** rromans has quit IRC22:19
*** agrebennikov has quit IRC22:20
*** rromans has joined #openstack-ansible22:21
*** thorst has quit IRC22:23
*** rromans has quit IRC22:24
*** gouthamr has joined #openstack-ansible22:24
*** thorst has joined #openstack-ansible22:28
*** openstackgerrit has quit IRC22:33
*** openstackgerrit has joined #openstack-ansible22:36
openstackgerritMerged openstack/openstack-ansible master: Fix Barbican's health checks  https://review.openstack.org/49458322:36
openstackgerritMerged openstack/openstack-ansible master: Add tip for destroying containers  https://review.openstack.org/49464622:37
prometheanfireevrardjp: unassigning me?22:44
*** nollide has left #openstack-ansible22:49
evrardjpyup I thought you had less time to implement the tests22:50
evrardjpI expect if I do that jmccrory would take the bug :p22:50
evrardjpyou've reverted right prometheanfire?22:50
evrardjpI think I saw the rever22:50
evrardjpI think I saw the revert22:50
evrardjpif you want to do the tests, you can still do it too :)22:50
evrardjpthe assign/unassign is just indicative that work is done right now22:51
evrardjpat least for the bug smash22:51
prometheanfireoh, if that's doing tests then ya22:51
prometheanfireI thought there was a separate bug for tests22:51
*** thorst has quit IRC22:51
evrardjpyou're right we don't have that written in the bug.22:52
evrardjplet me see if I am not wrong :p22:52
evrardjpok we never documented that from our conversations, so I'd have to dig into our meeting logs, which I won't do for today.22:55
evrardjp:p22:55
prometheanfirenn then :P22:58
*** woodard has joined #openstack-ansible23:07
openstackgerritweezer su proposed openstack/openstack-ansible stable/newton: Add rally_all variable file into os_rally-install.yml  https://review.openstack.org/49471723:38
*** markvoelker has quit IRC23:40

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!