Tuesday, 2018-05-15

*** cjloader has joined #openstack-ansible00:20
*** cjloader has quit IRC00:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Document everything in config  https://review.openstack.org/56839800:37
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Update role to gate using all supported distros  https://review.openstack.org/56839900:42
*** threestrands has quit IRC01:00
*** gyee has quit IRC01:18
*** harryhuang_ has joined #openstack-ansible01:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Update container pkg list and use qgroups  https://review.openstack.org/56840201:24
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Update role to gate using all supported distros  https://review.openstack.org/56839901:26
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Document everything in config  https://review.openstack.org/56840401:29
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Document everything in config  https://review.openstack.org/56840401:34
*** dave-mccowan has joined #openstack-ansible01:41
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Document everything in config  https://review.openstack.org/56840401:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Update role to gate using all supported distros  https://review.openstack.org/56839901:42
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Update role to gate using all supported distros  https://review.openstack.org/56839901:56
devxcloudnull you are certainly busy tonight01:57
cloudnulltrying to get that shored up before I disappear for the summit.01:57
devxahh yes...01:59
*** ivve has joined #openstack-ansible02:09
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Document everything in config  https://review.openstack.org/56840402:10
*** adrianreza has joined #openstack-ansible02:21
*** armaan has quit IRC02:29
*** armaan has joined #openstack-ansible02:30
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Update qgroup messages  https://review.openstack.org/56841402:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Update role to gate using all supported distros  https://review.openstack.org/56839902:33
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Update qgroup messages  https://review.openstack.org/56841402:33
openstackgerritMerged openstack/openstack-ansible master: Run inventory-manage.py from the ansible-runtime venv  https://review.openstack.org/56533602:46
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Update qgroup messages  https://review.openstack.org/56841403:07
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Update role to gate using all supported distros  https://review.openstack.org/56839903:08
*** udesale has joined #openstack-ansible03:10
*** klamath has quit IRC03:10
*** nicolasbock has quit IRC03:11
*** cjloader has joined #openstack-ansible03:15
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Enable quota system and set qgroups  https://review.openstack.org/56842703:18
*** cjloader has quit IRC03:19
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Enable quota system and set qgroups  https://review.openstack.org/56842703:19
*** udesale has quit IRC03:19
*** udesale has joined #openstack-ansible03:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Enable quota system and set qgroups  https://review.openstack.org/56843003:34
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833103:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Begin testing opensuse and centos with nspawn  https://review.openstack.org/56819703:37
*** dave-mccowan has quit IRC03:38
*** marst has quit IRC04:02
*** marst has joined #openstack-ansible04:08
*** klamath has joined #openstack-ansible04:09
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_glance master: Convert role to use a common systemd mount role  https://review.openstack.org/55218504:11
*** mmercer|2 has joined #openstack-ansible04:18
*** marst has quit IRC04:19
mmercer|2if one were to install openstack aio on a laptop, how hard is it to stop the machine, and restart it again later ?04:19
mmercer|2as far as i understand/have read, the only 'tricky' part is stopping galera and bringing it back up properly04:20
*** klamath has quit IRC04:20
*** Trieu-Van has joined #openstack-ansible04:27
*** udesale has quit IRC04:28
*** pcaruana has joined #openstack-ansible04:31
*** Trieu-Van has quit IRC04:32
*** linhnm has joined #openstack-ansible04:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Ensure minimal host facts are present in build  https://review.openstack.org/56844104:34
*** marst has joined #openstack-ansible04:36
*** linhnm has quit IRC04:37
cloudnullmmercer|2 rabbitmq and galera can be a pain but its not terrible04:37
*** linhnm has joined #openstack-ansible04:38
mmercer|2rabbitmq?  that one doesnt have any notes on the aio page04:38
cloudnullit should "just start"-tm04:38
mmercer|2on the bright side, i think i just about have a running aio install!  =D04:38
cloudnullnice!04:38
*** udesale has joined #openstack-ansible04:39
mmercer|2i think one of the next tasks i want to try to figure out is how to get the nova part off of the lxc onto the primary host itself, since its a pretty beefy instance, i dont want to lose the benefit of the hardware to begin with =D04:39
*** marst has quit IRC04:41
cloudnullnova is running on baremetal04:46
cloudnullonly the api is in lxc04:47
mmercer|2oooh, yay!04:47
mmercer|2i was worried nova was going to be running a container and id have to move it out, lol04:47
cloudnullwe only containerize the services where is makes the most sense. nova, cinder, swift, etc are all on baremetal .04:47
mmercer|2ahh, nice04:47
cloudnullthey all run within the venv and are san boxed using the systemd unit files, but not in a container.04:48
*** udesale has quit IRC04:49
cloudnullthat said, if ever you didnt want to run any containers, you could. everything can be run in and out of a container as needed.04:50
*** udesale has joined #openstack-ansible04:50
mmercer|2im assuming the way its setup is that the web ui is available on a proxied address from the primary eth interface ?04:51
mmercer|2or does it tell me after all the setup 'how to start using openstack'  lol04:52
mmercer|2based on everything else ive seen included it wouldnt surprise me if there were a final step that summarizes the environment04:52
*** chhagarw has joined #openstack-ansible04:54
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Ensure minimal host facts are present in build  https://review.openstack.org/56844105:01
*** linhnm has quit IRC05:04
cloudnullthe lb vip address will provide access to horizon (the web ui)05:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833105:07
cloudnullthere's nothing at the end of the deployment that summarizes the environment, however that would be nice ;)05:07
cloudnullthe deployment guide(s) kinda touch on those things but may not be exactly what you're looking for.05:08
mmercer|2hmmm,  it shouldnt be too difficult to add that -- the lb vip address is captured during install, right ?05:11
mmercer|2but the vip address is also non routable, hrum05:11
mmercer|2so it would have to be proxied to05:11
*** marst has joined #openstack-ansible05:16
cloudnullyea it is proxied from the host using haproxy05:20
cloudnullI do a lot of work with cloud servers to test parts of the stack, with the AIO all i need to know is how to get to the instance05:21
*** linhnm has joined #openstack-ansible05:26
*** armaan has quit IRC05:30
*** armaan has joined #openstack-ansible05:30
*** udesale_ has joined #openstack-ansible05:36
mmercer|2currently in the os_heat playbook05:39
mmercer|2so however close that is to being complete =D05:39
*** udesale has quit IRC05:39
*** udesale_ has quit IRC05:40
*** udesale has joined #openstack-ansible05:40
openstackgerritRobin Naundorf proposed openstack/openstack-ansible master: Update docs to reflect release of Queens   * Update the index page to reflect the release of Queens.  https://review.openstack.org/56844605:43
openstackgerritRobin Naundorf proposed openstack/openstack-ansible master: Update docs to reflect release of Queens  https://review.openstack.org/56844605:43
*** masber has joined #openstack-ansible05:51
*** mma has joined #openstack-ansible05:53
*** linhnm has quit IRC05:56
*** jbadiapa has quit IRC06:00
openstackgerritRobin Naundorf proposed openstack/openstack-ansible master: Update docs to reflect release of Queens  https://review.openstack.org/56844606:03
openstackgerritChristian Zunker proposed openstack/openstack-ansible-os_cloudkitty master: Configure cloudkitty-api to use uwsgi  https://review.openstack.org/56716806:04
*** radeks has joined #openstack-ansible06:12
*** klamath has joined #openstack-ansible06:17
evrardjpgood morning06:18
*** radeks_ has joined #openstack-ansible06:20
*** markvoelker has quit IRC06:20
*** radeks has quit IRC06:20
*** sar_ has quit IRC06:20
*** radeks has joined #openstack-ansible06:21
*** klamath has quit IRC06:21
*** linhnm has joined #openstack-ansible06:22
mmercer|2hrum....06:33
mmercer|2https://paste.fedoraproject.org/paste/61Vm0UNTua~R2IGBEQ7vlg06:33
mmercer|2https://paste.fedoraproject.org/paste/PxEE409SB4Bm8lXUwGG4Kw06:34
*** radeks__ has joined #openstack-ansible06:34
*** radeks has quit IRC06:37
*** udesale has quit IRC06:38
*** niraj_singh has joined #openstack-ansible06:40
*** sar_ has joined #openstack-ansible06:40
*** DanyC has joined #openstack-ansible06:40
*** udesale has joined #openstack-ansible06:40
*** DanyC_ has joined #openstack-ansible06:41
niraj_singhcloudnull: hi, in my ansible environment opensstacksdk version is 0.12.0. there is a new release 0.13.0  How can i install it?06:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Run inventory-manage.py from the ansible-runtime venv  https://review.openstack.org/56846306:43
niraj_singhcan i directly install it inside the container i want?06:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Run inventory-manage.py from the ansible-runtime venv  https://review.openstack.org/56846406:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Run inventory-manage.py from the ansible-runtime venv  https://review.openstack.org/56846606:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Run inventory-manage.py from the ansible-runtime venv  https://review.openstack.org/56846706:44
*** DanyC has quit IRC06:45
*** DanyC_ has quit IRC06:46
evrardjpniraj_singh: are you still in role testing?06:46
evrardjpby default it should take what's in openstack's upper constraints06:46
niraj_singhyes06:46
evrardjpso branch master?06:46
niraj_singhyes06:46
evrardjpon a clean machine?06:46
niraj_singhyes06:47
niraj_singhi am doing functional testing.06:47
evrardjphttps://github.com/openstack/requirements/blob/master/upper-constraints.txt#L40406:47
evrardjp0.13 should be installed06:47
evrardjpthere is a problem with your role then06:47
evrardjpcompare it with the others.06:47
evrardjpcheck the upper constraints part06:48
niraj_singhOthers also installed 0.12.006:48
niraj_singhok06:48
evrardjpno I mean other roles06:48
niraj_singhok06:48
evrardjplike https://github.com/openstack/openstack-ansible-os_glance06:48
evrardjp0.12 looks like you installed this from a non-clean machine that has a stable branch installed.06:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Simplify fact setting  https://review.openstack.org/56813406:48
niraj_singhevrardjp: I created new VM and clone openstack-ansible master then ran all playbook and scripts required to install openstack-ansible.06:52
evrardjpnope you don't need that06:55
odyssey4meniraj_singh if you're using openstack-ansible master, then the requirements repo pin is likely older than 14 days, when the 0.13 sdk merged06:55
evrardjpnew vm, git clone your role, and then run_tests.sh06:55
niraj_singhi created new VM 3 days before06:56
niraj_singhok i am looking into it. If i missed anything06:56
odyssey4meevrardjp shall we? https://review.openstack.org/#/c/56779606:58
evrardjpreviewing06:58
*** epalper has joined #openstack-ansible07:00
fghaasHmmm. Anyone able to offer suggestions on intermittent DNS failures in the gate that only seem to materialize during the functional tests on CentOS? See http://logs.openstack.org/60/568360/1/check/openstack-ansible-functional-centos-7/4ef1564/job-output.txt.gz (from https://review.openstack.org/#/c/568360/)07:03
*** mbuil has joined #openstack-ansible07:04
fghaasAt this stage I'm unsure whether it makes sense to keep rechecking...07:04
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: Public n/w access for vxlan tenant n/w in ml2.ovs  https://review.openstack.org/56780907:15
*** klamath has joined #openstack-ansible07:16
*** pcaruana has quit IRC07:17
*** pcaruana has joined #openstack-ansible07:17
*** pcaruana has quit IRC07:18
fghaasAlso, I believe evrardjp asked to be notified if people ran into issues not being covered by test cases. https://bugs.launchpad.net/openstack-ansible/+bug/1771200 would be one such issue.07:19
openstackLaunchpad bug 1771200 in openstack-ansible "stable/pike (16.0.11): missing default for neutron_ovs_service_name" [Undecided,New]07:19
fghaasThat one should have immediately broken any functional test that ran with ML2/OVS rather than ML2/LB, I believe.07:20
*** markvoelker has joined #openstack-ansible07:20
*** klamath has quit IRC07:21
openstackgerritRobin Naundorf proposed openstack/openstack-ansible master: Update docs to reflect release of Queens  https://review.openstack.org/56844607:21
*** pmannidi has quit IRC07:22
*** pcaruana has joined #openstack-ansible07:23
openstackgerritChristian Zunker proposed openstack/openstack-ansible-os_cloudkitty master: Configure cloudkitty-api to use uwsgi  https://review.openstack.org/56716807:25
*** lvdombrkr has joined #openstack-ansible07:27
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_aodh master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56831107:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Move database creation into role  https://review.openstack.org/56848107:30
odyssey4meevrardjp ^ what do you think of that?07:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Move database creation into role  https://review.openstack.org/56848507:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Move database creation into role  https://review.openstack.org/56848107:35
*** mhayden has quit IRC07:35
openstackgerritRobin Naundorf proposed openstack/openstack-ansible master: Update docs to reflect release of Queens  https://review.openstack.org/56844607:35
*** linhnm has quit IRC07:36
openstackgerritRobin Naundorf proposed openstack/openstack-ansible stable/queens: Update docs to reflect release of Queens  https://review.openstack.org/56848707:37
*** DanyC has joined #openstack-ansible07:40
evrardjpodyssey4me: it makes sense to give to the role a list of mysql servers. They should then be used for glance config and user/db creation07:40
evrardjpgood example of I/O of a role07:40
openstackgerritMerged openstack/openstack-ansible master: Ensure that the repo servers also use the pypi cache  https://review.openstack.org/56311407:41
*** DanyC has quit IRC07:41
evrardjpthen we set the convention to use x (here galera_all)07:41
odyssey4meevrardjp I'm trying to use convention instead of putting another var into group_vars, so I'm just setting the default to the first member of galera_all if that exists, otherwise assume localhost07:41
odyssey4meif we can replicate this pattern for rabbitmq too, then we pull a lot of extra stuff out of group_vars07:42
evrardjpby moving this, we are effectively complexifying the role, but for a good reason. I guess this is different with package installs too07:43
*** vnogin has quit IRC07:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Move database creation into role  https://review.openstack.org/56849207:45
evrardjpthe group vars should still be able to override things/wire things together07:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Move database creation into role  https://review.openstack.org/56848107:45
evrardjpand we'll be able to remove some of the plays in tests too07:45
evrardjpthe idea of moving it to playbooks was different07:46
odyssey4meYeah, given that the service roles are complex anyway - I think it's best to make peace with that and rather just go with it.07:46
evrardjpit was to set everything into a role, like what we do for haproxy/keepalived.07:46
evrardjpso gather things into one place07:46
odyssey4meyeah, exept in this case it duplicated things07:47
odyssey4meI think for some roles that approach works - but for these it's caused confusion and duplication07:47
evrardjpcould we have it as a different include file?07:47
odyssey4methese roles are integration roles - they pull lots of things together to make a service work07:47
odyssey4methat's different to the keepalived/haproxy roles which are far simpler, and don't rely on so many things07:48
odyssey4menot sure what you mean by 'different include file'?07:48
*** tosky has joined #openstack-ansible07:49
odyssey4mein my mind, given that the role requires the wiring to the database anyway, it makes sense to do this - it keeps all the vars for the role in one place without any duplication07:50
evrardjpglance_db_setup now includes two things07:50
evrardjpthe openstack like things : db sync ...07:50
evrardjpand the setup db07:50
odyssey4meyes, the db creation and the migrations - the second relies on the first07:50
odyssey4methis is, in fact, how we used to do it ages back - as can be seen in https://github.com/openstack/openstack-ansible-os_cloudkitty/blob/master/tasks/cloudkitty_db_setup.yml which has never been changed07:51
evrardjpyes07:51
evrardjpI am fine with that07:51
evrardjpbut if possible, the db creation/credentials should be in another include07:51
evrardjpwell07:51
evrardjpdb_setup is VERY explicit07:51
evrardjpso let's keep it there07:52
evrardjpI mean the db_migrations should probably be in another include07:52
evrardjpso for example, if package installs have a problem with the db creation (they should skip it because they create it for example)07:52
hwoaranggood morning07:52
evrardjpthen we can just say it in the include07:52
evrardjpgood morning hwoarang07:52
odyssey4mecould do, although to me that's adding another include without much value - in some roles that might be best (perhaps nova), but in most roles I think this is simple and good07:53
odyssey4meo/ hwoarang07:53
odyssey4meyeah, package installs don't create the db afaik07:53
evrardjpok07:53
*** DanyC has joined #openstack-ansible07:53
odyssey4meif they do, then happy to move them07:53
evrardjpyeah.07:53
odyssey4mehwoarang I'd like your thoughts on https://review.openstack.org/#/q/topic:move-db-setup-into-roles+(status:open+OR+status:merged) too please07:54
evrardjpor if we do want to do a run a setup db tasks for all the roles thing.07:54
odyssey4meI'm thinking we can do this for the db and the mq stuff. I'm hoping to enlist the help of Tahvok and perhaps others to get this pattern implemented this cycle across all roles.07:54
evrardjpbut right now it's not there.07:54
evrardjpyeah that's a good idea07:55
evrardjpTahvok: seems interested in helping reducing tech debt, and simplifying things07:55
*** markvoelker has quit IRC07:55
hwoarangodyssey4me: it looks reasonable to me. i presume that all roles need to convert to that right?07:55
evrardjpI hope it's not peer pressure there :p07:55
evrardjphwoarang: yes07:55
evrardjpit would simplify the openstack-ansible-tests in the long run, and simplify our playbooks too07:56
hwoarangi like it that the roles are becoming more independencit of the tests and integrated repo07:56
evrardjpI think it's a positive rollback07:56
odyssey4mehwoarang yeah, I'm hoping to just set the pattern and enlist help by other contributors to make it so07:56
evrardjpodyssey4me: an etherpad would be good07:56
evrardjpwe could list patterns there, and where it is applied07:57
odyssey4meevrardjp or low-hanging-fruit bugs07:57
evrardjpso people can just adapt it07:57
evrardjpyeah that could work too07:57
openstackgerritMerged openstack/openstack-ansible-os_glance master: vars: Do not install build dependencies for distro installs  https://review.openstack.org/56779607:58
evrardjpwe are doing great this cycle, we have many initiatives started07:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Ensure that the repo servers also use the pypi cache  https://review.openstack.org/56850207:59
evrardjpubuntu 18, include roles of systemd things, roles cleanup, group vars cleanup, testing refactoring, python venv builds/repo changes08:00
evrardjpinventory changes08:00
evrardjpYes all of that ^ will be used in a presentation in the upcoming summit :)08:00
evrardjpdon't hesitate to add things :)08:00
evrardjppackages instead of source08:00
odyssey4meI was just about to do that08:01
odyssey4mesome new roles too08:01
odyssey4mepanko, masakari... can't remember the others08:01
evrardjpcongress08:02
hwoarangyeah so many things can go wrong :D08:02
evrardjphaha yeah08:02
*** mhayden has joined #openstack-ansible08:03
evrardjpI'll throw it over the fence on september to the next one, hoping it won't be me :p08:03
evrardjpwow mhayden ! :)08:03
evrardjpthat's very early08:04
openstackgerritMerged openstack/openstack-ansible-os_designate master: Get the adminuri variable from adminurl variable  https://review.openstack.org/54835308:04
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-galera_server master: Add Bionic testing  https://review.openstack.org/56703008:08
*** shardy has joined #openstack-ansible08:09
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-galera_server master: Add Bionic testing  https://review.openstack.org/56703008:09
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-nspawn_hosts master: Add voting jobs for bionic  https://review.openstack.org/56851108:12
openstackgerritMerged openstack/openstack-ansible master: Correct galera cluster maintainance example wording  https://review.openstack.org/56836208:13
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-nspawn_container_create master: Add Bionic testing  https://review.openstack.org/56704308:15
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-nspawn_container_create master: Add Bionic testing  https://review.openstack.org/56704308:16
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-plugins master: Add Bionic testing  https://review.openstack.org/56704408:17
odyssey4meanyone happy to push the button here? https://review.openstack.org/56814108:19
*** errr has quit IRC08:22
fghaasodyssey4me: can I bother you with a request for a suggestion on how to handle the (apparently DNS induced?) failures in https://review.openstack.org/#/c/568360/ ?08:23
*** vnogin has joined #openstack-ansible08:25
fghaas(tl;dr: failure to resolve http://mirror.ord.rax.openstack.org/centos/7/os/x86_64/repodata/repomd.xml half-way through; in earlier runs I also saw it fail to resolve the OVH mirror)08:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Move MQ vhost/user creation into role  https://review.openstack.org/56851708:26
odyssey4mefghaas well, I wonder whether https://review.openstack.org/#/q/I11d069e2d0cb3becad067689fa8f1e4c9391f368 should actually be implemented... but I haven't figured out why Queens is failing there08:27
odyssey4meI haven't really had much time to look into it. Perhaps you have some thoughts?08:28
odyssey4meevrardjp hwoarang perhaps those fixes should go into Ocata/Pike, and we leave Queens alone as it doesn't appear to be exhibiting the same issue?08:28
fghaasodyssey4me: if the problematic resolv.conf would be the problem, then wouldn't this affect all platforms and not just CentOS?08:29
*** vnogin has quit IRC08:29
odyssey4mefghaas that kinda makes sense - but it also depends on what's installed in the image08:29
odyssey4melet me get this thing done, then I'll context switch and take a look - I don't know much about centos though :/08:30
evrardjpand the scripts are platform specific and centos is not using resolvconf08:30
evrardjpthat's a debian/ubuntu thing08:30
evrardjpiirc08:30
odyssey4medid we move to using systemd in queens? or was that rocky only?08:30
evrardjpq08:31
odyssey4mesure about that?08:31
evrardjpdepends on what part though08:31
odyssey4mejust the containers08:31
evrardjpresolved and networkd is only m08:31
evrardjpmaster*08:31
evrardjpoh nspawn?08:31
odyssey4mejust the network interface setup08:31
evrardjpmaster08:31
odyssey4menop, the network interfaces in the lxc containers08:31
evrardjpI think that's only master, except if that was backported08:32
odyssey4mepersonally, I think that was all master ionly08:32
evrardjpyeah I thought you were talking about something else, the usage of systemd module08:32
evrardjpqueens maybe using different images?08:33
evrardjpor did we ensure that it's fine?08:33
evrardjpI think that was master too08:33
odyssey4mequeens uses the lxc images IIRC08:33
evrardjpmoving so fast this cycle!08:33
odyssey4meyeah, lots on the go08:34
evrardjpto answer your question, I'd prefer if we add some other deployers into this backports for O and P -- like jmccrory or logan-08:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Move MQ vhost/user creation into role  https://review.openstack.org/56851708:34
evrardjplogan-: has a specific use case with unbound, and jmccrory has the experience08:34
evrardjpso it's good to have their opinion there08:35
*** errr has joined #openstack-ansible08:35
*** rmart04 has joined #openstack-ansible08:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Move MQ vhost/user creation into role  https://review.openstack.org/56852208:39
*** vnogin has joined #openstack-ansible08:42
*** qwebirc77208 has joined #openstack-ansible08:45
*** vnogin has quit IRC08:45
*** vnogin has joined #openstack-ansible08:45
qwebirc77208hi guys! i 've deployed openstack ansible queens. now i created an alarm for autoscaling but the alarm always statys in insufficient data mode!! what is the problem what shoud i do?08:45
*** gkadam has joined #openstack-ansible08:51
*** markvoelker has joined #openstack-ansible08:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Move MQ vhost/user creation into role  https://review.openstack.org/56853108:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Move MQ vhost/user creation into role  https://review.openstack.org/56851708:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Move MQ vhost/user creation into role  https://review.openstack.org/56851708:54
Tahvokodyssey4me, evrardjp: yes, I'm all in to simplify things, but what's the tl;dr version of what you were talking about?08:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Move MQ vhost/user creation into role  https://review.openstack.org/56852208:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Move MQ vhost/user creation into role  https://review.openstack.org/56852208:59
odyssey4meTahvok the commit messages in https://review.openstack.org/#/q/topic:move-db-setup-into-roles+(status:open+OR+status:merged) and https://review.openstack.org/#/q/topic:move-mq-setup-into-roles+(status:open+OR+status:merged) explain it.09:01
odyssey4meessentially we're doing something in playbooks which could be done in the roles, and by doing it in the roles we remove a bunch of group_var duplication09:01
odyssey4meso - assuming those test patches pass tests, and get voted through, I'd like help replicating that change of pattern across all roles09:02
odyssey4mebut nothing should be done until those are merged09:02
odyssey4mein other news, I really hate this terrible error message... absolutely no diagnostic information provided: http://logs.openstack.org/81/568481/3/check/openstack-ansible-v2_registry_enabled/1377aba/logs/ara-report/result/f4af02fa-cf89-4f85-b574-4ce4bc910743/09:03
odyssey4medoes anyone have any idea how we can get better output from that? perhaps add some config to apt, or perhaps turn up ansble's verbosity?09:03
*** qwebirc77208 has quit IRC09:04
*** mmercer has quit IRC09:06
fghaasConsidering this comes from ansible using python-apt, rather than invoking the apt command (if I remember correctly), I think you're stuck with this.09:07
TahvokWoaaa09:09
TahvokI'm surprised actually.. Didn't look at the database creation process before, but I'm surprised it was done so far in the playbooks and not in the roles09:10
*** linhnm has joined #openstack-ansible09:11
Tahvokodyssey4me: I hate these messages.. I had exact errors on Sunday.. Turns out one of my repo containers was not working properly for some repo.. Had to rerun the repo install playbook to make it all work again09:12
odyssey4meTahvok we used to, a long time ago, do them in the roles - then we switched to doing it in the playbooks, but no reason was given09:13
evrardjpodyssey4me: that's enough user friendliness: it failed to update cache. https://media.giphy.com/media/Nx2Lx1RmLadtC/giphy.gif09:14
evrardjphahah09:14
evrardjplet me check what you can do09:14
*** jbadiapa has joined #openstack-ansible09:15
TahvokI'll have some time to work on the rabbitmq this week, maybe I'll come up with some elegant upgrade solution for clusters..09:15
evrardjpodyssey4me: https://github.com/ansible/ansible/blob/devel/lib/ansible/modules/packaging/os/apt.py#L1011-L102509:15
odyssey4meTahvok great, I hope so!09:16
odyssey4meevrardjp ok, so if we can configure apt with some extra conf, we might get better errors?09:16
evrardjpthat's very weird09:16
TahvokReminds me when I worked on some other role 2 years ago in some other company.. I had to create around 10 tasks with with_together when each had at least 3 variables in it... I spoke to my friends from there, turns out they still run it without any change and it still works XD09:17
evrardjpodyssey4me: you have the exception text09:17
*** klamath has joined #openstack-ansible09:17
evrardjphaha no09:18
evrardjp2.4.3 doesn't show it09:18
evrardjphttps://github.com/ansible/ansible/blob/v2.4.3.0-1/lib/ansible/modules/packaging/os/apt.py#L96509:18
evrardjpodyssey4me: for ansible for your case?09:18
evrardjpodyssey4me: change these lines https://github.com/ansible/ansible/blob/v2.4.3.0-1/lib/ansible/modules/packaging/os/apt.py#L962-L965 to show the exception and you're good to go09:19
odyssey4meevrardjp evrardjp same for 2.3 https://github.com/ansible/ansible/blob/v2.3.3.0-1/lib/ansible/modules/packaging/os/apt.py#L88509:20
*** admin0 has joined #openstack-ansible09:20
odyssey4meand 2.2 :/09:21
odyssey4melikely 2.1 too09:21
*** klamath has quit IRC09:22
jrosserfwiw in some of my roles we use command: rather than the built in apt module for apt-get update09:24
jrossera combination of ansible apt bugs and wanting to see the output iirc09:25
*** markvoelker has quit IRC09:25
evrardjpuse a fork of ansible :)09:27
evrardjpthat's probably better09:27
TahvokWill they ever start merging all their pull requests?09:27
evrardjpTahvok: they do09:27
evrardjpit's a manual process to backport things.09:28
odyssey4meevrardjp ok, so we could propose the error report to be ported back to Ansible 2.5 and 2.4, right? 2.3 and earlier is not accepting changes afaik?09:31
evrardjpthat won't get accepted in more than 2.5 I think09:31
evrardjp2.5/2.409:32
evrardjpbut in the meantime, you can run your fork to find the root cause of your issue09:32
*** udesale_ has joined #openstack-ansible09:33
*** udesale has quit IRC09:34
*** nsingh has joined #openstack-ansible09:37
*** niraj_singh has quit IRC09:41
*** linhnm has quit IRC09:42
fghaasMy bet is on DNS :)09:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Simplify fact setting  https://review.openstack.org/56813309:55
*** udesale_ has quit IRC10:01
*** udesale has joined #openstack-ansible10:03
*** sar_ has quit IRC10:08
openstackgerritMerged openstack/openstack-ansible stable/queens: Update docs to reflect release of Queens  https://review.openstack.org/56848710:11
*** tosky has quit IRC10:11
odyssey4mePR for Ansible 2.5 up: https://github.com/ansible/ansible/pull/4014310:11
*** tosky has joined #openstack-ansible10:12
openstackgerritMerged openstack/openstack-ansible master: Update docs to reflect release of Queens  https://review.openstack.org/56844610:12
odyssey4mePR for Ansible 2.4 up: https://github.com/ansible/ansible/pull/4014410:14
*** markvoelker has joined #openstack-ansible10:23
*** nicolasbock has joined #openstack-ansible10:40
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_barbican master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56780810:43
*** markvoelker has quit IRC10:55
*** armaan has quit IRC10:56
*** marst has quit IRC10:56
*** armaan has joined #openstack-ansible10:56
*** marst has joined #openstack-ansible11:09
*** marst has quit IRC11:14
*** klamath has joined #openstack-ansible11:18
*** sar_ has joined #openstack-ansible11:20
*** klamath has quit IRC11:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/queens: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56713711:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/queens: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56713711:25
*** ansmith has quit IRC11:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/queens: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56713711:27
*** Taseer has quit IRC11:29
odyssey4mefghaas ^ I found the bug in my implementation, so I'll push to have this implemented in Queens, then ported back to Pike & Ocata.11:30
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Allow integration of externally deployed RadosGW  https://review.openstack.org/56827611:31
fghaasodyssey4me: ok, so what I do is wait until that lands, and when it has recheck my own change?11:31
odyssey4mefghaas yeah, it'll at least need to be proposed to the same branch before you can do anything :/ hopefully we can get this out the way pronto11:32
*** Taseer has joined #openstack-ansible11:33
fghaasSure, got it. If I star your change, does that mean I get notifications like a proposer/reviewer?11:35
fghaasI'll try that out, at least. :)11:36
odyssey4mefghaas yes, you should get updates for that patch via email if you star it11:37
odyssey4meTahvok Did those db/mq changes make sense to you? Would you be able to help implement them across the roles if they're accepted and merged?11:39
*** rodolof has joined #openstack-ansible11:42
TahvokI would need to find time for this, and currently we have other problems than openstack. I do want to help, but this will take time if only I'll be working on this11:44
openstackgerritMerged openstack/openstack-ansible master: Add python-keystoneclient to the ansible-runtime venv  https://review.openstack.org/56814111:44
openstackgerritMerged openstack/openstack-ansible master: Adjust inside/outside openstack-ci bootstrap-host tasks  https://review.openstack.org/56715911:44
*** Taseer has quit IRC11:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/queens: common-tasks: Do not sync preconfigured /etc/pip.conf file  https://review.openstack.org/56856311:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/pike: common-tasks: Do not sync preconfigured /etc/pip.conf file  https://review.openstack.org/56856511:50
*** markvoelker has joined #openstack-ansible11:52
guilhermesphey guys, morning (UTC -3)11:54
guilhermespAs I mentioned earlier, I've been passing through some issues with repo_build. The task [repo_build : Wait for the venvs builds to complete] is having broken pipe caused by mux_client_read_packet: read header failed11:54
guilhermesphere's a paste: http://paste.openstack.org/show/720988/11:54
guilhermespI google it and found some workarounds, like downgrading ansible, but not sure what this can cause acutally. I boostraped ansible in order to download the required dependencies for os_monasca role11:54
guilhermespthis is one of the places that I read about downgrading ansible https://github.com/ansible/ansible/issues/2635911:55
openstackgerritMerged openstack/openstack-ansible master: Remove unused radosgw_ssl variable  https://review.openstack.org/56569311:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Adjust inside/outside openstack-ci bootstrap-host tasks  https://review.openstack.org/56856811:59
odyssey4meguilhermesp we test with a specific ansible version, so that's not an option12:00
*** Taseer has joined #openstack-ansible12:00
odyssey4meguilhermesp your paste output there is not a failure, it's the first attempt at checking the status of the async task - can you paste the actual failure?12:01
*** marst has joined #openstack-ansible12:01
*** markvoelker_ has joined #openstack-ansible12:02
guilhermespodyssey4me: sorry, I forgot to mention that it uses all the 180 retries until failure12:04
*** markvoelker has quit IRC12:04
guilhermespodyssey4me: let me see if I can paste the failure here12:04
odyssey4meguilhermesp in pastebin please, not in the channel12:08
guilhermespodyssey4me: sure12:09
jrosserany ideas why haproxy is configured to check for a 405 response from radosgw? https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/haproxy/haproxy.yml#L36612:10
guilhermespodyssey4me: I'm just executing again to get more details. pastebin asap12:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Adjust inside/outside openstack-ci bootstrap-host tasks  https://review.openstack.org/56857112:13
odyssey4meany cores available to review https://review.openstack.org/567137 ?12:15
odyssey4meand also https://review.openstack.org/568146 (to help clean up host pip installs)12:17
*** udesale_ has joined #openstack-ansible12:18
*** mma has quit IRC12:18
*** mma has joined #openstack-ansible12:18
odyssey4mejrosser probably due to the healthcheck URL being useless or unauthorised... if there's a better one, rather change it12:19
*** udesale has quit IRC12:19
jrosserhmmm ok, well it checks / and gets a 200 right now, which fails12:20
jrosserwell suceeds, indicating failure :) ykwim12:20
odyssey4meheh, perhaps it should be failed_when no in [200, 405]12:21
odyssey4meor something like that12:21
*** mma has quit IRC12:23
*** gokhan has quit IRC12:25
*** Taseer has quit IRC12:28
*** Taseer has joined #openstack-ansible12:29
odyssey4mehwoarang evrardjp here's a thought which may be useful to reduce some of the file synchronizing that we do across repositories12:31
*** rmart04 has quit IRC12:31
*** jamesdenton has joined #openstack-ansible12:31
odyssey4mewe could make https://github.com/openstack/openstack-ansible-tests/blob/master/run_tests_common.sh#L45 use the common tests repo bindep file instead of the remote repo bindep file12:32
odyssey4methat way we can just have a blank bindep file in repo to prevent the fallback bindep file from being used12:32
odyssey4meassuming the fallback bindep file is still a thing in infra12:33
*** armaan has quit IRC12:33
odyssey4mewe could do the same thing with the test-requirements.txt file in each repo12:34
*** guilhermesp_ has joined #openstack-ansible12:35
*** gokhan has joined #openstack-ansible12:38
*** electrofelix has joined #openstack-ansible12:46
hwoarangodyssey4me: i remember that infra was telling us that we need to keep a bindep.txt on every repo12:50
hwoarangi will try to remember the details12:50
odyssey4meyeah, if we don't - we get the fallback, which is a miserable bunch of packages12:50
hwoarangah yes, like you said, if we don't have one then they will use a fallback which is not good for us12:50
*** ansmith has joined #openstack-ansible12:50
odyssey4meso I'm thinking we have a blank one instead, copied from the tests repo - but use a common-bindep.txt file for the actual bindep install12:51
odyssey4methis would mean that *we* do our own bindep installs, both outside and inside infra... we don't rely on any infra tooling to do it12:51
hwoarangi suppose it would work...12:51
hwoarangi wonder if we need a minimal set of packages for run_test.sh to work12:52
hwoarangif yes, then we need a real bindep12:52
hwoarangi am thinking stuff like openssl, etc12:53
odyssey4mewell, run_tests.sh currently installs git, clones the tests repo - then runs the common script which installs bindep and goes ahead12:53
odyssey4meso the only thing we need for run_tests in every repo is git - everything else is driven from the common repo12:54
hwoarangok12:55
*** nicolasbock has quit IRC12:55
evrardjpwasn't bindep used for bootstrap ansible before we read the requirements?12:57
mnaserbonjour12:59
mnaserhwoarang: sorry i haven't dived into the uwsgi thing, i need a bit of time to debug and i have a lot of summit prep right now :(12:59
hwoarangmnaser: no worries12:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins master: Remove requirements file names from output  https://review.openstack.org/56857912:59
odyssey4meevrardjp bindep is used to put packages down which ansible needs, and test-requirements puts the pip packages down that it needs... then our scripts put ansible there13:00
odyssey4meit's a bit of a mess due to the g-r process13:00
*** nicolasbock has joined #openstack-ansible13:01
*** mma has joined #openstack-ansible13:02
*** dave-mccowan has joined #openstack-ansible13:02
*** mma has quit IRC13:02
*** rpittau has quit IRC13:02
*** mma has joined #openstack-ansible13:02
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins master: Remove requirements file names from output  https://review.openstack.org/56857913:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Update repo_build test-vars data  https://review.openstack.org/56858113:09
evrardjpodyssey4me: I just want to avoid to make the thing more complex/obscure13:13
odyssey4meevrardjp agreed - it's debatable whether this does that or not13:14
odyssey4mewe could actually move all test-requirements and bindep things to the common tests repo - one could argue that's easier to follow13:15
odyssey4meeverything in one place, and all that13:15
guilhermespI was running repo_build until now, so the first failure appeard: http://paste.openstack.org/show/720998/13:17
guilhermespbut there are some other executions that were with status "changed"13:18
guilhermespit is still running13:18
odyssey4meguilhermesp ok, now look at /var/log/repo/ for the ironic venv build log to find the error13:18
guilhermespodyssey4me: got it13:18
*** klamath has joined #openstack-ansible13:19
guilhermespodyssey4me: the end of the log file: http://paste.openstack.org/show/721001/13:24
guilhermespsome syntax errors13:24
*** klamath has quit IRC13:24
odyssey4meguilhermesp those are normal, and not a problem - the files successfully installed so it looks like it didn't fail13:25
odyssey4meguilhermesp you're trying to install 16.0.0? is there a reason you're trying to use something so old?13:26
guilhermespyes, I was looking this here, os_nova for exempla was with status changes and also have the synax errors13:26
odyssey4meguilhermesp I'm not sure I understand what you mean.13:26
odyssey4me16.0.13 is the most recent pike release, and I recommend you go with that instead - there have been many, many external factors which will break for 16.0.0 - including a recent pip and pbr release13:27
guilhermespodyssey4me: sorry, going to be more clear, but first, let me say why I am using 16.0.013:27
odyssey4me16.0.0 just will not work without quite a few extra patches13:28
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: Public n/w access for vxlan tenant n/w in ml2.ovs  https://review.openstack.org/56780913:29
guilhermespI deployed this cloud a few months ago, we use this cloud here with custom modifications in the source code of nova scheduler, for exemple. The purpose of this cloud is to experiment allocation of EPC for instances using intel SGX, so my boss and his team choose to not upgrade the cloud to not interfer in their work13:30
guilhermespI'd really like to do minor upgrades13:30
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: Public n/w access for vxlan tenant n/w in ml2.ovs  https://review.openstack.org/56780913:30
guilhermespMaybe this is a good opportunity to convince him to upgrade :)13:31
odyssey4meguilhermesp if they're worried about changes to openstack itself, then you can override the openstack SHA pins... but I recommend that you make use of the latest OSA deployment playbooks and roles13:31
*** fghaas has left #openstack-ansible13:32
guilhermespodyssey4me: and about you not understanding what I was trying to say: you said that the syntax error was normal and I really checked that all venvs logs had the syntax error, which confirms what you said13:33
odyssey4meguilhermesp this patch is one that will likely fix the failure you're seeing: https://github.com/openstack/openstack-ansible-repo_build/commit/475d9efc075fdd078a226fcdf7e4f92a5855507e13:33
guilhermespI hope I have been clearer :)13:34
guilhermespodyssey4me: gonna look at it13:34
odyssey4meguilhermesp ah, yes - thanks :)13:34
odyssey4meguilhermesp not too many pike patches to repo_build, but they're all important: https://github.com/openstack/openstack-ansible-repo_build/commits/stable/pike13:34
guilhermespgreat, I'm gonna take a look. Really appreciate13:35
guilhermespbut indeed, I'm going to convince people here that we need to use the up do date releases13:36
guilhermespour changes in nova scheduler source code are minimal, we can revert any issues13:37
*** esberglu has joined #openstack-ansible13:37
odyssey4meyeah, if the concern is the openstack code due to the org's custom code, then you're able to override the openstack code SHA's we pin to so that your ansible changes won't affect the openstack environment at all - it'll just update the ansible bits and keep that going nicely13:38
*** cmart has joined #openstack-ansible13:38
guilhermespnoted :D13:39
*** rpittau has joined #openstack-ansible13:40
odyssey4meguilhermesp here's a docs page for that: https://docs.openstack.org/openstack-ansible/latest/user/source-overrides/index.html#overriding-other-upstream-projects-source-code13:40
odyssey4mewith that you're also able to deploy from a fork of the upstream repositories, which could make the management of the custom code quite a lot easier13:41
*** klamath has joined #openstack-ansible13:42
*** jwitko_ has joined #openstack-ansible13:42
openstackgerritMerged openstack/openstack-ansible-repo_server master: Support devpi as the upstream pip server  https://review.openstack.org/56784813:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server stable/queens: Support devpi as the upstream pip server  https://review.openstack.org/56858613:45
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/queens: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56713713:45
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Replace deprecated "auth_uri" by "www_authenticate_uri"  https://review.openstack.org/56771313:45
openstackgerritMerged openstack/openstack-ansible master: Improve the limited connectivity documentation  https://review.openstack.org/56802313:46
guilhermespthat's great! I will certainly try this approach and after change from 16.0.0 to 16.0.13-113:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/pike: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56716113:47
guilhermespand about the venv logs, all of them only have the syntax error, everything seems to be installed sucessfully13:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/ocata: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56718413:49
*** Brew has joined #openstack-ansible13:49
*** jwitko_ has quit IRC13:50
odyssey4meguilhermesp you'll also hit the bug in https://bugs.launchpad.net/openstack-ansible/+bug/1768592 if deploying 16.0.0, and will need to apply patches/workarounds from that13:50
openstackLaunchpad bug 1768592 in openstack-ansible "/usr/local/bin/cache-prep-commands.sh failing to write to /etc/resolv.conf when resolvconf used on Xenial" [Critical,Fix committed] - Assigned to Jesse Pretorius (jesse-pretorius)13:50
*** jwitko_ has joined #openstack-ansible13:51
odyssey4meoff the top of my head, I'm not sure what else you may hit as a bug - the release notes should hopefully help13:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Improve the limited connectivity documentation  https://review.openstack.org/56858913:54
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: DNM - Testing the ODL gates  https://review.openstack.org/56859013:56
guilhermespodyssey4me: yes, I already aware of this bug, I'm using the two variables proposed: lxc_cache_prep_[pre,pos]_commands in user_variables13:56
*** cjloader has joined #openstack-ansible13:57
guilhermesplxc_cache_prep_[pre,post]_commands*13:59
*** weezS has joined #openstack-ansible14:00
*** armaan has joined #openstack-ansible14:02
openstackgerritMerged openstack/openstack-ansible-os_zaqar master: Replace deprecated "auth_uri" by "www_authenticate_uri"  https://review.openstack.org/56771214:02
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Update auth_uri option to www_authenticate_uri  https://review.openstack.org/56171314:02
*** sar_ has quit IRC14:03
cloudnullmornings14:05
cloudnullqq - w/ rocky I'm seeing the following error on one of my environments. http://paste.openstack.org/show/721008/ looks like the apt cache update isn't happening so the package isn't being found. is this a known issue ?14:06
jrosserodyssey4me: i can't help feeling this radosgw 405 check is just bogus, from the docs "If you receive an 405 error, check to see if you have the S3 subdomain set up correctly."14:06
mmercer|2morning14:06
mmercer|2cloudnull: https://paste.fedoraproject.org/paste/61Vm0UNTua~R2IGBEQ7vlg14:07
mmercer|2https://paste.fedoraproject.org/paste/PxEE409SB4Bm8lXUwGG4Kw14:07
cloudnullodyssey4me: if you get a chance, mind reviewing https://review.openstack.org/#/q/topic:bug/1753790+(status:open+OR+status:merged) - I believe this will resolve https://bugs.launchpad.net/openstack-ansible/+bug/175379014:07
openstackLaunchpad bug 1753790 in openstack-ansible "spurious 'no space left on device' errors during venv build" [High,In progress] - Assigned to Kevin Carter (kevin-carter)14:07
mmercer|2so close..... but not quite there =D14:08
cloudnullmmercer|2 tempest is a bit particular when it comes to environment setup. have you been able to use the api generally ?14:09
odyssey4mejrosser I honestly have no clue. :)14:09
*** throwsb1 has joined #openstack-ansible14:09
jrosser:) i was wondering if id did wierd things in the gate check with no dns, i'll make a patch and see what happens14:10
mmercer|2cloudnull: no idea, since that part failed i assumed my environment still wasnt ready =D14:11
jrossermmercer|2: there is a more readable tempest log dropped on the utility container14:11
mmercer|2jrosser: happen to know where at ?14:12
odyssey4mecloudnull if that's bionic, it's likely real because I suspect there is no UCA for bionic14:12
*** gkadam has quit IRC14:12
odyssey4mecloudnull apparently I'm wrong: https://packages.ubuntu.com/bionic/ubuntu-cloud-keyring14:13
jrossermmercer|2: generally start in /openstack on whichever physical host runs the utility container14:13
cloudnullodyssey4me no, this was xenial14:13
mmercer|2hehe, found it --  /var/lib/machines/aio1_utility...../openstack/venvs/tempest.../workspace/logs/14:14
mmercer|2its only 3.9M  =D14:14
*** gkadam has joined #openstack-ansible14:14
cloudnulltinny tiny :)14:14
mmercer|2lol, right ?14:15
mmercer|2i dont think there are enough values logged....14:17
odyssey4mecloudnull small tweak in https://review.openstack.org/#/c/568427/2 otherwise looks fine14:17
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Enable quota system and set qgroups  https://review.openstack.org/56842714:19
cloudnullupdated.14:19
cloudnullthanks!14:19
cloudnullI think (hope) that resolves that issue for good14:20
odyssey4mehope so too!14:21
nsinghi am getting error for this task while running test TASK [First ensure apt cache is always refreshed] "fatal: [localhost]: FAILED! => {"attempts": 5, "changed": false, "failed": true, "msg": "Failed to lock apt for exclusive operation"}"14:22
nsinghany clue please14:22
odyssey4mensingh sounds like your apt is already locked - perhaps running in another session14:22
nsinghok.. so how should i resolve this.14:24
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/ocata: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56718414:24
odyssey4mensingh you have two things trying to do apt updates or apt installs on the same host - figure out how that's happening, and resolve it - you're going to have to understand what you're doing and how that happens in your own env... that's not something we can really help with14:25
odyssey4mehwoarang mind giving this a go? https://review.openstack.org/56716114:25
nsinghodyssey4me: sorry. i will work on it.14:25
hwoarangdone14:26
odyssey4methx hwoarang14:26
*** lvdombrkr89 has joined #openstack-ansible14:30
devxls14:30
devxoops wrong window :)14:30
*** lvdombrkr has quit IRC14:32
mmercer|2https://paste.fedoraproject.org/paste/~DwedK5SkANQpM2Rb33GJQ14:33
mmercer|2seems like the api itself is working, just that various things were 404s14:34
mmercer|2is there a 'healtcheck' command i can run to validate that everything is ok at this point ?14:34
*** dxiri_ has quit IRC14:35
*** dxiri has joined #openstack-ansible14:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833114:36
mmercer|2oooh, i have a horizon webui,  woot....   now to look up the default creds =D14:37
*** kstev has joined #openstack-ansible14:37
cloudnullthe creds can be sourced from the openrc file in the home folder14:37
cloudnullor in the /etc/openstack_deploy/*secrets.yml file14:37
cloudnullyou can validate a deployment using the various clients. I typically use hatop to make sure everything is running.14:38
mmercer|2hmmm,  so should be:  admin // the string for horizon_secret_key  right ?14:40
cloudnullyes.14:40
*** tosky has quit IRC14:40
mmercer|2invalid password :(14:40
cloudnullcat the  ~/openrc file14:41
cloudnullthe username is "admin" the password will be some hash14:41
*** geb has left #openstack-ansible14:42
mmercer|2woohoo14:42
mmercer|2i have an openstack14:42
admin0mmercer|2, congratulations ..14:43
admin0keep it safe :D14:43
*** tosky has joined #openstack-ansible14:44
mmercer|2hmmm.....   so i have a 'public subnet',  which is set on a class C cidr,  but there is no associated router for that subnet ?14:44
mmercer|2awwww,  aio is limited to 10 instances?  oh well14:45
cloudnullthats just the default quota14:45
cloudnullyou can change all that14:45
mmercer|2ahh14:45
mmercer|2im like .....  hrum....  thats a rather small limit for a box with 32 cores and 144G of ram =D14:46
mmercer|2aaahh,  i see,  under the admin / system section14:47
mmercer|2nice14:47
cloudnullyup, you can tune / tweak all the things to your liking14:47
cloudnullthe world is you oyster :)14:47
mmercer|2how does the default public subnet work if there is no 'router' defined for it ?  its still a bogon network, so something has to act as a nat layer14:48
admin0you have to create a router and link to it mmercer|214:49
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/pike: Fix LXC cache resolvers more appropriately  https://review.openstack.org/56716114:49
*** lvdombrkr89 has quit IRC14:49
mmercer|2interesting, looks like there is a default router for it, its just not visible under the project view, but is visible under admin/network/routers14:51
*** goldenfr_ has joined #openstack-ansible15:01
*** weezS has quit IRC15:01
logan-evrardjp odyssey4me: re the ping earlier about resolver stuff.. are we moving things to systemd-resolved?15:01
odyssey4melogan- that's all done already in Rocky, but Queens backwards is all still the old stuff15:01
logan-id be in favor of switching over from resolvconf to systemd-resolved in queens personally15:02
openstackgerritMerged openstack/openstack-ansible-plugins master: Remove requirements file names from output  https://review.openstack.org/56857915:02
odyssey4melogan- perhaps, but the transition involves new roles, etc and has involved quite a bit of change, and given we're still finding other issues with queens I'd be wary of pulling all that bac15:03
odyssey4me(back15:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/queens: Remove requirements file names from output  https://review.openstack.org/56861015:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/pike: Remove requirements file names from output  https://review.openstack.org/56861115:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-plugins stable/ocata: Remove requirements file names from output  https://review.openstack.org/56861215:04
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Change to using the package module instead of apt  https://review.openstack.org/56861515:12
openstackgerritPeriyasamy Palanisamy proposed openstack/openstack-ansible-os_neutron master: Public n/w access for vxlan tenant n/w in ml2.ovs  https://review.openstack.org/56780915:12
openstackgerritMerged openstack/openstack-ansible master: Only implement openrc/clouds.yaml on a designated host  https://review.openstack.org/56814615:12
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833115:13
cloudnulllogan- odyssey4me getting resolved setup within the containers can be done using the system-networkd role15:13
cloudnulleven if no networks are used.15:13
cloudnullhttps://github.com/openstack/ansible-role-systemd_networkd/blob/master/defaults/main.yml#L111-L12115:14
cloudnulland o/ logan- :)15:15
cloudnullwill you be in vancouver by chance ?15:15
logan-o/ ...and nope :(15:16
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Begin testing opensuse and centos with nspawn  https://review.openstack.org/56819715:16
cloudnullbummer15:16
evrardjpoh so...15:16
evrardjpvancouver:15:16
evrardjphttps://etherpad.openstack.org/p/YVR-openstack-ansible15:16
evrardjptada!15:17
jrossercloudnull: i'm just giving your ELK stuff a test-drive - got a moment?15:17
odyssey4mecloudnull same disk space error: http://logs.openstack.org/27/568427/3/experimental/openstack-ansible-integrated-deploy-aio/fe2801e/logs/openstack/aio1_repo_container-90c712b9/repo/venv_build_horizon-18.0.0.0b2-x86_64.log15:18
odyssey4methat's from https://review.openstack.org/56842715:19
openstackgerritMerged openstack/openstack-ansible master: Ensure facts are updated for new containers  https://review.openstack.org/56364115:19
openstackgerritMerged openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.22  https://review.openstack.org/56815515:19
cloudnullodyssey4me sadly the two PRs will be needed to know if its fully resolved .15:20
cloudnull568427 is for the hosts15:20
odyssey4mecloudnull same error for the lxc_container_create one: http://logs.openstack.org/30/568430/1/experimental/openstack-ansible-integrated-deploy-aio/6b1b5f8/logs/openstack/aio1_repo_container-1b39fc1b/repo/venv_build_designate-18.0.0.0b2-x86_64.log15:21
odyssey4meand that one deps on the other one, so they should have been combined15:21
*** DanyC has quit IRC15:21
odyssey4mebut, seeing as the two patches are gating now - let's see what happens15:22
evrardjpandymccr: are you still chairing the meeting today?15:22
cloudnullwelp if we see it more often now at least we'll have a way to reproduce it :)15:22
cloudnulljrosser what's up ?15:22
jrossercloudnull: got a couple new hosts, built the containers and then this http://paste.openstack.org/show/721020/15:23
evrardjpare there people wanting to add info about what happened this week? https://wiki.openstack.org/wiki/Meetings/openstack-ansible#Meeting_section_.22Last_week_highlights.2215:24
evrardjpthinking hwoarang cloudnull odyssey4me ^15:24
*** udesale_ has quit IRC15:25
cloudnulljrosser I think the port needs to be quoted in config15:25
mmercer|2ok, so i so right now,  /var/lib/nova/instances is mounted on a loop partition via an img file under openstack....  is there any impact to hanging this to an actual partition (that is much, much larger)15:26
mmercer|2so i so.... whoops, lol15:26
cloudnulland I think my use of inline comments in the readme, when pasted into config, forces those options to strings15:26
cloudnulljrosser ^15:27
jrosseryes it wasnt happy with the indentation of that just pasted striaght in either15:27
andymccri can yeah! that means old school meeting starting in 34 mins15:27
andymccrcloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, colinmcnamara, thorst, adreznec, eil397, qwang,nis15:27
andymccrhpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking, Tahvok, mnaser, nicolasbock15:27
andymccr^15:27
cloudnullmmercer|2 the aio script does that by default, you can move var/lib/nova to a real partition15:28
cloudnulljrosser yea looks like that first line needs another space15:28
jrossercloudnull: in fact is the config right? there are two elastic-logstash service sections15:28
mmercer|2cloudnull: gotcha, and then i would simply unmount the instances raw volume.  okies15:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Add openstack_openrc role to common test requirements  https://review.openstack.org/56862115:29
cloudnullyup15:29
cloudnulljrosser?15:29
evrardjpandymccr: old schoool is the best :)15:29
jrossercloudnull: https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics_6x <- i'm following the readme here15:30
cloudnulljrosser, ah, yes. there are two entries for elastic-logstash.15:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Update repo_build test-vars data  https://review.openstack.org/56858115:30
odyssey4mecores - I made a bit of a boobo which is causing some role tests to fail, please review https://review.openstack.org/568621 pronto15:31
evrardjpodyssey4me: we merged it so it's not only you:)15:32
hwoarangevrardjp: re https://blueprints.launchpad.net/openstack-ansible/+spec/openstack-distribution-packages what needs to be done to update its status?15:32
hwoaranglike approval status, direction etc. do we need to update any of that?15:32
hwoarangbecause i do not seem to have powerzz to update all the fields there15:33
odyssey4meevrardjp answered your comment15:33
evrardjpomg I am completely blind15:34
evrardjpI thought the two lists (before after) had different sizes.15:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Update repo_build test-vars data  https://review.openstack.org/56858115:35
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: DNM - Testing the ODL gates  https://review.openstack.org/56859015:36
jrossercloudnull: if you have a good haproxy_extra_services i can fix it up in the readme15:36
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Enable quota system and set qgroups  https://review.openstack.org/56842715:37
cloudnulljrosser https://gist.github.com/cloudnull/69bde16011d1ea94edf926252ea93933#file-user_lab_variables-yml-L111-L13715:38
jrossercloudnull: ta i'll give it a whirl15:38
*** gyee has joined #openstack-ansible15:39
mmercer|2hrm... am i overlooking something?  lxc list created a new cert and isnt showing me any of the containers15:41
cloudnullmmercer|2 - lxc-ls -f15:41
odyssey4memmercer|2 lxc list is part of lxd, not lxc... not sure why they did that15:41
odyssey4melxc-ls is for lxc15:41
mmercer|2oh... lol15:42
mmercer|2well isnt that confusing =D15:42
cloudnullwhat odyssey4me said - canonical made a mess there. I have no idea why15:42
mmercer|2ooh, neat, it summarizes the public and private ips too, nice15:42
mmercer|2so if i wanted to stop all instances for the moment (to change partition setup for /var/lib/nova)  what would be the cleanest way15:43
cloudnullyou shouldnt need to mess with the containers to do that.15:44
cloudnullstop nova-compute `systemctl stop nova-compute`15:44
cloudnulldo whats needed, `systemctl start nova-compute`15:44
odyssey4mecloudnull does nova-compute stopping stop all instances? I don't think so15:44
mmercer|2i havent created any yet =D15:44
cloudnulloh if there are instances then yea. you will need to power them down15:45
mmercer|2yeah, i havent gotten that far, im still in the exploratory phase15:45
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Ensure facts are updated for new containers  https://review.openstack.org/56862615:45
odyssey4meyou can use the utility container's CLI to list and stop instances15:46
odyssey4methe openstack CLI inside the utility container I mean15:46
odyssey4melxc-attach -n <utility container name>15:46
odyssey4methen openstack --os-cloud default ....15:46
mmercer|2ok, now that thats done.... i can go back and delete the nova.img since ive already moved it to a real partition15:47
odyssey4megood news, better apt update error messages coming soon in the next ansible 2.5 release :) https://github.com/ansible/ansible/pull/4014315:48
mmercer|2ok,  so right now, /var/lib/nova is on a larger partition,  the 'volume storage' is separate from this though, yes ?15:50
mmercer|2my goal is to have the raid volume act as the volume storage partition, not the instance partition15:51
mmercer|2but im not seeing anything customized for cinder storage mapping15:51
odyssey4mecloudnull posed a question in return in https://review.openstack.org/#/c/563641/615:51
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Change to using the package module instead of apt  https://review.openstack.org/56861515:53
cloudnullodyssey4me might make some sense to add that into the lxc container create role too15:54
cloudnullthis is whats happening in the nspawn role https://github.com/openstack/openstack-ansible-nspawn_container_create/blob/master/tasks/main.yml#L358-L362 - you think it'd be worth adding that to the lxc role too ?15:55
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833115:57
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Change to using the package module instead of apt  https://review.openstack.org/56861515:58
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833115:58
mmercer|2where is the default volume store partition ?15:59
*** johndaurte has joined #openstack-ansible15:59
mmercer|2i know it should be provided by cinder, and i have a cinder container, but i can't figure out where the volume store itself exists =D15:59
cloudnullits using the "cinder-volumes" VG15:59
odyssey4mecloudnull yeah, I think so - nice thing is that then limits don't need to be used for container creation16:00
cloudnullodyssey4me ++16:00
odyssey4mewell, the lxc_hosts don't need to be in the limit16:00
mmercer|2doh, hahaha16:00
andymccrok!16:00
andymccrmeeting time16:00
cloudnullmeeting time, the best of times!16:00
andymccr#startmeeting openstack_ansible_meeting16:00
odyssey4mecloudnull you gonna do it, or shall I?16:00
openstackMeeting started Tue May 15 16:00:50 2018 UTC and is due to finish in 60 minutes.  The chair is andymccr. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:00
andymccralways!16:00
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:00
cloudnullodyssey4me either way16:01
andymccr#topic rollcall16:01
*** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)"16:01
* cloudnull sits down for the meeting 16:01
andymccreverybody who is about put a hand in the air :D16:01
cloudnull /o presente16:01
andymccrand then with the other hand type on the keyboard to say youre here16:01
mmercer|2lol16:01
* mmercer|2 eavesdrops instead16:01
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Enable quota system and set qgroups  https://review.openstack.org/56843016:02
andymccrlets get started!16:02
andymccr#topic last weeks follow ups16:02
*** openstack changes topic to "last weeks follow ups (Meeting topic: openstack_ansible_meeting)"16:02
evrardjpo/16:03
andymccrso the main thing is: https://etherpad.openstack.org/p/YVR-openstack-ansible16:03
andymccrif you're going to Vancouver, or if you have anything to add to the agenda for Vancouver - please take a look and update the etherpad!16:03
evrardjpyeah not much other last week feedback :(16:03
andymccrsuper useful to have good topics for the feedback sessions etc.16:04
evrardjpagreed16:04
andymccralso the etherpad has some pretty good info on where/when things are - feel free to add to that!16:04
odyssey4meo/16:04
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add task to regather facts after run  https://review.openstack.org/56863216:05
andymccrthat's pretty much the only topic for last weeks highlights,  does anybody have anything new this week?16:05
hwoarango/16:05
mattto/16:05
andymccrotherwise we can move onto everybodies favourite time of the week. Bug Triage!16:05
andymccri'll give it a few mins16:06
andymccrok!16:07
andymccr#topic bug triage16:07
*** openstack changes topic to "bug triage (Meeting topic: openstack_ansible_meeting)"16:07
andymccras always: https://etherpad.openstack.org/p/osa-bugtriage16:07
andymccrfirst up!16:08
andymccr#link https://bugs.launchpad.net/openstack-ansible/+bug/177120016:08
openstackLaunchpad bug 1771200 in openstack-ansible "stable/pike (16.0.11): missing default for neutron_ovs_service_name" [Undecided,New]16:08
*** weezS has joined #openstack-ansible16:08
hwoaranglooks like this is WIP16:08
andymccrcould be already fixed16:09
andymccri see there was a recheck16:09
odyssey4meyep, it's busy checking16:09
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Add task to regather facts after run  https://review.openstack.org/56863516:09
andymccrthe fix seems ifne16:10
andymccrfine16:10
andymccrand the bug seems good so lets move on16:10
evrardjpit would be very nice if we could have a scenario later. But yes :)16:10
andymccrputting importance to high16:10
andymccrhaha yeah that has been a thing forever pretty much16:10
*** vakuznet has joined #openstack-ansible16:11
andymccr#link https://bugs.launchpad.net/openstack-ansible/+bug/176919516:11
openstackLaunchpad bug 1769195 in openstack-ansible "Ocata Series Release Notes in openstack-ansible" [Undecided,New] - Assigned to Jesse Pretorius (jesse-pretorius)16:11
hwoarangwhy does the bug title say 'relase notes' ?16:11
*** epalper has quit IRC16:11
hwoarangwhen this is about resolv.conf?16:11
andymccrhaha yeah16:11
odyssey4mebecause this is a bug in the release note, and an update happened after that16:12
andymccri was confused16:12
andymccrwell it seems like its under control, odyssey4me were you able to confirm it?16:12
odyssey4mehttps://review.openstack.org/#/q/I11d069e2d0cb3becad067689fa8f1e4c9391f368 got merged earlier, so this issue should be solved in new versions16:12
andymccrif its valid thats high/critical - but im guessing its already fixed16:12
andymccrwe're waiting on feedback so perhaps incomplete?16:12
odyssey4meincomplete, yeah16:12
odyssey4mewe have patches up to fix both the reno, and the lxc_hosts role... so it's pretty much incomplete now until we get an answer16:13
andymccrsweet16:13
andymccrdone16:13
andymccrnext!16:13
andymccr#link https://bugs.launchpad.net/openstack-ansible/+bug/175814416:13
openstackLaunchpad bug 1758144 in openstack-ansible "resolv.conf in containers set too late" [Undecided,New]16:13
andymccrpretty similar16:13
evrardjpincomplete indeed16:13
evrardjpyeah the bugs remaining are old ones nobody confirmed yet16:14
*** harryhuang_ has quit IRC16:14
evrardjpand nobody got the time to confirm16:14
odyssey4meno idea about this one16:14
andymccryeah not too sure16:14
andymccri feel like we need more info on that16:15
evrardjpyeah logan- had an idea but that's as far as I go16:16
andymccrguessing logan- isn't about16:16
logan-i don't have an idea, I just figured some things got rearranged in queens that breaks unbound. but i haven't done queens testing with unbound yet :/16:17
evrardjpok16:17
logan-correction, not breaks unbound, but maybe causes a race condition where the resolvers aren't set in the containers in time16:17
*** DanyC has joined #openstack-ansible16:18
openstackgerritMerged openstack/openstack-ansible-os_glance master: Move database creation into role  https://review.openstack.org/56848116:18
andymccrlogan-: perhaps we can ask for more info, like way to recreate etc?16:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Remove default pip_links value  https://review.openstack.org/56863716:18
odyssey4menot sure if dcdamien is about, as he registered the bug16:18
*** DanyC_ has joined #openstack-ansible16:19
andymccrahh nice16:19
logan-we might just need to add something like https://github.com/openstack/openstack-ansible/blob/b3c670faeba53eb00212deb1e197499959c40561/playbooks/repo-server.yml#L16-L20 to repo-use.yml16:20
andymccrlogan-: we could propose that as an idea and perhaps dcdamien can verify - would you mind putting a comment into that issue?16:20
logan-although that pretty much reverts the whole unbound "JIT" thing because it runs across all containers/hosts16:20
andymccrhmm16:21
logan-so another possibility is to revert https://github.com/openstack/openstack-ansible/commit/b3c670faeba53eb00212deb1e197499959c40561. I think it was meant as groundwork for container JIT creation but since that never happened, this commit isnt really needed16:21
*** DanyC has quit IRC16:22
*** rodolof has quit IRC16:23
*** rodolof has joined #openstack-ansible16:23
evrardjpI am not for or against JIT unbound, but right now I am wondering what its value16:24
evrardjpwhat is its* value16:24
logan-also if we decide to do systemd-resolved it changes this whole thing entirely16:24
logan-systemd-resolved in queens*16:24
logan-because you'd get rid of the resolvconf role execution and have to deal with other race conditions instead when the containers are being created16:25
evrardjplet's not talk about backporting new features in stable branches while I am close to going to bed, to avoid my future nightmares.16:25
evrardjp:D16:25
odyssey4mewith repo-use in place doing pip_install things on the containers, the strategy either needs to be to switch the repo-use things to JIT, or to switch the resolvconf things to repo-use16:25
logan-yeah i'm not sure what repo-use does, maybe just run the JIT using the same scoping (everything)16:25
evrardjpbasically you have the repo, then you point all the nodes to "use" it, that's repo-use. Sorry if I came up with that name.16:26
odyssey4merepouse re-runs the pip_install role to reconfigure pip to use the repo now that it's built... but pip_install in queens installs more things16:27
logan-ohh gotcha16:27
evrardjpso I think resolution should happen before16:27
evrardjpat container creation16:27
odyssey4mewe could also backport the thing in master which does the pip_install idempotently, so the second round is a noop except for the config change16:27
evrardjplet's just wait for input to know what's working and what's not working maybe?16:28
odyssey4methat would make repo-use not really need to do any resolving, and therefore solve the resolver issue16:28
logan-nice odyssey4me16:29
logan-that might do the trick16:29
andymccrso does somebody want to propose something in that bug? and/or a PR?16:29
odyssey4melemme take a look at this - I've got some issues for queens to solve relating to pip which touches repo-use16:29
*** vnogin has quit IRC16:29
andymccrok cool16:29
odyssey4meI've assigned it to me16:29
odyssey4meI'll fire up an unbound setup too - never done that before, so I'm curious. :)16:29
andymccrthanks odyssey4me!16:29
andymccrok16:30
andymccrlast one16:30
andymccr#link https://bugs.launchpad.net/openstack-ansible/+bug/174303216:30
openstackLaunchpad bug 1743032 in openstack-ansible "Galera cluster maintenance in OpenStack-Ansible" [Undecided,New]16:30
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Add task to regather facts after run  https://review.openstack.org/56863516:30
* odyssey4me runs away16:30
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add task to regather facts after run  https://review.openstack.org/56863216:30
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Change to using the package module instead of apt  https://review.openstack.org/56861516:31
andymccr*crickets* :P16:31
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Begin testing opensuse and centos with nspawn  https://review.openstack.org/56819716:32
evrardjpandymccr: :)16:32
*** vnogin has joined #openstack-ansible16:32
andymccrpart of me feels those docs should point to a galera doc about that16:32
andymccrits a 3 node galera cluster like any other16:32
*** pcaruana has quit IRC16:33
evrardjpwe completely changed the docs too16:33
*** vnogin has quit IRC16:33
andymccrahh16:33
andymccrmaybe that is done16:33
andymccrsince our new instructions do not match what is listed as wrong there16:34
evrardjpit has "Please also have a look at upstream starting a cluster page"16:34
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833116:34
evrardjpI think it's worth saying incomplete, and just get it over with16:34
odyssey4meyeah, we should reference the upstream docs and stop trying to maintain this stuff16:34
andymccrit explains the systemd bits better now16:34
andymccrbut yeah thats my opinion16:35
andymccrwe set it up and tell you how to set it up using our roles16:35
andymccrbut running it is something you should check on their website, we;re using base packages so nothing magical16:35
andymccrok cool16:36
andymccrthat's it for today16:36
andymccrthink we need to figure out a meeting chair for next week's meeting - any volunteers?!16:37
cloudnullI will be out the summit, I can take the following week though16:37
andymccrahh yeah16:37
andymccrof course, summit is next week!16:37
andymccrevrardjp: should we skip next week's?16:37
odyssey4meperhaps a good idea16:38
hwoarangsure16:38
evrardjpyes16:38
andymccrok cool. and cloudnull is up for the week after! (and since he's at the summit we can get a recap of summit activities yay)16:38
evrardjpwe should still roll the meeting chair16:39
evrardjpok16:39
evrardjpcool16:39
evrardjpthanks cloudnull16:39
cloudnull++16:39
andymccrthanks cloudnull!16:39
andymccron that note.16:39
andymccr#endmeeting16:39
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs"16:39
openstackMeeting ended Tue May 15 16:39:21 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:39
evrardjpthanks everyone!16:39
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-05-15-16.00.html16:39
andymccrgo team16:39
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-05-15-16.00.txt16:39
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-05-15-16.00.log.html16:39
jrossercloudnull: i got a bit further, it was inventory brok.16:39
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_nova master: Update to use oslo.messaging services for RPC and Notify  https://review.openstack.org/55862016:40
jrossercloudnull: next q though, i'm doing this on a queens deploy so not ansible 2.5, hence using the embedded version of 2.5. I figure i'm missing a ton of stuff from /etc/openstack-deploy if i don't use the openstack-ansible wrapper though?16:42
cloudnullyes, you'll be missing things.16:45
*** mbuil has quit IRC16:45
cloudnullhowever you can include what you need manually16:45
cloudnullin my deployment I didn't need to source any additional var files16:45
cloudnullbut if you did you can add "-e @...path..."16:46
jrosseri got group_vars and host_vars too, need to think about this16:46
*** mbuil has joined #openstack-ansible16:47
cloudnullyou can source all of the environment options16:50
cloudnull- /usr/local/bin/openstack-ansible.rc16:50
cloudnullor at least pull in what you need16:51
*** mbuil has quit IRC16:52
*** armaan has quit IRC16:53
*** armaan has joined #openstack-ansible16:54
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_cinder master: Update to use oslo.messaging service for RPC and Notify  https://review.openstack.org/56057416:58
*** exodusftw has quit IRC17:00
*** jra has joined #openstack-ansible17:05
*** mmercer|2 is now known as daemoen17:06
jraI'd like to manage internal OpenStack objects like flavors and images from Ansible as well. I know there are roles for these things in Ansible core, but is there a best practice for integrating these kinds of plays alongside openstack-ansible?17:07
*** gkadam has quit IRC17:07
prometheanfirejra: we do17:08
*** daemoen is now known as mmercer17:08
prometheanfirehttps://github.com/rcbops/rpc-openstack/blob/master/playbooks/openstack-image-setup.yml https://github.com/rcbops/rpc-openstack/blob/master/playbooks/openstack-flavor-setup.yml17:08
jra@prometheanfire - that's fantastic, exactly what I was hoping for! Thanks so much for sharing those playbooks17:09
*** mmercer has quit IRC17:09
prometheanfireyarp17:09
*** yolanda_ has quit IRC17:09
*** mmercer has joined #openstack-ansible17:10
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_keystone master: Update to use oslo.messaging service for RPC and Notify  https://review.openstack.org/56202617:10
jraDo I take it that you're sourcing the OS_ environment variables to authenticate those plays?17:10
*** shardy has quit IRC17:12
mmercerby default, is there anything in the cinder-volumes (i see it creates a lv pool....  which ill have to create), but im moving cinder volumes to a raid lvm group17:14
*** chhagarw has quit IRC17:15
*** rodolof has quit IRC17:17
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_neutron master: Update to use oslo.messaging service for RPC and Notify  https://review.openstack.org/56375817:19
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Remove the package cache update  https://review.openstack.org/56861517:19
*** yolanda_ has joined #openstack-ansible17:20
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Use fan out when deploying with nspawn  https://review.openstack.org/56833117:22
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_glance master: Update to use oslo.messaging services for RPC and Notify  https://review.openstack.org/56401517:25
*** armaan has quit IRC17:27
*** armaan has joined #openstack-ansible17:28
*** tosky has quit IRC17:33
*** tosky has joined #openstack-ansible17:38
*** mmercer has quit IRC17:38
*** jra has quit IRC17:50
openstackgerritMerged openstack/openstack-ansible-tests master: Add openstack_openrc role to common test requirements  https://review.openstack.org/56862117:51
*** kaiokmo has quit IRC17:52
openstackgerritMerged openstack/openstack-ansible master: Add mount options for better machinectl performance  https://review.openstack.org/55797017:55
*** dave-mccowan has quit IRC17:55
*** dave-mcc_ has joined #openstack-ansible17:56
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Correct contianer network creation and test it  https://review.openstack.org/56865518:03
*** tacoboy has joined #openstack-ansible18:04
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Correct contianer network creation and test it  https://review.openstack.org/56865518:16
openstackgerritChristian Zunker proposed openstack/openstack-ansible-os_cloudkitty master: Configure cloudkitty-api to use uwsgi  https://review.openstack.org/56716818:20
cloudnulljrosser did you get the elk components online ?18:26
cloudnullmmercer no, the vg is empty until cinder creates new volumes18:27
cloudnulljra those playbooks use shade and the clouds.yml file18:27
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_container_create master: Correct contianer network creation and test it  https://review.openstack.org/56865518:31
jrossercloudnull: not quite - i had to travel home18:40
jrosseri figure i just need to let it see the internal_lb address and the inventory and it shouldnt need anything else18:41
*** mma has quit IRC18:53
*** mma has joined #openstack-ansible18:53
*** mmercer has joined #openstack-ansible18:54
*** mma has quit IRC18:58
*** dmsimard|off is now known as dmsimard18:58
*** ansmith has quit IRC18:59
DimGRhowdy folks19:01
cloudnullo/ DimGR19:07
cloudnulljrosser it should all be fairly self contained.19:08
*** johndaurte has quit IRC19:17
*** radeks__ has quit IRC19:19
*** radeks_ has quit IRC19:20
jrossercloudnull: yeah actually it's easier than i thought19:20
*** mma has joined #openstack-ansible19:23
*** cmart has quit IRC19:23
jrossercloudnull: hrrm actually the connection plugin might be an issue/19:27
jrosser?19:27
*** mma has quit IRC19:37
*** armaan has quit IRC19:39
*** mma has joined #openstack-ansible19:41
cloudnullI havent had an issue with that so far.19:43
jrosserah well i think it's becasue my deployment is queens19:44
cloudnullbut it could be something that we need to address in the ansible embed19:44
cloudnullmy local deployment is rocky :)19:44
jrosseri'm just wiring the master version of the connection plugin into the embedded ansible19:44
cloudnullthat probably needs to happen19:44
*** cmart has joined #openstack-ansible19:56
*** mma has quit IRC19:58
*** cjloader_ has joined #openstack-ansible20:00
*** cjloader has quit IRC20:00
*** cjloader_ has quit IRC20:02
*** cjloader has joined #openstack-ansible20:02
*** cjloader has quit IRC20:13
*** cjloader has joined #openstack-ansible20:14
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Correct contianer network creation and test it  https://review.openstack.org/56865520:19
admin0hey DimGR .. i have a question20:23
admin0the kubernetics version .does it come from the platform (magnum) or does it come from the Atomic image ?20:24
DimGRits in the atomic20:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-ops master: Use Ansible 2.5 compatible version of connection plugin  https://review.openstack.org/56868920:36
jrossercloudnull: ^ connection plugin20:36
cloudnullvery nice!20:38
DimGRhows Milo20:38
DimGR:)20:38
cloudnullhe's great20:39
*** cjloader has quit IRC20:50
*** oneswig has joined #openstack-ansible20:52
openstackgerritMerged openstack/openstack-ansible-ops master: Use Ansible 2.5 compatible version of connection plugin  https://review.openstack.org/56868920:52
*** mma has joined #openstack-ansible20:55
*** cjloader has joined #openstack-ansible20:56
guilhermespjust to share: I ended up the day with a successful monasca installation on pike :D20:56
*** vakuznet has quit IRC21:05
openstackgerritMerged openstack/openstack-ansible-tests master: Update to use oslo.messaging services for RPC and Notify  https://review.openstack.org/55912721:15
cloudnullguilhermesp nice!21:26
cloudnullwas there much to fix ?21:26
*** jwitko__ has joined #openstack-ansible21:30
*** jwitko__ has quit IRC21:31
*** jwitko__ has joined #openstack-ansible21:32
*** jwitko_ has quit IRC21:34
*** ansmith has joined #openstack-ansible21:37
*** jwitko__ has quit IRC21:39
*** dmsimard is now known as dmsimard|off21:43
*** cmart has quit IRC21:44
*** esberglu has quit IRC21:50
*** cjloader has quit IRC21:52
*** mma has quit IRC22:00
*** mma has joined #openstack-ansible22:00
*** Brew has quit IRC22:01
*** oneswig has quit IRC22:04
*** mma has quit IRC22:05
*** kstev has quit IRC22:08
*** jwitko_ has joined #openstack-ansible22:34
*** vnogin has joined #openstack-ansible22:34
mmercerhehe.... that was definitely not the cleanest way of migrating that lvm volume pool.... in theory.... it should work though22:36
*** throwsb1 has quit IRC22:38
*** pmannidi has joined #openstack-ansible22:40
*** vnogin has quit IRC22:47
*** vnogin has joined #openstack-ansible22:56
*** vnogin has quit IRC23:00
*** SamYaple has quit IRC23:02
*** SamYaple has joined #openstack-ansible23:02
*** SamYaple has quit IRC23:04
*** SamYaple has joined #openstack-ansible23:05
*** SamYaple has quit IRC23:06
*** SamYaple has joined #openstack-ansible23:06
*** vnogin has joined #openstack-ansible23:11
*** vnogin has quit IRC23:15
*** dxiri_ has joined #openstack-ansible23:17
mmercerwoohoo, surgery complete -- my openstack environment is (should) be fully usable now =D23:18
*** dxiri has quit IRC23:21
*** weezS has quit IRC23:23
*** SamYaple has quit IRC23:24
*** SamYaple has joined #openstack-ansible23:24
*** tosky has quit IRC23:26
*** SamYaple has quit IRC23:30
*** dxiri_ has quit IRC23:31
*** dxiri has joined #openstack-ansible23:32
*** vnogin has joined #openstack-ansible23:47
*** vnogin_ has joined #openstack-ansible23:50
*** vnogin has quit IRC23:52
*** vnogin_ has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!