Monday, 2018-06-11

*** poul has joined #openstack-ansible00:06
*** poul has quit IRC00:10
*** poul has joined #openstack-ansible00:24
*** poul has quit IRC00:29
*** paulfantom has quit IRC00:38
*** poul has joined #openstack-ansible00:42
*** poul has quit IRC00:47
*** jeferobles has quit IRC00:47
*** jeferobles has joined #openstack-ansible00:48
*** poul has joined #openstack-ansible01:00
*** poul has quit IRC01:05
*** nurdie has quit IRC01:10
*** poul has joined #openstack-ansible01:18
*** hassenius has joined #openstack-ansible01:20
*** dxiri has joined #openstack-ansible01:23
*** poul has quit IRC01:23
*** hassenius has quit IRC01:25
*** jeferobles has quit IRC01:28
*** jeferobles has joined #openstack-ansible01:30
*** nurdie has joined #openstack-ansible01:31
*** poul has joined #openstack-ansible01:36
*** nurdie has quit IRC01:36
*** poul has quit IRC01:41
*** sak has joined #openstack-ansible01:45
*** sak has quit IRC01:49
*** sak has joined #openstack-ansible01:50
*** dxiri has quit IRC01:51
*** nurdie has joined #openstack-ansible01:52
*** nurdie has quit IRC01:56
*** jeferobles has quit IRC01:57
*** gregoryo has joined #openstack-ansible01:59
*** chyka has joined #openstack-ansible02:01
*** jeferobles has joined #openstack-ansible02:03
*** jeferobles has quit IRC02:03
*** jeferobles has joined #openstack-ansible02:04
sakHello, using latest release setup-infrastructure fails in play "Configure all nodes to use the repo container for phython/apt packages" in Task "test proxy url for connectivity"... Fatal SSH Error. Please help...02:07
sakOK for all physical hosts and Repo containers but all other containers show as unreachable... I can ssh into them directly without issue from the deployment host02:11
*** chyka has quit IRC02:11
*** dxiri has joined #openstack-ansible02:13
*** jeferobles has quit IRC02:20
*** jeferobles has joined #openstack-ansible02:22
*** poul has joined #openstack-ansible02:31
*** nurdie has joined #openstack-ansible02:34
*** poul has quit IRC02:35
*** jeferobles has quit IRC02:36
*** jeferobles has joined #openstack-ansible02:36
*** nurdie has quit IRC02:38
*** poul has joined #openstack-ansible02:49
*** poul has quit IRC02:54
*** nurdie has joined #openstack-ansible02:55
*** nurdie has quit IRC02:59
*** jeferobles has quit IRC03:01
*** jeferobles has joined #openstack-ansible03:03
*** poul has joined #openstack-ansible03:07
*** weezS has joined #openstack-ansible03:12
*** poul has quit IRC03:12
*** nurdie has joined #openstack-ansible03:15
*** poul has joined #openstack-ansible03:17
*** nurdie has quit IRC03:20
*** poul has quit IRC03:21
*** jeferobles has quit IRC03:27
*** jeferobles has joined #openstack-ansible03:28
*** dxiri has quit IRC03:31
*** poul has joined #openstack-ansible03:35
*** nurdie has joined #openstack-ansible03:36
*** Bhujay has joined #openstack-ansible03:37
*** poul has quit IRC03:39
*** nurdie has quit IRC03:41
*** yolanda has joined #openstack-ansible03:44
*** Bhujay has quit IRC03:44
*** weezS has quit IRC03:46
*** yolanda_ has quit IRC03:46
*** sak has quit IRC03:52
*** poul has joined #openstack-ansible03:53
*** jeferobles has quit IRC03:54
*** poul has quit IRC03:57
*** nurdie has joined #openstack-ansible04:04
*** weezS has joined #openstack-ansible04:10
*** poul has joined #openstack-ansible04:11
*** poul has quit IRC04:16
*** jbadiapa_ has joined #openstack-ansible04:20
*** poul has joined #openstack-ansible04:29
*** Bhujay has joined #openstack-ansible04:33
*** poul has quit IRC04:34
*** poul has joined #openstack-ansible04:47
*** Bhujay has quit IRC04:50
*** Bhujay has joined #openstack-ansible04:50
*** poul has quit IRC04:51
*** udesale has joined #openstack-ansible05:09
*** jeferobles has joined #openstack-ansible05:09
*** Taseer has quit IRC05:31
*** jeferobles has quit IRC05:36
*** jeferobles has joined #openstack-ansible05:39
*** udesale_ has joined #openstack-ansible05:40
*** udesale has quit IRC05:41
*** poul has joined #openstack-ansible05:42
*** poul has quit IRC05:47
*** radeks has joined #openstack-ansible05:52
*** weezS has quit IRC05:53
*** weezS has joined #openstack-ansible05:54
*** weezS has quit IRC05:54
*** jeferobles has quit IRC05:54
*** weezS has joined #openstack-ansible05:54
*** jeferobles has joined #openstack-ansible05:55
*** weezS has quit IRC05:55
*** weezS has joined #openstack-ansible05:55
*** weezS has quit IRC05:56
*** weezS has joined #openstack-ansible05:56
*** fghaas has joined #openstack-ansible06:00
*** poul has joined #openstack-ansible06:00
*** udesale__ has joined #openstack-ansible06:01
*** udesale_ has quit IRC06:03
*** poul has quit IRC06:04
*** weezS has quit IRC06:05
*** jeferobles has quit IRC06:05
*** biffi has joined #openstack-ansible06:07
*** biffi has quit IRC06:08
*** biffi has joined #openstack-ansible06:11
*** radeks has quit IRC06:11
*** poul has joined #openstack-ansible06:18
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_zun master: Add zuul jobs  https://review.openstack.org/57413906:21
*** poul has quit IRC06:22
*** pcaruana has joined #openstack-ansible06:26
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Add OpenStack Zun support to OSA  https://review.openstack.org/57140006:28
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_zun master: Add zuul jobs  https://review.openstack.org/57413906:30
evrardjpfolks, could we stop +w on only one +2 please?06:31
*** Taseer has joined #openstack-ansible06:37
*** mma has joined #openstack-ansible06:37
prometheanfirethat's happening?06:37
evrardjpyeah, ppl take the liberty of doing so.06:41
evrardjpit's generally fine, but I'd like it to be restricted to some edge cases06:41
prometheanfireyarp06:43
openstackgerritShangXiao proposed openstack/openstack-ansible-os_zun master: Add release notes link to README  https://review.openstack.org/57414206:47
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Set format options when prepairing filesystems  https://review.openstack.org/57230706:50
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_blazar master: This patch ensures that the functional tests for Blazar pass.  https://review.openstack.org/57138806:51
*** smorant has joined #openstack-ansible06:53
*** poul has joined #openstack-ansible06:58
*** armaan has joined #openstack-ansible07:01
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Use production like interfaces in the gate  https://review.openstack.org/55363607:01
*** hassenius has joined #openstack-ansible07:22
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_blazar master: This patch ensures that the functional tests for Blazar pass.  https://review.openstack.org/57138807:24
*** mbuil has joined #openstack-ansible07:25
*** hassenius has quit IRC07:27
*** maybebuggy has joined #openstack-ansible07:28
*** epalper has joined #openstack-ansible07:28
*** fghaas1 has joined #openstack-ansible07:30
*** fghaas has quit IRC07:30
*** armaan has quit IRC07:34
*** armaan has joined #openstack-ansible07:34
*** lvdombrkr has joined #openstack-ansible07:36
*** tosky has joined #openstack-ansible07:40
*** armaan has quit IRC07:44
*** armaan has joined #openstack-ansible07:45
*** radeks has joined #openstack-ansible07:45
hwoaranggood morning07:47
hwoarangcould i get another +2 on https://review.openstack.org/#/c/573629/ to resolve the random neutron failures?07:47
*** rodolof has joined #openstack-ansible07:48
*** rodolof has quit IRC07:48
*** DanyC has joined #openstack-ansible07:55
openstackgerritGaudenz Steinlin proposed openstack/openstack-ansible master: Use TCP mode for console if SSL is configured  https://review.openstack.org/57415307:55
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/57366107:58
Taseerevrardjp: Good morning. Can you please tell me what might be the cause for this => http://logs.openstack.org/88/571388/17/check/openstack-ansible-functional-ubuntu-xenial/43f029e/job-output.txt.gz#_2018-06-11_07_48_38_14677707:59
Taseerit fails while install keystone packages, saying my python environment is 2.7, while it is downloading for 3.508:01
*** pvradu has joined #openstack-ansible08:03
*** pvradu has left #openstack-ansible08:11
*** pvradu has joined #openstack-ansible08:11
*** shardy has joined #openstack-ansible08:11
*** pvradu has quit IRC08:14
*** electrofelix has joined #openstack-ansible08:16
*** pvradu has joined #openstack-ansible08:17
*** pvradu has quit IRC08:21
*** pvradu has joined #openstack-ansible08:21
evrardjpTaseer: you don't have the proper packages to build cryptography. build-essential, python-dev, and one I don't remember.08:27
evrardjpbut AFAIK, there is a way to install cryptography with wheels, so there is maybe something going on there.08:27
*** pvradu has quit IRC08:31
*** pvradu has joined #openstack-ansible08:34
hwoarangthat problem is hitting other roles too08:35
hwoarangi may have broken stuff08:35
*** Bhujay has quit IRC08:39
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_keystone master: vars: Add openssl devel packages  https://review.openstack.org/57417008:40
hwoarangevrardjp: odyssey4me a bit urgent ^^08:40
hwoaranglikely a few more roles are affected08:40
hwoarangTaseer: too^08:40
lvdombrkrhello folks, is there any issues if deployment host and target host is the same?08:41
*** radeks has quit IRC08:41
*** radeks has joined #openstack-ansible08:42
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/57366108:46
Taseerhwoarang: I see. how can we mitigate it ?08:46
hwoarangmy merging the patch08:46
hwoarang*by08:46
*** rodolof has joined #openstack-ansible08:47
*** nurdie has quit IRC08:51
Taseerhwoarang: If I had the priviliges, would have done with eyes closed !08:58
*** gregoryo has quit IRC08:59
evrardjplvdombrkr: nope that's what we do in AIOs.08:59
evrardjpTaseer: he meant locally :)09:00
evrardjphwoarang: let's discuss your patch09:00
*** radeks_ has joined #openstack-ansible09:00
evrardjpI am concerned about two things:09:00
hwoarangTaseer: you can do various workarounds to install the openssl devel before the pip builds09:00
evrardjp1) build-essential should probably be there, did you test without it, and it worked?09:01
evrardjp2) why do we need them in the first place?09:01
*** radeks has quit IRC09:01
Taseerhwoarang: I am testing on Ubuntu. openssl devel relates to CentOS, does it not ?09:01
evrardjphttps://pypi.org/project/cryptography/#files09:02
hwoarangwhy do we need what?09:02
evrardjphwoarang: who are you talking about?09:02
evrardjphwoarang: who are you talking with/about what?09:02
evrardjp:)09:03
hwoarang<evrardjp> 2) why do we need them in the first place?09:03
evrardjpyeah I am surprised we need openssl-dev09:03
hwoarangbuild/temp.linux-x86_64-2.7/_openssl.c:493:30: fatal error: openssl/opensslv.h: No such file or directory\n     #include <openssl/opensslv.h>\n09:03
hwoarangwhen building cryptography09:03
evrardjpyeah... and that's used for?09:03
evrardjpexactly my point :p09:03
hwoarangi dont understand09:03
evrardjpcryptography, starting from a certain version, is shipping wheels.09:04
evrardjpso installing it should be straightforward, and not require building anything09:04
hwoarangwe are building cryptography from source09:04
evrardjpbut why?09:04
*** pvradu has quit IRC09:04
*** pvradu has joined #openstack-ansible09:04
hwoarangbecause of that09:04
hwoaranghttps://github.com/openstack/openstack-ansible-tests/blob/master/test-vars.yml#L58109:04
evrardjpI remember that message...09:05
evrardjpbut at that time we didn't have distro packages.09:05
hwoarangi still do not understand i am sorry09:05
evrardjpso what if we remove that option everywhere, and install cryptography as a necessary distro package?09:05
evrardjpwhat if we try again?09:05
hwoarangi tried recently09:06
hwoarangand that was the reason of the tempest mess09:06
hwoarangthat has half of stuff from distro and half from pip09:06
hwoarangsome packages require a higher version of cryptography that's not available on distros09:06
*** pvradu has quit IRC09:06
evrardjphttps://github.com/pyca/cryptography/pull/381109:06
*** pvradu has joined #openstack-ansible09:07
evrardjphwoarang: ok so let's not have cryptography as distro09:07
evrardjpbecause bad idea then.09:07
evrardjpSo what about a proper wheel then?09:08
andymccrif anybody is about to review: https://review.openstack.org/#/c/566292/ would be appreciated :)09:08
hwoarangit didnt work the last time i tried, keystone was segfaulting09:08
andymccr(somebody that isnt jp haha)09:08
hwoarangon opensuse09:09
hwoarangdue to this symbol thing09:09
evrardjpbut like I said, the version of cryptography changed since then09:09
evrardjpso this shouldn't happen again?09:09
hwoarangwhen i said last time, i meant like a month ago09:09
hwoarangi dont know what to tell you right now09:10
hwoarangif we are not building anything and we are using wheels then maybe we can drop all the devel packages09:10
evrardjpthat's my point.09:11
hwoarangok i can't investigate that right now09:11
evrardjphow did you see the failure with the symbols trigger?09:12
*** pvradu has quit IRC09:12
hwoarangwell try to use keystone tempest with wheel cryptography09:12
*** pvradu has joined #openstack-ansible09:12
hwoarangbasically os_keystone and simply use wheel cryptography instead of building it from source09:12
*** radeks_ has quit IRC09:13
*** radeks_ has joined #openstack-ansible09:13
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Do not build cryptography  https://review.openstack.org/57418109:16
evrardjphwoarang: ok09:16
*** Bhujay has joined #openstack-ansible09:16
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: [DNM] Test do not build cryptography  https://review.openstack.org/57418209:18
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: [DNM] Test keystone with cryptography wheel build  https://review.openstack.org/57418309:19
*** radeks_ has quit IRC09:20
*** fghaas has joined #openstack-ansible09:23
*** fghaas1 has quit IRC09:24
*** fghaas has quit IRC09:26
*** nurdie has joined #openstack-ansible09:32
*** pvradu has quit IRC09:33
*** pvradu has joined #openstack-ansible09:33
*** nurdie has quit IRC09:37
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: Revert "vars: Do not install devel packages by default"  https://review.openstack.org/57419409:41
hwoarangevrardjp: andymccr^ it's best to do that for now and i will fix the roles to add the missing deps and then revert it back09:41
andymccrhwoarang: ack09:41
hwoarangos_keystone still fails because os_tempest fails and os_tempest needs os_keystone so there is a bit of a mess there09:41
andymccrmakes sense09:42
*** udesale_ has joined #openstack-ansible09:45
*** udesale__ has quit IRC09:47
*** pingfrog has joined #openstack-ansible09:48
evrardjp[m]hwoarang: maybe we should do cross gate checks with tempest and keystone09:49
hwoaranghow can we do that09:49
hwoarangcan you 'A depends on B' and 'B depends on A' ?09:49
*** udesale_ has quit IRC09:50
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_keystone master: vars: Add required devel packages  https://review.openstack.org/57417009:55
hwoarangevrardjp: even if we manage to fix the cryptography issue we still need the devel packages for other pip builds right?09:56
hwoarangbecause we dont have wheels for everything09:56
hwoarangright?09:56
hwoarangand openstack infra does not have wheels for opensuse423 at all09:56
evrardjp[m]it's generic linux amd64, right? suse should be okay?09:57
evrardjp[m]i expect these should only be in repo build node09:58
evrardjp[m]these= the necessary packages09:58
evrardjp[m]well I will see in more details later... in the meantime the revert is fine.09:59
hwoarangi am confused with the pip architecture to be honest10:00
hwoarangbecause we have this http://mirror.ca-ymq-1.vexxhost.openstack.org/pypi/packages/ but also thishttp://mirror.ca-ymq-1.vexxhost.openstack.org/wheel/10:01
evrardjp[m]i think it's fine to list the build deps where required and repeat ourselves if necessary10:01
hwoarangboth dirs contain wheels and sometimes we consume from the former some other times from the latter10:01
hwoarangmaybe the latter does not contain the same wheels with the former10:02
hwoaranganyway10:02
*** nurdie has joined #openstack-ansible10:14
*** nurdie has quit IRC10:18
*** lvdombrkr has quit IRC10:24
*** nicolasbock has joined #openstack-ansible10:39
*** hassenius has joined #openstack-ansible10:40
*** smorant has quit IRC10:51
*** pingfrog has quit IRC10:53
*** nurdie has joined #openstack-ansible10:55
*** fghaas has joined #openstack-ansible10:59
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Revert "vars: Do not install devel packages by default"  https://review.openstack.org/57419410:59
*** nurdie has quit IRC11:00
*** udesale has joined #openstack-ansible11:03
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Remove dependency on EPEL  https://review.openstack.org/57339111:05
*** bgmccollum has quit IRC11:11
*** udesale has quit IRC11:14
*** hassenius has quit IRC11:18
openstackgerritMerged openstack/openstack-ansible-repo_server master: Remove dependency on EPEL  https://review.openstack.org/57339011:20
*** hassenius has joined #openstack-ansible11:22
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq to the latest stable release  https://review.openstack.org/57220711:24
*** udesale has joined #openstack-ansible11:29
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/57366111:34
*** udesale has quit IRC11:35
*** rodolof has quit IRC11:37
*** pingfrog_ has joined #openstack-ansible11:37
*** shardy is now known as shardy_lunch11:37
*** rodolof has joined #openstack-ansible11:38
openstackgerritRobert Donovan proposed openstack/openstack-ansible-os_horizon master: Add support for the default_dns_nameservers variable, introduced in Newton, which allows you to specify default DNS servers populated when creating a tenant subnet.  https://review.openstack.org/57422711:45
openstackgerritRobert Donovan proposed openstack/openstack-ansible-os_horizon master: Add support for the default_dns_nameservers variable  https://review.openstack.org/57422711:53
openstackgerritRobert Donovan proposed openstack/openstack-ansible-os_horizon master: Add support for the default_dns_nameservers variable  https://review.openstack.org/57422711:54
*** nurdie has joined #openstack-ansible11:56
*** armaan has quit IRC11:57
*** armaan has joined #openstack-ansible11:58
*** pvradu has quit IRC11:59
*** pvradu has joined #openstack-ansible12:00
*** nurdie has quit IRC12:01
*** armaan has quit IRC12:02
*** nurdie has joined #openstack-ansible12:02
*** ivve_ is now known as ivve12:03
*** nurdie has quit IRC12:05
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: [DNM] Revert "Revert "vars: Do not install devel packages by default""  https://review.openstack.org/57423112:07
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_tempest master: vars: Add required devel packages  https://review.openstack.org/57423212:08
*** nurdie has joined #openstack-ansible12:14
*** shardy_lunch is now known as shardy12:16
*** armaan has joined #openstack-ansible12:18
*** armaan has quit IRC12:20
*** armaan has joined #openstack-ansible12:20
*** nurdie has quit IRC12:28
*** nurdie has joined #openstack-ansible12:28
*** nurdie has quit IRC12:33
*** udesale has joined #openstack-ansible12:38
*** pcaruana has quit IRC12:39
*** odyssey4me has quit IRC12:39
*** odyssey4me has joined #openstack-ansible12:39
*** ansmith has joined #openstack-ansible12:41
*** pylot has quit IRC12:44
*** chyka has joined #openstack-ansible12:45
*** weezS has joined #openstack-ansible12:45
*** sxc731 has joined #openstack-ansible12:47
mnasermorning12:48
_moep_morning12:48
*** hassenius has quit IRC12:48
*** chyka has quit IRC12:50
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Setup separate users for service RPC and Notify messaging  https://review.openstack.org/57301412:51
*** hassenius has joined #openstack-ansible12:52
evrardjpmorning mnaser _moep_12:54
*** weezS has quit IRC12:55
evrardjpmnaser ansmith hwoarang do you need any high prio review right now?12:59
hwoarangprob this one for me https://review.openstack.org/#/c/573629/ thanks12:59
ansmithevrardjp: hello, nothing high prio at the moment, will the qdrouterd repo be moving over soon?12:59
evrardjpk12:59
evrardjpansmith: it should be on its way12:59
ansmithperfect13:00
evrardjpansmith: https://github.com/openstack/ansible-role-qdrouterd this is already present13:00
evrardjpbut I am waiting for governance decision13:00
evrardjpthen I can introduce the first jobs13:00
evrardjpthen we can continue with its inclusion13:00
*** armaan has quit IRC13:01
*** armaan has joined #openstack-ansible13:01
ansmiththanks, just let me know if there is anything I can help with13:01
pingfrog_Hello all, I'm thoroughly new to this project so thank you hwoarang for commenting so promptly on my first change13:03
evrardjpansmith: I guess now we are at a point where we can clean up roles, re-wiring them properly, and removing the non-necessary group vars, so it's a slow work, but highly rewarding at the end13:04
mgariepymorning everyone13:04
evrardjppingfrog_: welcome to the team13:04
evrardjpmorning mgariepy13:04
evrardjphwoarang: did you see tempest results there: https://review.openstack.org/#/c/574181/ ?13:06
evrardjp(well not tempest, but gate results)13:06
evrardjpoh wait, maybe the other changes merged in the meantime13:06
*** udesale has quit IRC13:07
hwoarangpossibly13:07
mnaserpingfrog_: yay, welcome! :)13:07
hwoarangi need to move forward with the distro stuff for neutron and nova then i can look for optimizations again13:07
mnaserfwiw any jobs failing, please send them my way13:08
ansmithevrardjp: I am not sure if you had a chance to glance at https://review.openstack.org/#/c/57301413:09
mnaserhmm13:09
hwoarangmnaser: is rdo now a complete replacement for epel?13:09
mnaseri'm confused13:09
*** nurdie has joined #openstack-ansible13:09
hwoarangre uwsgi etc?13:09
mnaserhwoarang: not yet but we're working on it, they made a 'scratch' build of uwsgi rpms13:09
ansmithevrardjp: I noticed the aio_lxc-ubuntu job was still showing rabbit auth failures that were due notifications13:09
hwoarangmnaser: ok but you are removing epel from different repos is that ok to do it?13:09
mnasernot installable by yum repo but can be installing manaully13:10
mnaserhwoarang: unfortunately all my changes removing epel have resulted in epel still somehow being installed, lol13:10
mnaseri was going to try and see how it was going to break, but it didn't13:10
ansmithevrardjp: now that the transports are separate, users also need to be, it actually helps with debugging who is using the bus13:10
mnasersomething still installs epel-release and i dont know what it is13:10
hwoarangok13:11
hwoarangmnaser: epel is in the dib images13:11
hwoarangin the openstack images by default13:11
mnaseri thought it was disabled by default13:11
ansmithevrardjp: it also indicates that the notify transport_url might not want to be gated by *ceilometer_enabled as there are services sending notifications13:11
hwoarangi think you get it by default if I am not mistaken13:11
evrardjpmnaser: EPEL is installed in gates13:11
evrardjpin images*13:11
evrardjpansmith: yeah it's better that way13:12
evrardjpmnaser: sorry I realize hwoarang just said it13:12
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/57366113:12
evrardjpansmith: I am not sure to understand what you mean there, could you point me to the code?13:12
mnaserevrardjp: oh i see13:13
mnaserhwoarang: https://cbs.centos.org/koji/taskinfo?taskID=44383613:13
mnaserthey asked if we can use tat13:13
mnasernot sure if you have time to push up a wip patch that installs *those* uwsgi packages with an ensure epel-release is gone type of thing13:13
hwoarangmnaser: i am not familiar with this webpage but it looks like this is for the rocky builds right?13:13
hwoarangwhereas we are using the queens repo13:13
mnaserhwoarang: that is a 'manually' built set of uwsgi packages that rdo team built for us13:14
mnaserthey asked that we test those rpms from there manually13:14
*** nurdie has quit IRC13:14
hwoarangah ok13:14
mnaserif they are okay, they will likely publish them13:14
hwoarangmnaser:  i need to finish neutron+nova distro packages this week. then I can go back and look for more optimizations (including moving centos to voting)13:15
mnaserhwoarang: no problem, i will see if i can find some time to do this13:15
evrardjpansmith: I am thinking about migration path though, it's gonna be a nightmare with different users, though.13:15
*** udesale has joined #openstack-ansible13:15
mnaserlet me know if you need any help with reviews13:15
evrardjp(for upgrade)13:15
evrardjpand it's gonna break things13:15
*** zul has quit IRC13:15
evrardjplet me write that in the review13:16
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: [DNM] - Testing openSUSE nova role  https://review.openstack.org/49576713:18
openstackgerritRobert Donovan proposed openstack/openstack-ansible-os_horizon master: Add support for the default_dns_nameservers variable  https://review.openstack.org/57422713:19
*** zul has joined #openstack-ansible13:19
ansmithevrardjp: here is where user creation is gated https://github.com/openstack/openstack-ansible/blob/master/playbooks/os-nova-install.yml#L4313:19
ansmithevrardjp: and gating of transport_url for notifications in the .conf https://github.com/openstack/openstack-ansible-os_nova/blob/master/templates/nova.conf.j2#L8513:20
ansmithevrardjp: I am not sure I understand completely how upgrades work but we could always map an existing user into both the rpc and notify user13:22
jrossercloudnull: this is an issue https://github.com/openstack/requirements/search?q=elasticsearch&unscoped_q=elasticsearch beacsue of this https://www.elastic.co/blog/strict-content-type-checking-for-elasticsearch-rest-requests13:22
evrardjpansmith: what I mean is this:13:27
evrardjphttps://github.com/openstack/openstack-ansible/blob/899bc74a676bb9b14511ecf67628eccb1149e0d4/inventory/group_vars/nova_all.yml#L3513:27
evrardjpthat var can stay13:27
evrardjpI don't see why we are changing the tasks to add the notification if it's not necessary13:27
evrardjpis there a requirement to now notify at all times? I wasn't aware of this13:28
evrardjpd34dh0r53: were you working on selenium testing for horizon?13:29
*** rodolof has quit IRC13:30
*** rodolof has joined #openstack-ansible13:30
*** pcaruana has joined #openstack-ansible13:32
*** Bhujay has quit IRC13:35
evrardjpit's so painful to have so many distro gated, as we have timeout issues that are definitely outside our control13:39
*** jwitko has joined #openstack-ansible13:39
evrardjpI extended the timeout for tempest long ago, it helped, but it's not enough13:39
evrardjpI can't extend this to an insane amount13:40
hwoarangwhat distro jobs timeout?13:41
*** hassenius has quit IRC13:42
evrardjpwell it's random13:42
evrardjpit depends on which one get ovh :p13:42
evrardjpbecause of our hack to use qemu instead of kvm13:42
evrardjpfor ovh nodes13:42
evrardjpjohnsom: do you, by any chance, know if we can revert that hack?13:43
evrardjpAre the kernels from OVH fixed?13:43
*** rodolof has quit IRC13:47
*** rodolof has joined #openstack-ansible13:47
*** hassenius has joined #openstack-ansible13:48
*** nurdie has joined #openstack-ansible13:50
*** sxc731 has quit IRC13:50
*** sxc731 has joined #openstack-ansible13:51
*** cjloader_ has quit IRC13:51
cloudnullmornings13:51
cloudnulljrosser, what's that ?13:52
jrosserthe version of elasticsearch pip package that gets installed is quite old13:53
*** shardy has quit IRC13:53
*** shardy has joined #openstack-ansible13:53
jrosserand all the 6.x stuff appears to be much more strict about the form of the requests made to it13:54
cloudnullah.13:54
cloudnullso do we need elasticsearch>2.4.113:54
cloudnullha https://pypi.org/project/elasticsearch/13:55
cloudnulllooks like they're on 6x on pypi13:55
*** nurdie has quit IRC13:55
hwoarangcores: any opinions on https://review.openstack.org/#/c/573754/ ?13:55
jrosseryeah that :) i've been seeing exceptions related to missing content-type13:55
hwoarangi'd like to get that in to test distro installations properly13:55
hwoarangs/properly/more realistically/13:56
cloudnulljrosser I wonder if we can use a modern package there?13:56
jrossercloudnull: if you git-blame on a this you see the content-type stuff was added recently, and isnt in 2.4.1 https://github.com/elastic/elasticsearch-py/search?q=content-type&unscoped_q=content-type13:56
jrosserwe're just having a go at wedging in the latest version and see what happens13:56
cloudnull# /openstack/venvs/neutron-17.0.5/bin/pip list | grep elast13:59
cloudnullelasticsearch (6.2.0)13:59
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56753014:00
cloudnulllooks like I've had a modern version installed :)14:00
jrosseris that becasue of doing it with the ad-hoc command in the ops repo?14:00
cloudnullyup14:00
*** hasseniu_ has joined #openstack-ansible14:00
jrosseryeah thought that might happen - perhaps explains why i've had difficulty14:01
cloudnull# ansible -m shell -a 'find /openstack/venvs/* -maxdepth 0 -type d -exec {}/bin/pip install osprofiler elasticsearch --isolated \;' all --forks 2514:01
cloudnullthat's what I had run before14:01
cloudnullIve not rebuilt the venvs14:01
jrossersure, i guess a proper solution is needed for the patch to the horizon role though14:01
*** ianychoi has quit IRC14:02
cloudnullIf I rebuild the venvs it'll pull in 2.4.114:03
jrosseryeah, i think "dont do that" is a good plan14:03
cloudnullhttp://paste.openstack.org/show/723202/14:03
*** hassenius has quit IRC14:04
cloudnullIf I add a global constraint it should do the right thing14:04
*** dxiri has joined #openstack-ansible14:04
jrosserah i see, yes14:04
*** armaan has quit IRC14:05
cloudnullevrardjp is requesting a change to the package inclusions, https://review.openstack.org/#/q/topic:osprofiler+(status:open+OR+status:merged) maybe we just make a general purpose list for osprofiler allowing folks to override it in user_variables14:05
*** throwsb1 has joined #openstack-ansible14:06
*** armaan has joined #openstack-ansible14:06
cloudnullseems I need to adjust those includes to be optional.14:07
jrossermy only thoughts on that were the "cost" of enabling profiling14:09
jrosserand the how willing folks would be to rebuild their venvs/redeploy stuff in order to then do --os-profile14:10
cloudnull++ I'm not sure.14:10
cloudnullosprofiler is in all openstack services.14:10
cloudnullit just doesn't have the package installed by default14:10
johnsomevrardjp: nope, still broken and some evidence that the new limestone hosts have started.14:11
cloudnullIMHO it makes sense to just include it and allow the deployer to define the config section as needed.14:11
*** zul is now known as zul_14:11
jrosseri figure you don't really want to use this stuff until you are in a fix of some kind14:12
cloudnull++14:12
cloudnullI tend to agree.14:12
cloudnullevrardjp what say you ?14:12
jrosserand then you might be really quite unwilling to change much14:12
*** sxc731 has quit IRC14:13
*** esberglu has joined #openstack-ansible14:14
*** zul_ is now known as zul14:14
*** rodolof has quit IRC14:16
*** maybebuggy has quit IRC14:16
*** rodolof has joined #openstack-ansible14:16
cloudnulld34dh0r53 https://review.openstack.org/#/c/573797 if you get a moment14:18
cloudnulld34dh0r5314:18
cloudnulld34dh0r53 ding14:18
cloudnulld34dh0r53 ding14:18
cloudnulld34dh0r53 ding14:18
cloudnulld34dh0r53 ding14:18
cloudnulld34dh0r53 sits next to me at the office14:19
cloudnulld34dh0r53 compute says "Ding!"14:19
*** chhagarw has joined #openstack-ansible14:20
d34dh0r53ARGHTHEHRHG!!!!14:20
cloudnulld34dh0r53 ding14:20
*** rodolof has quit IRC14:22
*** pingfrog_ has quit IRC14:22
*** rodolof has joined #openstack-ansible14:22
*** hassenius has joined #openstack-ansible14:22
logan-johnsom: limestone hosts started what?14:24
nicolasbockAny hints on how to replace the hard-coded branch reference in tox.ini? (https://review.openstack.org/#/c/573812/)14:24
nicolasbockHi by the way :)14:24
cloudnullo/ nicolasbock14:24
nicolasbockHey, how are you cloudnull ?14:25
cloudnullnicolasbock doing well, and you ?14:25
cloudnullon the hard coded branch tox, you could use an environment variable14:25
nicolasbockI am doing great. Suffering a bit from acute trail closure due to drought though... :(14:25
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: zuul.d: jobs: Trigger functional jobs on tox.ini changes  https://review.openstack.org/57427614:26
nicolasbockHow do I get that into the tox.ini file though?14:26
*** hasseniu_ has quit IRC14:26
cloudnullnicolasbock you could add something like so https://github.com/rcbops/rpc-maas/blob/master/tox.ini#L3214:27
johnsomlogan-: Crashing qemu when kvm is enabled instead of tcg14:27
cloudnullwhich is used like https://github.com/rcbops/rpc-maas/blob/master/tox.ini#L35 and https://github.com/rcbops/rpc-maas/blob/master/tox.ini#L71-L7814:27
jrossercloudnull: elasticsearch 2.4.1 -> bad, 6.2 -> good14:28
cloudnull ++14:28
nicolasbockok thanks cloudnull !14:28
cloudnulljrosser, in your opinion, whats the easiest path forward to getting this kinda change into the system.14:29
cloudnullshould we make it a global variable ? document it in the ops repo?14:30
cloudnullnp nicolasbock I hope that works, let us know.14:30
cloudnulld34dh0r5314:30
logan-johnsom: let me know if I can help debug it somehow. limestone is running an almost all defaults osa pike install. do you have any idea what might be causing it? host kernel or qemu versions maybe?14:30
*** cjloader has joined #openstack-ansible14:30
cloudnullDING!14:30
d34dh0r53lol14:30
logan-johnsom: just to make sure I understand... what you're saying is nested virt isnt working correctly?14:30
nicolasbockThanks cloudnull I will!14:30
jrossercloudnull: i'd like to be sure that the underlying libs just shouldnt be installed by default, even if the config is missing14:31
evrardjpcloudnull: I don't think there is a need for something so different, we can use the standard way to have packages that are optionally loaded14:32
johnsomlogan- Yes.  Just a second and I will see if I can point you at a log file14:32
evrardjpcloudnull: like this: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/vars/main.yml#L34-L55 if osprofiler_enabled -> boom add ES and osprofiler14:32
evrardjpneutron_osprofiler_enabled in this example14:33
*** nurdie has joined #openstack-ansible14:33
johnsomlogan- This is an example log from the Octavia project: http://logs.openstack.org/58/571358/4/check/octavia-v1-dsvm-scenario/66f292c/logs/libvirt/qemu/instance-00000001.txt.gz14:34
cloudnullevrardjp but do we really need it to be an optional library given that it is in the default service config for all openstack services14:34
johnsomlogan- Note the "accel=kvm" in the command line.  Also, this was attempting to boot a cirros image, but booting Ubuntu images causes the same behavior.14:34
cloudnullif so, I will get to implementing it in those patches ASAP.14:35
evrardjpcloudnull: I don't see why ppl need elasticsearch installed in all installs14:35
cloudnullits just the lib14:35
evrardjpwell in fact, I see a place where it actually hurts14:35
evrardjpI know it's just the lib14:35
johnsomlogan- It is super unfortunate as before this started using KVM takes ~50 minutes off our test runs.14:35
cloudnullits not enabling the functionality14:35
evrardjpelse you'd have put java and all that jazz14:35
cloudnullno.14:35
cloudnullits a python lib14:36
logan-johnsom: did this just start happening recently?14:36
*** sxc731 has joined #openstack-ansible14:36
cloudnullservices like magnum already have osprofiler installed https://github.com/openstack/openstack-ansible-os_magnum/blob/master/defaults/main.yml#L11714:37
evrardjpcloudnull: I know that's what I meant, I said "I know it's just a lib, else you'd have to put java and all that hazz"14:37
evrardjpjazz*14:37
cloudnullah.14:37
evrardjpthat's not a good example14:37
johnsomlogan- It started at OVH about a year ago now, but limestone is a new host provider.  I saw a few good runs with them and this one showed up.14:37
evrardjp: p14:37
cloudnullit is an example though :)14:37
evrardjpwell let's say it's a bad one : )14:37
evrardjp:p14:37
evrardjpI don't see why this new feature would not be opt-in, as we usually do14:38
cloudnullalmost all of the services have osprofiler in the paste config14:38
cloudnullhttps://github.com/openstack/openstack-ansible-os_glance/blob/master/templates/glance-api-paste.ini.j2#L314:38
evrardjpbut I agree I'd prefer if we have a one bit flip to enable it globally, or more surgically if I want to14:38
evrardjpyeah osprofiler was pushed for14:39
logan-johnsom: yeah limestone is relatively new. I brought it online in March. also, no updates have occurred since late March. so if something broke lets say a week or two ago, Im thinking its something that changed inside the test nodes which has a bad interaction with the hypervisor14:39
cloudnullthought the lib to enable that pipeline is not present14:39
johnsomlogan- Yeah, we are having a hard time tracking down if it is something with the base host hardware, maybe on just a few in the pool, or if it's something infra is doing inside the image they use, etc.14:40
cloudnullI can make it optional. Happy to do so, I just dont want to make it all optional only to have to change it all again.14:40
jrosserperhaps some of this is really all down to what you'd want the user experience to be14:40
evrardjpcloudnull: wait a minute then14:41
evrardjpwe'll make all other ppl vote :)14:41
jrosserto get from "why can't i use --os-profile" -> "oh look theres my profi8le data"14:41
cloudnull++14:41
johnsomlogan- Here is an older example at limestone that ran fine: http://logs.openstack.org/58/571358/2/check/octavia-v2-dsvm-scenario/eab6b3d/controller/logs/libvirt/qemu/instance-00000001_log.txt.gz14:41
evrardjpI am fine with the fact we decide together14:41
johnsomlogan- Oh, odd, ok, that was running tcg14:41
johnsomlogan- Hmm, so maybe it never worked at limestone and I just saw a job that didn't have KVM enabled.14:42
evrardjposprofiler doesn't mean ES per se, right?14:42
evrardjpso maybe we can have elasticsearch_profiler instead14:43
openstackgerritMerged openstack/openstack-ansible-ops master: Set threadpool tuning and fstype  https://review.openstack.org/57379714:43
cloudnullthanks d34dh0r5314:43
evrardjpcloudnull: also that would be cool to pin it to a certain version14:44
evrardjpelasticsearch I mean14:44
d34dh0r53np cloudnull14:44
evrardjpexcept if 2.4.1 is okay for you14:44
evrardjpbut python-elasticsearch is 5.2.0 now IIRC14:45
cloudnullits pinned to 2.4.1 in global requirements.14:45
evrardjpso for example, if we install it with distro packages, we might have silent breakages, because we don't test the feature properly14:45
cloudnullthough 6.2.0 seems to work fine14:45
jrosserfor me 2.4.1 breaks14:46
evrardjpis it 6.2.0? fff that flies.14:46
evrardjpjrosser: oh great.14:46
cloudnullhttps://pypi.org/project/elasticsearch/14:46
evrardjpso now you're overriding your versions for making it work14:46
evrardjpcloudnull: yup I just based it on my memory :)14:46
jrosserthe version of elasticsearch-py needs to match the major version numbering of the ELK stack14:46
evrardjpwell bringing it in is bad idea14:47
evrardjpit sets false expectations14:47
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/56753014:47
evrardjp"it should work now" "oh but I need to install latest version" "oh now I need to override the constraints for it, nothing should go wrong, right?"14:48
*** jafeha has joined #openstack-ansible14:50
logan-johnsom: well for just step 1 troubleshooting I checked that kvm_intel has the nested parameter enabled on every compute host. they do. so gonna have to do some more digging but i really suspect something with older host kvm/qemu/etc having problems with the newer versions of that stuff in the test nodes. Ill try to find some time to get that little cloud updated to queens soon.14:52
hwoarangcores: neutron + distro packages is ready for review https://review.openstack.org/#/c/573661/14:54
hwoarangmbuil ^14:54
*** mma has quit IRC14:57
*** mma has joined #openstack-ansible14:57
openstackgerritMerged openstack/openstack-ansible-tests master: test-distro_install-vars: Add new var file for distro installations  https://review.openstack.org/57375415:00
mbuilhwoarang: good!15:01
*** mma has quit IRC15:02
evrardjphwoarang: good job.15:02
johnsomlogan- Awesome. Let me know if the Octavia team can help, we would really like to have KVM as an option.  (Ansible team as well)15:02
*** chyka has joined #openstack-ansible15:02
hwoarangi'd appreciate some reviews on https://review.openstack.org/#/c/574276/ so i can properly test changes in the tox.ini file15:03
evrardjpoh that's right15:03
evrardjpthat shouldn't be there15:03
evrardjpgood catch hwoarang15:04
spotzHey we have anyone here that can answer a red hat question?15:07
spotzI know hwoarang and cloudnull are our suse fans:)15:08
hwoarangspotz: you prob need mnaser15:14
mnaserhi15:14
*** radeks has joined #openstack-ansible15:14
spotzHey mnsaer - I got hit up by someone through FC. Do you always have to use ip netns to connect to instances on red hat?15:15
spotzThat's my experience but he configured DVR and isn't sure it's configured correctly15:15
mnaserspotz: only if you want to enter it from the control plane15:15
mnaseryou shouldn't have to15:15
openstackgerritCam J. Loader proposed openstack/openstack-ansible-os_ironic master: Add glance auth information to ironic.conf for communication  https://review.openstack.org/57382215:15
spotzmnaser: He's trying to reach it from the compute/controller15:16
mnaserit should work fine if the control plane is sitting on the same network15:16
mnaseris it a tripleo deploy15:16
spotzpackstack and everyone was asleep on the rdo channel:)15:16
*** DanyC has quit IRC15:17
spotzHe logged out, but if he shows up again tomorrow I'll let him know. It's what I've experienced in my labs but those are all AIOs15:18
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Remove dependency on EPEL  https://review.openstack.org/57338515:18
mnaserah i see15:18
mnaserfeel free to have him ping me15:18
spotzThanks mnaser, And I'll be playing with tripleo again the next few weeks so will need to brush up on my red hat15:19
openstackgerritCam J. Loader proposed openstack/openstack-ansible-os_ironic master: Add glance auth information to ironic.conf for communication  https://review.openstack.org/57382215:21
*** jeferobles has joined #openstack-ansible15:22
openstackgerritCam J. Loader proposed openstack/openstack-ansible-os_ironic master: Add glance auth information to ironic.conf for communication  https://review.openstack.org/57382215:23
*** radeks has quit IRC15:24
*** hassenius has quit IRC15:24
*** radeks has joined #openstack-ansible15:24
*** hassenius has joined #openstack-ansible15:25
cloudnullevrardjp So I'm in agreement with jrosser, if the packages are installed by default the deployer has options to profile a cloud without a lot of change. if they're not installed venvs have to be rebuilt to enable the functionality optionally.15:25
cloudnulland IMHO while profiling a cloud might be nice as a rule, its really useful when debugging .15:26
cloudnullso forcing a deployer to enable optional functionality which requires a rebuilding everything and restarting everything seems like a poor user experience15:27
cloudnullespecially if the deployer is reaching for this functionality in an effort to troubleshott15:27
cloudnull* troubleshoot15:27
cloudnullif the lib is just there, the only thing needed to enable said functionality is the service config. which does require a restart/reload, but is a lot easier pill to swallow than rebuild and restart all the things.15:29
* cloudnull my 2 cents, though would love additional thoughts on the matter. 15:29
*** radeks has quit IRC15:30
*** Leo_m has joined #openstack-ansible15:37
tomtom001hello, just did a fresh install of the queens version....  my controllers seem to have to oom kill a bunch of stuff and then become unreachable.  Anyone who has installed queens run into any services that cause memory to be used up?15:38
*** armaan has quit IRC15:39
evrardjptomtom001: how much ram do you have?15:39
tomtom001They have 16GB of ram15:40
tomtom001is that enough?15:41
*** fghaas has quit IRC15:44
openstackgerritMerged openstack/openstack-ansible-tests master: Remove dependency on EPEL  https://review.openstack.org/57338915:44
*** jeferobles has quit IRC15:46
evrardjptomtom001: for an aio yes15:47
evrardjpjust enough15:47
evrardjpdepends on what you put on it15:47
evrardjpif you put many services at some point it will struggle15:48
evrardjpcloudnull: what does this mean for people using redis or mongo, or for ppl needing python-es 6.2?15:50
hwoaranghas anyone noticed nova failures in the "Synchronize the nova API DB schema" ?15:50
hwoaranghttp://logs.openstack.org/30/567530/5/check/openstack-ansible-functional-distro_install-ubuntu-xenial/55e1617/job-output.txt.gz#_2018-06-11_15_45_06_49119715:50
evrardjpintegrated?15:51
openstackgerritzhulingjie proposed openstack/openstack-ansible master: fix tox python3 overrides  https://review.openstack.org/57431315:52
tomtom001evrardjp: ok that is the most likely issue then, so to run a "staging" environment that is simply a smaller version of my prod system how much ram would be recommended?  I am installing all services from the setup-openstack playbook except for tacker and molteniron.15:53
*** electrofelix has quit IRC15:53
*** rodolof has quit IRC15:53
*** dxiri_ has joined #openstack-ansible15:53
*** dxiri has quit IRC15:53
*** pvradu has quit IRC15:55
*** DanyC has joined #openstack-ansible15:58
openstackgerritCam J. Loader proposed openstack/openstack-ansible-os_ironic master: Add glance auth information to ironic.conf for communication  https://review.openstack.org/57382216:00
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: lxc_install_dnf: Fix symlink  https://review.openstack.org/57431716:00
hwoarangcores: ^^ a quick one please16:00
cloudnullevrardjp I don't believe redis requires any extra libs to make osprofiler work. I guess we could include py-mongo too, though at this point I don't know anyone use that or want to use that.16:00
*** vnogin has joined #openstack-ansible16:01
evrardjpwe need to fix the no space left on device16:01
evrardjpcloudnull: but if I want to use ceilometer with osprofiler, there is no lib either16:01
cloudnullevrardjp - re nospace left on device - https://review.openstack.org/#/c/572307/16:01
evrardjpI don't see the point of adding the lib16:01
cloudnullevrardjp if you wanted to use osprofiler and ceilometer you would need osprofiler installed16:02
cloudnullotherwise it wont work16:02
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible-os_blazar master: This patch ensures that the functional tests for Blazar pass.  https://review.openstack.org/57138816:02
openstackgerritzhulingjie proposed openstack/openstack-ansible-os_aodh master: fix tox python3 overrides  https://review.openstack.org/57431916:02
evrardjposprofiler yes16:02
*** DanyC has quit IRC16:02
evrardjpold elasticsearch meh16:03
cloudnullthe three known backends for osprofiler are ceilometer, redis, elasticsearch16:03
evrardjpand you still need to enable it in the config16:03
evrardjpright?16:03
cloudnullyup16:03
evrardjpso why not having this based on var?16:03
evrardjp :p16:03
cloudnulla service restart is a lot less intrusive than having to rebuild and restart everything16:03
evrardjpI re-iterate my question, can't we make that optional?16:04
evrardjpif user is using osprofiler + ES, then build the thing, and he can switch it on and off when he needs to16:04
evrardjpif the user wants osprofiler + ceilometer, he can switch it on and off when he needs to16:05
cloudnullwe can. though the argument is that if your profiling something its likely due to having an issue with something and rebuilding it all in order to enable this functionality is less than idea from an operator standpoint16:05
cloudnull**ideal16:05
evrardjpwhy?16:05
evrardjpyou still have to restart the service anyway16:05
cloudnulladding config with a service restart is akin to setting debug16:05
cloudnullwhile rebuilding the venv replaces the runtime16:06
evrardjpwell it shouldn't16:06
cloudnullwhy would it not?16:06
cloudnullit has to rebuild the venv16:06
*** radeks has joined #openstack-ansible16:06
evrardjpbut the venv is supposed to be built with the same things16:06
cloudnullstore it on teh repo server, download it, expand it, and restart the service16:06
evrardjpjust the extra elasticsearch for your case for example16:06
cloudnulland osprofiler16:07
cloudnullthe two packages have to be installed16:07
cloudnullin my case16:07
evrardjpas a person running osprofiler + ceilometer, I don't care about elasticsearch version superold16:07
evrardjpas a user of osprofiler + elasticsearch, I need a new version of elasticsearch, incompatible with constraints16:08
evrardjpnone of that seems very nice to me16:08
cloudnullin order to have any of it  osprofiler has to be present16:08
evrardjpwhile I can agree with osprofiler being included, I have trouble with ES16:08
cloudnullat a minimum16:08
evrardjpI agree with that16:08
evrardjpit's kinda weird we don't have it if we have the api-paste16:09
cloudnullits just ignored in the service start given that the config is not enabled.16:09
evrardjpwhile nobody really complained about it, and I don't know the impact of it if the lib is available and no config is done (is it enabled by default on everything non sql or disabled by default?)16:09
cloudnullbut if you enable the config the service will refuse to start without the osprofile lib16:10
evrardjpok16:10
*** mbuil has quit IRC16:10
cloudnullits disabled by default16:10
evrardjpso let's meet halfway, we add osprofiler, we remove python-elasticsearch16:11
cloudnullok. I can do that16:12
*** epalper has quit IRC16:13
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: [DNM] Test keystone with cryptography wheel build  https://review.openstack.org/57418316:13
evrardjpcloudnull: on a later commit, we can make it smart in terms of osprofiler backends16:13
evrardjpthe same way we do with neutron16:14
* cloudnull was just going to write something similar 16:14
tomtom001hey evrardjp, do you think 32GB or 64GB would be good to run all the services?16:14
cloudnulllet me whip up a prospect change to see if we can agree on a pattern. Then I'll update all the things16:14
cloudnulljrosser ^16:14
evrardjptomtom001: what do you run ?16:15
jrosserok16:15
*** poul has quit IRC16:15
evrardjpalso why not using ceilometer?16:15
evrardjpI am surprised16:16
tomtom001evrardjp: I run all the services even octavia and barbican, I don't run molteniron or tacker, but may want to in the future.  heat, sahara, trove, etc... are all ON the list.16:16
*** vnogin has quit IRC16:22
cloudnullevrardjp if you can make ceilometer work , im sure more would use it16:23
*** agrebennikov has joined #openstack-ansible16:24
cloudnullthough in this case we have elasticsearch which can correlate application, system, and now openstack profile metrics into a single backend.16:24
cloudnulland with x-pack enabled graph will build associations into the data giving deployers a lot insight into the stack. which is not only openstack focused.16:25
*** jeferobles has joined #openstack-ansible16:25
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Revert "Ensure LBaaSv2 deployment is tested"  https://review.openstack.org/57362916:29
openstackgerritMerged openstack/ansible-config_template master: Allow default section in ini to be specified  https://review.openstack.org/56629216:29
*** jeferobles has quit IRC16:29
*** shardy has quit IRC16:33
*** jra has quit IRC16:39
*** jra has joined #openstack-ansible16:39
*** sxc731 has quit IRC16:42
*** esberglu has quit IRC16:55
*** poul has joined #openstack-ansible16:56
*** udesale has quit IRC16:56
*** fghaas has joined #openstack-ansible16:57
jrosseri would like to move this forward if anyone has time to review https://review.openstack.org/#/c/568276/916:57
*** armaan has joined #openstack-ansible16:57
*** poul_ has joined #openstack-ansible16:57
spotzjrosser: looking16:58
jrosserthankyou :)16:59
spotzjrosser: NP, good luck with the gates:)17:01
jrosserindeed!17:01
*** poul has quit IRC17:01
*** gyee has joined #openstack-ansible17:03
*** DanyC has joined #openstack-ansible17:03
*** pingfrog_ has joined #openstack-ansible17:04
*** poul has joined #openstack-ansible17:07
*** poul_ has quit IRC17:10
*** armaan has quit IRC17:13
*** armaan has joined #openstack-ansible17:14
*** jra has quit IRC17:14
*** jra has joined #openstack-ansible17:15
*** poul_ has joined #openstack-ansible17:20
*** jra has quit IRC17:20
*** jra has joined #openstack-ansible17:21
*** armaan has quit IRC17:22
*** armaan has joined #openstack-ansible17:23
*** poul has quit IRC17:23
*** armaan has quit IRC17:27
*** armaan has joined #openstack-ansible17:27
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_swift master: Update to use oslo.messaging service for Notify  https://review.openstack.org/57435917:33
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_aodh master: Add packages required for osprofiler  https://review.openstack.org/57349617:42
cloudnulljrosser evrardjp ^ mind having a look17:42
cloudnullif that pattern is acceptable I will make a change to the other various roles17:42
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-openstack_hosts master: SUSE: Add support for openSUSE Leap 15  https://review.openstack.org/57229317:49
*** armaan has quit IRC17:52
openstackgerritMerged openstack/openstack-ansible master: Set format options when prepairing filesystems  https://review.openstack.org/57230717:52
*** sxc731 has joined #openstack-ansible17:54
*** poopcat has joined #openstack-ansible18:00
*** jeferobles has joined #openstack-ansible18:05
jrossercloudnull: how does the elasticsearch version work? deployers choice to put it in global requirements?18:07
*** BjoernT has joined #openstack-ansible18:08
*** jeferobles has quit IRC18:11
*** esberglu has joined #openstack-ansible18:20
*** armaan has joined #openstack-ansible18:24
*** dave-mcc_ has quit IRC18:25
*** dave-mccowan has joined #openstack-ansible18:25
*** armaan has quit IRC18:27
hwoarangmnaser: could the removal of EPEL lead to this centos7 problems https://review.openstack.org/#/c/574317/ ?18:34
hwoarangiirc it started to happen as soon as the change to remove EPEL was merged18:34
mnaserlooking18:34
mnaser"No package matching 'aria2' found available, installed or updated" hmm18:34
mnaseri'll update lxc_hosts to install epel-release18:35
mnaser(the idea is to only install epel-release when we need it)18:35
mnaseri wonder why it didn't fail in the change18:35
*** klamath has joined #openstack-ansible18:35
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: Install epel-release for ARIA2  https://review.openstack.org/57438218:37
mnaserhwoarang: ^18:37
mgariepymnaser, didn't you had a patch to install with yum-repository ?18:39
mnasermgariepy: for percona18:39
mnaserhttps://github.com/geerlingguy/ansible-role-repo-epel18:40
* mnaser wonders why we don't just use that18:40
hwoarangmnaser: why not revert e073fee153684e64e0b01c6b0a24179dece7aa8118:45
mnaserhwoarang: because that removes it from the 'cached' pkgs in containers18:46
mnaserthe real change that broke it was18:46
hwoarangmnaser: then maybe you need to add this package to lxc_hosts_distro_packages ?18:46
hwoaranginstead of adding a new task just for installing a single package?18:46
hwoarangvars/redhat-7-host.yml18:46
mnaserhwoarang: i'm not sure if that works because epel-release adds a repo18:47
mnaserso it won't be able to resolve that18:47
hwoarangok then18:47
mnaserbecause aria2 is in epel18:47
*** vnogin has joined #openstack-ansible18:47
mnaserso yum install epel-release aria2 won't pull it18:47
mnasernow i have no idea how the first change passed...18:47
*** chhagarw has quit IRC18:50
*** sxc731 has left #openstack-ansible18:52
*** hassenius has quit IRC18:53
openstackgerritMerged openstack/openstack-ansible master: Allow integration of externally deployed RadosGW  https://review.openstack.org/56827618:56
*** hassenius has joined #openstack-ansible19:03
*** Neptu has joined #openstack-ansible19:04
mgariepymnaser, the other passed because of : https://review.openstack.org/#/c/573389 < this patch not being merged i think.19:09
mgariepymnaser, is aria2 package part of RDO package request ?19:10
*** chyka_ has joined #openstack-ansible19:11
*** chyka_ has quit IRC19:12
*** chyka has quit IRC19:12
*** chyka has joined #openstack-ansible19:12
*** hassenius has quit IRC19:24
*** klamath has quit IRC19:50
*** poul_ has quit IRC19:50
*** poul has joined #openstack-ansible19:51
*** klamath has joined #openstack-ansible19:51
*** klamath has quit IRC19:53
*** hassenius has joined #openstack-ansible19:54
-openstackstatus- NOTICE: Zuul was restarted for a software upgrade; changes uploaded or approved between 19:30 and 19:50 will need to be rechecked19:55
*** armaan has joined #openstack-ansible19:55
*** poul has quit IRC19:56
*** hassenius has quit IRC19:59
*** jra has quit IRC19:59
*** jra has joined #openstack-ansible20:00
*** armaan has quit IRC20:00
*** vnogin has quit IRC20:01
*** hassenius has joined #openstack-ansible20:07
*** poul has joined #openstack-ansible20:09
*** sgrasley has joined #openstack-ansible20:10
*** poul has quit IRC20:14
*** fghaas has quit IRC20:21
*** poul has joined #openstack-ansible20:27
*** poul has quit IRC20:31
*** hassenius has quit IRC20:35
mnasermgariepy: i believe not, we can see how we can deliver that20:39
mnaseralso does anyone have access to a machine with relatively fast internets to run iperf against20:39
*** hassenius has joined #openstack-ansible20:41
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_swift master: Update to use oslo.messaging service for Notify  https://review.openstack.org/57435920:45
*** poul has joined #openstack-ansible20:45
*** radeks has quit IRC20:45
guilhermesphey guys, quick question: I want to run this task https://github.com/openstack/openstack-ansible-lxc_hosts/blob/25b074a46418ef76913d8babdad1a5e97f3cdc4e/tasks/lxc_cache_preparation.yml#L16620:46
*** radeks has joined #openstack-ansible20:46
matttmnaser: when do all those rocky m2 deprecations need to be resolved by ?20:46
guilhermespcoz I want to chance the ssh port of my containers20:46
mnasermattt: better question for evrardjp or other cores, i'm relatively new20:46
guilhermespalready added a regex in the default variable lxc_cache_sshd_configuration20:46
guilhermesplike - { regexp: "^Port",line: "Port 23422" }20:47
matttmnaser: cool, i guess i'll ask in the meeting tomorrow20:47
*** poul has quit IRC20:50
*** ansmith has quit IRC20:50
guilhermespchange*20:57
*** DanyC has quit IRC21:00
*** DanyC has joined #openstack-ansible21:01
*** poul has joined #openstack-ansible21:03
*** DanyC has quit IRC21:06
*** throwsb1 has quit IRC21:06
*** radeks has quit IRC21:07
*** poul has quit IRC21:08
*** DanyC has joined #openstack-ansible21:08
*** hamzy has quit IRC21:08
*** hamzy has joined #openstack-ansible21:11
*** DanyC has quit IRC21:16
*** DanyC has joined #openstack-ansible21:17
*** poul has joined #openstack-ansible21:21
*** cjloader has quit IRC21:23
*** cjloader_ has joined #openstack-ansible21:23
*** poul has quit IRC21:26
*** cjloader_ has quit IRC21:27
*** jeferobles has joined #openstack-ansible21:32
*** jeferobles has quit IRC21:35
*** jeferobles has joined #openstack-ansible21:35
*** Leo_m has quit IRC21:36
*** poul has joined #openstack-ansible21:39
*** poul has quit IRC21:44
*** jeferobles has quit IRC21:45
*** paulfantom has joined #openstack-ansible21:45
*** ansmith has joined #openstack-ansible21:46
*** jeferobles has joined #openstack-ansible21:46
*** poul has joined #openstack-ansible21:49
*** jeferobles has quit IRC21:50
*** poul has quit IRC21:53
hwoarangmnaser: i commented on https://review.openstack.org/#/c/574382/121:56
hwoarangthe fix does not seem to be complete :/21:56
hwoarangbut it's getting late here so can't investigate more21:56
*** dxiri_ has quit IRC21:56
*** dxiri has joined #openstack-ansible21:57
*** poul has joined #openstack-ansible21:58
*** armaan has joined #openstack-ansible21:59
*** jwitko has quit IRC21:59
*** BjoernT has quit IRC21:59
*** poul has quit IRC22:03
*** nicolasbock has quit IRC22:05
*** esberglu has quit IRC22:08
*** poul has joined #openstack-ansible22:08
*** poul has quit IRC22:13
*** armaan has quit IRC22:13
*** armaan has joined #openstack-ansible22:14
*** esberglu has joined #openstack-ansible22:14
prometheanfirecloudnull: :D22:14
*** poul has joined #openstack-ansible22:25
*** cjloader has joined #openstack-ansible22:28
*** poul has quit IRC22:31
*** armaan has quit IRC22:33
*** cjloader has quit IRC22:33
*** armaan has joined #openstack-ansible22:33
*** jra has quit IRC22:35
*** jra has joined #openstack-ansible22:35
*** poul has joined #openstack-ansible22:35
*** sak has joined #openstack-ansible22:37
*** DanyC has quit IRC22:39
*** DanyC has joined #openstack-ansible22:40
*** poul has quit IRC22:40
*** EmilienM|PTO is now known as EmilienM22:41
*** nurdie has quit IRC22:46
*** nurdie has joined #openstack-ansible22:46
*** armaan has quit IRC22:50
*** nurdie has quit IRC22:50
*** armaan has joined #openstack-ansible22:50
*** poul has joined #openstack-ansible22:53
*** poul has quit IRC22:57
*** hassenius has quit IRC23:01
*** mmercer has joined #openstack-ansible23:01
mmercerhey guys, whats the impact of doing system updates on an aio environment ?23:02
*** hassenius has joined #openstack-ansible23:03
*** DanyC has quit IRC23:04
*** DanyC has joined #openstack-ansible23:05
*** armaan has quit IRC23:06
*** hassenius has quit IRC23:08
*** DanyC has quit IRC23:10
*** poul has joined #openstack-ansible23:11
*** poul has quit IRC23:16
*** ThiagoCMC has joined #openstack-ansible23:22
*** nurdie has joined #openstack-ansible23:23
ThiagoCMCHey guys, I'm trying to deploy OSA on a bunch of VMs running at my Desktop (32G of RAM, 8 core), and it is failing here:FAILED - RETRYING: Ensure that the LXC cache has been prepared23:23
ThiagoCMCany idea?23:23
ThiagoCMCmaybe my system is too slow for this timeout?23:24
*** cjloader has joined #openstack-ansible23:29
*** poul has joined #openstack-ansible23:29
jraSo I'm trying to hook up my OSA deployment config/playbooks to a CI pipeline so I can test our changes on an AIO before I let them get promoted to staging. A major roadblock in that process is that our CI system wants very much to stage its test environments in Docker containers, which causes OSA to be most unhappy when it wants to alter system-level stuff like sysctl. Is it a done thing to build AIOs inside a container, or do I nee23:30
jrad at least a kernel-and-all VM to make this go?23:30
*** tosky has quit IRC23:32
*** cjloader has quit IRC23:33
*** poul has quit IRC23:34
*** chyka has quit IRC23:42
*** chyka has joined #openstack-ansible23:44
*** poul has joined #openstack-ansible23:47
*** chyka has quit IRC23:49
*** poul has quit IRC23:52
*** ThiagoCMC has quit IRC23:55
mmercerheh, was about to point thiago at the release notes =D23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!