Wednesday, 2020-07-22

*** gyee has quit IRC00:20
*** also_stingrayza has joined #openstack-ansible01:22
*** stingrayza has quit IRC01:25
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_gnocchi master: Add centos-8 support  https://review.opendev.org/74232401:28
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_ceilometer master: Add centos-8 support  https://review.opendev.org/74225301:31
*** redrobot has quit IRC03:42
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_gnocchi master: Add centos-8 support  https://review.opendev.org/74232404:21
*** rh-jelabarre has quit IRC04:25
*** raukadah is now known as chandankumar05:10
*** udesale has joined #openstack-ansible05:27
noonedeadpunkdmsimard: um, I05:55
noonedeadpunk* I guess we need some capacity different from infra one to process CLI and running API?05:56
noonedeadpunkbut CLI is really nice!05:57
*** mjwales has joined #openstack-ansible06:32
*** mjwales has quit IRC06:36
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Fix ceph deployment for CentOS 7  https://review.opendev.org/74226206:40
*** tosky has joined #openstack-ansible07:39
*** markvoelker has quit IRC07:45
*** markvoelker has joined #openstack-ansible07:47
*** markvoelker has quit IRC07:52
*** mjwales has joined #openstack-ansible07:58
*** tosky has quit IRC08:04
*** tosky_ has joined #openstack-ansible08:04
*** tosky_ is now known as tosky08:19
openstackgerritJan Marquardt proposed openstack/openstack-ansible-os_nova master: Avoid rebuilding the venv with every run  https://review.opendev.org/74236908:27
*** also_stingrayza is now known as stingrayza08:40
*** jbadiapa has quit IRC09:22
*** mjwales has quit IRC09:36
*** pcaruana has quit IRC09:50
*** jbadiapa has joined #openstack-ansible09:54
jrossernoonedeadpunk: i am in the datacenter all day today - if you need any reviews ping me09:57
*** udesale_ has joined #openstack-ansible09:58
*** udesale has quit IRC10:01
*** pcaruana has joined #openstack-ansible10:02
*** jbadiapa is now known as jbadiapa|away10:09
*** shyamb has joined #openstack-ansible10:12
openstackgerritMerged openstack/ansible-hardening stable/train: Enable syncing of docs  https://review.opendev.org/73357210:21
*** gokhani has quit IRC10:22
*** yasemind has quit IRC10:22
kleiniUnfortunately I currently only have a single controller node and therefore a single MariaDB Galera server. This server is killed from time to time with signal 9 (KILL). This mostly happens when multiple VMs are spawned using Terraform. What can be the cause for this KILL signal to MariaDB?10:41
*** shyamb has quit IRC10:46
jrosseryou should check for the OOM killer in syslog, see if you're runnig out of RAM10:55
noonedeadpunk+1 for oom10:56
noonedeadpunkjrosser: got it10:56
*** shyamb has joined #openstack-ansible10:57
*** pcaruana has quit IRC11:03
*** gokhani has joined #openstack-ansible11:05
*** sshnaidm is now known as sshnaidm|afk11:14
*** shyamb has quit IRC11:36
*** yasemind has joined #openstack-ansible11:36
*** sakharkar has quit IRC11:47
kleiniindeed it is the OOM killer on the controller host11:53
kleinipuh, 32G are not sufficient for a controller, that is sad...11:53
*** jbadiapa|away is now known as jbadiapa11:54
noonedeadpunkoh, 32gb is really not enough11:55
noonedeadpunklike only nova can alone eat about 10Gb and that's kind of ok11:56
kleinihow much is sufficient for a controller node?11:57
ioni32 is kinda at limit, depending of how many services are you running11:58
ioni64GB is the best11:58
kleiniI have network nodes separated, so only neutron-server on controller ant the rest of neutron on a network node11:59
kleinibut those neutron agents do not require that much11:59
kleinilet's see, how I can solve that11:59
*** rh-jelabarre has joined #openstack-ansible12:00
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Added checks for failed cinder services  https://review.opendev.org/73477812:05
*** dave-mccowan has joined #openstack-ansible12:10
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/ussuri: Use Ussuri RDO repo on ussuri branch  https://review.opendev.org/74218812:13
*** sep has quit IRC12:38
*** fridtjof[m] has quit IRC12:40
*** csmart has quit IRC12:40
*** ioni has quit IRC12:40
*** masterpe has quit IRC12:40
*** sep has joined #openstack-ansible12:42
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Update ansible metadata to indicate support for centos-8  https://review.opendev.org/74211212:43
*** fridtjof[m] has joined #openstack-ansible12:49
*** pcaruana has joined #openstack-ansible12:53
openstackgerritMerged openstack/openstack-ansible-galera_server master: Fix default galera_wsrep_provider_options  https://review.opendev.org/73816212:57
*** spatel has joined #openstack-ansible13:00
spatelnoonedeadpunk: morning! can you check this patch and tell why it failed even i included gnocchi as dependent - https://review.opendev.org/#/c/742253/13:02
spatelis this correct way to do - Depends-On: https://review.opendev.org/742324 ?13:03
noonedeadpunkspatel: you did everything correct and gnocchi is passing. It fails next on aodh... THe thing is, that here we will never be able to resolve conflicts, so we need to temporary disable centos8 check (set it to non voting)13:04
noonedeadpunkhttps://zuul.opendev.org/t/openstack/build/6c3fb25ae3894254afb4b960cea69ad1/log/job-output.txt#1327413:04
spatelso set it to non voting for both ceilometer and gnocchi?13:06
noonedeadpunkand aodh and panke13:06
noonedeadpunk*panko13:07
noonedeadpunkwe need to do it like that both for gate and check pipelines https://opendev.org/openstack/openstack-ansible-galera_server/src/commit/36f35bee263f1d87440a4204d018dda45d19d98e/zuul.d/project.yaml#L27-L2813:07
noonedeadpunkbut mention all failing centos8 tasks13:07
noonedeadpunklet me know if you need some help with that - I can do an example :)13:08
noonedeadpunkonce we merge ceilometer, gnocchi, aodh and panko - centos8 jobs should start passing again and we wil need to make it voting again13:09
openstackgerritMerged openstack/openstack-ansible master: Simplify version check  https://review.opendev.org/73622213:14
spatellet me try myself and if any issue i will ping you13:16
spatelnoonedeadpunk: where is non-voting button :)13:21
spateli think i need your help13:21
*** ioni has joined #openstack-ansible13:21
*** masterpe has joined #openstack-ansible13:21
*** csmart has joined #openstack-ansible13:21
noonedeadpunkok, sure)13:26
*** sshnaidm|afk is now known as sshnaidm13:29
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Add centos-8 and ubuntu focal support  https://review.opendev.org/74225313:35
noonedeadpunkspatel: I guess smth like this will be needed for gnocchi, aodh, panko https://review.opendev.org/#/c/742253/3/zuul.d/project.yaml13:36
openstackgerritMerged openstack/openstack-ansible master: Ensure distro packages are present for utility wheel build  https://review.opendev.org/73942813:36
spatelnoonedeadpunk: i can see what you did.. great13:39
spateldo you want me to do for gnocchi, aodh, panko?13:39
noonedeadpunkif you have patches for them and some time that would be great. I can do the same for them otherwise :p13:39
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/ussuri: Ensure distro packages are present for utility wheel build  https://review.opendev.org/74242913:40
noonedeadpunkjrosser: can you kindly vote on it?:) https://review.opendev.org/#/c/740289/613:41
mnaserbtw13:47
mnaserglance has marked deployed via uwsgi unsupported13:47
spatelnoonedeadpunk: let me try to understand and i will let you know if any confusion :)13:47
mnaserand backported that patch that says its 'unsupported' too...13:47
noonedeadpunkuh...13:47
mnaserto both ussuri and train too13:47
mnaserhttps://review.opendev.org/#/q/I93dc7c999ff7a180e6b3ff760fa65328b9a883f313:47
noonedeadpunkwe have https://opendev.org/openstack/openstack-ansible-os_glance/src/branch/master/defaults/main.yml#L259 in master13:48
mnaseri'm working on getting that reverted and dansmith is working on fixing it so that glance image import works with uwsgi..13:48
noonedeadpunkSo I guess it's needed to be backported and set t ofalse by default13:48
mnaseri'm aiming to revert that right now, but yeah, we'll sadly have to switch that if that's what ends up happening13:48
mnaser(not ok, imho, but we're likely going to have it fixed)13:48
noonedeadpunkbut yeah, interoperable import is known not to work with uwsgi...13:49
mnaseryeah, dansmith has a patch up that fixes it13:49
noonedeadpunkthey just didn't care about uwsgi I guess13:49
noonedeadpunkoh, that's nice!13:49
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance stable/train: Make possible to run glance-api not with uwsgi  https://review.opendev.org/74243313:50
mnasernoonedeadpunk: https://review.opendev.org/#/c/742065/13:50
noonedeadpunklooks pretty nice and pretty understandable why it didn't work with uwsgi without taskflow processor...13:56
noonedeadpunkbut still probably would be nice to backport opportunity to disable uwsgi usage as this won't be backported I think...13:56
*** dave-mccowan has quit IRC14:07
noonedeadpunkcloudnull: tag 1.1.1 is ready https://opendev.org/openstack/ansible-config_template/src/tag/1.1.1 :)14:09
*** yolanda has quit IRC14:10
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Deploy resources only when tempest_run is True  https://review.opendev.org/73981014:11
*** yolanda has joined #openstack-ansible14:12
*** dave-mccowan has joined #openstack-ansible14:20
*** poopcat has joined #openstack-ansible14:22
*** dave-mccowan has quit IRC14:26
cloudnullWoot! Thank you noonedeadpunk!14:29
noonedeadpunklet me know if I can do anything for you :)14:30
openstackgerritMerged openstack/ansible-role-uwsgi master: Use X-Forwarded-For header in logs  https://review.opendev.org/74046914:32
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Remove unused neutron_management_ip  https://review.opendev.org/74117714:38
*** KeithMnemonic has joined #openstack-ansible14:59
jrossernoonedeadpunk: you still need +W on  https://review.opendev.org/#/c/740289/6 ?15:29
noonedeadpunkjrosser: Would be nice to have)15:43
*** gyee has joined #openstack-ansible15:48
*** spatel has quit IRC15:57
*** spatel has joined #openstack-ansible16:17
spatelnoonedeadpunk: i need to add debian.yml also right https://review.opendev.org/#/c/742253/3/vars/debian.yml16:17
spatelI think we need debian to handle python-libvirt so let me do that16:22
*** udesale_ has quit IRC16:47
openstackgerritMerged openstack/openstack-ansible stable/stein: Bump SHAs for stable/stein  https://review.opendev.org/74059316:53
openstackgerritMerged openstack/openstack-ansible stable/train: Bump SHAs for stable/train  https://review.opendev.org/74059416:59
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_gnocchi master: Add centos-8 support  https://review.opendev.org/74232417:00
*** sshnaidm is now known as sshnaidm|afk17:09
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_aodh master: Add centos-8 support  https://review.opendev.org/73940117:16
*** sshnaidm|afk has quit IRC17:23
openstackgerritamolkahat proposed openstack/openstack-ansible-os_tempest master: Added tempest ironic resources setup.  https://review.opendev.org/72070517:25
*** sshnaidm has joined #openstack-ansible17:27
*** sshnaidm is now known as sshnaidm|afk17:27
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_blazar master: Add centos-8 support  https://review.opendev.org/73964718:19
spatelnoonedeadpunk: When you get a time check - https://review.opendev.org/#/c/739653/18:28
spatellook like broken repository and it outside my knowledge to fix it18:29
openstackgerritSatish Patel proposed openstack/openstack-ansible-os_panko master: Add centos-8 support  https://review.opendev.org/74250718:34
noonedeadpunkspatel: I guess I know the reason18:34
spatelsha hash issue?18:35
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add congress to required projects  https://review.opendev.org/74250818:36
noonedeadpunkspatel: set this as depends-on ^18:36
noonedeadpunkno, it's CI specific thing18:36
spateloh okay!18:41
spateloh! i saw your patch look like name: openstack/congress was missing18:42
dmsimardnoonedeadpunk: hey, sorry, missed your reply18:46
noonedeadpunknp)18:46
dmsimardthe cli client commands in http://paste.openstack.org/show/796193/ are included in the base ara package and can query any server (either local/offline or remote)18:47
noonedeadpunkspatel: oh... https://opendev.org/openstack/congress18:47
noonedeadpunkI think we should just forget about congress18:47
dmsimardnow, as to where the data is hosted, for my testing I use https://api.demo.recordsansible.org/18:47
* noonedeadpunk needs to sunset the role18:48
dmsimardI don't have the budget to host OSA :( lol18:48
noonedeadpunkThat's totally fair18:48
spatelBelieve me congress is not functional anywhere in world (it was political joke)18:48
dmsimardhowever, if you use 1.x in your jobs, you can use the same CLI18:48
noonedeadpunkin case we get hold :p18:49
noonedeadpunkyeah, got it, thanks for updating. I'm not sure we can provide a capacity for hosting results as well at the moment. Eventually zuul logs are already hosted, so...18:50
dmsimardit could be worthwhile to consider ara a component of osa (like mysql or rabbitmq would be) and then have OSA's ansible send data there to have it available for reporting or querying18:51
noonedeadpunkoh, that might be useful for osa deployers18:51
noonedeadpunkand that's really interesting18:51
dmsimardyeah, in production18:51
noonedeadpunkI never though it that way18:52
noonedeadpunkI'd love to have ara as a part of production to be able to look through logs after some error raised18:52
dmsimardmnaser: ^ :p18:52
spatelnoonedeadpunk: may be same case with murano - https://review.opendev.org/#/c/739639/18:53
noonedeadpunkspatel: murano is still present https://opendev.org/openstack/murano18:54
spatelhmm.. it has all short of tempest error18:55
spatelis it ok to delete congress patch from list so it will free up queue :)18:55
noonedeadpunkyes, totally, just abandon it (there's gerrit button for it)18:56
spatellet me do it..18:56
spatelI think we are inch close to clean up all centos-8 related patches..18:59
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_congress master: Retire os_congress role  https://review.opendev.org/74252019:26
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Retire os_congress role  https://review.opendev.org/74252119:27
*** spatel has quit IRC19:28
*** also_stingrayza has joined #openstack-ansible19:34
*** stingrayza has quit IRC19:36
*** spatel has joined #openstack-ansible19:44
*** yolanda has quit IRC20:05
*** yolanda has joined #openstack-ansible20:08
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Deprecate os_congress role  https://review.opendev.org/74252120:18
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_congress master: Deprecate os_congress role  https://review.opendev.org/74252020:18
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Install py3 distro packages  https://review.opendev.org/73989620:20
*** spatel has quit IRC20:37
*** spatel has joined #openstack-ansible21:01
*** spatel has quit IRC21:23
*** jbadiapa has quit IRC21:40
*** rh-jlabarre has joined #openstack-ansible21:47
*** rh-jelabarre has quit IRC21:51
*** d34dh0r53 has quit IRC22:17
*** tosky has quit IRC23:03
*** mjwales has joined #openstack-ansible23:05
*** yolanda has quit IRC23:23
*** yolanda has joined #openstack-ansible23:24
*** markvoelker has joined #openstack-ansible23:27
*** markvoelker has quit IRC23:32

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!