Monday, 2019-05-06

openstackgerritMohammed Naser proposed openstack/openstack-ansible-openstack_hosts master: debian: switch to generic version  https://review.opendev.org/65729000:04
*** aludwar has joined #openstack-ansible00:11
*** aludwar has quit IRC00:11
logan-https://review.opendev.org/#/c/657057/ openstack venvs building with py3 works on debian and bionic at least :)00:13
guilhermespthat's a good start logan- :)00:14
guilhermesphave you seen the results of placement stuff? The rename of the user_secrets works nice running gate script locally, but everything breaks in the gates on zuul =(00:14
guilhermespI'd like to travel back home ( flight in two hours ) at least with a green field :P hahahahah but seems that wont be possible00:15
logan-haha00:15
logan-i'll take a look at it00:15
guilhermespmaybe there is a circular dependency in there00:16
logan-for greenfield i think you just need to add the new secret00:18
logan-the upgrade playbook renaming the old secret to the new one and removing the old one from user_secrets can come later once all usage of the old secret is removed00:19
guilhermespI thought it was breaking because the nova DNM patch was breaking00:20
guilhermespmy idea was just remove the nova_placement_service_password, and use placement_service_password in both roles, os_placement and os_nova00:21
*** aludwar has joined #openstack-ansible00:21
guilhermespjust to merge the placement integration and then get rid of everything related placement in os_nova role00:21
logan-actually if we're using a different database user etc, we don't really need to migrate the old secret00:23
logan-we can just create a new one and add an upgrade playbook to clean up the old one00:23
guilhermespok so, the idea now is forget os_nova changes and just upgrade the nova_placement_service_password to placement_service_password and that's it?00:24
guilhermespah, that other idea of add the placement_service_password in group_vars didn't work tho. We tried that yesterday  think00:25
logan-just add placement_service_password to user secrets00:26
logan-for get the old secret00:26
logan-we will delete it later00:26
guilhermespyou mean this https://review.opendev.org/#/c/656891/26/etc/openstack_deploy/user_secrets.yml ?00:27
logan-right except don't delete the old secret00:28
logan-the deployment still depends on that var00:28
guilhermesplet me revert that ( the real gate time is coming :P )00:28
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible master: Add support to deploy placement  https://review.opendev.org/65689100:30
guilhermespok so, but with that we still hit the issue of creating a password for placement twice00:30
logan-yep00:31
logan-oh because you're re-using the same mysql username I guess right?00:31
guilhermespyep00:31
guilhermespit overrides the password when os_nova runs00:32
logan-ok got it00:32
guilhermespwe tried your suggestion of placement_service_password: {{ nova_place...... }} in both user_secrets and group_vars yesterday00:33
guilhermespbut didn't work00:33
logan-maybe we should split this up more. we may be biting off too much at once with a broken gate. we could not add placement_service_password and continue using nova_placement_service_password instead. then rename the var once we have a working deployment.00:34
openstackgerritLogan V proposed openstack/openstack-ansible-lxc_hosts master: Revert "Temporary fix of failing aria2 on centos"  https://review.opendev.org/65729200:38
guilhermespyep... to merge that patch right now we just need to, in one way or another avoid the use of both placement passwords as each role uses its own name00:38
guilhermespbut for now I think this is an episode for tomorrow, time to spend 10 more hours, but now flying00:39
logan-++ sounds good00:42
*** djhankb has joined #openstack-ansible00:43
openstackgerritLogan V proposed openstack/openstack-ansible master: Add support to deploy placement  https://review.opendev.org/65689100:47
openstackgerrittonybrad proposed openstack/openstack-ansible-os_panko master: Change tests source to opendev  https://review.opendev.org/65729300:52
*** cmart has joined #openstack-ansible01:07
*** cshen has quit IRC01:10
*** cmart has quit IRC01:14
*** cshen has joined #openstack-ansible01:14
*** radeks has joined #openstack-ansible01:18
*** cshen has quit IRC01:19
*** radeks_ has joined #openstack-ansible01:26
openstackgerrittonybrad proposed openstack/openstack-ansible-os_manila master: Update the tests source  https://review.opendev.org/65729601:28
*** radeks has quit IRC01:28
*** radeks__ has joined #openstack-ansible01:30
*** radeks_ has quit IRC01:30
*** cshen has joined #openstack-ansible01:36
logan-guilhermesp: it passes :) http://logs.openstack.org/91/656891/28/check/openstack-ansible-deploy-aio_metal-ubuntu-bionic/3170432/01:51
openstackgerrittonybrad proposed openstack/openstack-ansible-rsyslog_client master: Move to opendev  https://review.opendev.org/65729702:00
*** cshen has quit IRC02:01
openstackgerritLogan V proposed openstack/openstack-ansible master: Add support to deploy placement  https://review.opendev.org/65689102:11
*** radeks__ has quit IRC02:15
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: debian: use ansible_lsb.codename  https://review.opendev.org/65729802:25
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_client master: debian: use ansible_lsb.codename  https://review.opendev.org/65729902:28
*** cshen has joined #openstack-ansible02:31
*** kplant has quit IRC02:32
*** altlogbot_2 has quit IRC02:41
*** altlogbot_0 has joined #openstack-ansible02:42
openstackgerritMohammed Naser proposed openstack/openstack-ansible-rabbitmq_server master: debian: move to installing from bintray  https://review.opendev.org/65730202:49
openstackgerritMohammed Naser proposed openstack/openstack-ansible-rabbitmq_server master: debian: use ansible_lsb.codename  https://review.opendev.org/65730302:52
openstackgerritMohammed Naser proposed openstack/openstack-ansible-rabbitmq_server master: debian: install from distro for debian  https://review.opendev.org/65730503:02
*** cshen has quit IRC03:05
openstackgerrittonybrad proposed openstack/openstack-ansible-repo_server master: Change the tests source to opendev  https://review.opendev.org/65730903:19
*** altlogbot_0 has quit IRC03:31
*** altlogbot_2 has joined #openstack-ansible03:31
*** cshen has joined #openstack-ansible03:37
openstackgerritMerged openstack/openstack-ansible-os_placement master: Ensure libxml2 is present as a library for uwsgi  https://review.opendev.org/65711703:41
*** gkadam has joined #openstack-ansible03:42
*** cshen has quit IRC03:42
*** gkadam has quit IRC03:42
*** udesale has joined #openstack-ansible03:53
*** raukadah has quit IRC04:00
*** chandankumar has joined #openstack-ansible04:01
*** cshen has joined #openstack-ansible04:11
*** ivve has quit IRC04:12
*** Talion has quit IRC04:31
*** DanyC has joined #openstack-ansible04:39
*** cshen has quit IRC05:13
*** ivve has joined #openstack-ansible05:15
*** cshen has joined #openstack-ansible05:16
*** cshen has quit IRC05:21
*** DanyC has quit IRC05:30
*** DanyC has joined #openstack-ansible05:37
*** cshen has joined #openstack-ansible05:39
*** DanyC has quit IRC05:42
*** cshen has quit IRC05:45
*** DanyC has joined #openstack-ansible05:48
*** radeks__ has joined #openstack-ansible05:48
*** DanyC has quit IRC05:52
*** mkuf has quit IRC05:55
*** radeks__ has quit IRC05:56
*** DanyC has joined #openstack-ansible05:57
*** DanyC has quit IRC06:01
*** radeks has joined #openstack-ansible06:04
*** DanyC has joined #openstack-ansible06:05
openstackgerrittonybrad proposed openstack/openstack-ansible-pip_install master: Update to opendev  https://review.opendev.org/65731806:10
*** cshen has joined #openstack-ansible06:15
*** udesale has quit IRC06:23
*** udesale has joined #openstack-ansible06:24
openstackgerrittonybrad proposed openstack/openstack-ansible-os_sahara master: Update tests git source to opendev  https://review.opendev.org/65732206:25
*** cshen has quit IRC06:27
*** mkuf has joined #openstack-ansible06:30
*** eumel8 has quit IRC06:32
openstackgerrittonybrad proposed openstack/ansible-hardening master: Update requiment source  https://review.opendev.org/65732406:37
*** admin0 has joined #openstack-ansible06:42
fnpanicgood morning06:49
*** kopecmartin|off is now known as kopecmartin06:52
*** aedc has quit IRC07:00
*** cshen has joined #openstack-ansible07:07
*** cshen has quit IRC07:12
*** altlogbot_2 has quit IRC07:13
*** altlogbot_0 has joined #openstack-ansible07:17
*** tosky has joined #openstack-ansible07:28
*** arxcruz|rover is now known as arxcruz07:37
*** kaiokmo has quit IRC07:45
*** udesale has quit IRC07:55
*** udesale has joined #openstack-ansible07:55
*** aedc has joined #openstack-ansible08:03
*** DanyC has quit IRC08:20
*** CeeMac has joined #openstack-ansible08:21
CeeMacMorning08:22
*** pcaruana has joined #openstack-ansible08:24
*** hamzaachi has joined #openstack-ansible08:27
*** ivve has quit IRC08:40
openstackgerrittonybrad proposed openstack/openstack-ansible-repo_server master: Updated the git source  https://review.opendev.org/65735008:51
*** ivve has joined #openstack-ansible08:55
openstackgerrittonybrad proposed openstack/openstack-ansible-rsyslog_client master: Updated git source  https://review.opendev.org/65735208:56
*** mkuf_ has joined #openstack-ansible08:58
*** mkuf has quit IRC09:02
*** cshen has joined #openstack-ansible09:08
*** mkuf_ has quit IRC09:10
*** altlogbot_0 has quit IRC09:11
*** cshen has quit IRC09:13
*** altlogbot_2 has joined #openstack-ansible09:14
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: Replace tempestconf job with aio_distro_metal-tempestconf job  https://review.opendev.org/65735909:14
*** altlogbot_2 has quit IRC09:15
*** altlogbot_1 has joined #openstack-ansible09:15
*** mkuf_ has joined #openstack-ansible09:38
*** hwoarang has quit IRC09:49
*** hwoarang has joined #openstack-ansible09:49
*** aedc has quit IRC09:51
openstackgerritmelissaml proposed openstack/openstack-ansible-os_zun master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65727010:11
*** strattao has joined #openstack-ansible10:15
openstackgerritmelissaml proposed openstack/openstack-ansible master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723110:17
openstackgerritmelissaml proposed openstack/ansible-config_template master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65722610:19
openstackgerritmelissaml proposed openstack/ansible-role-python_venv_build master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65722810:22
openstackgerritmelissaml proposed openstack/openstack-ansible-galera_server master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723410:33
openstackgerritmelissaml proposed openstack/openstack-ansible-ceph_client master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723210:34
openstackgerritmelissaml proposed openstack/openstack-ansible-haproxy_server master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723510:34
*** udesale has quit IRC10:34
*** udesale has joined #openstack-ansible10:35
openstackgerritmelissaml proposed openstack/openstack-ansible-nspawn_container_create master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724010:40
openstackgerritmelissaml proposed openstack/openstack-ansible-nspawn_hosts master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724110:44
openstackgerritmelissaml proposed openstack/openstack-ansible-nspawn_hosts master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724110:45
openstackgerritmelissaml proposed openstack/openstack-ansible-openstack_hosts master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724210:46
*** nicolasbock has joined #openstack-ansible10:47
openstackgerritmelissaml proposed openstack/openstack-ansible-ops master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65722510:47
openstackgerritmelissaml proposed openstack/openstack-ansible-os_aodh master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724310:48
openstackgerritmelissaml proposed openstack/openstack-ansible-os_congress master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724810:56
openstackgerritmelissaml proposed openstack/openstack-ansible-os_barbican master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724410:58
openstackgerritmelissaml proposed openstack/openstack-ansible-os_cinder master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724710:58
openstackgerritmelissaml proposed openstack/openstack-ansible-os_blazar master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65724611:01
*** noonedeadpunk has joined #openstack-ansible11:04
openstackgerritmelissaml proposed openstack/openstack-ansible-os_glance master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725211:07
openstackgerritmelissaml proposed openstack/openstack-ansible-os_designate master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725111:08
openstackgerritmelissaml proposed openstack/openstack-ansible-os_horizon master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725411:09
openstackgerritmelissaml proposed openstack/openstack-ansible-os_ironic master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725511:09
openstackgerritmelissaml proposed openstack/openstack-ansible-os_heat master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725311:10
openstackgerritmelissaml proposed openstack/openstack-ansible-os_gnocchi master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65722711:10
noonedeadpunkmornings everyone11:11
openstackgerritmelissaml proposed openstack/openstack-ansible-os_mistral master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726011:14
openstackgerritmelissaml proposed openstack/openstack-ansible-os_magnum master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725811:14
openstackgerritmelissaml proposed openstack/openstack-ansible-os_masakari master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725711:16
*** udesale has quit IRC11:17
openstackgerritmelissaml proposed openstack/openstack-ansible-os_keystone master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725611:17
*** altlogbot_1 has quit IRC11:19
*** altlogbot_3 has joined #openstack-ansible11:20
*** ansmith has quit IRC11:21
openstackgerritmelissaml proposed openstack/openstack-ansible-os_monasca-agent master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726111:24
openstackgerritmelissaml proposed openstack/openstack-ansible-os_placement master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726311:24
openstackgerritmelissaml proposed openstack/openstack-ansible-os_octavia master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726611:24
openstackgerritmelissaml proposed openstack/openstack-ansible-os_neutron master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726211:24
openstackgerritmelissaml proposed openstack/openstack-ansible-os_nova master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725911:26
openstackgerritmelissaml proposed openstack/openstack-ansible-os_panko master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726411:26
openstackgerritmelissaml proposed openstack/openstack-ansible-os_rally master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726511:30
openstackgerritmelissaml proposed openstack/openstack-ansible-os_tempest master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726911:30
openstackgerritmelissaml proposed openstack/openstack-ansible-os_swift master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726811:30
openstackgerritmelissaml proposed openstack/openstack-ansible-os_zun master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65727011:31
openstackgerritmelissaml proposed openstack/openstack-ansible-os_trove master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65726711:31
openstackgerritmelissaml proposed openstack/openstack-ansible-os_tacker master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65727111:32
*** blinkiz has quit IRC11:33
openstackgerritmelissaml proposed openstack/openstack-ansible-rsyslog_server master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723811:35
openstackgerritmelissaml proposed openstack/openstack-ansible-rabbitmq_server master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723611:35
openstackgerritmelissaml proposed openstack/openstack-ansible-repo_build master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723711:36
openstackgerritmelissaml proposed openstack/openstack-ansible-os_ceilometer master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65725011:38
openstackgerritmelissaml proposed openstack/openstack-ansible-tests master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65723911:41
*** vnogin has joined #openstack-ansible11:49
*** vnogin has quit IRC12:03
openstackgerritmelissaml proposed openstack/openstack-ansible-lxc_container_create master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65737712:05
openstackgerritmelissaml proposed openstack/openstack-ansible-lxc_hosts master: Replace git.openstack.org URLs with opendev.org URLs  https://review.opendev.org/65737812:06
*** mgariepy has joined #openstack-ansible12:08
*** vnogin has joined #openstack-ansible12:10
*** altlogbot_3 has quit IRC12:14
*** udesale has joined #openstack-ansible12:19
*** altlogbot_0 has joined #openstack-ansible12:20
*** DanyC has joined #openstack-ansible12:21
*** vnogin has quit IRC12:21
*** kplant has joined #openstack-ansible12:25
*** DanyC has quit IRC12:25
*** udesale has quit IRC12:25
*** udesale has joined #openstack-ansible12:26
*** pcaruana has quit IRC12:29
jamesdentonGood morning12:40
*** ansmith has joined #openstack-ansible12:42
CeeMachey12:43
*** Talion has joined #openstack-ansible12:45
*** cmart has joined #openstack-ansible12:47
jamesdentonHey there, CeeMac12:55
*** cshen has joined #openstack-ansible13:08
*** cshen has quit IRC13:12
*** altlogbot_0 has quit IRC13:15
*** altlogbot_0 has joined #openstack-ansible13:16
*** pcaruana has joined #openstack-ansible13:16
CeeMachi jamesdenton how's it going?13:19
jamesdentonnot bad, not bad. How was your trip back?13:19
CeeMaclong, but uneventful13:20
*** hjohnson1 has joined #openstack-ansible13:20
*** altlogbot_0 has quit IRC13:21
*** altlogbot_2 has joined #openstack-ansible13:24
*** yetiszaf has joined #openstack-ansible13:24
*** altlogbot_2 has quit IRC13:25
*** altlogbot_1 has joined #openstack-ansible13:26
mgariepyanyone had issue with rabbitmq after a power outage ?13:28
mgariepyi had to reinstall it in order to fix it. some services didn't came up after. like mistral and neutron-l3-agent13:29
mgariepyusing rocky 18.1.613:29
noonedeadpunkhad probably common thing, when after coming up rabbitmq node stopped whole cluster working13:34
noonedeadpunkstatus was ok, but in fact services were not communicating13:35
noonedeadpunkand this was resolved only be running rabbitmq-install.yml with rabbitmq_upgrade=True13:36
mgariepythat's what i did to fix it.13:37
mgariepyjust wondering why some service were ok and others not.13:38
noonedeadpunkNot sure if this fixes this problem https://review.opendev.org/#/c/652187/5 but it might be related I guess.13:38
noonedeadpunkAs everything looks like that qeues just dissapear  after failed node returns.13:38
noonedeadpunkAs we don't have really ha queues for rocky13:40
noonedeadpunkmgariepy: I think that it depends on what node queue is placed.13:42
*** udesale has quit IRC13:46
*** udesale has joined #openstack-ansible13:47
*** ianychoi has quit IRC13:48
mgariepyand the order of the powerlost maybe.13:49
*** vnogin has joined #openstack-ansible13:51
*** ianychoi has joined #openstack-ansible13:52
*** ianychoi has quit IRC14:04
openstackgerritLogan V proposed openstack/openstack-ansible-lxc_hosts stable/stein: Temporary fix of failing aria2 on centos  https://review.opendev.org/65738614:12
*** spatel has joined #openstack-ansible14:16
spatelMorning folks14:16
*** udesale has quit IRC14:16
spatelcloudnull: how you doing bro?14:16
*** vnogin has quit IRC14:18
*** ianychoi has joined #openstack-ansible14:18
*** udesale has joined #openstack-ansible14:21
redkriegdoes anyone have any guidance for including a new pip package in the openstack-ansible repo container?  I tried adding its name to utility_pip_packages in a new user_utility.yml file, and it does try to install but the repo isn't building it.  Is there some central manifest for the repo playbook to build from that I'm not seeing?14:27
*** samueldmq has joined #openstack-ansible14:27
*** mgariepy has quit IRC14:29
*** ivve has quit IRC14:40
*** cshen has joined #openstack-ansible15:08
redkriegare rocky->stein upgrades known to be working yet?15:08
*** cshen has quit IRC15:12
noonedeadpunkredkrieg: you probably may ping mnaser or cloudnull about hteir experience, afaik they've already provided bunch of such upgrades.15:13
noonedeadpunkbut be aware that centos is now broken due to problems with aria2 package in epel repo15:13
*** gyee has joined #openstack-ansible15:13
*** mgariepy has joined #openstack-ansible15:15
redkriegnoonedeadpunk: luckily I'm on Ubuntu.  thanks for the info15:16
*** markvoelker has joined #openstack-ansible15:16
chandankumarnoonedeadpunk: Hello15:16
chandankumarnoonedeadpunk: please have a look at  this issue http://logs.openstack.org/42/654942/6/check/openstack-ansible-functional-tempestconf-centos-7/28cc895/job-output.txt.gz#_2019-05-06_09_56_41_90542315:17
*** djhankb has quit IRC15:25
*** djhankb has joined #openstack-ansible15:27
noonedeadpunkchandankumar: I think we have the same problem over there https://review.opendev.org/#/c/656499/15:27
noonedeadpunkSo it's not tempest related....15:27
noonedeadpunkJust now don't really have enough time to dig inside this problem:(15:28
djhankbHi guys, for Stein, which version should I be using at this point? I pulled tag "stable/stein" from git, however I've been having some issues with my Utility container, as well as Cinder playbooks15:29
noonedeadpunkdjhankb: isn't cinder problem looks like https://bugs.launchpad.net/cinder/+bug/1806156 ?15:30
openstackLaunchpad bug 1806156 in Cinder "shared_targets_online_data_migration fails when cinder-volume service not running" [Undecided,Confirmed]15:30
djhankbnoonedeadpunk: I actually forgot about that issue - I am actually running into a 404 error on a fresh install for Cinder when running some pip commands15:33
djhankbI also am hitting an issue during the container build: fatal: [osa-control1_utility_container-18691486]: FAILED! => {"changed": true, "cmd": "openstack complete > /etc/bash_completion.d/openstack_client", "delta": "0:00:00.039811", "end": "2019-05-06 15:25:47.499157", "msg": "non-zero return code", "rc": 127, "start": "2019-05-06 15:25:47.459346", "stderr": "/bin/sh: 1: openstack: not found", "stderr_lines": ["/bin/sh:15:34
djhankb1: openstack: not found"], "stdout": "", "stdout_lines": []}15:34
*** aludwar has quit IRC15:34
*** aludwar has joined #openstack-ansible15:34
djhankbthat would be the utility container15:34
noonedeadpunkhm, that's strange... do you have python-openstackclient installed inside utility?15:35
djhankbis that installed via apt?15:36
djhankba dpkg -l does not list any open stack client being installed15:36
logan-chandankumar: I'm guessing it is related to the placement service breakout. https://review.opendev.org/#/c/656891/ will address placement, but that is currently blocked on one last failing job (centos 7 distro packages deploy): http://logs.openstack.org/91/656891/29/check/openstack-ansible-deploy-aio_distro_metal-centos-7/60303ef/logs/ara-report/re15:36
logan-sult/4b3b398d-675b-4fff-b7c3-d01aea29f75d/15:36
logan-er, link is: http://logs.openstack.org/91/656891/29/check/openstack-ansible-deploy-aio_distro_metal-centos-7/60303ef/logs/ara-report/result/4b3b398d-675b-4fff-b7c3-d01aea29f75d/15:36
chandankumarlogan-: yes, I pinged rdo folks, it is a known issue15:37
*** nollidec has joined #openstack-ansible15:39
*** chandankumar is now known as raukadah15:41
noonedeadpunkdjhankb: if yours install_method == "distro", then it should be installed with apt. Otherwise (be default) it's installed with pip15:42
*** aludwar has quit IRC15:49
*** hamzaachi has quit IRC15:51
*** aludwar has joined #openstack-ansible15:53
djhankbnoonedeadpunk: I used install_method: source - when I try to run pip from within the Utility container, I get: bash: pip: command not found15:54
djhankbI have re-run playbooks over and over, would it help to delete the containers before I re-run  setup-hosts.yml and setup-infrastructure.yml15:54
djhankbit seems like even though some builds succeeded, I have some missing pieces.15:55
djhankbin fact - my Cinder error that I am getting is also pip related: raise HTTPError(http_error_msg, response=self)\nHTTPError: 404 Client Error: Not Found for url: http://192.168.41.41:8181/simple/pip/\n15:56
noonedeadpunkthat's really strange... do you have utility venv inside container in /openstack/venvs/15:56
djhankbit appears that the repo container should have that /simple/pip/ folder - and it does not15:56
djhankbyes I do - /openstack/venvs/utility-19.0.0.0rc2.dev2715:57
openstackgerritLogan V proposed openstack/openstack-ansible-os_nova master: Remove nova-placement-api package from CentOS  https://review.opendev.org/65739816:01
*** strattao has quit IRC16:03
*** aedc has joined #openstack-ansible16:04
antonymdjhankb: i was getting a similar error with a rocky to stein upgrade and i had to yank the /root/.pip/pip.conf off the repo/hosts to get it to get past that error16:04
djhankbantonym: where exactly would I be looking for that - I am checking my deployment host, as well as infrastructure hosts and I do not have a .pip in any of my home directories16:08
*** nollidec has quit IRC16:08
antonyminfra nodes and repo containers: /root/.pip/pip.conf16:08
antonymhttps://review.opendev.org/#/c/656721/16:09
noonedeadpunkdjhankb: in stein repo container dos not contain pip wheels any more - we've migrated to python_build_venv role16:12
djhankbok yeah I do not have a .pip/ folder anywhere that I can find in infra nodes or containers16:12
noonedeadpunk* python_venv_build16:13
*** nollidec has joined #openstack-ansible16:13
*** strattao has joined #openstack-ansible16:13
djhankbnoonedeadpunk: what does that mean for me then? With this being a brand-new build is there a way to easily just delete everything and start over without a full OS reinstall?16:14
noonedeadpunkactually "Not Found for url: http://192.168.41.41:8181/simple/pip/" says, that for some point inside cinder container some pip.conf is located16:18
noonedeadpunklike this http://paste.openstack.org/show/750724/16:19
*** ivve has joined #openstack-ansible16:20
noonedeadpunkyou may drop containers with /opt/openstack-ansible/playbooks/lxc-containers-destroy.yml --limit cinder_all,utility_all16:20
noonedeadpunkafter that try to launch playbooks again. Or just create containers with /opt/openstack-ansible/playbooks/lxc-containers-create.yml --limit cinder_all,utility_all,lxc_hosts16:21
noonedeadpunkand setup-openstack after that16:22
*** ivve has quit IRC16:35
cloudnullafternoons all !16:40
cloudnullhows it ?16:40
cloudnullfrom the outside it looked like a good infra summit and PTG. anything amazing come from the talks or sessions I should go watch ?16:42
noonedeadpunkthat's great question:) I'd love to join to it and get some recommendations on what to watch at the first place:)16:45
strattaoI thought some of the labs were pretty good, but the session I thought was most interesting was the “Optimize OpenStack performance and TCO for large-scale Private Cloud”16:58
strattaomissed meeting you at the summit cloudnull16:59
cloudnullhopefully we can catch up on the next one :)17:00
strattaoYou going to Shanghai then? ;)17:02
cloudnullone can hope17:03
cloudnulltoo early to tell at this point17:03
*** Talion has quit IRC17:04
redkriegcloudnull: have you done any rocky->stein upgrades successfully since stein has been released?17:07
*** cshen has joined #openstack-ansible17:08
*** cshen has quit IRC17:13
*** kopecmartin is now known as kopecmartin|off17:17
mnaserstein h as not been released yet officially fwiw17:18
*** ivve has joined #openstack-ansible17:18
djhankbnoonedeadpunk: thank you - that makes sense about the pip.conf being there for cinder, I forgot that's a machine that I am re-using from a previous deployment. I will try the container destroy and see how it goes17:21
djhankbconfirmed /root/.pip/pip.conf was present on the cinder physical machine17:23
*** shertel has joined #openstack-ansible17:23
*** udesale has quit IRC17:27
cloudnullredkrieg technically I've done the rocky stein upgrade. My lab environment is running the head of master OSA which I upgrade on a fairly regular basis. So far so good.17:32
cloudnullI did however run into the cinder online DB migration issues reported a while back but that was overcome with a manual DB sync17:32
cloudnullhttps://bugs.launchpad.net/cinder/+bug/180615617:33
openstackLaunchpad bug 1806156 in Cinder "shared_targets_online_data_migration fails when cinder-volume service not running" [Undecided,Confirmed]17:33
redkriegthanks for the tip.  I'm going to be launching for customers soon and would like to start out on stein to get ahead of the upgrade woes with clients on there.  I don't really want to reinstall 5 regions if the upgrade is mostly working :D17:33
cloudnullidk if thats due to something we're doing wrong or something cinder needs to resolve >17:33
cloudnull?17:34
cloudnull++ good call .17:34
cloudnullstein has been solid17:34
cloudnullfor me at least, and the folks at vexxhost - https://medium.com/@vexxhostinc/vexxhost-is-running-openstack-stein-in-production-on-day-one-of-the-release-19c9c76b90ff -cc mnaser :D17:35
openstackgerritLogan V proposed openstack/openstack-ansible-os_nova master: Remove nova-placement-api package from CentOS  https://review.opendev.org/65739817:36
kplantif i change out the aria2c calls with wget it works fine for me17:39
noonedeadpunkcloudnull that's great question regarding cinder... Don't know as well, and that's what I'd love to ask cinder folks, if I were on summit...17:39
noonedeadpunkkplant: you may apply https://review.opendev.org/#/c/656625/17:40
kplantyeah that's much cleaner than calling wget with shell :-)17:42
openstackgerritVadim Kuznetsov proposed openstack/openstack-ansible-os_octavia master: Add support for using distribution packages for OpenStack services  https://review.opendev.org/65204917:42
openstackgerritLogan V proposed openstack/openstack-ansible master: Set CentOS 7 distro job to non-voting  https://review.opendev.org/65741517:45
openstackgerritLogan V proposed openstack/openstack-ansible master: Revert "Set CentOS 7 distro job to non-voting"  https://review.opendev.org/65741617:45
openstackgerritLogan V proposed openstack/openstack-ansible master: Add support to deploy placement  https://review.opendev.org/65689117:45
*** Weifan has joined #openstack-ansible17:47
openstackgerritLogan V proposed openstack/openstack-ansible master: Set CentOS 7 distro job to non-voting  https://review.opendev.org/65741517:47
openstackgerritLogan V proposed openstack/openstack-ansible master: Revert "Set CentOS 7 distro job to non-voting"  https://review.opendev.org/65741617:47
*** strattao has quit IRC17:57
*** strattao has joined #openstack-ansible18:02
vakuznetodyssey4me  This https://opendev.org/openstack/openstack-ansible-os_octavia/src/branch/master/tasks/octavia_post_install.yml#L40 only works if octavia_cert_setup_host is localhost18:03
vakuznetodyssey4me re: https://review.opendev.org/#/c/582641/18:04
*** radeks_ has joined #openstack-ansible18:07
*** radeks has quit IRC18:09
*** markvoelker has quit IRC18:10
vakuznetodysey4me do you agree?18:11
noonedeadpunkvakuznet: you mean that task lacks delegate_to?18:13
vakuzneti don't think delegate will work (in all use case). slurp + copy content will.18:16
*** prometheanfire has quit IRC18:17
*** Weifan has quit IRC18:22
*** Weifan has joined #openstack-ansible18:26
*** Weifan has quit IRC18:33
*** KeithMnemonic has joined #openstack-ansible18:39
kplantnoonedeadpunk: i see you're already +2 on that change but i just want to add that it worked for me18:49
*** DanyC has joined #openstack-ansible18:55
*** prometheanfire has joined #openstack-ansible18:56
*** BjoernT has joined #openstack-ansible18:59
*** DanyC has quit IRC18:59
BjoernTquick question, stein is still a RC1 ?19:01
cjloaderhttps://releases.openstack.org/19:13
BjoernTYepp I know, was just wandering why there is a stable/stein branch but no tag19:15
djhankbBjoernT: Are you talking about the 19.0.0 tag? I was curious about the same thing19:17
hjohnson1Has anyone seen any problems regarding privsep?  Specifically, on Rocky, I have set glance to use cinder as the storage method.  Whenever I try to upload an image, I get errors about privsep...http://paste.openstack.org/show/750733/19:18
mnaserI think we're waiting for placement support to land first19:21
mnaserthat would be a good rc2 time19:21
hjohnson1I think it has something to do with sudo but I am having a hard time figuring out exactly what the cause is.19:22
logan-stein can't deploy on centos right now due to https://review.opendev.org/#/c/657386/19:25
logan-why would placement block stein though? maybe I misunderstood, but I thought we discussed at the ptg that there are no plans to backport it from train since it is not needed in stein19:28
strattaoI’m getting an error deploying a new rocky. The upper constraints file says I need python-manilaclient 1.24.2, but the repo server is only pulling in 1.24.119:29
BjoernTThanks logan-19:30
mnaserlogan-: well we've thought about getting the upgrade over with considering that stein is technically not out19:31
logan-gotcha19:31
*** mkuf has joined #openstack-ansible19:32
*** BjoernT_ has joined #openstack-ansible19:33
mgariepyhjohnson1, what os ?19:34
*** strattao_ has joined #openstack-ansible19:34
mgariepyhjohnson1, centos or ubuntu ?19:35
*** hwoarang_ has joined #openstack-ansible19:35
strattao_the openstack_release that is getting deployed with stable/rocky is 18.1.7dev719:37
strattao_does that version sound right?19:37
*** strattao_ has left #openstack-ansible19:38
*** strattao_ has joined #openstack-ansible19:38
*** strattao_ has left #openstack-ansible19:38
*** strattao_ has joined #openstack-ansible19:38
*** BjoernT has quit IRC19:39
*** strattao has quit IRC19:39
*** mkuf_ has quit IRC19:39
*** aedc has quit IRC19:39
*** hjohnson1 has quit IRC19:39
*** hwoarang has quit IRC19:39
*** strattao_ is now known as strattao19:39
kplantare there any plans to bring ceph-ansible up to 3.2 for stable/rocky?19:45
*** BjoernT_ has quit IRC19:48
*** hjohnson1 has joined #openstack-ansible19:48
hjohnson1Got temporarily disconnected from freenode :-(19:49
mgariepyhjohnson1, centos or ubuntu ?19:49
*** partlycloudy has quit IRC19:50
*** radeks_ has quit IRC19:50
*** partlycloudy has joined #openstack-ansible19:51
hjohnson1CentOS 719:51
logan-placement reviews please: https://review.opendev.org/#/c/657415/ https://review.opendev.org/#/c/656891/19:51
hjohnson1Also I think some packages may have been missed on installation??? For instance there is no oslo_rootwrap.cmd in the glance container.19:52
*** Weifan has joined #openstack-ansible19:52
mgariepydo you have /etc/sudoers.d/openstack-ansible ?19:53
hjohnson1mgariepy: let me check...19:54
hjohnson1mgariepy: Yes... just one line... Defaults:root !requiretty19:55
mgariepyhmm. cinder needs that: maybe there is something missing for glance ?  https://github.com/openstack/openstack-ansible-os_cinder/blob/master/templates/sudoers.j219:57
hjohnson1mgariepy Oh wow... the same stuff is missing from the /etc/sudoers.d/openstack-ansible  file in the cinder container as well :-(19:59
mgariepyhjohnson1, on cinder it should be sudoers.d/cinder_sudoers20:00
*** nwonknu has quit IRC20:00
mgariepy https://github.com/openstack/openstack-ansible-os_cinder/blob/stable/stein/tasks/cinder_post_install.yml#L14420:01
hjohnson1mgariepy:  Ooops...duh!!!20:01
mnaserlogan-: looks like 657415 failed? :<20:03
hjohnson1mgariepy: Ok... cinder has it... just not glance!20:03
mgariepyhjohnson1, maybe it's missing some stuff for that config.20:03
*** spatel has quit IRC20:03
logan-mnaser: ouch, apparently our aria2c fallback to get_url failed there http://logs.openstack.org/15/657415/2/check/openstack-ansible-deploy-aio_lxc-centos-7/1eb8589/logs/ara-report/result/2cdaf95b-1dee-46b0-b5cb-594b210bfe00/20:03
logan-mnaser: recheck should pass, thats first time ive seen the fallback fail20:04
mgariepyI gtg. but at least now you have some sort of idea where to look for this issue.20:04
mnaserthe internet sucks.20:04
logan-++20:04
hjohnson1mgariepy: Thanks for all the help!  I'll start digging20:04
hjohnson1My aria2c workaround the other day was recompile and re-install arai2c20:05
hjohnson1Kind of extreme but it worked :)20:06
*** BjoernT has joined #openstack-ansible20:06
*** hwoarang_ has quit IRC20:09
*** hwoarang has joined #openstack-ansible20:15
*** djhankb has quit IRC20:27
*** ansmith has quit IRC20:34
strattaoFYI, for future reference, we were pointing to the wrong upper-constraints file. ;)20:48
*** strattao has quit IRC20:48
*** pcaruana has quit IRC20:51
*** vnogin has joined #openstack-ansible20:51
*** vnogin has quit IRC20:56
*** nwonknu has joined #openstack-ansible21:01
*** nollidec has quit IRC21:07
*** djhankb has joined #openstack-ansible21:11
*** Miouge has quit IRC21:16
*** miouge1 has joined #openstack-ansible21:17
*** miouge1 has quit IRC21:18
*** miouge has joined #openstack-ansible21:18
*** nicolasbock has quit IRC21:21
*** miouge has quit IRC21:27
*** miouge has joined #openstack-ansible21:32
*** Talion has joined #openstack-ansible21:38
*** miouge has quit IRC21:38
*** miouge has joined #openstack-ansible21:39
*** miouge has quit IRC21:48
*** miouge has joined #openstack-ansible21:49
*** miouge has quit IRC21:49
*** miouge has joined #openstack-ansible21:50
*** miouge has quit IRC21:51
*** miouge has joined #openstack-ansible21:52
*** miouge has quit IRC21:54
*** miouge has joined #openstack-ansible21:55
*** hjohnson1 has quit IRC22:02
*** hamzaachi has joined #openstack-ansible22:03
*** ansmith has joined #openstack-ansible22:04
*** kplant has quit IRC22:19
*** hamzaachi has quit IRC22:28
NobodyCamGood afternoon OSA folks, I am converting a compute node to a shared_infra node, I stoped nova-compute, and neutron-linuxbridge-agent ran the remove playbook (remove_compute_node.yml), I'm now planing on setting up as a shared_infra node, any gotchas I should look out for?22:31
NobodyCamie. do I need to systemctl disable nova-compute / neutron-linuxbridge-agent22:32
*** kplant has joined #openstack-ansible22:38
*** Weifan has quit IRC22:49
NobodyCamlooking at https://docs.openstack.org/openstack-ansible/latest/admin/scale-environment.html; do I have to also list the containers if I want to add them all22:52
*** Weifan has joined #openstack-ansible22:55
guilhermespyou guys believe that I'm still "on the road"? :P hahah22:56
guilhermesphow's everyone?22:56
*** Weifan has quit IRC22:56
*** Weifan has joined #openstack-ansible22:56
*** hwoarang has quit IRC22:57
*** Weifan has quit IRC22:57
*** hwoarang has joined #openstack-ansible22:59
*** hjohnson1 has joined #openstack-ansible23:00
*** BjoernT has quit IRC23:01
openstackgerritKanishk Godha proposed openstack/openstack-ansible-os_swift master: Replace Module  https://review.opendev.org/65750223:23
*** gyee has quit IRC23:25
openstackgerritKanishk Godha proposed openstack/openstack-ansible-os_swift master: Replace Module  https://review.opendev.org/65677523:28
*** tosky has quit IRC23:32
openstackgerritKanishk Godha proposed openstack/openstack-ansible-os_keystone master: Replace Module  https://review.opendev.org/65639723:36
openstackgerritKanishk Godha proposed openstack/openstack-ansible-os_trove master: Replace Module  https://review.opendev.org/65677723:39
*** jsquare has quit IRC23:39
*** hwoarang has quit IRC23:41
*** hwoarang has joined #openstack-ansible23:42
kplanti have no idea why but my containers seem to be getting the wrong cidr... this is a snippet from my config: http://paste.openstack.org/show/750842/23:45
djhankbIf I have a venv not populate correctly - in this example, Cinder is failing because the venvs/cinder-xx/etc/os-brick folder is missing, how do I force its re-creation? Simply delete the venv? There isn't a container here23:45
kplanteth1 in the containers is getting 192.168.0.0/24 when it should be 192.168.24.0/2423:45
kplanttotally missing what i'm messing up here23:45
*** jsquare has joined #openstack-ansible23:45
djhankbkplant: Mine looks nearly identical, I'm using 192.168.41.0/24 and am not having that issue. I can paste it if you like - the only difference is the order23:47
kplantyeah i haven't had this problem in the past, i'm pretty sure i changed something and blew it up23:49
kplanti have no idea what though23:49
kplantwould you mind pasting yours? i've gone over mine so many times and i'm pretty sure i'm too biased to catch my own mistake at this point23:51
kplantsomething to do a stare and compare might be helpful23:52
djhankbsure give me a moment23:52
kplantappreciate it23:53
NobodyCamwell I guess you do have to add the containers23:57
*** ChosSimbaOne has quit IRC23:59
*** ChosSimbaOne has joined #openstack-ansible23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!