Friday, 2018-09-28

*** vnogin has joined #openstack-ansible00:17
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/rocky: Remove skip-metering-database deprecated param from ceilometer-upgrade  https://review.openstack.org/60576800:18
*** vnogin has quit IRC00:22
*** hamzy has joined #openstack-ansible00:25
prometheanfireis ocata dead for OSA?00:30
* prometheanfire is asking for http://logs.openstack.org/09/602309/1/check/openstack-ansible-functional-ubuntu-xenial/11b8abb/job-output.txt.gz#_2018-09-28_00_20_04_97647600:30
* prometheanfire thought there was something a week or so ago about pip failures around openssl00:40
mnaserprometheanfire: i think i saw odyssey4me push up a patch in relation to that00:48
mnaseri believe ocata is going to EM and odyssey4me/rax volunteer to maintain it :p00:48
mnaseri looked at that error and i had no ideas00:49
prometheanfireya, I work for rax :P I think it was him00:50
*** gyee has quit IRC00:51
*** shardy has quit IRC01:10
*** vnogin has joined #openstack-ansible01:17
*** shardy has joined #openstack-ansible01:18
openstackgerritinspurericzhang proposed openstack/openstack-ansible-os_neutron master: [Trivial Fix] Replace Chinese punctuation with English punctuation  https://review.openstack.org/60589901:19
*** vnogin has quit IRC01:21
openstackgerritinspurericzhang proposed openstack/openstack-ansible-plugins master: [Trivial Fix] Replace Chinese punctuation with English punctuation  https://review.openstack.org/60590001:24
openstackgerritinspurericzhang proposed openstack/openstack-ansible-ops master: [Trivial Fix] Replace Chinese punctuation with English punctuation  https://review.openstack.org/60590101:41
openstackgerritinspurericzhang proposed openstack/openstack-ansible-plugins master: [Trivial Fix] Replace Chinese punctuation with English punctuation  https://review.openstack.org/60590001:45
openstackgerritMerged openstack/openstack-ansible-tests master: zuul: Add template for jobs using distribution packages  https://review.openstack.org/60573401:49
*** vnogin has joined #openstack-ansible01:56
*** mschuppert has joined #openstack-ansible01:57
*** vnogin has quit IRC02:00
*** jamesdenton has joined #openstack-ansible02:07
*** cshen has joined #openstack-ansible02:29
*** cshen has quit IRC02:33
openstackgerritMerged openstack/openstack-ansible-ops master: Add changes to the sysconfig defaults file  https://review.openstack.org/60558603:02
openstackgerritMerged openstack/openstack-ansible-ops master: Refactor Filebeat configuration file  https://review.openstack.org/60583703:04
*** maddtux has joined #openstack-ansible03:07
*** cshen has joined #openstack-ansible04:29
*** cshen has quit IRC04:35
*** vnogin has joined #openstack-ansible04:37
*** cshen has joined #openstack-ansible04:42
*** vnogin has quit IRC04:42
*** cshen has quit IRC04:47
*** udesale has joined #openstack-ansible05:09
*** vnogin has joined #openstack-ansible05:17
*** vnogin has quit IRC05:21
*** mma has joined #openstack-ansible05:28
openstackgerritMerged openstack/openstack-ansible-ops master: [Trivial Fix] Replace Chinese punctuation with English punctuation  https://review.openstack.org/60590105:30
*** cshen has joined #openstack-ansible05:40
*** mma has quit IRC05:40
*** mma has joined #openstack-ansible05:45
*** cshen has quit IRC05:45
*** chkumar|off is now known as chandankumar05:46
*** mma has quit IRC06:05
*** mma has joined #openstack-ansible06:10
*** pcaruana has joined #openstack-ansible06:11
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592106:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592206:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592306:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592406:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592506:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592606:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592706:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592806:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592906:17
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593006:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593106:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593206:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593306:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593406:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593506:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593606:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593706:18
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593806:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593906:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594006:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594106:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594206:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594306:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594406:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594506:19
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594606:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594706:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594806:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594906:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595006:20
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595106:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595206:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595306:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595406:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595506:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595606:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_searchlight master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595706:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595806:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595906:21
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596006:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596106:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596206:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596306:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_zun master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596406:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596506:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596606:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596706:22
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596806:23
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596906:23
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597006:23
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597106:23
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597206:23
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597306:23
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597406:23
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597506:24
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597606:24
openstackgerritOpenStack Proposal Bot proposed openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597706:24
openstackgerritMerged openstack/openstack-ansible-ops master: Add Instance ID to logs  https://review.openstack.org/60583806:33
openstackgerritMerged openstack/openstack-ansible-ops master: Fix blank microversion  https://review.openstack.org/60585506:35
openstackgerritMerged openstack/openstack-ansible-ops master: Fix auditd logs using Filebeat  https://review.openstack.org/60586906:36
*** cshen has joined #openstack-ansible06:37
*** shardy has quit IRC07:01
*** shardy has joined #openstack-ansible07:02
*** gkadam has joined #openstack-ansible07:23
*** vnogin has joined #openstack-ansible07:34
*** hamzaachi has joined #openstack-ansible07:36
*** markvoelker has quit IRC07:36
arxcruzodyssey4me: http://logs.openstack.org/92/604292/4/check/openstack-ansible-functional-ubuntu-bionic/4be0b7d/logs/openstack/keystone1/stackviz/ \o/07:37
*** markvoelker has joined #openstack-ansible07:37
*** vnogin has quit IRC07:40
*** markvoelker has quit IRC07:42
openstackgerritMerged openstack/openstack-ansible master: Enable CentOS 7 basekit jobs  https://review.openstack.org/59336007:42
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/60599007:48
*** tosky has joined #openstack-ansible07:50
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services  https://review.openstack.org/60469507:58
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15  https://review.openstack.org/60428607:58
noonedeadpunkmorning everyone07:59
noonedeadpunkwhat do you think about this patch https://review.openstack.org/#/c/605769/2 ?08:01
*** vnogin has joined #openstack-ansible08:23
*** cshen has quit IRC08:24
*** vnogin has quit IRC08:28
*** DanyC has joined #openstack-ansible08:34
*** markvoelker has joined #openstack-ansible08:37
*** olivierb has joined #openstack-ansible08:38
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_keystone master: zuul: Switch to distro package installation template  https://review.openstack.org/60599808:44
*** arxcruz is now known as arxcruz|doctor08:49
*** shyamb has joined #openstack-ansible08:52
*** rgogunskiy has joined #openstack-ansible08:54
*** hamzaachi has quit IRC08:58
*** markvoelker has quit IRC08:59
olivierbMorning everyone, any volunteer for reviewing a very easy one ? https://review.openstack.org/#/c/605440/09:01
*** tosky has quit IRC09:02
*** tosky has joined #openstack-ansible09:03
odyssey4mejrosser: thanks for monitoring that rocky patch and rechecking it :)09:20
*** gillesMo has joined #openstack-ansible09:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server stable/rocky: Remove task which was for P-Q upgrade  https://review.openstack.org/60601409:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server stable/queens: Ensure that required python package install has a fallback  https://review.openstack.org/60601509:38
*** cshen has joined #openstack-ansible09:42
*** cshen has quit IRC09:55
*** shyamb has quit IRC09:56
openstackgerritbrandon zhao proposed openstack/openstack-ansible-os_glance master: use import_playbook instead of include  https://review.openstack.org/60602209:56
*** markvoelker has joined #openstack-ansible09:57
*** shyamb has joined #openstack-ansible09:58
openstackgerritMerged openstack/openstack-ansible stable/pike: Use loop_control for haproxy keystone back-end enablement  https://review.openstack.org/60551809:59
openstackgerritbrandon zhao proposed openstack/openstack-ansible-os_cinder master: use include_tasks instead of include  https://review.openstack.org/60602510:03
*** markvoelker has quit IRC10:18
*** shyamb has quit IRC10:27
*** hamzaachi has joined #openstack-ansible10:27
*** olivierb has quit IRC10:47
*** shyamb has joined #openstack-ansible11:01
*** flaviosr_ has quit IRC11:04
*** vnogin has joined #openstack-ansible11:05
*** vnogin has quit IRC11:10
*** flaviosr_ has joined #openstack-ansible11:15
*** udesale has quit IRC11:32
ebbexodyssey4me: https://review.openstack.org/#/c/605700/ does this need more context, or is this ok?11:38
odyssey4meebbex: you went backwards in time? I see the date there is 10.01.2017 from 10.02.201811:40
*** hamzaachi has quit IRC11:40
odyssey4meebbex: if you oculd include a link to the patch which removes the fixme that'd be good11:40
ebbexI don't know who's been doing the dates, but they haven't checked the git commits at all in that time (according to the git repo dates)11:40
odyssey4mealso, just do an introduction of the problem, given that there's no bug for this11:40
odyssey4meebbex: oh - that date is when it was last updated by us, not the commit date11:41
*** shyamb has quit IRC11:41
*** shyamb has joined #openstack-ansible11:41
ebbexodyssey4me: Yeah, I know, but according to the "git repo" there's been several changes in that period. That sum hasn't been updated since a commit in 2016, but there's been several commits to the project since then and "the master checksum".11:42
odyssey4meyeah, weird11:43
ebbexI figured I'd use the commit date, since it's really weird not using the latest commit in master but writing "latest in master as of <date>"11:44
*** yolanda has joined #openstack-ansible11:44
odyssey4meok, perhaps just explain the mismatch and your reasining in the commit message11:47
*** mschuppert has quit IRC11:54
*** Bhujay has joined #openstack-ansible11:58
openstackgerritErik Berg proposed openstack/openstack-ansible stable/queens: Bump SHA to fix flipping screens in spicehtml5  https://review.openstack.org/60570012:02
*** shyamb has quit IRC12:02
*** shyamb has joined #openstack-ansible12:03
openstackgerritMerged openstack/openstack-ansible master: Unfreeze networking-odl  https://review.openstack.org/60224312:04
noonedeadpunkodyssey4me evrardjp: can you take a look at https://review.openstack.org/#/c/605769/2 if you have some time?12:14
*** rgogunskiy has quit IRC12:22
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_cinder master: SUSE: Add support for openSUSE Leap 15  https://review.openstack.org/60605312:25
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_cinder master: zuul: Switch to distro package installation template  https://review.openstack.org/60605412:27
openstackgerritJames Denton proposed openstack/openstack-ansible-os_neutron master: Restart openvswitch only where needed  https://review.openstack.org/60018512:29
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_swift master: zuul: Switch to distro package installation template  https://review.openstack.org/60605612:30
mnasergood morning!12:31
mnaserpoor gate12:31
*** nicolasbock_ has joined #openstack-ansible12:32
odyssey4memnaser: yeah, thankfully it does seem to be slowly catching up again - I see the post jobs depleting slowly12:33
odyssey4meI think it should catch up over the w/end12:33
openstackgerritJames Denton proposed openstack/openstack-ansible master: Adds haproxy endpoints for networking-ovn support  https://review.openstack.org/58406912:34
hwoarangwhat's up with the gates in general? they feel really slow. was there a reduction in the infrastructure?12:38
*** maddtux has quit IRC12:40
openstackgerritMerged openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594412:41
openstackgerritMerged openstack/ansible-role-python_venv_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597412:42
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596712:42
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597012:42
openstackgerritMerged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594212:43
openstackgerritMerged openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596312:43
openstackgerritMerged openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596512:44
openstackgerritMerged openstack/ansible-role-systemd_service master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597712:44
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594312:44
openstackgerritMerged openstack/openstack-ansible-os_congress master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594012:45
openstackgerritMerged openstack/openstack-ansible-os_zun master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596412:46
openstackgerritMerged openstack/ansible-role-systemd_mount master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597512:46
openstackgerritMerged openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596812:46
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597112:46
openstackgerritMerged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596612:47
openstackgerritMerged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596912:47
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593812:47
openstackgerritMerged openstack/ansible-role-systemd_networkd master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597612:47
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596212:48
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595612:48
openstackgerritMerged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597312:48
openstackgerritMerged openstack/ansible-config_template master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60597212:48
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595312:48
openstackgerritMerged openstack/openstack-ansible-os_searchlight master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595712:49
openstackgerritMerged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595812:49
openstackgerritMerged openstack/openstack-ansible-os_panko master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595412:49
*** shyamb has quit IRC12:49
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593712:49
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594612:50
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595912:50
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595112:50
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594512:51
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594812:51
openstackgerritMerged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595512:52
mnasersorry for the spam but wanted to get those out of the way early12:52
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593412:52
openstackgerritMerged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594112:52
openstackgerritMerged openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596112:52
*** gokhani has quit IRC12:53
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593512:53
openstackgerritMerged openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595012:53
openstackgerritMerged openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593312:54
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594912:54
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592212:55
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592812:56
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593012:56
openstackgerritMerged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592312:56
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592512:57
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592112:57
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592612:57
openstackgerritMerged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60595212:57
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60594712:57
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592712:57
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_heat master: zuul: Switch to distro package installation template  https://review.openstack.org/60606312:57
mnaserodyssey4me: are you able to run next weeks meeting by any chance?13:03
odyssey4memnaser: yeah, I think i can do that - let me add a reminder to prepare13:04
mnaserodyssey4me: thank you.  i will be at openstack days nordic at that time so likely wont be able to13:04
openstackgerritMerged openstack/openstack-ansible-os_blazar master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593613:05
mnaseri can probably hop on my phone and tag along but certainly not run it13:05
odyssey4memnaser: ok, added a reminder13:08
hwoarangodyssey4me: i am looking at these random failures with the 'DB creation' for neutron http://logs.openstack.org/95/604695/18/check/openstack-ansible-functional-opensuse-423/b1b899c/logs/ara-report/ . I was wondering if the 'Create DB for service task' should have a run_once: True statement since we really want to create one database in the end no?13:08
hwoarangi think there is a race there where two hosts are delegated to the same host and they try to create the same DB at the same time13:09
hwoarangwhat do you think13:09
odyssey4mehwoarang: definitely, https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/main.yml#L155-L159 should have the same conditional as https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/main.yml#L136-L13813:10
odyssey4megood catch there!13:10
*** mma has quit IRC13:10
mnaseryep13:10
mnaseri agree13:11
hwoarangah conditional then13:11
hwoarangno run_once13:11
hwoarangok13:11
mnaserwhy not a run_once btw?13:11
odyssey4meno run_once, because there are many agents - we want only the server to do this13:11
mnaserahhhh13:11
mnaseryes13:11
mnasergood point13:11
hwoarangright13:11
hwoarangon it13:11
odyssey4mekeep the db creation on the control plane13:11
mnaserim gonna guess there might be a few other projects13:12
mnaserwith the same issue13:12
hwoarangyeah :/13:12
odyssey4mewell, only those with dstributed agents - so nova, neutron, cinder13:12
mnasernova is good13:12
odyssey4memaybe some fringe roles - masakari, etc13:12
mnaserhttps://github.com/openstack/openstack-ansible-os_nova/blob/master/tasks/main.yml#L128-L13313:12
odyssey4meceilometer I guess13:12
mnaserhttps://github.com/openstack/openstack-ansible-os_cinder/blob/master/tasks/main.yml#L94-L10113:13
mnasercinder is good too13:13
mnaserceilometer has no db anymore i think?13:13
odyssey4mefyi the same should be true for the mq tasks, so double-check those13:13
mnaserhttps://github.com/openstack/openstack-ansible-os_ceilometer/blob/master/tasks/main.yml#L112-L11513:13
mnaserits run_Once tho13:13
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593913:13
mnaserbtw odyssey4me i realize that because we use include_role13:13
mnaseri am unable use --tags ?13:13
odyssey4memnaser: which is that?13:14
mnaserfor example os_nova uses an include_role13:14
mnaserrather than roles: - os_nova13:14
mnaserand i think tags dont propagate..13:14
odyssey4meit can be done with tags - but only if done right - th emq tasks work with tags13:14
odyssey4meoh yeah - include role - is there in import role?13:15
mnaserweird, i tried nova-config the other day and it didnt actually run the config13:15
mnaserit just skipped everything13:15
odyssey4meimport role would make it work: https://docs.ansible.com/ansible/2.4/import_role_module.html13:15
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services  https://review.openstack.org/60469513:16
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15  https://review.openstack.org/60428613:16
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: tasks: neutron_db_setup: Only create the DB from the first neutron server  https://review.openstack.org/60606813:16
*** zul has quit IRC13:16
odyssey4meinclude_role is dynamic - dynamic includes only bring in the code at run-time, and tags are at play start, not run time13:16
odyssey4mebut we need to be careful where we use import, because import will make that code run no matter what... so it slows things down13:17
odyssey4meso if we want the code to always run, then we should use import13:17
hwoarangodyssey4me: jrosser mind giving the apparmor neutron thing another look please https://review.openstack.org/60469513:17
odyssey4meI think rocky/master is going to need some work for that13:17
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-openstack_openrc master: Change locale for openrc  https://review.openstack.org/60606913:17
openstackgerritMerged openstack/openstack-ansible stable/rocky: Use loop_control for haproxy keystone back-end enablement  https://review.openstack.org/60550413:18
odyssey4me\o/ finally!13:18
odyssey4meevrardjp: ok, if you could prep the next RC tag, which will be our release tag IMO, please go ahead13:19
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Remove unnecessary distro package installs  https://review.openstack.org/59018313:21
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60596013:21
openstackgerritMerged openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/60599013:25
openstackgerritMerged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592413:26
*** arxcruz|doctor is now known as arxcruz13:27
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593213:28
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60593113:29
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Move openstack_release to seperate file  https://review.openstack.org/60607613:30
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: DNM: test bumping openstack_release  https://review.openstack.org/60607813:31
mnaserodyssey4me: evrardjp ^ as we discussed, the DNM patch should prove it working13:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/rocky: Remove unnecessary distro package installs  https://review.openstack.org/60608013:31
mgariepycan i have some review on : https://review.openstack.org/#/c/605789/ please :D13:32
openstackgerritbhujay kumar proposed openstack/openstack-ansible master: Improve HAproxy SelfSign cert generation method  https://review.openstack.org/60608113:32
hwoarangmgariepy: done13:34
mgariepyyou guys are awesome13:34
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create master: Updated from OpenStack Ansible Tests  https://review.openstack.org/60592913:34
hwoarangthat's true13:34
mgariepywhich version of haproxy is available on suse ?13:35
hwoarangwhich suse :)13:35
mgariepyI stumbled upon https://www.haproxy.com/blog/truly-seamless-reloads-with-haproxy-no-more-hacks/ this but it requires 1.7 or 1.813:35
hwoarangleap 15.0 has 1.8.813:36
hwoarang42.3 is at 1.613:36
mgariepyok13:37
openstackgerritManuel Buil proposed openstack/openstack-ansible stable/rocky: Ensure ceilometer repo gets installed with neutron  https://review.openstack.org/60367713:38
openstackgerritArx Cruz proposed openstack/openstack-ansible-tests master: Add stackviz directory to the list of find_files  https://review.openstack.org/60429213:40
openstackgerritArx Cruz proposed openstack/openstack-ansible master: Add stackviz directory to the list of find_log_files  https://review.openstack.org/60608413:42
openstackgerritArx Cruz proposed openstack/openstack-ansible-os_tempest master: Enable stackviz support  https://review.openstack.org/60310013:43
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: tasks: neutron_db_setup: Only create the DB from the first neutron server  https://review.openstack.org/60606813:46
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services  https://review.openstack.org/60469513:46
openstackgerritMarkos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15  https://review.openstack.org/60428613:47
*** spatel has joined #openstack-ansible14:03
spateljamesdenton: i have question related SR-IOV network design in datacenter14:05
jamesdentonsure, whats up14:05
spatelI have switch in rack TOR-1 and TOR-2  (both 10G and connected to compute node )14:05
spatelin that rack i have 30 server14:05
jamesdentonk14:06
spatelif i set SR-IOV on eno1 (connected tor1) then if tor1 is dead then everything will be dead14:07
spatelcan i configure odd / even here?14:07
gillesMoHello ! openstack-ansible 17.1.1 : os-keystone role put kestone endpoints in maintenance mode in haproxy, but don't re-enable them (or there's a bug in haproxy). I have to reload haproxy to regain access and for other roles to be able to authenticate. Does someone see this too ?14:07
spatellike 15 compute connected to tor1 and other 15 connected to tor214:08
spatelhow do you design if this is your datacenter.. ?14:08
jamesdentonspatel that would be one way of doing it.14:08
openstackgerritPanagiotis Karalis proposed openstack/openstack-ansible-os_tacker master: [WIP]Tacker uses OpenStack Barbican for secret keys  https://review.openstack.org/60578414:09
*** mma has joined #openstack-ansible14:09
spateli should put both NIC in "sriov_host_interfaces: "eno1,eno2"14:09
jamesdentonspatel it's sort of one of the downsides at the moment, as i see it anyway, especially since you don't really have any control over which PF a VF might be sources from (when you have multiple NICs in a box)14:09
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Use PBR to determine current OpenStack version  https://review.openstack.org/60607614:10
jamesdentonall that will do is potentially provide VFs across both interfaces with no control over which will be used14:10
mnaserodyssey4me: evrardjp ^ i tested this locally and it works :D14:10
mnaserit should be much easier to backport too14:10
*** dxiri has quit IRC14:10
mnaserno more openstack_release bump14:11
spatelIf i enable VF on eno1 then it will target eno1 right?14:11
spatellets say i enable VF on eno1 of compute-1  and enable eno-2 on compute-214:12
spateladd / even14:12
jrosserodyssey4me: why does this keep going back into the check queue, rather than gate? https://review.openstack.org/#/c/605504/14:12
spatelodd / even14:12
spatelI want to keep second nic for control plan14:12
jamesdentonFor me, the use case is virtual network appliances that support some method of failover. So, I might have a virtual firewall in CAB1 using SR-IOV that is peered with a virtual firewall in CAB2. Each available only when their respective TOR is up. But because they are in a failover configuration, i can survive a TOR going offline14:12
jrosserodyssey4me: it's done that once for you and twice for me now, /me not understanding....14:13
spatelhmm!14:13
mnaserjrosser: it's merged anyways14:13
mnaserso?14:13
spatelDid you try bonding inside VM with SR-IOV ?14:14
jamesdentonspatel Yes, you can probably do that. You would have to move to per-node definitions (via openstack_user_config) rather than a global override in user_variables, but it should be doable. Ultimately, one one set of nodes 'vlan' provider label maps to eno1, and on the others to eno214:14
jamesdentoni have not, but given both virtual functions could potentially come from the same PF it doesn't make sense.14:14
spateljamesdenton: that would be good14:14
spatelbut it make sense if your PF connected to multiple TOR switches so you will survive switch failure14:15
spatelswitch failure knock out your rack14:16
gillesMoIt seems I hit https://bugs.launchpad.net/openstack-ansible/+bug/1791873 and also https://bugs.launchpad.net/openstack-ansible/+bug/1680075 if I disable my LDAP domain14:16
openstackLaunchpad bug 1791873 in openstack-ansible "Keystone LDAP tasks fail because haproxy pool is drained during install" [Medium,Confirmed] - Assigned to Jesse Pretorius (jesse-pretorius)14:16
openstackLaunchpad bug 1680075 in openstack-ansible "keystone fails with haproxy in maint mode" [High,Fix released] - Assigned to Logan V (loganv)14:16
spatelI think i like your idea about per compute configuration14:16
jamesdentonnow, there's probably a way to make it work using two provider labels (physnet1,physnet2) mapped to eno1 and eno2, respectively. You could then configure a provider network on each of those labels using the same VLAN and SUBNET info, and give a port from each to the VM. You might be able to configure bonding then, but not mode4. This is purely hypothetical14:16
spatelmanually i map them to eno1 and eno2  pci_passthrough14:16
jamesdentonWell each port on a NIC is considered a PF in most cases, so it won't do any good to span a NIC across two switches in this case - the VM gets a single port bound to a VF from one of those PFs (nic ports)14:17
spatelsomething like this https://community.mellanox.com/docs/DOC-148514:19
jamesdentonYou can use different NICs for difference hosts using the method here: http://www.jimmdenton.com/osa-sriov/. Check the 'Configuring overrides' section14:20
jamesdentonThat mellanox doc is fine, but assumes you have control over the VFs. Which with Neutron, you won't14:20
jamesdentonAFAIK, anyway14:20
jamesdentonHow many VMs run on these computes?14:21
spatelcool! i like that14:21
openstackgerritMerged openstack/openstack-ansible-repo_build stable/pike: Update repo_build test-vars data  https://review.openstack.org/60569114:22
spatelI have currently 2 VM per compute node14:22
spatelapplication is CPU intensive so i don't want to load more VM also i am doing numa pinning so no way i can crowd them14:22
jamesdentonhave you tried the same load testing with 2 VMs per host already?14:23
spatelI am doing it today14:23
spateli was going to build VM now14:23
jamesdentonI would also be curious to see how it differs by using the 'macvtap' vnic type vs 'direct'. That should be all you need to change. It still uses SR-IOV, but might give you more visibility in the OS14:23
jamesdentonwould be curious to see if you still see imrpovements14:24
spatelI tried macvtap and got lots of packet drops14:24
jamesdentonoh really? ok, well nevermind then14:24
spatelperformance was poor like tap14:24
spatelI am curious about DPDK now14:24
spatelwhat i need to do to test DPDK in existing OSA ?14:25
openstackgerritbhujay kumar proposed openstack/openstack-ansible-haproxy_server master: Improve SelfSign cert generation method  https://review.openstack.org/58485714:25
spateli need to migrate LinuxBridge to OSA right?14:25
jamesdentonYou would need to convert to OVS at a minimum, yes14:25
jamesdentonand the patches aren't merged, so there would be work to do there, too14:26
spatelbut how difficult its to doing on single compute node?14:26
jamesdentonit's a PITA14:26
spatelhmm!14:26
spateli am looking at your doc http://paste.openstack.org/show/731103/14:27
spatelcan i move this config to /host_var/ dir ?14:27
spatelis it possible ?14:28
jamesdentondo you already have host overrides there?14:28
spatelI have some custom setting related compute in /etc/openstack_deploy/host_vars/compute-1.yml14:28
spatelcan i fit your SR-IOV config there?14:29
jamesdentoni think you can14:29
spatelthat would be awesome!14:29
spatelso all i need "container_vars:" stanza right in /host_var/ ?14:29
spateli think i should try14:30
jamesdentontry it.14:30
spateldoing it now...14:30
spatelyou should link this doc to official website of OSA :)14:30
ioniyou can't use SRV-IO over bonding?14:31
spatelthis is very neat!14:31
spatelioni: NO NO NO :(14:31
ionii'm sad14:31
ioni:D14:31
spatelthat is biggest limitation14:31
mbuil_hwoarang: regarding https://review.openstack.org/#/c/606068/2, I wonder why we see two servers when doing gates if they are testing with aio. Do you know why?14:31
hwoarangmbuil_: we are not testing with AIO in the roles tests14:32
hwoarangAIO is only used in openstack-ansible repo14:32
ionispatel, so if you want redundancy if you have two switches, you will have to do bonding inside vm14:32
spatelioni: yes14:32
spatelioni: but again that need planning14:32
mbuil_hwoarang: oh ok! Then I understand we are testing in some sort of HA mode with two neutron servers?14:32
hwoarangno14:33
hwoarangwell neutron servers are just two containers14:33
spatelyou need 4 nic (first pair for data and second pair for control plan)14:33
hwoarangi am guessing there is a haproxy in front of them on the physical host if that's what you are asking14:33
hwoarangbut i dont remember how the test is wired up to be honest14:33
*** mma has quit IRC14:34
*** electrofelix has quit IRC14:34
spatelgeneral question folks, i have compute node showing it has two VM but when i run virsh list its showing only single VM :(14:34
spatelwhat do i find other VM info? nova think your compute node has no capacity but i can see it has only single vm running14:35
openstackgerritMerged openstack/openstack-ansible-repo_build stable/ocata: Update repo_build test-vars data  https://review.openstack.org/60569214:36
*** dxiri has joined #openstack-ansible14:36
spatelvirsh list --all  only showing single VM14:38
spatelHorizon saying you have no capacity14:39
*** Bhujay has quit IRC14:58
*** macza has joined #openstack-ansible14:58
*** dave-mccowan has joined #openstack-ansible15:07
*** mma has joined #openstack-ansible15:13
*** dave-mccowan has quit IRC15:13
*** mma has quit IRC15:15
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/rocky: Ceilometer is a requirement of networking-odl  https://review.openstack.org/60491515:21
mbuil_spatel: where do you see that the compute node is showing it has two VMs?15:32
spatelhorizon (hypervisor list)15:33
spatelit say count 2 and showing Used vCPU 32 ( i have 32 core on compute host)15:33
*** lbragstad is now known as elbragstad15:38
*** dxiri has quit IRC15:46
spateljamesdenton: i am trying to create sr-iov instance and getting this error in nova.conf   http://paste.openstack.org/show/731106/15:51
spatellibvirtError: Node device not found: no node device with matching name 'net_enp3s1f4_00_00_00_00_00_00'15:52
spatellook like SR-IOV created bunch of enp3s1f* interface for VF15:52
*** DanyC has quit IRC15:52
jamesdentoni noticed similar behavior on my qlogic nic15:52
jamesdentondoes this node already have a VF assigned to some VM?15:53
*** DanyC has joined #openstack-ansible15:53
spatelthis is fresh machine15:53
spatelnothing running on it15:53
spatelin /etc/nova/nova.conf has "pci_passthrough_whitelist = "{ "physical_network":"vlan", "devname":"eno1" }""15:53
jamesdentonis there a enp3s1f4 interface?15:53
spatelhttp://paste.openstack.org/show/731107/15:54
spateli have created 8 VF in eno115:54
spatelso it spawn 8 enp3s1f[1-7]15:55
jamesdentoni take the VM failed to boot?15:55
spatelyes it failed with this error "Insufficient compute resources: Claim pci failed"15:56
jamesdentoncan you send the output of 'ip link show enp3s1f4'15:56
-spatel- [root@ostack-compute-66 nova]# ip link show enp3s1f415:56
-spatel- 31: enp3s1f4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 100015:56
-spatel- link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff15:56
jamesdentonis eno1 UP?15:57
*** DanyC has quit IRC15:57
spatelyes its UP15:57
spateli wonder if we need to change eno1 to enp3s1f*   here "{ "physical_network":"vlan", "devname":"eno1" }"15:57
jamesdentonstandby15:58
*** hamzaachi has joined #openstack-ansible15:58
spatelk15:58
jamesdentonthis is centos, right?16:01
spatelyes16:01
spatel7.516:01
jamesdentoncan you send output of 'ip link show eno1' to pastebin?16:01
spatelok16:01
spatelhttp://paste.openstack.org/show/731108/16:02
spatelhold on something is wrong ethtool eno1 saying  "Link detected: no"16:03
spatelbut still it shouldn't throw that error16:04
jamesdentonNO-CARRIER usually means something isn't connected16:04
spateli am looking at switch16:04
jamesdentonwell, it may not bind if the interface is in a DOWN state16:04
spatellet me pick other compute node hold on16:05
jamesdentoni also have a similar error in my logs, for a port that is currently in use for sr-iov16:05
jamesdentonevery 60 seconds16:05
spateldid you fix it ?16:06
spatellook like bad cable Ethernet1/27 is down (Link not connected)16:06
spatelfinding other compute node16:06
spatelBRB16:08
jamesdentoni see similar bugs related to that error. but i don't know that its a failure-induced error. my vm is working fine16:08
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia master: Generate certificates once only  https://review.openstack.org/60612416:09
mnaserhwoarang: odyssey4me ^ another run_once mess up16:09
*** jonher has quit IRC16:16
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for oslo.messaging backend deployment  https://review.openstack.org/57026116:24
*** gyee has joined #openstack-ansible16:24
*** Leo_m has joined #openstack-ansible16:24
*** Darcidride has joined #openstack-ansible16:30
*** shyamb has joined #openstack-ansible16:30
*** jonher has joined #openstack-ansible16:31
*** Darcidride has quit IRC16:32
*** shyamb has quit IRC16:35
*** shyamb has joined #openstack-ansible16:35
*** hamzaachi has quit IRC16:36
*** dxiri has joined #openstack-ansible16:36
*** dxiri has quit IRC16:38
*** ianychoi has quit IRC16:39
*** dxiri has joined #openstack-ansible16:39
*** gkadam has quit IRC16:42
*** ianychoi has joined #openstack-ansible16:44
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia stable/rocky: use include_tasks instead of include  https://review.openstack.org/60613716:49
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia stable/rocky: use include_tasks instead of include  https://review.openstack.org/60613716:51
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia stable/rocky: Generate certificates once only  https://review.openstack.org/60613816:51
*** priteau has joined #openstack-ansible16:54
*** shyamb has quit IRC17:03
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia master: Automatically create and import keypair if it doesn't exist  https://review.openstack.org/60614317:05
*** hamzaachi has joined #openstack-ansible17:07
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia master: Automatically create and import keypair if it doesn't exist  https://review.openstack.org/60614317:08
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia master: Automatically create and import keypair if it doesn't exist  https://review.openstack.org/60614317:16
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia master: Create flavor once only (but set flavor fact on all nodes)  https://review.openstack.org/60614617:16
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_octavia master: Only run OpenStack tasks once  https://review.openstack.org/60614617:21
*** macza has quit IRC17:24
*** macza has joined #openstack-ansible17:24
*** macza has quit IRC17:29
spateljamesdenton: check this out https://lists.gt.net/openstack/dev/6441817:35
jamesdentondid you get the link up?17:37
jamesdentoni would ignore the error for now17:37
spatelrebooting machine.. had some issue with NIC firmware so upgraded firmeware17:37
spatelrunning playbook on compute to configure SR-IOV17:44
spatelBRB17:46
*** spatel has quit IRC18:02
*** macza has joined #openstack-ansible18:07
prometheanfireodyssey4me: does os_ironic need whatever fix you did for pyopenssl? http://logs.openstack.org/09/602309/1/check/openstack-ansible-functional-ubuntu-xenial/11b8abb/job-output.txt.gz#_2018-09-28_00_20_04_97647618:08
*** macza has quit IRC18:12
jamesdentonIf anyone has some time, i could use a hand in figuring out what i can do about failures here: https://review.openstack.org/#/c/584069/18:13
openstackgerritMerged openstack/openstack-ansible-os_neutron master: tasks: neutron_db_setup: Only create the DB from the first neutron server  https://review.openstack.org/60606818:20
*** macza has joined #openstack-ansible18:30
*** spatel has joined #openstack-ansible18:39
*** gillesMo has quit IRC18:47
spateljamesdenton: i setup new compute node and there getting "error: pop from empty list"18:54
spatelfull error is instance, pci_request_id.pop()  pop from empty list18:55
spatellook like some strange stuff going on here18:55
spateli can see it created VF on PF18:55
jamesdentonyour playbooks completed successfully?18:56
spatelyes18:56
spatelthey all successful18:56
*** hamzaachi has quit IRC18:56
spateli can see 3rd node in "neutron agent-list --agent_type 'NIC Switch agent'"18:56
jamesdentonwhat changed between this attempt and the one you did last week? just moving the variables?18:56
*** hamzaachi has joined #openstack-ansible18:56
spatelnothing changed so far18:57
spatellet me compare two node side by side18:57
jamesdentonyou're using the same method?18:57
spatelyes same method same nic name... all compute node are identical18:57
jamesdentonok. you had mentioned moving some things to host_vars, and possibly using different nic port, thats why i ask18:58
spateli didn't do that i am just trying to do same method which i did with first node.. if that work then i will do other custom method18:58
jamesdentonok. where did you see that "pop from empty list" error? nova-compute log?18:59
spatelyes on compute node..18:59
spatelhold on let me try something18:59
spateldo i need to run neutron playbook on all infra node again?19:00
jamesdentonno, you should be good there.19:00
spateloh!! ok19:00
jamesdentonjust neutron and nova playbooks against this one node19:00
spateli am re-running them anyway19:00
spatelincase something missed19:00
spatelyes!! i just ran two playbook against new compute node..19:01
spatelneutron agent-list --agent_type 'NIC Switch agent'   showing all compute node with  :-)19:01
jamesdentonthat's a start19:01
-spatel- [root@ostack-compute-63 ~]# cat /etc/nova/nova.conf | grep pci19:02
-spatel- pci_passthrough_whitelist = "{ "physical_network":"vlan", "devname":"eno1" }"19:02
spatelalso i can see all VF in "ip link show eno1"19:02
mnaserspotz: id love for you to document a lot of this stuff :)19:03
mnasererr19:03
mnaserspotz: oops19:03
mnaserGAH19:03
mnaserspatel: **19:03
spateldo i need to re-create neutron port or i can use old neutron port ?19:03
spotzmnaser: hehehe19:03
jamesdentonyou should be able to reuse it19:03
spatelthat what i thought19:03
jamesdentonmnaser some of it is documented here: https://docs.openstack.org/openstack-ansible-os_neutron/latest/configure-network-services.html. Hopefully spatel can provide some good feedback on how to tweak that19:06
noonedeadpunkfolks, probably you can check this change https://review.openstack.org/#/c/605769/2 ?19:07
spatelI am on that page and i follow that document to setup SR-IOV19:07
jamesdentonsomeone yesterday mentioned we need to tweak the nova.conf template to move some vars around.19:07
spatelhe was talking about put pci stuff in [pci] section19:09
jamesdentonthats right19:09
spateldo you think that is the issue..19:09
spateli don't think so19:09
jamesdentonno19:09
spatellet me reboot my compute node and see19:09
*** elbragstad has quit IRC19:10
*** elbragstad has joined #openstack-ansible19:10
*** noonedeadpunk has quit IRC19:11
jamesdentonspatel looks like pci_passthrough_whitelist was deprecated in Ocata. Still works as-is, but we'll need to fix that moving forward19:11
*** hamzaachi has quit IRC19:12
jamesdentonspatel re: the error you're seeing "no node device with matching name" - http://lists.openstack.org/pipermail/openstack/2018-January/045982.html19:17
spateli read that19:20
spatelvirsh nodedev-list   i am not seeing any device list here which is in error19:20
spateldo you seeing your PCI device in that command?19:20
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Use PBR to determine current OpenStack version  https://review.openstack.org/60607619:22
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: Add ceph-handler role  https://review.openstack.org/60617819:22
mnasercores: we have a gate blockage from ceph -- https://review.openstack.org/#/c/606178/119:23
mnasercc logan- ^19:23
logan-thanks mnaser19:25
mnaserthis is going to cause so much resets to the gate :(19:25
jamesdentonspatel I did not see the interface it was complaining about in that output, but after restarting libvirtd it appeared19:26
logan-whys that mnaser? doesnt look like we have anything gating atm19:26
mnaserah probably not gates but we'll need a lot of rechecks19:26
mnaserwith a big queue :(19:26
logan-oh, gotcha19:26
logan-yeah, at least the noderequest backlog should die off over the weekend :)19:27
spateli am not seeing device list here is the output http://paste.openstack.org/show/731114/19:28
spatelare you seeing same ?19:28
jamesdentonoh i see what you mean. no, i can see my devices. but i wouldn't worry about that at the moment.19:29
spatelhmm19:34
spatelstill getting same error Instance failed to spawn: IndexError: pop from empty list19:39
*** hamzaachi has joined #openstack-ansible19:42
jamesdentonok. do you get that immediately from the client? Or are you seeing that in a log19:44
jamesdentonand are you doing any cpu pinning via flavor19:45
spatelwhen i launch instance it shows building VM and then throwing error19:50
spatelyes i did CPU pinning19:50
spatellet me try different flavor19:50
spatelnon-numa19:50
*** Emine has quit IRC19:52
spateli tried different flavor (non-numa and got same error)19:54
spatelError updating resources for node ostack-compute-63: libvirtError: Node device not found: no node device with matching name 'net_enp3s1f4_00_00_00_00_00_00'19:54
spateldo you think this is causing issue19:55
spatelhow do i know my compute node pushing information to nova-scheduler ?19:55
*** Emine has joined #openstack-ansible19:55
*** DanyC has joined #openstack-ansible19:55
spatelpop empty means scheduler doesn't have any PCI info related compute right>19:57
spateljamesdenton: where this info coming from http://paste.openstack.org/show/731117/19:58
*** openstackgerrit has quit IRC20:07
jamesdentonpop usually refers to an attempt to pop an item out of a list. if the list is empty, there's nothing to pop20:12
jamesdentondo you know the node id for this particular compute node?20:14
*** DanyC has quit IRC20:34
*** openstackgerrit has joined #openstack-ansible20:38
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Fixes too low security group rules quota  https://review.openstack.org/60082620:38
openstackgerritGerman Eichberger proposed openstack/openstack-ansible-os_octavia master: Break out config files for each octavia service  https://review.openstack.org/60322820:50
*** spatel has quit IRC20:58
*** shardy has quit IRC21:00
*** priteau has quit IRC21:42
*** hamzaachi has quit IRC21:43
*** KeithMnemonic has quit IRC21:47
*** spatel has joined #openstack-ansible22:09
*** spatel has quit IRC22:14
*** macza_ has joined #openstack-ansible22:40
*** macza has quit IRC22:42
*** tosky has quit IRC22:42
openstackgerritMerged openstack/openstack-ansible-os_octavia stable/rocky: use include_tasks instead of include  https://review.openstack.org/60613722:45
*** elbragstad has quit IRC22:48
*** macza_ has quit IRC22:53
*** macza has joined #openstack-ansible22:53
*** macza has quit IRC22:58
*** elbragstad has joined #openstack-ansible23:01
*** elbragstad has quit IRC23:11
*** vnogin has joined #openstack-ansible23:15
*** macza has joined #openstack-ansible23:17
*** vnogin has quit IRC23:20
*** macza has quit IRC23:21
*** gyee has quit IRC23:33
*** priteau has joined #openstack-ansible23:44
*** priteau has quit IRC23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!