Tuesday, 2018-12-18

*** Emine has quit IRC00:04
*** dave-mccowan has joined #openstack-ansible00:11
*** cshen has quit IRC00:12
*** macza has quit IRC00:13
*** macza has joined #openstack-ansible00:15
*** dave-mccowan has quit IRC00:18
*** macza has quit IRC00:20
*** fmulti has joined #openstack-ansible00:22
fmultihi00:22
fmultii ran ansible-hardening on ubuntu 16.0400:22
fmultii am now trying to plug in a USB external HDD and am not having any luck00:22
fmultii told ansible-hardening to enable autofs and allow usb mass storage00:23
fmultidrive shows via "lsusb" command, but thats it00:23
fmultiam i missing something?00:26
fmultishouldn't the drive just pop-up on the desktop?00:26
*** Emine has joined #openstack-ansible00:34
*** ansmith has joined #openstack-ansible00:40
*** nurdie has joined #openstack-ansible00:46
*** nurdie has quit IRC00:51
*** DanyC_ has joined #openstack-ansible00:56
*** DanyC has quit IRC00:59
*** DanyC_ has quit IRC01:00
*** ansmith has quit IRC01:02
*** fmulti has quit IRC01:07
*** gyee has quit IRC01:18
*** Emine has quit IRC02:00
*** hwoarang has quit IRC02:32
*** hwoarang has joined #openstack-ansible02:34
*** idlemind has joined #openstack-ansible02:36
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Revert "Use tempest run for generating subunit results"  https://review.openstack.org/62507002:59
*** hwoarang has quit IRC03:16
*** hwoarang has joined #openstack-ansible03:17
*** hwoarang has quit IRC03:30
*** hwoarang has joined #openstack-ansible03:32
*** cshen has joined #openstack-ansible04:10
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882004:10
*** udesale has joined #openstack-ansible04:11
*** cshen has quit IRC04:15
*** Bhujay has joined #openstack-ansible04:20
*** Bhujay has quit IRC04:21
*** Bhujay has joined #openstack-ansible04:21
*** Bhujay has quit IRC04:22
*** Bhujay has joined #openstack-ansible04:23
*** hwoarang has quit IRC04:46
*** hwoarang has joined #openstack-ansible04:49
*** chkumar|out is now known as chandankumar04:53
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_tempestconf_profile for handling named args  https://review.openstack.org/62318705:49
*** cshen has joined #openstack-ansible05:53
*** cshen has quit IRC05:57
*** yolanda has joined #openstack-ansible06:07
*** mgagne_ has quit IRC06:35
*** mgagne has joined #openstack-ansible06:39
*** hwoarang has quit IRC06:57
*** hwoarang has joined #openstack-ansible07:00
*** DanyC has joined #openstack-ansible07:11
*** DanyC has quit IRC07:16
*** DanyC has joined #openstack-ansible07:17
*** cshen has joined #openstack-ansible07:24
fnpanicgood morning07:27
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_tempestconf_profile for handling named args  https://review.openstack.org/62318707:28
*** gkadam has joined #openstack-ansible07:28
*** cshen_ has joined #openstack-ansible07:30
*** cshen has quit IRC07:30
*** Namrata has joined #openstack-ansible07:35
jrosserMorning07:48
fnpanicjrosser: does the proxy zuul job work?07:51
jrosserfnpanic: you can see it here https://review.openstack.org/#/c/62552307:52
fnpanicoh some jobs are failing07:53
jrosserHere is the squid log from that http://logs.openstack.org/23/625523/8/check/openstack-ansible-deploy-aio_proxy-ubuntu-bionic/8cb7838/logs/host/squid/access.log.txt.gz07:54
fnpaniclooks like when you install from distro packages it does not work or do i read this wrong?07:55
jrosserDon’t worry about the failing jobs, they are unrelated and are non voting07:55
jrosserThe only one job running with the proxy has “proxy” in the job name. The rest are as before07:55
*** hwoarang has quit IRC07:56
fnpanicah ok07:56
fnpanicthe squid log does at least block nothing07:56
*** shardy has joined #openstack-ansible07:56
jrosserClick the job name you can navigate all the log files07:56
fnpanicthe proxy job seems to work :-)07:57
*** hwoarang has joined #openstack-ansible07:57
fnpanicara also looks great07:58
fnpanicthis is very cool ci infra...07:58
fnpanicdamn07:58
jrosserIt does - I arranged it so the containers have no default route so they get good coverage with the proxy07:58
*** kopecmartin|off is now known as kopecmartin07:59
fnpanicawesome so if i cherry pick  625545  and 625312 it should work?07:59
fnpanicbrb coffee07:59
jrosserBut tasks on the host just runs ansible with the proxy env in place, but things can still go direct if they choose so the coverage is not so good07:59
fnpanicok. so i will try in my setup where there is no direct route :-)08:00
jrosserIf you make sure you have cherry picked the two depends-on patches you should be good08:00
*** rodolof has joined #openstack-ansible08:00
chandankumarjrosser: Hello08:01
jrosserHello08:01
chandankumarjrosser: regarding this review https://review.openstack.org/#/c/625670/1 -> regarding yesterday discussion on octavia and octavia-tempest-plugin08:01
chandankumarjrosser: https://github.com/openstack/openstack-ansible-os_tempest/commit/bf077bc1936432d3677cc67eb28f7b268505dd79 from this commit, it does not provide too much info why it was added in the first place08:02
jrosserIt’s is odd isn’t it - I might have expected a comment given it’s not actually a plug-in08:03
jrosserPerhaps we propose a patch to remove it and make sure the Octavia tests still work?08:03
chandankumarjrosser: yes I will do that08:03
chandankumarjrosser: one more thing I need to discuss08:03
chandankumarjrosser: https://review.openstack.org/623187 -> we cannot tempest patches in os_tempest roles as required projects are missing from the job08:04
chandankumarjrosser: because when I added a depends on for python-tempestconf on os_tempest role it was not working08:05
chandankumarjrosser: I am not sure here my assumption is correct or not, please have a look08:05
jrosserI will look - I do find it hard to follow all the moving parts here though :/08:07
*** rodolof has quit IRC08:07
*** noonedeadpunk[h] has joined #openstack-ansible08:07
fnpanicmhhh08:08
fnpanici am a bit confused about the rabbit patch08:08
fnpanicit will look for /etc/ssl/mariadb-key08:08
fnpanicwhere is this key downloaded?08:08
fnpanicthe files in the patch refer to files/gpg/4D206F8908:09
fnpanicmaybe i am to dump08:09
*** noonedeadpunk has quit IRC08:09
NamrataHi while upgrading from queens to rocky /run-upgrade.sh fails at task  RUN_TASKS+=("rabbitmq-install.yml -e 'rabbitmq_upgrade=true'") more information: http://paste.openstack.org/show/737525/\08:11
Namratacan anybody help me with this08:11
Namratahttp://paste.openstack.org/show/737525/08:12
*** hamzaachi has joined #openstack-ansible08:12
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Remove octavia in favor of octavia-tempest-plugin  https://review.openstack.org/62582808:17
chandankumarjrosser: ^^08:17
*** DanyC has quit IRC08:18
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Remove octavia in favor of octavia-tempest-plugin  https://review.openstack.org/62582808:21
*** Namrata has quit IRC08:21
*** jamesdenton has quit IRC08:22
*** jamesdenton has joined #openstack-ansible08:23
*** priteau has joined #openstack-ansible08:47
*** thuydang has joined #openstack-ansible08:48
fnpanicso for the proxy patches08:51
fnpanicwhich task is downloading the keys to /etc/ssl/mariadb-key for example? the patches states files with files/gpg/ID08:51
fnpanic?08:51
jrosserfnpanic: for galera client this https://review.openstack.org/#/c/625681/09:00
*** mcela has joined #openstack-ansible09:08
jamesdentonodyssey4me looks like the neutron migration patch is coming along! it's looking like i won't be able to give it a closer look until the end of the week. i'm out another day with a sick infant09:11
*** mcela has quit IRC09:19
*** cshen_ has quit IRC09:21
*** mcela1 has joined #openstack-ansible09:22
*** gkadam has quit IRC09:23
*** Bhujay has quit IRC09:24
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Update ansible to 2.7.5  https://review.openstack.org/62586009:41
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-tests master: Update ansible to 2.7.5  https://review.openstack.org/62586109:44
fnpanicjrosser: thanks!09:46
fnpanicdeploy is already running :-)09:46
*** DanyC has joined #openstack-ansible09:51
*** cshen has joined #openstack-ansible09:56
*** cshen has quit IRC10:01
*** Bhujay has joined #openstack-ansible10:02
*** Bhujay has quit IRC10:03
*** Bhujay has joined #openstack-ansible10:04
*** Bhujay has quit IRC10:05
*** Bhujay has joined #openstack-ansible10:05
*** Bhujay has quit IRC10:06
*** Bhujay has joined #openstack-ansible10:07
cloudnullgood mornings OSA peoples!10:11
jrossero/ morning cloudnull! how were your travels?10:11
*** electrofelix has joined #openstack-ansible10:12
cloudnullo/ hey jrosser -- the travels were good! just got back home yesterday, so now begins the time shift re-adjustment period :)10:12
cloudnullTL;DR on the traveling: if you've never been to vietnam, or cambodia, go.10:13
jrosserah yes bodyclock=rand()10:13
cloudnull^ trutg10:13
cloudnull**truth10:13
* cloudnull its 0400 but i think its 1400.10:13
chandankumarjrosser: is it a known issue http://logs.openstack.org/28/625828/2/check/openstack-ansible-functional-opensuse-423/0ce3a87/job-output.txt.gz#_2018-12-18_08_52_07_004590 ?10:17
jrosserchandankumar: i did see that - we are at the mercy of upstream repos breaking us sadly, that needs a bit of suse knowhow and digging in their repo to figure out whats gone wrong10:20
jrosserevrardjp: hwoarang  any clues on http://logs.openstack.org/28/625828/2/check/openstack-ansible-functional-opensuse-423/0ce3a87/job-output.txt.gz#_2018-12-18_08_52_07_00459010:21
*** maharg101 has quit IRC10:21
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Further simplify the networking stack by eliminating veths  https://review.openstack.org/60875910:23
evrardjpjrosser: did you try removing libxml2 ?10:23
jrossercloudnull: i have a pile here if you're looking at reviews https://review.openstack.org/#/q/topic:deprecate-filters-as-tests+(status:open+OR+status:merged)10:24
jrosserevrardjp: i didnt try anything yet.....10:25
fnpanicjrosser: hosts and infra playbooks worked with the scripts10:26
fnpanicopenstack setup fails because the proxy is used instead of direct access with aio :-(((10:27
openstackgerritMerged openstack/openstack-ansible-rsyslog_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62176710:27
evrardjpit's also very new10:27
fnpanichttp://paste.openstack.org/show/737539/10:27
fnpanicsynnefo-proxy is the squid10:28
jrosserevrardjp: is it that the repo is inconsistent? Problem: libxml2-devel-2.9.8-3.14.x86_64 requires libxml2-2 = 2.9.810:28
cloudnulljrosser looking10:28
jrosserthat the point release of libxml isnt there to match the devel file dependancies10:28
evrardjpyeah I thought of that jrosser10:29
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning master: Update mailinglist from dev to discuss  https://review.openstack.org/62178710:29
evrardjpI asked on our channels10:29
openstackgerritMerged openstack/openstack-ansible-specs master: Update mailinglist from dev to discuss  https://review.openstack.org/62178610:29
evrardjpmaybe recheck -- see if it works better10:29
openstackgerritMerged openstack/openstack-ansible-os_trove master: Update mailinglist from dev to discuss  https://review.openstack.org/62176110:30
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Update mailinglist from dev to discuss  https://review.openstack.org/62178110:30
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Update mailinglist from dev to discuss  https://review.openstack.org/62177510:31
openstackgerritMerged openstack/openstack-ansible-os_designate master: Update mailinglist from dev to discuss  https://review.openstack.org/62174910:32
openstackgerritMerged openstack/openstack-ansible-os_zaqar master: Update mailinglist from dev to discuss  https://review.openstack.org/62176810:32
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Update mailinglist from dev to discuss  https://review.openstack.org/62174710:32
openstackgerritMerged openstack/openstack-ansible-os_rally master: Update mailinglist from dev to discuss  https://review.openstack.org/62177610:32
*** rodolof has joined #openstack-ansible10:33
openstackgerritMerged openstack/openstack-ansible-os_nova master: Update mailinglist from dev to discuss  https://review.openstack.org/62179410:34
openstackgerritMerged openstack/openstack-ansible-os_monasca master: Update mailinglist from dev to discuss  https://review.openstack.org/62178810:34
openstackgerritMerged openstack/openstack-ansible-os_zun master: Update mailinglist from dev to discuss  https://review.openstack.org/62174110:34
openstackgerritMerged openstack/openstack-ansible-ops master: Update mailinglist from dev to discuss  https://review.openstack.org/62174310:34
openstackgerritMerged openstack/openstack-ansible-os_heat master: Update mailinglist from dev to discuss  https://review.openstack.org/62178310:34
openstackgerritMerged openstack/openstack-ansible-rsyslog_client master: Update mailinglist from dev to discuss  https://review.openstack.org/62178210:34
openstackgerritMerged openstack/openstack-ansible-openstack_openrc master: Update mailinglist from dev to discuss  https://review.openstack.org/62178410:34
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Update mailinglist from dev to discuss  https://review.openstack.org/62174810:35
openstackgerritMerged openstack/openstack-ansible-repo_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62177110:35
openstackgerritMerged openstack/openstack-ansible-os_swift master: Update mailinglist from dev to discuss  https://review.openstack.org/62174410:35
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62175010:35
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Update mailinglist from dev to discuss  https://review.openstack.org/62175310:35
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Update mailinglist from dev to discuss  https://review.openstack.org/62177710:35
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Update mailinglist from dev to discuss  https://review.openstack.org/62176510:35
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Update mailinglist from dev to discuss  https://review.openstack.org/62178510:35
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Update mailinglist from dev to discuss  https://review.openstack.org/62177810:36
chandankumarodyssey4me: Hello10:36
evrardjpjrosser: I don't know where we fetch libxml2-devel10:36
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Update mailinglist from dev to discuss  https://review.openstack.org/62177310:36
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Update mailinglist from dev to discuss  https://review.openstack.org/62175510:36
chandankumarodyssey4me: I need some help on this help https://review.openstack.org/#/c/623187/10:37
evrardjpjrosser: 2.9.8 should be a tumbleweed only package -- https://software.opensuse.org/package/libxml2-devel10:37
evrardjpdid we mix repos there?10:37
chandankumarodyssey4me: current in python-tempestconf job tempestconf is getting installed from pip http://logs.openstack.org/87/623187/7/check/openstack-ansible-functional-tempestconf-centos-7/ec08089/logs/ara-report/result/9d33dcab-7d31-4871-8bd3-47746bc81802/10:37
openstackgerritMerged openstack/openstack-ansible-memcached_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62176910:37
openstackgerritMerged openstack/openstack-ansible-repo_build master: Update mailinglist from dev to discuss  https://review.openstack.org/62177210:37
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Update mailinglist from dev to discuss  https://review.openstack.org/62177410:37
openstackgerritMerged openstack/openstack-ansible-os_molteniron master: Update mailinglist from dev to discuss  https://review.openstack.org/62174610:37
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Update mailinglist from dev to discuss  https://review.openstack.org/62176010:37
openstackgerritMerged openstack/openstack-ansible-galera_client master: Update mailinglist from dev to discuss  https://review.openstack.org/62175710:37
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Update mailinglist from dev to discuss  https://review.openstack.org/62175810:37
chandankumarodyssey4me: I want to install it from zuul cloned and checkout repo10:38
chandankumarodyssey4me: what do I need to do make it happen?10:38
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62176310:38
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Update mailinglist from dev to discuss  https://review.openstack.org/62178010:38
openstackgerritMerged openstack/openstack-ansible-os_glance master: Update mailinglist from dev to discuss  https://review.openstack.org/62177010:38
chandankumarodyssey4me: It might be happening due to this https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L27810:38
openstackgerritMerged openstack/openstack-ansible-pip_install master: Update mailinglist from dev to discuss  https://review.openstack.org/62175610:39
chandankumarodyssey4me: please have a look10:39
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent master: Update mailinglist from dev to discuss  https://review.openstack.org/62176410:39
*** udesale has quit IRC10:40
openstackgerritMerged openstack/openstack-ansible-plugins master: Update mailinglist from dev to discuss  https://review.openstack.org/62176210:41
*** cshen has joined #openstack-ansible10:42
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Fix ansible deprecation warnings  https://review.openstack.org/62163510:42
openstackgerritDebo Zhang proposed openstack/openstack-ansible-plugins master: Fix Chinese quotes  https://review.openstack.org/62587610:46
openstackgerritMerged openstack/openstack-ansible-os_searchlight master: Update mailinglist from dev to discuss  https://review.openstack.org/62177910:49
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Update mailinglist from dev to discuss  https://review.openstack.org/62174510:53
openstackgerritMerged openstack/openstack-ansible-tests master: Update mailinglist from dev to discuss  https://review.openstack.org/62174210:55
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/queens: gnocchi_resources override fixed  https://review.openstack.org/62521510:55
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Update mailinglist from dev to discuss  https://review.openstack.org/62176610:55
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Fix ansible deprecation warnings  https://review.openstack.org/62163810:56
openstackgerritMerged openstack/openstack-ansible-repo_build master: Fix ansible deprecation warnings  https://review.openstack.org/62164310:59
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Allow backend and backup node rise/fall parameters to be set  https://review.openstack.org/62512411:03
openstackgerritMerged openstack/openstack-ansible-galera_server stable/rocky: Increase Galera self-signed SSL CA expiration  https://review.openstack.org/62520111:05
openstackgerritMerged openstack/openstack-ansible-galera_server master: Update mailinglist from dev to discuss  https://review.openstack.org/62175411:05
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Update mailinglist from dev to discuss  https://review.openstack.org/62175111:06
jrosserevrardjp: it's coming from here https://github.com/openstack/openstack-ansible-os_keystone/blob/master/vars/suse.yml#L2711:13
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/rocky: Enable overriding the service setup host python interpreter  https://review.openstack.org/62402811:22
evrardjpjrosser: my concern is not about the need from libxml2-devel (I can understand that), but the reason the wrong version got in11:35
evrardjpjrosser: it should not be 2.9.811:35
evrardjpmost of those packages require 2.7 or above, so the version provided by 42.3 by default should be good11:35
evrardjpthere is something messed up in the repositories11:36
evrardjpjrosser: did a recheck failed? Could you list all the repos (zypper lr -u) and show info for libxml? (zypper info libxml2-devel)11:37
evrardjp(maybe we should add that into the logs we gather)11:37
jrosseri don't have a local build for this11:37
evrardjpjust adding a task before the failing task should do :)11:38
evrardjpsorry I can't do that now11:38
jrosseri'll just recheck it first see if it's a transient repo thing11:38
chandankumarjrosser: evrardjp What I need to change here https://github.com/openstack/openstack-ansible-os_tempest/blob/master/tasks/tempestconf.yml#L16 so that it should install from zuul cloned repo instead of pip?11:39
jrossersorry i have no idea, thats probably a question for odyssey4me11:40
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts master: Change ssh variable in Ubuntu and remove masks  https://review.openstack.org/61933911:42
*** Bhujay has quit IRC11:46
*** ansmith has joined #openstack-ansible11:49
jrosseroh dear i hope we've not broken suse a bit more with these repo key stuffs http://logs.openstack.org/44/621644/2/gate/openstack-ansible-functional-opensuse-423/cf44dae/job-output.txt.gz#_2018-12-18_10_57_21_82838011:49
*** Bhujay has joined #openstack-ansible11:52
*** Bhujay has quit IRC11:53
*** Bhujay has joined #openstack-ansible11:53
*** Bhujay has quit IRC11:54
*** Bhujay has joined #openstack-ansible11:55
*** Bhujay has quit IRC11:56
*** Bhujay has joined #openstack-ansible11:56
odyssey4mejrosser nah, I've seen that same error multiple times over the last few months11:57
*** Bhujay has quit IRC11:57
openstackgerritMerged openstack/openstack-ansible-galera_client stable/rocky: Use in-repo GPG keys  https://review.openstack.org/62568111:57
*** Bhujay has joined #openstack-ansible11:58
*** Bhujay has quit IRC11:59
*** Bhujay has joined #openstack-ansible11:59
*** Bhujay has quit IRC12:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server master: Use in-repo GPG keys  https://review.openstack.org/62531212:01
*** Bhujay has joined #openstack-ansible12:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Publish readable journal files in the gate  https://review.openstack.org/62589512:03
*** ansmith has quit IRC12:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: [DOC] fix some typos and fix some stuff  https://review.openstack.org/62589712:08
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Ensure that control plane hosts are also updated correctly  https://review.openstack.org/62589812:09
*** shardy has quit IRC12:11
evrardjpchandankumar: odyssey4me can probably confirm, but it looks like venv_pip_packages are passed to pip task, which mean you can probably use a git url as requirement12:15
odyssey4mejamesdenton yep, it is taking some shape - I'm working on getting the agent migration happening now...12:16
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_swift master: Ensure ssh client is available for rsync on centos  https://review.openstack.org/62589912:17
odyssey4mechandankumar yes, it's being installed from pip because no git info has been given it - you would need to setup variables like these: https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L43-L5012:20
odyssey4mechandankumar and then have tasks which execute, same as the tempest package12:21
odyssey4mechandankumar all that really has to happen is that the constraint has to be the path to the git repo, but the above is how we make that happen12:22
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_swift master: Ensure ssh client is available for rsync  https://review.openstack.org/62589912:23
openstackgerritMerged openstack/openstack-ansible master: Fix ansible deprecation warnings  https://review.openstack.org/62154112:24
odyssey4meFYI I'll be afk for most of today  - I'll catch up again tomorrow. :)12:25
*** udesale has joined #openstack-ansible12:27
openstackgerritMerged openstack/openstack-ansible-plugins master: Fix Chinese quotes  https://review.openstack.org/62587612:28
chandankumarodyssey4me: I am sending a seperate patch for the same12:32
*** cshen has quit IRC12:41
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-galera_server master: Normalise in-repo GPG key implementation  https://review.openstack.org/62568312:41
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/rocky: Adds ability to set no-resolv for dnsmasq.  https://review.openstack.org/62477912:45
openstackgerritMerged openstack/openstack-ansible-galera_server master: Fix ansible deprecation warnings  https://review.openstack.org/62164412:48
odyssey4megood catch there, thanks jrosser12:48
jrossersure thing - i just fixed it quick if you'd already been away busy12:49
*** hamzaachi has quit IRC12:51
*** hamzaachi has joined #openstack-ansible12:52
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing python-tempestconf from git  https://review.openstack.org/62590412:56
jrosseri'm also afk for the most of this afternoon - theres a whole slew of jobs failing on suse libxml dependancy errors if anyone fancies taking a look at that12:57
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing python-tempestconf from git  https://review.openstack.org/62590412:57
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_tempestconf_profile for handling named args  https://review.openstack.org/62318713:01
chandankumarodyssey4me: ^^13:01
openstackgerritMerged openstack/openstack-ansible-galera_server stable/queens: Increase Galera self-signed SSL CA expiration  https://review.openstack.org/62520213:02
*** vnogin has joined #openstack-ansible13:04
*** mwe1 has joined #openstack-ansible13:06
openstackgerritMerged openstack/openstack-ansible stable/queens: Isolate the Ansible bootstrap  https://review.openstack.org/62552913:11
*** hamzaachi_ has joined #openstack-ansible13:24
*** cshen has joined #openstack-ansible13:24
*** hamzaachi has quit IRC13:27
*** hamzaachi_ has quit IRC13:34
neithI noticed I still have  some old conf in "/etc/openstack_deploy/openstack_inventory.json"  that should have been erased when I modified openstack_user_config.yml . whats the best path to edit openstack_inventory.json to fix my issue?13:40
*** ansmith has joined #openstack-ansible13:40
openstackgerritMerged openstack/openstack-ansible stable/pike: Update Octavia to latest stable/pike SHA  https://review.openstack.org/62530913:41
openstackgerritMerged openstack/openstack-ansible stable/rocky: Update Octavia to latest stable/rocky SHA  https://review.openstack.org/62530613:41
openstackgerritMerged openstack/openstack-ansible stable/queens: Update Octavia to latest stable/queens SHA  https://review.openstack.org/62530713:41
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882013:54
openstackgerritkourosh vivan proposed openstack/openstack-ansible-os_trove stable/rocky: Add segmentation option  https://review.openstack.org/62474113:56
odyssey4meback for the afternoon it seems, I'm going to continue with the P2Q upgrade stuff13:57
odyssey4meneith very often removing things from openstack_user_config will not automatically have it removed from inventory.json - back up the file and have it it with a text editor... unless it's removing a host, in which case use inventory-manage.py13:58
mnaserodyssey4me: hiya!14:02
mnaseri'm thinking of adding idempotency tests inside integrated (which will naturally extend out into roles when we roll it out)14:02
mnaseri'm seeing a lot of issues with random things happening/restarting when they shouldnt when rerunning playbooks14:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/pike: Adds ability to set no-resolv for dnsmasq.  https://review.openstack.org/62478614:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/queens: Adds ability to set no-resolv for dnsmasq.  https://review.openstack.org/62478114:06
odyssey4memnaser most of the roles are not idempotent at all, and it'd be a considerable amount of work to make them so - it's also actually easier to do it now with the roles tests because we have the facility already14:07
mnaserodyssey4me: well i figured start by adding it to integrated and see what breaks/where14:07
mnaseri just had a deployment where galera was magically restarted with a run of setup-hosts.yml14:08
mnaserno bueno.14:08
odyssey4memnaser yes, that happens because of lxc-containers-create... you have to pass it a var to prevent restarting of containers14:08
odyssey4mehttps://github.com/openstack/openstack-ansible/blob/master/scripts/run-upgrade.sh#L17814:08
mnaserodyssey4me: even just running it without an upgrade?14:09
odyssey4methat would be odd - it would only happen if some of the lxc container config changed14:09
mnaserodyssey4me: thats what i thought as well14:10
mnaseri spoke to the person who ran it and they claim no config changes, no rebootstrap14:10
mnaserso its just rerunning it again.. i dunno.14:10
odyssey4meI'd really like to work out a nicer upgrade mechanism, but I've not time now. I have some ideas, but as we discussed at the PTG it's not high priority. Perhaps I'll take a peek at it in U.14:11
odyssey4memnaser it is plausible that we've let a patch through which changes the container config - that has happened before.14:11
mnaserodyssey4me: i agree :(14:11
mnaseri think if we get upgrade jobs, the story of upgrades becomes a lot simpler14:12
odyssey4memnaser happy with https://review.openstack.org/625683 ?14:13
* mnaser click14:13
odyssey4meif you have a gap, https://review.openstack.org/625312 could do with some eyes14:14
odyssey4mealso https://review.openstack.org/624058 and https://review.openstack.org/62437914:14
mnaserodyssey4me: lgtm, thanks for the refactor, ill look at the others now14:15
mnaseri think a the time we had a gate blocker so it was a: lets get it in asappp14:16
*** nurdie has joined #openstack-ansible14:17
*** nurdie has quit IRC14:19
*** cshen has quit IRC14:19
*** nurdie has joined #openstack-ansible14:19
neithodyssey4me: thanks14:20
neiththats what I thought14:20
mnaserodyssey4me: do you think we can fit a deploy+upgrade in <3 hours ?14:20
odyssey4memnaser with a limited set of services - yes14:21
odyssey4meif we can't, then we should make an effort to improve our run times so that we can14:21
mnaseri'm tempted to push a wip change to see how long it lasts14:21
odyssey4meno need - just look at the existing periodics14:22
odyssey4meunfortunately they're all abit broken, so we need to get them fixed14:22
odyssey4meI have a fix for the current R->S upgrade issue in the works - galera_server is failing because the service stop task has a broken failed_when.14:22
odyssey4meI just need to spend a little time working out how to achieve the intent in https://github.com/openstack/openstack-ansible-galera_server/commit/068bb7299914b59cefc7ef619db06fc957d20c50 because that's what broke it.14:23
odyssey4meI have an idea, and a test system to try it with - so I'll work on it a little later once I've got the P-Q neutron agent migrations in the bag.14:24
*** nurdie has quit IRC14:24
odyssey4mein fact, let me work up a patch now14:26
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Remove octavia in favor of octavia-tempest-plugin  https://review.openstack.org/62582814:27
mnaserodyssey4me: thanks for all the awesome work you've put into ci/upgrades/cleanups14:34
*** shardy has joined #openstack-ansible14:35
chandankumarodyssey4me: https://review.openstack.org/#/c/625904/ please have a look at this review14:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: When upgrading, only stop the service if it exists  https://review.openstack.org/62592914:38
*** ostackz has joined #openstack-ansible14:39
odyssey4memnaser cloudnull https://review.openstack.org/625929 should resolve the current upgrade brokenness in the periodics... once that's through, we'll see what falls out next14:39
openstackgerritMerged openstack/ansible-role-python_venv_build master: Add ability to symlink host python packages into venv  https://review.openstack.org/62405814:40
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_trove stable/rocky: Add segmentation option  https://review.openstack.org/62474114:43
openstackgerritMerged openstack/openstack-ansible-galera_server master: Normalise in-repo GPG key implementation  https://review.openstack.org/62568314:44
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Added support for installing python-tempestconf from git  https://review.openstack.org/62590414:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/rocky: Normalise in-repo GPG key implementation  https://review.openstack.org/62593514:47
*** weezS has joined #openstack-ansible14:52
*** Bhujay has quit IRC14:53
*** cshen has joined #openstack-ansible14:53
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for rpc messaging backend deployment  https://review.openstack.org/62418414:57
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/rocky: Use the distro package for libvirt-python  https://review.openstack.org/62437914:58
*** cshen has quit IRC14:59
odyssey4mejrosser mnaser is there a way to see which routers/networks/subnets are allocated to which agents?15:00
mnaserodyssey4me: there is a neutron list-networks-hosted-on-l3-agent15:01
mnaseror something like that15:01
odyssey4meah, interesting... openstack --os-cloud default network agent list --router 02bcc09c-e5c8-46b1-a8a5-97b854fcc03215:03
prometheanfirecloudnull: I think barbican is dead jim (package install the last couple times)15:03
mnaserodyssey4me: you can do it back and forth, you can list agents hosting a network, but also networks hosted on an agent15:03
mnaserand i think the latter is what you're interested in15:03
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Use in-repo GPG keys  https://review.openstack.org/62531215:06
*** vnogin has quit IRC15:08
odyssey4memnaser jrosser jamesdenton So I'm wondering whether any of the rebalancing in https://bugs.launchpad.net/openstack-ansible/+bug/1804770 actually needs to be done. It looks to me like the default setup has all dhcp agents hosting all networks, and the routers are HA.15:10
openstackLaunchpad bug 1804770 in openstack-ansible "Pike -> Queens Upgrade: Documentation for OVS setup and neutron agent rebalancing missing" [High,Confirmed] - Assigned to James Denton (james-denton)15:10
mnaserodyssey4me: neutron router-list-on-l3-agent15:10
mnaserodyssey4me: i agree. in that case, it won't be needed, *but* i wonder if neutron automatically reschedules when an agent goes down15:10
mnaserim thinking what might be happening is that an agent doesnt replace the one that disappeared15:10
*** goldenfri has quit IRC15:10
jrosserodyssey4me: it’s the keepalived bits I see sticking around from the old venvs15:15
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for rpc messaging backend deployment  https://review.openstack.org/62418415:17
ostackzHi, reinstalled my Queens cluster from previous openstack_user_config.yml, but neutron_server_containers do not have eth10 interface at all. Where can be the catch? https://pastebin.com/raw/A3jyMgnp15:20
odyssey4mejrosser ok, so I'm hoping that disabling the agent will resolve that - let me see what happens15:21
evrardjpmnaser: do we have meeting today?15:25
mnaserevrardjp: i believe so, i've missed the past 2, but it looks like we have enough people around with good activity for one today.15:25
mnaserno one noticed.. so maybe it wasn't going to be too productive anyways, heh15:25
evrardjpwhat do you mean by no one noticed?15:26
evrardjp:p15:26
*** nurdie has joined #openstack-ansible15:29
ostackzRegarding missing eth10 interfaces in neutron containers - ansible log is full of Device "eth10" does not exist.non-zero return code. Wondering why final ansible status report did not show any issues15:30
jrosserI noticed :) but ironically today is the Tuesday I can’t make the meeting!15:37
odyssey4meIt'd be great to get some eyes on https://review.openstack.org/625929 so that I can look out for the next periodic upgrade test failure.15:42
*** cshen has joined #openstack-ansible15:43
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882016:00
mnaserhola16:00
mnaserfriendly ping16:00
mnasercloudnull, DimGR, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, colinmcnamara, thorst, adreznec, eil397,16:00
mnaserqwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking, mnaser, nicolasbock, jrosser, cjloader, antonym, dcdamien16:00
guilhermespo/16:00
mnaser#startmeeting openstack_ansible_meeting16:00
openstackMeeting started Tue Dec 18 16:00:49 2018 UTC and is due to finish in 60 minutes.  The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
mnaser#topic rollcall16:00
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:00
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:00
mnasero/16:00
*** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)"16:00
*** nurdie has quit IRC16:01
*** fnpanic has quit IRC16:01
mnaserquiet quiet :)16:02
chandankumar\o/16:02
chandankumaryear end is going on :-)16:02
mnasernot much in last week highlights, we can discuss open topics in open discussion16:03
guilhermespwould we wait to a quorum or can we discuss placement a bit?16:03
mnaserguilhermesp: we can do that in open discussion16:03
*** nurdie has joined #openstack-ansible16:03
mnaser#topic bug triage16:03
*** openstack changes topic to "bug triage (Meeting topic: openstack_ansible_meeting)"16:03
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180883016:03
openstackLaunchpad bug 1808830 in openstack-ansible "container properties were not updated from env.d file" [Undecided,New]16:03
chandankumarmnaser: do we need a proper blueprint/spec related to os_tempest part?16:03
mnaserchandankumar: can we discuss this later in open discussion?  but probably not :>16:04
chandankumarmnaser: sure16:04
mnaserhmm16:04
mnaserlooks like someone is using lvm16:04
mnaserfor containers16:04
mnaseri remember cloudnull mentioning that this swallows data16:04
mnaseri dont know enough about this16:05
mnaseri'll leave it, hopefully next time we triage we can see what things look like16:05
evrardjpproperties have been documented as part of o_u_config16:06
evrardjpnot as env.d16:06
evrardjpiirc16:06
evrardjpoh wait16:06
mnaserok so what they're doing is just wrong?16:06
evrardjpI meant container_vars16:06
evrardjpmmm16:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Add automated migration of neutron agents to bare metal  https://review.openstack.org/62533116:06
mnaserso their workarounds is really the right way to do it?16:06
odyssey4meo/16:07
evrardjpyeah that's how I'd configure things16:07
evrardjpcontainer_vars: <variable>16:07
mnaserin that case we'll put as invalid and mention that the workaround is the right way to go about it16:07
odyssey4memnaser evrardjp so I helped the guy out yesterday - effectively the inventory was generated before the env.d file change, and if that's done then the env.d change does not take effect16:08
mnaseraaaah16:08
mnaserso it works but because the inventory already exists16:08
mnaserit doesnt update16:08
mnaserso we're not really overriding, its just an 'initial' value16:08
evrardjpodyssey4me: also I notice there is a 1 space difference16:08
evrardjpas you can see container_fs_size is wrongly indented16:08
odyssey4meI don't know if we consider that as a bug - but it's not obvious, and we don't really do a good job of documenting how people can do things like this after the fact.16:08
odyssey4meevrardjp I suspect that's just launchpad being stupid.16:09
odyssey4meIt would be good to verify it independently.16:09
evrardjpI mean that would be a good reason why it doesn't show up on an empty inventory.16:09
evrardjpafter that our inventory is quite a mess, so things not updating would not be a surprise to me16:10
odyssey4meyah, when I worked through it with him - he had the spacing right16:10
odyssey4melemme find the eavesdrop16:10
mnaserokay so if we wanna quickly triage this, how do we feel like16:10
mnaseri would defer to evrardjp or odyssey4me because this isn't my strength :)16:11
evrardjpif someone really cares about the inventory, (s)he/it should step up, as to my knowledge, everybody is fine with the current way of working, even if it's bugged16:12
odyssey4methe beginning of the very long conversation is here: http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/%23openstack-ansible.2018-12-17.log.html#t2018-12-17T14:23:2316:12
evrardjpso I'd say low16:12
odyssey4meperhaps good to add that to the bug16:12
mnaserbut confirmed?16:12
odyssey4meI would not say it's confirmed unless someone else verifies it16:13
mnaseri'm not asking anyone to fix it, but just if we recognize that this is an issue or not :)16:13
mnaserso triaged/low?16:13
odyssey4meassign to me - I'll try to confirm it, it shouldn't be hard16:13
odyssey4meso leave it new16:14
*** dave-mccowan has joined #openstack-ansible16:14
mnaserok cool16:14
mnaserthank you odyssey4me16:14
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180869316:14
openstackLaunchpad bug 1808693 in openstack-ansible "haproxy galera backend config contains httpchk statement" [Undecided,New]16:15
odyssey4meI think it might just be a simple doc fix - a known issue somewhere.16:15
evrardjpon that we have an http middleware16:15
evrardjpI'd say invalid16:15
mnaseri think this is probably invalid, this deployment probably failed to start the xinetd server16:15
evrardjpindeed16:15
evrardjpdisabling checks is NOT a solution :)16:15
mnaserdone16:16
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180854316:16
openstackLaunchpad bug 1808543 in openstack-ansible "Keystone Federation cannot complete SP node setup on stable/rocky" [Undecided,New]16:16
mnaseroh that's redkrieg :)16:16
*** fnpanic has joined #openstack-ansible16:16
mnaseri see a keystone traceback16:17
mnasercould this be a keystone thing?  i personally dont know much about federation.. a little bit16:17
odyssey4meyeah, this was piped up in channel too and I asked for a bug report16:18
odyssey4meIt's been a while since I've done any federation things - hopefully I can confirm this... I'd say leave new and assign to me16:18
guilhermespwould it be a dependency error following the keystone traceback?16:18
*** dave-mccowan has quit IRC16:18
odyssey4meunless someone else wants to have a bash at it16:18
odyssey4meit might just be a new dependency which isn't covered16:19
guilhermespspecifically keystone.auth.saml2?16:19
mnaserMaybe we can ask redkrieg to dig in a bit if he has time. He’s done a bunch of python :)16:20
odyssey4meit seems like it might just be that whatever that task is doing, it's not using the venv16:20
mnaserLet’s leave it as is and catch up with redkrieg this week16:21
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180740016:22
openstackLaunchpad bug 1807400 in openstack-ansible "networksegments table in neutron can not be cleared automatically" [Undecided,New]16:22
mnaserSounds like a neutron bug?16:23
odyssey4methat does seem like it's not registered to the right project16:23
odyssey4memark invalid, but add neutron16:24
mnaseryep done16:25
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180734616:25
openstackLaunchpad bug 1807346 in openstack-ansible "[heat] Installations fails during Update Q->R" [Undecided,New]16:25
mnaserhuh thats weird16:26
guilhermespsounds like variable changes between Q -> R?16:26
guilhermespthat is breaking the task16:26
*** dave-mccowan has joined #openstack-ansible16:27
mnaserits almost liek16:27
mnaserits trying to create a user called `stack_domain_admin` but there's already one?16:27
mnaseroh wait i didnt scroll down16:27
mnaserseems like ansible bugs ?16:28
*** mcela1 has left #openstack-ansible16:28
odyssey4mehmm, ok - I haven't seen this yet, but I guess I could take the time to verify it unless someone else has a little time for it?16:28
guilhermespcan be assigned to me16:28
odyssey4meIt seems that I'm falling on the upgrade sword. :p16:28
mnaserwe have to do another pretty big upgrade soon16:29
odyssey4meYay! Thanks guilhermesp :)16:29
mnaserso i might run into that i guess16:29
mnaserassigned to guilherme for further heck16:29
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180707416:29
openstackLaunchpad bug 1807074 in openstack-ansible "Neutron OVS bridge_mappings not built on computes" [Undecided,New]16:29
mnaserjamesdenton: did you want to grab this?16:30
mnaserjamesdenton: you know i feel this relates to that fix i did a while back16:31
mnaserhttps://review.openstack.org/#/c/614282/16:32
odyssey4meseems legit, and that's in rocky - perhaps note that in the bug, but leave it new to give jamesdenton some time to look again16:32
odyssey4meI think he's out today.16:33
mnaserokay cool, ill leave it as new so we can see it again next week16:33
odyssey4meI don't think that patch is in a released OSA - or it's only in the most recent release.16:33
mnaseryeah but that patch needs another follow up one16:33
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180693816:34
openstackLaunchpad bug 1806938 in openstack-ansible "RabbitMQ Upgrade does not work during upgrade from Q->R" [Undecided,New]16:34
*** jonher has quit IRC16:34
guilhermespsame guy from heat one16:34
odyssey4meah, a patch for that merged recently16:34
noonedeadpunk[h]yeah, I think mnaser has already fixed it16:34
mnaseryep.16:34
odyssey4mehttps://review.openstack.org/62520016:34
mnaserthat was a very expensive bug ill let you know that.16:34
mnaser;[16:34
*** fresta has quit IRC16:35
*** fresta_ has joined #openstack-ansible16:35
odyssey4mesorry mnaser :/16:35
*** jonher has joined #openstack-ansible16:35
mnaserits okay16:35
mnaserthats why i wanna try and help with some of hte ugprade stuff soon16:35
*** noonedeadpunk[h] is now known as noonedeadpunk16:35
mnasergah16:36
mnaserlaunchpad wont let me comment16:36
odyssey4mehttps://media.giphy.com/media/b3hWtl6x3H3Ko/giphy.gif16:36
*** jonher has quit IRC16:36
*** fresta has joined #openstack-ansible16:36
mnasergetting a wall of red text16:37
*** jonher has joined #openstack-ansible16:37
mnaseraunchpad requires a <code>REFERER</code> header to perform this action. There is no <code>REFERER</code> header present. This can be caused by configuring your browser to block <code>REFERER</code> headers.16:37
guilhermespi think this happened in summit when we were registering a bug or something on a session16:37
odyssey4meI can't seem to find my favourite cat presses button and kaboom gif - evrardjp knows the one I mean,16:37
mnasercan someoen else comment that was fixed in https://review.openstack.org/#/c/625200/16:37
guilhermesplemme try mnaser16:38
mnaserand set status to fix released16:38
evrardjpodyssey4me: I don't have it here16:38
evrardjpbut yeah.16:38
mnaserthanks guilhermesp16:39
mnaser#link https://bugs.launchpad.net/openstack-ansible/+bug/180669616:39
openstackLaunchpad bug 1806696 in openstack-ansible "Galera lxc shutdown results in corrupted db" [Undecided,New]16:39
*** fresta_ has quit IRC16:40
mnaseroh no16:40
*** jonher_ has joined #openstack-ansible16:40
*** fresta- has joined #openstack-ansible16:40
odyssey4meFYI Christian Zunker and his team at Codecentric have done a wonderful job of reporting decent bugs and submitting fixes.16:40
mnaser+++16:40
mnaserare they on irc16:40
odyssey4meHe was at Berlin IIRC.16:40
odyssey4meI don't think so.16:40
mnaseryeah i saw some cool patches16:40
odyssey4meheh, 5 secs to kill a container is a bit harsh for galera - that sounds legit16:41
odyssey4meIt's probably better to make that a pretty long wait time - maybe 5 mins or something.16:41
noonedeadpunkbut is it the case for nspawn?16:41
mnaserive always lxc-stop'd things16:41
*** fresta has quit IRC16:42
*** jonher has quit IRC16:43
*** jonher_ is now known as jonher16:43
mnaserset to confirmed16:43
odyssey4meit'd be nice to get something sorted for that asap16:43
francoishi guys, I'm working with Justin who reported this bug, if there's any additional info needed16:43
evrardjpit sounds like a bad bug indeed16:43
mnasersearching SHUTDOWNDELAY in codesearch shows nothing16:43
mnaserso maybe this isnt something we deploy?16:43
odyssey4memnaser no, it's likely a default - but we can probably implement something to change it16:44
mnaseryep ok16:44
odyssey4mefrancois great bug, and it'd be nice to figure out a lxc_hosts role patch to increase that timeout16:44
evrardjpat least make it match with the value used in timeout for galera16:44
odyssey4meevrardjp yeah, I think that's 180 secs16:44
odyssey4meI'd go for 5 mins myself.16:45
mnaserfrancois: do you think you have someone who can help submit a patch for this? i can help them land it16:45
mnaseri just dont wanna land it myself16:45
evrardjpI remember that was longer than 5 minutes in old times16:45
evrardjpremember we searched with mancdaz something about 3600s timeout?16:45
evrardjp:)16:45
evrardjpthat's too much indeed16:45
francoisyeah definitely if there's an idea and the best way to fix it16:45
odyssey4meoh man, that's like back in the day when the dinosaurs were still roaming16:45
evrardjpbut 5 minutes wouldn't be that bad16:45
evrardjpodyssey4me: hahaha16:46
*** cshen has quit IRC16:46
mnaserok lets sync up after the meeting16:47
francoisagreed that 5 minutes sounds much saner then 5 secondes, it looks like a pretty harsh default16:47
mnaserid like to go to open discussion cause we took a bit a lot of time16:47
mnaser#topic open discussion16:47
*** openstack changes topic to "open discussion (Meeting topic: openstack_ansible_meeting)"16:47
evrardjpI can't really help on finding out where to start for this16:47
mnaseranyone has any things?16:47
guilhermespI do about placement16:47
guilhermespcan someone give a feedback https://review.openstack.org/#/c/618820/ ?16:48
guilhermespwe have greenfiled soon but16:48
guilhermespuwsgi app is not running yet16:48
odyssey4meI might find a little time to look into it evrardjp mnaser francois - upgrade tests take quite a bit of time. ;)16:48
mnaserguilhermesp: it looks like something is not wired up properly16:48
guilhermespin that last patch I added two tasks to configure uwsgi but seems that the ini file is not being placed under /etc/uwsgi16:48
mnaserdo you have a vm with that role in there?  maybe we can dig in and see it there later?16:48
guilhermespyep I've been doing this this morning16:49
guilhermespI intend to continue dig in16:49
guilhermespand about the tests, placement doesnt have its own tempest tests16:49
*** udesale has quit IRC16:49
mnaserthat's really f'n annoying that they dont16:49
guilhermespguys from the channel said to reuse compute tests16:49
guilhermespyep that's bad16:50
mnaserwell thats not easy because it's going to conflict with the placement thats alreadty deployed16:50
guilhermespI didn't ask the reasons they have but I can try to figure out, anyways...16:50
mnaserunless we add a patch to remove placement and we have this circular dependency16:50
mnaserugh16:50
guilhermespindeed16:50
mnaserlets get it to run and validate it locally and merge it that way.. i dunno, icant think of any other way.16:50
guilhermespI will need to test by hand as soon as  I finish my PR so the code can be merged16:50
odyssey4mefor now, don't bother with any real tests - do something simple like validate the service is running and be done with it16:51
guilhermespwe are up to 51 versions in my PR :P16:51
evrardjpodyssey4me: +116:51
odyssey4meonce we change os_nova to use it, then we can do something16:51
guilhermespodyssey4me: makes sense for now16:51
odyssey4meguilhermesp yeah, for now I'm more inclined to get that patch in even if it's not fully functional - it's getting too big16:51
pabelangerheads up, new ansible-lint released today, if you start seeing new linting failures16:52
pabelangerhttps://docs.ansible.com/ansible-lint/rules/default_rules.html16:52
guilhermespI believe today or within the next days you guys can review and merge hopefully16:52
*** vnogin has joined #openstack-ansible16:52
pabelangershould help with what is new16:52
odyssey4mepabelanger we pin ansible-lint :)16:52
mnaserchandankumar: anything at yor side?16:52
odyssey4meon that topic, we're long overdue for an asible-lint pin update16:52
chandankumarmnaser: I got the answer regarding the spec/blueprint question16:52
pabelangerodyssey4me: nice, I might start doing that as the new linters are some what aggressive IMO16:53
chandankumarmnaser: we are sending os_tempest calloboration update on openstack-discuss list , anything we can improve in that report?16:53
mnaserchandankumar: i *love* it16:54
mnaserim going to try and do smething similar inside OSA side, i really really like those16:54
francoisis there some plan to upgrade ansible in stable/rocky, as it seems to fix issues like https://bugs.launchpad.net/openstack-ansible/+bug/180338216:54
openstackLaunchpad bug 1803382 in openstack-ansible "unbound-client.yml failure depending on TERMCAP envvar content" [High,Confirmed] - Assigned to Francois Deppierraz (francois-ctrlaltdel)16:54
odyssey4mepabelanger I dunno if there's a default job for ansible-lint, but it'd be nice if it supported pinning - we could then use it, possibly16:54
evrardjpfrancois: nice launchpad id16:55
pabelangerodyssey4me: not sure either, I still manage it via tox-linters job and tox.ini16:55
chandankumarmnaser: glad to know that you guys liked that , last update of the year is tomorrow, then, we can do send resume in new year16:55
francoisevrardjp: :)16:55
mnaserchandankumar: wonderful, its been a pleasure working together16:55
chandankumarmnaser: :-)16:56
*** macza has joined #openstack-ansible16:56
odyssey4mefrancois hmm, I'm not sure we could safely upgrade to ansible 2.6 for rocky... that'd be a new minor revision for sure if we did16:56
odyssey4meis there no way to get the right fix into ansible 2.5?16:56
*** shardy has quit IRC16:57
odyssey4mepersonally, I'd like rocky to be ansible 2.6 - but it is a big change that risks destabilising more things16:57
odyssey4meit might be better to just document that as a known issue16:57
mnaseri agree that we shouldnt make a big leap like that16:57
mnaseri would want to work with upstream ansible to land those fixes instead16:57
francoisodyssey4me: I wasn't actually able to find the exact fix in ansible16:58
odyssey4meyep, if possible - otherwise just document that people shouldn't use screen and use tmux instead :p16:58
mnaserodyssey4me: maybe we can have openstack-ansible clear env16:59
mnaserand we can pass only the things we want down to ansible16:59
odyssey4methat said, I think jrosser might have actually identified the fix for it - or at least a workaround16:59
odyssey4memnaser that sounds a bit like a minefield16:59
mnaseradd a little spice to your life16:59
odyssey4mehahaha :)17:00
mnaserto end it17:00
mnaserhappy new year in advance.  this is our last meeting of the year17:00
mnasernext tuesday is the 25th17:00
mnaserso unless y'all wanan celebrate xmas here together, we'll cancel that one :)17:00
mnaserthanks for all the awesome work, we're doing great progress in what we discussed since the PTG17:00
odyssey4mehttps://media.giphy.com/media/3o7TKtsBMu4xzIV808/giphy.gif17:01
mnaserand it's awesome to see people excited about recommending OSA for large deployments in the ML (if anyone saw that thread!)17:01
guilhermesphappy holidays you all! It's been a pleasure to work with osa team. I remember my first steps were this year17:01
guilhermespmid-year I think17:01
guilhermespand the plan is to keep working hard to contribute as many as I can17:01
odyssey4meguilhermesp thank you for joining the party :)17:01
mnaserand on that fun note, i'll end it with the lame joke we all wanted to say17:02
guilhermespodyssey4me: o/ let's rock17:02
* odyssey4me pencils a note to catch up on the ML17:02
mnasersee y'all in next years meeting17:02
mnaser#endmeeting17:02
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC"17:02
openstackMeeting ended Tue Dec 18 17:02:16 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:02
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-12-18-16.00.html17:02
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-12-18-16.00.txt17:02
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-12-18-16.00.log.html17:02
odyssey4mealright folks, I'm out for the night17:02
guilhermesptake care odyssey4me17:02
francoischeers and merry xmas!17:03
odyssey4meevrardjp answered your comment/suggestion in https://review.openstack.org/62592917:03
odyssey4memore eyes on that review would be good - I'd like it in before the next upgrade periodic17:04
*** kopecmartin is now known as kopecmartin|off17:05
*** tosky has joined #openstack-ansible17:06
*** chandankumar is now known as chkumar|out17:13
*** cshen has joined #openstack-ansible17:15
cloudnullmnaser nice!17:15
* cloudnull goes to read the thread 17:16
mnasercloudnull: hope you enjoyed your trip17:19
*** rodolof has quit IRC17:20
*** cshen has quit IRC17:23
cloudnullthread about deployment tool choice - http://lists.openstack.org/pipermail/openstack-discuss/2018-December/001034.html17:24
cloudnullmnaser yea the trip was great!17:24
cloudnullit was nice to get away for a while '17:25
guilhermespcloudnull: through your pics, It seemed reeaaaly fun :P17:26
cloudnullit was ! :D17:26
mnasercloudnull: now nspawn :D17:26
cloudnullhahaha17:26
* cloudnull runs 17:26
mnasercloudnull: i actually tried a lot here but i got stuck -- https://review.openstack.org/#/c/608433/17:26
mnaserthe way we wire up networking somehow doesn't work, i dunno.17:26
cloudnullmnaser I will have a look !17:27
cloudnullthough it will be in an hour :)17:27
mnaserbut it deploys successfully17:28
mnaserits just the way we setup the bridges that is mucking things up i think17:28
cloudnullah , that could very well be17:28
cloudnullI'll try and take your PR and see where I get with it17:28
mnaserid be more than happy to explain what i tried to do if you'd like but i'll let you enjoy lunch :)17:28
mnaseryeah, hopefully there's enough logs and iterations there :)17:28
cloudnull++17:28
* cloudnull is catching up on EMAIL and meetings 17:29
mnaseryes thats haaaaard17:30
*** cshen has joined #openstack-ansible17:31
*** vnogin has quit IRC17:33
*** cshen has quit IRC17:45
*** weezS has quit IRC17:55
*** weezS has joined #openstack-ansible17:56
redkrieghey mnaser sorry I missed your pings earlier.  I got as far as I could debugging federation but I didn't really have a lot of experience with configuring it manually.  I got the impression there was a conflict because of the required apache config for keystone but didn't get much further before I gave up and started to configure a vpn for my keystone traffic between locations18:26
*** cshen has joined #openstack-ansible18:41
mnaserredkrieg: ah gotcha.  so not really have the environment there still18:43
redkriegno, sorry.  did a clean reinstall for this one, but I do wish to use federation eventually.18:43
redkriegjust can't spend too much time on it when another solution can work as well in the short term18:44
mnaserah i see18:44
cloudnullmnaser so regarding the suse 42.3 failures, http://logs.openstack.org/39/625639/1/gate/openstack-ansible-functional-opensuse-423/e81fc9d/job-output.txt.gz#_2018-12-18_16_45_11_473080 - looks like there's an issue with the OBS repo. I would suspect there's a package in that repo that has a broken dep18:46
cloudnullThis is the error expanded -  https://pasted.tech/pastes/36da33c2dff5f4b8acb8107999012a138d74597f18:46
cloudnulland these are the specific repos - http://logs.openstack.org/39/625639/1/gate/openstack-ansible-functional-opensuse-423/e81fc9d/logs/suse-zypper-repolist-host.txt.gz18:46
cloudnullthe broken package is coming from OBS:Cloud:OpenStack:Master18:47
cloudnullit looks like the packages were built with some tumbleweed repos present ?18:47
cloudnull-cc evrardjp hwoarang mnaser18:47
*** gyee has joined #openstack-ansible18:48
cloudnullbased on this, I think it might be wise to set 423 as non-voting in master, at least until we can figure out what is up with repos18:56
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Updated the connection plugins and add env options  https://review.openstack.org/62099118:57
*** priteau has quit IRC18:58
jrosserI looked at this a bit and figured we’re stuck until someone at suse fixes the repos, were blocked until then, so switch to nv would get my vote18:58
mnasercloudnull: jrosser im in favour of that. i personally dont know how to fix that and it seems like an upstream issue19:02
*** rodolof has joined #openstack-ansible19:52
cloudnullmnaser ++19:59
openstackgerritJustin Alford proposed openstack/openstack-ansible-lxc_hosts master: Increasing LXC container default shutdown delay Related-Bug: 1806696  https://review.openstack.org/62599820:05
openstackbug 1806696 in openstack-ansible "Galera lxc shutdown results in corrupted db" [Undecided,Confirmed] https://launchpad.net/bugs/180669620:05
*** DanyC has quit IRC20:14
*** DanyC has joined #openstack-ansible20:15
*** DanyC has quit IRC20:19
openstackgerritAndy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for rpc messaging backend deployment  https://review.openstack.org/62418420:24
prometheanfiresuse jobs stick?20:26
prometheanfirestuck...20:26
evrardjpcloudnull: how did you find out that it was from OBS:Cloud:OS:Master? Because last time I checked I didn't see the libxml2-devel there.20:39
evrardjpcloudnull: but yeah the version is matching tumbleweed which was weird to me20:39
cloudnullevrardjp https://pasted.tech/pastes/36da33c2dff5f4b8acb8107999012a138d74597f - that was the expanded error20:39
evrardjpoh I see, there is some kind of inheritance20:40
evrardjplet me check20:40
evrardjpcloudnull: good catch20:41
evrardjphttps://build.opensuse.org/package/show/Cloud:OpenStack:Master/libxml220:41
evrardjptbechtold broke the thing20:41
evrardjpgreat!20:41
cloudnull^ ++ IDK how to fix it, but hopefully we can get it reported and the the repo updated20:42
evrardjpyeah20:42
evrardjpI am doing it right now20:42
cloudnullsweet!20:42
cloudnullhows it going evrardjp ?20:42
evrardjpwrist still hurts20:45
evrardjpbut except that it's good :)20:45
evrardjpyou ?20:45
spotzhey you 2!20:51
*** DanyC has joined #openstack-ansible20:54
cloudnullo/ spotz20:57
spotzLooks like you had a good time cloudnull!20:57
cloudnullI did :)20:57
*** DanyC has quit IRC20:58
mgariepynice .. https://bugs.launchpad.net/nova/+bug/180904021:00
openstackLaunchpad bug 1809040 in OpenStack Compute (nova) "pci device lost when error in the configuration file " [Undecided,New]21:00
*** ansmith has quit IRC21:30
*** rodolof has quit IRC21:31
*** aedc has quit IRC21:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: modify fact gathering to use local facts  https://review.openstack.org/62601921:45
jamesdentonmgariepy that one has been around a bit https://bugs.launchpad.net/nova/+bug/165381022:09
openstackLaunchpad bug 1653810 in OpenStack Compute (nova) "[sriov] Modifying or removing pci_passthrough_whitelist may result in inconsistent VF availability" [Undecided,Invalid]22:09
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: modify fact gathering to use local facts  https://review.openstack.org/62601922:24
*** nurdie has quit IRC22:32
*** nurdie has joined #openstack-ansible22:32
*** nurdie has quit IRC22:37
*** cshen has quit IRC22:45
*** cshen has joined #openstack-ansible22:48
*** cshen has quit IRC22:53
*** cshen has joined #openstack-ansible22:55
*** cshen has quit IRC23:00
*** cshen has joined #openstack-ansible23:12
*** ansmith has joined #openstack-ansible23:16
*** nurdie has joined #openstack-ansible23:18
*** cshen has quit IRC23:19
*** cshen has joined #openstack-ansible23:19
*** partlycloudy has joined #openstack-ansible23:19
*** nurdie has quit IRC23:22
*** weezS has quit IRC23:23
*** weezS has joined #openstack-ansible23:24
*** cshen has quit IRC23:24
*** weezS has quit IRC23:24
*** weezS has joined #openstack-ansible23:25
*** weezS has joined #openstack-ansible23:25
*** weezS has quit IRC23:26
*** weezS has joined #openstack-ansible23:26
*** weezS has quit IRC23:27
*** weezS has joined #openstack-ansible23:27
*** cshen has joined #openstack-ansible23:40
*** tosky has quit IRC23:40
*** cshen has quit IRC23:45
*** yolanda has quit IRC23:55
*** dave-mccowan has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!