Wednesday, 2016-09-21

*** itsuugo has joined #openstack-ansible00:00
*** jamielennox is now known as jamielennox|away00:00
*** schwicht has quit IRC00:01
*** itsuugo has quit IRC00:05
*** itsuugo has joined #openstack-ansible00:06
*** hughmFLEXin has quit IRC00:09
*** itsuugo has quit IRC00:11
*** itsuugo has joined #openstack-ansible00:11
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Change default log bind mount to be optional  https://review.openstack.org/37356100:13
*** jamielennox|away is now known as jamielennox00:14
*** BjoernT has quit IRC00:20
*** hughmFLEXin has joined #openstack-ansible00:21
*** hughmFLEXin has quit IRC00:21
*** adrian_otto has quit IRC00:21
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_swift: Ansible 2.1.1 role testing  https://review.openstack.org/35361400:22
*** itsuugo has quit IRC00:27
*** shanec has quit IRC00:27
*** itsuugo has joined #openstack-ansible00:27
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: [TEST] Only use overlayfs if the kernel version is >= 3.18  https://review.openstack.org/35177600:35
*** cfarquhar has quit IRC00:35
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_sahara: Ansible 2.1.1 role testing  https://review.openstack.org/35361200:39
*** itsuugo has quit IRC00:39
*** itsuugo has joined #openstack-ansible00:40
*** hj-hpe has quit IRC00:44
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Add Swift telemetry notification consumer to Ceilometer  https://review.openstack.org/37285200:45
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Update rootwrap filter copy for easier maintenance  https://review.openstack.org/37340000:49
openstackgerritMerged openstack/openstack-ansible-os_ceilometer: Filter Gnocchi Swift activity in the Ceilometer dispatcher  https://review.openstack.org/37286300:50
openstackgerritMerged openstack/openstack-ansible-os_designate: Update rootwrap filter copy for easier maintenance  https://review.openstack.org/37340400:52
openstackgerritMerged openstack/openstack-ansible-os_sahara: Update rootwrap filter copy for easier maintenance  https://review.openstack.org/37340800:52
*** psilvad has joined #openstack-ansible00:54
*** itsuugo has quit IRC00:54
*** itsuugo has joined #openstack-ansible00:55
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone: Correct Ansible 2.x [DEPRECATION WARNING]  https://review.openstack.org/37357200:56
openstackgerritAdam Reznechek proposed openstack/openstack-ansible: Update AIO script to support ubuntu-ports  https://review.openstack.org/37357300:56
*** itsuugo has quit IRC01:03
*** itsuugo has joined #openstack-ansible01:05
castulojamesdenton: I followed your steps but when restarting the galera container it got stuck again here:  * Starting MariaDB database server mysqld01:12
*** McMurlock1 has quit IRC01:13
*** itsuugo has quit IRC01:14
jamesdentonanything interesting in /var/log/mysql_logs/galera_server_error.log?01:14
*** itsuugo has joined #openstack-ansible01:15
*** sdake_ has joined #openstack-ansible01:19
*** aludwar has quit IRC01:20
*** aludwar has joined #openstack-ansible01:21
*** sdake has quit IRC01:21
castulowell I see these errors a lot: [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out)01:22
castulo[ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1380: Failed to open channel 'openstack_galera_cluster' at 'gcomm://172.29.239.66': -110 (Connection timed out)01:22
*** shanec has joined #openstack-ansible01:31
*** itsuugo has quit IRC01:36
*** Jeffrey4l has joined #openstack-ansible01:37
*** itsuugo has joined #openstack-ansible01:37
*** shanec_ has joined #openstack-ansible01:44
*** oben has joined #openstack-ansible01:46
*** itsuugo has quit IRC01:46
*** shanec has quit IRC01:46
obenHi! How do we rebuild/recover failed infrastructure host? Thanks!01:46
*** itsuugo has joined #openstack-ansible01:47
jamesdentonhmm. castulo those are recent errors?01:48
jamesdentonand did you bootstrap that cluster by starting the first one with '--wsrep-new-cluster'?01:49
*** hughmFLEXin has joined #openstack-ansible01:53
*** itsuugo has quit IRC01:55
*** itsuugo has joined #openstack-ansible01:56
*** hblah has joined #openstack-ansible02:00
*** psilvad has quit IRC02:01
*** itsuugo has quit IRC02:06
*** itsuugo has joined #openstack-ansible02:07
*** itsuugo has quit IRC02:12
*** itsuugo has joined #openstack-ansible02:12
openstackgerritMerged openstack/openstack-ansible-security: Fix a minor documentation typo.  https://review.openstack.org/37350402:12
*** itsuugo has quit IRC02:19
*** itsuugo has joined #openstack-ansible02:21
*** rromans is now known as robb_afk02:30
*** robb_afk is now known as rromans_afk02:33
*** itsuugo has quit IRC02:36
*** itsuugo has joined #openstack-ansible02:37
*** schwicht_at_work has quit IRC02:38
*** schwicht has joined #openstack-ansible02:39
*** itsuugo has quit IRC02:45
*** rstarmer has joined #openstack-ansible02:46
*** itsuugo has joined #openstack-ansible02:47
*** dragonmaster has quit IRC02:53
*** itsuugo has quit IRC02:58
*** itsuugo has joined #openstack-ansible03:00
*** winggundamth_ has quit IRC03:03
*** david-lyle has quit IRC03:04
*** itsuugo has quit IRC03:05
*** weezS has joined #openstack-ansible03:06
*** itsuugo has joined #openstack-ansible03:06
*** schwicht_at_work has joined #openstack-ansible03:06
*** schwicht has quit IRC03:07
*** winggundamth has joined #openstack-ansible03:14
*** schwicht_at_work has quit IRC03:15
*** itsuugo has quit IRC03:23
*** itsuugo has joined #openstack-ansible03:25
*** itsuugo has quit IRC03:29
*** itsuugo has joined #openstack-ansible03:31
*** itsuugo has quit IRC03:36
*** itsuugo has joined #openstack-ansible03:36
*** itsuugo has quit IRC03:41
*** itsuugo has joined #openstack-ansible03:42
*** sdake_ has quit IRC03:42
*** shanec_ has quit IRC03:43
*** itsuugo has quit IRC03:51
*** itsuugo has joined #openstack-ansible03:52
*** dragonmaster has joined #openstack-ansible03:54
*** shanec_ has joined #openstack-ansible03:54
*** shanec_ has quit IRC03:59
*** itsuugo has quit IRC03:59
*** itsuugo has joined #openstack-ansible04:01
*** markvoelker has quit IRC04:03
*** itsuugo has quit IRC04:05
*** itsuugo has joined #openstack-ansible04:06
*** markvoelker has joined #openstack-ansible04:10
*** itsuugo has quit IRC04:11
*** itsuugo has joined #openstack-ansible04:12
*** itsuugo has quit IRC04:17
*** itsuugo has joined #openstack-ansible04:18
*** kjw3 has joined #openstack-ansible04:21
*** itsuugo has quit IRC04:23
*** itsuugo has joined #openstack-ansible04:24
*** itsuugo has quit IRC04:29
*** itsuugo has joined #openstack-ansible04:30
*** shausy has joined #openstack-ansible04:34
*** itsuugo has quit IRC04:45
*** itsuugo has joined #openstack-ansible04:46
*** itsuugo has quit IRC04:51
*** itsuugo has joined #openstack-ansible04:53
*** McMurlock1 has joined #openstack-ansible05:00
*** McMurlock1 has quit IRC05:09
*** sc68cal_ has joined #openstack-ansible05:09
*** hughmFLEXin has quit IRC05:09
*** sc68cal has quit IRC05:11
*** itsuugo has quit IRC05:12
*** itsuugo has joined #openstack-ansible05:12
*** asettle has joined #openstack-ansible05:20
*** itsuugo has quit IRC05:26
*** itsuugo has joined #openstack-ansible05:27
*** asettle has quit IRC05:28
openstackgerritavnish proposed openstack/openstack-ansible-plugins: Added sphinix config to setup.cfg  https://review.openstack.org/37365505:30
openstackgerritavnish proposed openstack/openstack-ansible-rabbitmq_server: Added sphinix config to setup.cfg  https://review.openstack.org/37365605:32
*** itsuugo has quit IRC05:32
*** itsuugo has joined #openstack-ansible05:33
openstackgerritavnish proposed openstack/openstack-ansible-ops: Added sphinix config to setup.cfg  https://review.openstack.org/37365905:35
*** janki has joined #openstack-ansible05:47
*** Jeffrey4l has quit IRC05:49
openstackgerritavnish proposed openstack/openstack-ansible-os_aodh: Added sphinix config to setup.cfg  https://review.openstack.org/37366805:50
*** Jeffrey4l has joined #openstack-ansible05:51
openstackgerritavnish proposed openstack/openstack-ansible-galera_server: Added sphinix config to setup.cfg  https://review.openstack.org/37367205:52
*** itsuugo has quit IRC05:53
openstackgerritavnish proposed openstack/openstack-ansible-os_zaqar: Added sphinix config to setup.cfg  https://review.openstack.org/37367305:54
*** itsuugo has joined #openstack-ansible05:54
openstackgerritavnish proposed openstack/openstack-ansible-repo_server: Added sphinix config to setup.cfg  https://review.openstack.org/37367905:58
*** itsuugo has quit IRC05:59
openstackgerritavnish proposed openstack/openstack-ansible-lxc_container_create: Added sphinix config to setup.cfg  https://review.openstack.org/37368105:59
*** itsuugo has joined #openstack-ansible06:01
openstackgerritavnish proposed openstack/openstack-ansible-apt_package_pinning: Added sphinix config to setup.cfg  https://review.openstack.org/37368206:01
*** markvoelker has quit IRC06:01
*** markvoelker has joined #openstack-ansible06:03
openstackgerritavnish proposed openstack/openstack-ansible-openstack_openrc: Added sphinix config to setup.cfg  https://review.openstack.org/37368506:03
openstackgerritavnish proposed openstack/openstack-ansible-rsyslog_server: Added sphinix config to setup.cfg  https://review.openstack.org/37368806:05
*** weezS has quit IRC06:05
*** itsuugo has quit IRC06:05
openstackgerritMerged openstack/openstack-ansible-repo_build: Evaluate /etc/environment during repo building  https://review.openstack.org/37281606:06
*** itsuugo has joined #openstack-ansible06:07
openstackgerritavnish proposed openstack/openstack-ansible-openstack_hosts: Added sphinix config to setup.cfg  https://review.openstack.org/37369606:07
openstackgerritavnish proposed openstack/openstack-ansible-galera_client: Added sphinix config to setup.cfg  https://review.openstack.org/37370406:09
openstackgerritavnish proposed openstack/openstack-ansible-os_magnum: Added sphinix config to setup.cfg  https://review.openstack.org/37370706:11
*** markvoelker has quit IRC06:11
*** rstarmer has quit IRC06:17
*** itsuugo has quit IRC06:17
*** itsuugo has joined #openstack-ansible06:18
*** rstarmer has joined #openstack-ansible06:20
openstackgerritMerged openstack/openstack-ansible-os_rally: delete python bytecode including pyo before every test run  https://review.openstack.org/37126006:21
*** itsuugo has quit IRC06:25
*** itsuugo has joined #openstack-ansible06:27
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server: delete python bytecode including pyo before every test run  https://review.openstack.org/37126106:27
*** timrc has quit IRC06:29
*** timrc has joined #openstack-ansible06:32
*** itsuugo has quit IRC06:37
*** itsuugo has joined #openstack-ansible06:38
*** itsuugo has quit IRC06:43
*** itsuugo has joined #openstack-ansible06:45
odyssey4memrda are you around?06:54
mrdaodyssey4me: I am here06:56
odyssey4meah, good evening to you sir06:56
odyssey4meI don't know if you've noticed, but the os_ironic role is failing tests consistently06:57
mrdaAnd good early morning to you, guv'na!06:57
odyssey4menot sure if something's changed upstream or what the deal is - haven't looked into it06:57
mrdaStrange you say that, I'm looking right now06:57
odyssey4meah, good06:57
*** itsuugo has quit IRC07:02
*** itsuugo has joined #openstack-ansible07:03
*** admin0 has joined #openstack-ansible07:09
*** hughmFLEXin has joined #openstack-ansible07:09
*** itsuugo has quit IRC07:10
*** markvoelker has joined #openstack-ansible07:11
*** itsuugo has joined #openstack-ansible07:12
*** pcaruana has joined #openstack-ansible07:13
*** fxpester has joined #openstack-ansible07:13
*** hughmFLEXin has quit IRC07:14
*** markvoelker has quit IRC07:16
*** drifterza has joined #openstack-ansible07:21
drifterzaHello folks07:21
*** itsuugo has quit IRC07:25
*** itsuugo has joined #openstack-ansible07:27
*** admin0 has quit IRC07:33
*** itsuugo has quit IRC07:33
*** admin0 has joined #openstack-ansible07:33
*** itsuugo has joined #openstack-ansible07:35
*** admin0 has quit IRC07:41
*** rstarmer has quit IRC07:43
*** admin0 has joined #openstack-ansible07:54
*** itsuugo has quit IRC08:04
*** itsuugo has joined #openstack-ansible08:05
evrardjpMatias: there is something that concerns me there08:10
evrardjphttp://paste.openstack.org/show/582291/08:10
evrardjpthe backend server don't mention the IP you seem to be reporting08:10
evrardjpand this IP is on lxc- nat which doesn't make sense to me08:10
evrardjpI'd like to dig a little deeper there08:11
evrardjpping me when you're there08:11
evrardjpnormally we should run everything in br-mgmt and this is the network where we'd set the internal vip08:12
*** hblah has quit IRC08:34
*** asettle has joined #openstack-ansible08:45
*** pmannidi has quit IRC08:48
*** oben has quit IRC08:58
openstackgerritMerged openstack/openstack-ansible-os_neutron: Update paste, policy and rootwrap configurations 2016-09-20  https://review.openstack.org/37268509:07
*** pmannidi has joined #openstack-ansible09:09
*** pmannidi has quit IRC09:09
*** pmannidi has joined #openstack-ansible09:10
*** itsuugo has quit IRC09:16
*** hughmFLEXin has joined #openstack-ansible09:17
*** itsuugo has joined #openstack-ansible09:17
*** itsuugo has quit IRC09:22
*** itsuugo has joined #openstack-ansible09:23
asettleodyssey4me: Brian sent me this last night, I can't remember if in his email reply or not if he showed you too09:28
asettlehttps://kallimachos.github.io/sphinxmark/09:28
asettleBut this is all his sphinx work09:28
asettleMight be of soem interest to you09:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update all SHAs for 14.0.0  https://review.openstack.org/37256909:34
*** itsuugo has quit IRC09:34
*** itsuugo has joined #openstack-ansible09:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update all SHAs for 14.0.0  https://review.openstack.org/37256909:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update all SHAs for 14.0.0  https://review.openstack.org/37256909:41
odyssey4measettle yes, that's what's being used for the watermark thingamie09:42
asettleodyssey4me: yep :)09:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Update all SHAs for 14.0.0  https://review.openstack.org/37256909:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [TESTING] Ansible v2.1.2.0-0.3.rc3  https://review.openstack.org/35116510:02
hughsaundersodyssey4me: did you have a bug for the python package version thing?10:03
odyssey4mehughsaunders nope10:03
hughsaundersk10:03
odyssey4meit's only used by me for release purposes10:03
openstackgerritHugh Saunders proposed openstack/openstack-ansible: Filter pre_release versions of packages  https://review.openstack.org/37398910:05
*** d3n14l has joined #openstack-ansible10:07
*** d3n14l1 has joined #openstack-ansible10:08
*** d3n14l1 has quit IRC10:10
*** d3n14l1 has joined #openstack-ansible10:11
*** d3n14l has quit IRC10:11
*** d3n14l has joined #openstack-ansible10:13
*** d3n14l1 has quit IRC10:15
*** itsuugo has quit IRC10:21
*** itsuugo has joined #openstack-ansible10:23
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: This patch is to add the Trove role to the repository.  https://review.openstack.org/37400810:25
openstackgerritDonovan Francesco proposed openstack/openstack-ansible: Add integrated Trove deployment.  https://review.openstack.org/37400810:30
drifterzaJust adding the PR so we can release after newton. is this okay?10:30
*** janki has quit IRC10:33
*** itsuugo has quit IRC10:33
*** itsuugo has joined #openstack-ansible10:34
*** itsuugo has quit IRC10:41
*** smatzek has joined #openstack-ansible10:43
*** itsuugo has joined #openstack-ansible10:43
*** dfflanders has quit IRC10:47
*** Jeffrey4l has quit IRC10:50
*** retreved has joined #openstack-ansible10:50
odyssey4medrifterza yes, perfectly good10:50
*** Jeffrey4l has joined #openstack-ansible10:50
*** schwicht has joined #openstack-ansible10:50
*** retreved has quit IRC10:55
*** dragonmaster has quit IRC10:56
*** itsuugo has quit IRC10:58
*** janki has joined #openstack-ansible11:00
*** itsuugo has joined #openstack-ansible11:00
*** berendt has joined #openstack-ansible11:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [WIP] Implement modular tempest testing  https://review.openstack.org/37175311:03
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests: Include openstack_hosts in test-prepare-host.yml  https://review.openstack.org/37402911:03
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [WIP] Implement modular tempest testing  https://review.openstack.org/37175311:03
drifterzaodyssey4me, hopefully this will help with our coverage of the broader openstack projects11:05
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: [WIP] Implement modular tempest testing  https://review.openstack.org/37175311:08
odyssey4medrifterza yep, I'm working on test coverage in scenarios in another patch11:09
drifterzaawesome.11:10
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests: Include openstack_hosts in test-prepare-host.yml  https://review.openstack.org/37402911:10
*** qiliang28 has joined #openstack-ansible11:21
*** qiliang27 has quit IRC11:23
*** qiliang28 is now known as qiliang2711:23
odyssey4meevrardjp andymccr it looks like https://review.openstack.org/372569 is working - reviews please11:23
odyssey4mehughsaunders ^11:24
*** psilvad has joined #openstack-ansible11:25
odyssey4measettle It looks like https://review.openstack.org/372565 is working - it's just failing due to the build timeout.11:26
asettleodyssey4me: yeah I gave it a +1 until the build timeout fixes so it's in my queue11:26
asettleWould you rather the +2A  ?11:26
odyssey4measettle yep, so if it passes it'll continue on11:26
odyssey4meit only changes the docs stuff and we can see that's working11:27
asettleSure. What's up with the build timeout11:27
*** itsuugo has quit IRC11:28
*** itsuugo has joined #openstack-ansible11:29
openstackgerritMerged openstack/openstack-ansible: Move inventory management code to enable imports  https://review.openstack.org/37180511:29
*** retreved has joined #openstack-ansible11:32
*** kjw3 has quit IRC11:33
*** schwicht has quit IRC11:37
*** itsuugo has quit IRC11:39
*** itsuugo has joined #openstack-ansible11:40
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests: Ensure ring always rebalances.  https://review.openstack.org/37405211:41
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151011:45
*** Mudpuppy has joined #openstack-ansible11:46
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151011:46
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151011:49
*** d3n14l1 has joined #openstack-ansible11:50
*** itsuugo has quit IRC11:52
*** itsuugo has joined #openstack-ansible11:53
*** d3n14l has quit IRC11:54
*** d3n14l has joined #openstack-ansible11:57
*** d3n14l1 has quit IRC11:58
*** d3n14l1 has joined #openstack-ansible12:05
*** schwicht has joined #openstack-ansible12:06
odyssey4mehughsaunders https://review.openstack.org/#/c/371753/12:08
*** d3n14l has quit IRC12:08
*** d3n14l1 has quit IRC12:15
*** woodard has joined #openstack-ansible12:15
*** woodard has quit IRC12:17
*** kylek3h has joined #openstack-ansible12:17
*** woodard has joined #openstack-ansible12:17
*** schwicht has quit IRC12:18
*** schwicht has joined #openstack-ansible12:20
*** johnmilton has quit IRC12:22
*** schwicht has quit IRC12:23
*** kylek3h has quit IRC12:23
*** schwicht has joined #openstack-ansible12:23
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151012:29
*** itsuugo has quit IRC12:30
*** itsuugo has joined #openstack-ansible12:32
*** markvoelker has joined #openstack-ansible12:33
*** askb has quit IRC12:35
*** kstev has joined #openstack-ansible12:39
*** kstev has quit IRC12:41
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151012:42
automagicallymorning all12:43
andymccrif anybody is about to review: https://review.openstack.org/#/c/374029/ - we can get neutron 2.1.1 + integrated testing working12:43
* automagically looking now andymccr 12:44
*** schwicht has quit IRC12:44
andymccrautomagically: awesome - thats pretty much the reason ovs testing was failing.12:45
automagicallyYep, nice catch12:45
automagicallyOne of the role tests explicitly runs it already, need to track that down, so its now run twice12:45
automagicallys/now/not12:45
andymccrautomagically: its the openstack_hosts role12:46
andymccrit doesnt run the test-prepare-host.yml though12:46
andymccri think it got split out for that purpose12:46
*** johnmilton has joined #openstack-ansible12:48
*** johnmilton has quit IRC12:54
*** itsuugo has quit IRC12:55
*** johnmilton has joined #openstack-ansible12:55
*** david-lyle has joined #openstack-ansible12:56
*** itsuugo has joined #openstack-ansible12:57
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-rabbitmq_server: Remove test-install-openstack-hosts  https://review.openstack.org/37412312:58
automagicallyandymccr - found it ^12:58
*** schwicht has joined #openstack-ansible13:02
andymccrautomagically: you might still need that - since it doens't call "test-prepare-host"13:02
andymccrahh i see13:03
automagicallyit uses test-setup-host which includes test-prepare-host13:03
andymccrthats included13:03
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151013:05
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_swift: Store dedicated replication conditions in var  https://review.openstack.org/37413113:09
openstackgerritMerged openstack/openstack-ansible-tests: Include openstack_hosts in test-prepare-host.yml  https://review.openstack.org/37402913:10
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_neutron: Use openstack-ansible-tests and ansible 2.1.1  https://review.openstack.org/37344513:11
openstackgerritAndy McCrae proposed openstack/openstack-ansible-tests: Add note around using test-install-openstack-hosts  https://review.openstack.org/37413213:12
*** jperry has joined #openstack-ansible13:13
*** hblah has joined #openstack-ansible13:13
*** klamath has joined #openstack-ansible13:19
*** gouthamr has joined #openstack-ansible13:21
*** d3n14l has joined #openstack-ansible13:23
*** psilvad has quit IRC13:24
*** psilvad has joined #openstack-ansible13:25
*** d3n14l1 has joined #openstack-ansible13:25
*** TxGirlGeek has joined #openstack-ansible13:27
*** d3n14l has quit IRC13:27
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_swift: Store dedicated replication conditions in var  https://review.openstack.org/37413113:32
*** drifterza has quit IRC13:33
*** TxGirlGeek has quit IRC13:34
*** kb has joined #openstack-ansible13:35
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_cinder: Ansible 2.1.1 update  https://review.openstack.org/35356913:38
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_neutron: Use openstack-ansible-tests and ansible 2.1.1  https://review.openstack.org/37344513:39
*** TxGirlGeek has joined #openstack-ansible13:40
*** kb has quit IRC13:41
*** janki has quit IRC13:41
*** kberger has joined #openstack-ansible13:41
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ironic: Ansible 2.1.1 role testing  https://review.openstack.org/35360413:42
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_neutron: Use openstack-ansible-tests and ansible 2.1.1  https://review.openstack.org/37344513:48
odyssey4mehmm, this is not good - cloudnull I'm seeing a lot of deprecation notices which we shouldn't even be hitting... for example due to the conditionals in https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/neutron_post_install.yml#L111-L118 the include should be skipped, but it's not. Each task is being evaluated and skipped, and we're getting a ton of deprecation notices. The same for the13:51
odyssey4me keystone role where you pushed up https://review.openstack.org/373572 but it shouldn't even be necessary due to a higher level conditional include.13:51
odyssey4meI wonder if this has something to do with the changes to the execution strategy or connection plugin?13:51
*** asettle has quit IRC13:54
automagicallyI think its an Ansible 2.1.1 thing13:54
odyssey4meautomagically you think?13:54
*** asettle has joined #openstack-ansible13:55
odyssey4meI thought that Ansible 2.x changed behaviour from the 1.9 method where each task was evaluated every time, versus in 2.x where it was supposed to just skipe based on the conditional include.13:55
odyssey4me*skipped13:55
odyssey4mewe definitely did see that happening at some point earlier in the cycle13:56
*** hblah has quit IRC13:56
*** karimb has joined #openstack-ansible13:58
*** admin0 has quit IRC13:58
*** admin0 has joined #openstack-ansible13:59
*** sdake has joined #openstack-ansible13:59
*** sdake has quit IRC13:59
*** sdake has joined #openstack-ansible14:00
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ironic: Ansible 2.1.1 role testing  https://review.openstack.org/35360414:01
odyssey4meandymccr automagically perhaps instead of having https://review.openstack.org/#/c/374132/1/test-install-openstack-hosts.yml we should just remove it and only have that play in the role that uses it?14:01
odyssey4methat way we have no mistakes14:02
*** woodard has quit IRC14:02
automagicallyI’d be okay with that14:02
andymccralso okay with that14:02
automagicallyFWIW, a bunch of role gates are now going to fail due to ansible-role-requirements missing the role14:02
andymccri think we will get some failures now though14:02
andymccrbecause we've forced openstack_hosts as a role req.14:02
odyssey4methe common testing repo should having things that are commonly used across multiple repositories - not things used for only one repo14:02
andymccrhaha14:02
andymccrsnap14:02
andymccrim thinking we should have a base-requirements file too14:02
odyssey4methere is already one that's compile in the tests repo that has all the roles14:02
odyssey4meand a script to update it as I recall14:03
andymccris it work installing all role deps?14:03
andymccr*worth14:03
*** galstrom_zzz is now known as galstrom14:03
odyssey4mehttps://github.com/openstack/openstack-ansible-tests/commit/9112e2fdf579cc54296d7806b7bd4dde8a07d87a14:03
automagicallyUnfortunately we galaxy install the roles now before we clone the tests repo14:03
odyssey4meI would think that perhaps we should rather have the git clone methos in the tests repo, then we use that instead of galaxy installing.14:04
*** TxGirlGeek has quit IRC14:04
odyssey4meie add this to the tests repo: https://github.com/openstack/openstack-ansible/blob/master/tests/get-ansible-role-requirements.yml14:06
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_sahara: Ansible 2.1.1 role testing  https://review.openstack.org/35361214:06
odyssey4methen use it instead of galaxy to pull the roles down for role tests14:06
automagicallyodyssey4me: Not a bad idea14:06
automagicallyCan you open a bug in launchpad for it so we can circle back to it?14:06
odyssey4mesure, lemme do that14:07
*** pester has joined #openstack-ansible14:08
automagicallyodyssey4me and andymccr - Looking for ideas on how to tackle the Xenial failure here: https://review.openstack.org/#/c/353596/14:08
automagicallyLooks to be a case of Python3 urllib handling SSL cert validation differently unless I”m mistaken14:08
automagicallyAnd seems that tempest-horizon does not provide config options to ignore cert validation14:09
jmccroryodyssey4me automagically : was looking into skipped tasks a little earlier. it looks like 'when's for includes/roles just get applied to every task instead of outright skipping the include/role.14:10
jmccrory~5 minutes is being spent in the trusty gate just skipping systemd related tasks14:10
odyssey4mejmccrory yep, and I'm pretty sure this wasn't how things worked earlier in the cycle14:10
*** spedione|AWAY is now known as spedione14:10
odyssey4meI'd like to validate whether this is due to the changed ocnnection & strategy plugins.14:10
odyssey4meor whether this is just the way ansible is working14:11
automagicallystrategy could effect it, but I can’t imagine connection would14:11
odyssey4mefrom there we can figure out what to do about it14:11
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151014:11
*** fxpester has quit IRC14:12
odyssey4meautomagically https://bugs.launchpad.net/openstack-ansible/+bug/162611314:12
openstackLaunchpad bug 1626113 in openstack-ansible "Use git-clone instead of ansible-galaxy for role tests" [Wishlist,New]14:12
andymccrjmccrory: odyssey4me: isnt that the kind of thing we can fix with 2.1+ specific code blocks etc?14:13
odyssey4meandymccr yeah, but IIRC a conditional include was meant to skip the eval of all tasks in the included file if the condition was not met14:14
andymccrodyssey4me: yeah i agree, something has changed there.14:14
odyssey4meso basically it was a great way of us maintaining compatibility with 1.9.x and gaining performance imporovements14:15
*** hj-hpe has joined #openstack-ansible14:15
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_aodh: Add openstack_hosts to the role requirements  https://review.openstack.org/37418414:16
jmccroryandymccr : tested that a little earlier, same deal. condition was applied to each task within the block, so each task was run and skipped instead of the entire block being skipped14:18
andymccrhmm14:19
odyssey4meI have a build almost done - I'll try removing the strategy adjustment and see how that goes.14:19
*** shausy has quit IRC14:22
*** shausy has joined #openstack-ansible14:22
*** shausy has quit IRC14:28
cloudnullmornings14:28
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_barbican: Add openstack_hosts to the role requirements  https://review.openstack.org/37419614:28
*** mfisch has quit IRC14:28
qwanggood morning14:28
*** Mudpuppy has quit IRC14:29
odyssey4meautomagically andymccr ok, I've pulled out the connection, callback and strategy plugins and the behaviour still stands14:30
*** Mudpuppy has joined #openstack-ansible14:30
*** TxGirlGeek has joined #openstack-ansible14:30
odyssey4meno wonder our execution times are so far up - we now have many more execution paths and each damned task has to be evaluated individually through the cycle of <copy task script to target> -> <realise there's nothing to do> -> <tear down the connection>14:31
*** kylek3h has joined #openstack-ansible14:31
*** mfisch has joined #openstack-ansible14:31
*** mfisch has quit IRC14:32
*** mfisch has joined #openstack-ansible14:32
*** Mudpuppy has quit IRC14:32
*** Mudpuppy has joined #openstack-ansible14:33
odyssey4meas an example, even though we have this: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/meta/main.yml#L44-L4714:33
odyssey4methe memcached_server role still executes14:33
odyssey4mebut it skips all tasks14:34
cloudnullyes. that's a thing.14:34
odyssey4meI have to wonder about that meta-dep though. That doesn't seem right. Why would you install memcached on the keytsone hosts anyway when we have containers for it?14:34
openstackgerritJimmy McCrory proposed openstack/openstack-ansible: Fix deprecation warning for undefined variables  https://review.openstack.org/37420714:35
*** jheroux has joined #openstack-ansible14:35
cloudnullodyssey4me: when using the memcached token provider14:35
odyssey4mecloudnull wouldn't we use the memcache containers though?14:36
cloudnullthe memcached token provider does not use consistent hashing14:36
cloudnullso it can't use the normal caching cluster.14:36
odyssey4meoh ok - so it's a server local memcache14:36
cloudnullyup14:36
odyssey4medolphm ^ ?14:36
odyssey4melbragstad ^14:36
*** weezS has joined #openstack-ansible14:38
*** woodard has joined #openstack-ansible14:38
*** Mudpuppy has quit IRC14:40
openstackgerritJimmy McCrory proposed openstack/openstack-ansible: Fix deprecation warning for undefined variables  https://review.openstack.org/37420714:40
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Change default log bind mount to be optional  https://review.openstack.org/37356114:43
nishpatwa_Hi all Good Morning14:43
cloudnullodyssey4me:  we could further update our execution strategy to omit more tasks when we can eval the conditional ahead of time. I have more bits that can do that but they were held back because of the potential of causing very uncertain behavior in Ansible.14:43
nishpatwa_Can anyone elaborate on this https://bugs.launchpad.net/openstack-ansible/+bug/162611314:43
openstackLaunchpad bug 1626113 in openstack-ansible "Use git-clone instead of ansible-galaxy for role tests" [Wishlist,New]14:43
*** michaelgugino has joined #openstack-ansible14:43
nishpatwa_May be I can work on14:43
nishpatwa_this14:43
cloudnullnishpatwa_: we have this implemented in the integrated gate. https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L122-L12614:44
*** Mudpuppy has joined #openstack-ansible14:44
odyssey4mecloudnull sure, that's an option - but this is crazy... I really do remember being pleased with the whole task file being skipped earlier in the cycle14:44
*** joseg has joined #openstack-ansible14:45
cloudnullnishpatwa_: the playbook is here https://github.com/openstack/openstack-ansible/blob/master/tests/get-ansible-role-requirements.yml14:45
cloudnullso it'd be nice if that was made part of the integrated repo and done within the tox tests.14:45
cloudnullodyssey4me: correct me if im wrong.14:45
odyssey4mecloudnull yep, that's pretty much it14:46
nishpatwa_Okay14:46
cloudnullodyssey4me: ansible evaluates the task even if its skipped14:46
odyssey4menishpatwa_ try working up a patch in one of the repositories where we already have ansible 2.1.1 implemented - we can work it through in review14:46
cloudnullthe same is true for the roles.14:46
nishpatwa_Okay14:47
*** schwicht has quit IRC14:47
nishpatwa_Which repository you are referring to odyssey4me?14:48
nishpatwa_I am not clear about it14:48
*** Mudpuppy has quit IRC14:49
*** Mudpuppy has joined #openstack-ansible14:51
*** drifterza has joined #openstack-ansible14:51
odyssey4mecloudnull automagically jmccrory *sigh* yes, it appears that this is the standard behaviour for both includes and blocks14:52
odyssey4methat sucks so bad I feel like table flipping14:52
cloudnullyup14:53
lbragstadodyssey4me o/14:54
*** neith has joined #openstack-ansible14:57
odyssey4mecloudnull jmccrory automagically ok, here's an interesting aside - if you do a block without includes in it, it actually gets properly ignored in its entirety... but if there's an include it breaks the block behaviour14:58
*** openstack has joined #openstack-ansible15:03
odyssey4mecloudnull ok, in that case I think we may need to try and figure out how to make the strategy we have trim these down more15:07
odyssey4methis is just silly15:07
odyssey4meI'm going to register a bug for it.15:07
*** galstrom is now known as galstrom_zzz15:10
*** schwicht has joined #openstack-ansible15:16
odyssey4mecloudnull jmccrory automagically oh interesting, it looks like ansible 2.1.0 does what I thought it did... so this is a regression in ansible 2.1.115:18
odyssey4mean example for the keystone SP include15:19
automagicallyoh joy15:19
odyssey4meTASK [os_keystone : include] ***************************************************15:19
odyssey4metask path: /etc/ansible/roles/os_keystone/tasks/main.yml:16115:19
odyssey4me<aio1_keystone_container-2df88c3b> Task "" has been omitted from the job because the conditional "[u'keystone_idp != {}']" was evaluated as "False"15:19
odyssey4me<aio1_keystone_container-2df88c3b> Task "" has been omitted from the job because the conditional "[u'keystone_idp != {}']" was evaluated as "False"15:19
odyssey4meI'm going to work up a bug report for this to ansible with a simple way to demonstrate it... what should we do - maybe we should drop back to ansible 2.1.0 for Newton?15:20
odyssey4melemme push up a patch to test that out15:20
odyssey4mealright, let's see how https://review.openstack.org/374239 goes15:24
*** jamesden_ has joined #openstack-ansible15:28
cloudnullodyssey4me: -- the comment "<aio1_keystone_container-2df88c3b> Task "" has been omitted from the job because the conditional "[u'keystone_idp != {}']" was evaluated as "False"" is from our plugin15:29
odyssey4mecloudnull hmm, can't be - I removed the plugin15:30
cloudnullthat's our execution strategy15:30
odyssey4meoh blast, I left out the strategy one15:30
cloudnullhttps://github.com/openstack/openstack-ansible-plugins/blob/master/strategy/linear.py#L82-L8315:31
cloudnullthat note is simply telling you that the task is not being queued15:31
*** cfarquhar has joined #openstack-ansible15:31
cloudnullotherwise it'd be run through the task executor15:31
cloudnullso in that case, it's working15:31
odyssey4meok, that's weird then... why is that not happening in our runs then15:32
*** galstrom_zzz is now known as galstrom15:32
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Add export host option for inventory-manage script  https://review.openstack.org/37179815:32
cloudnullruns where / when?15:33
*** drifterza has quit IRC15:36
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Change default log bind mount to be optional  https://review.openstack.org/37356115:38
cloudnullodyssey4me: we're not going to see that message in all places at all times.15:39
cloudnullwe've limited our plugin to only perform this action on tasks without an iterator or include and should an execption happen in handling it defaults to run.15:41
cloudnullwe could make it do more though15:42
cloudnullwe've just errored on the side of caution15:43
*** d3n14l1 has quit IRC15:52
*** Guest95_ has joined #openstack-ansible15:52
*** spotz_zzz is now known as spotz15:53
*** Guest95_ is now known as BjoernT15:53
*** itsuugo has quit IRC15:53
*** d3n14l has joined #openstack-ansible15:53
*** d3n14l1 has joined #openstack-ansible15:55
*** itsuugo has joined #openstack-ansible15:55
mhaydenjust saw openstack-ansible on a slide at ibm edge! :)15:55
mhaydenadreznec and thorst are talking about openstack/POWER15:55
cloudnullwin!15:55
cloudnullthat's awesome!15:56
*** arbrandes1 is now known as arbrandes15:56
*** KLevenstein has joined #openstack-ansible15:56
*** admin0 has quit IRC15:57
*** admin0 has joined #openstack-ansible15:57
*** d3n14l has quit IRC15:58
mhaydenphoto: https://twitter.com/majorhayden/status/77862443912658944015:59
andymccrcloudnull, automagically: neutron gate is failing randomly on 1 test each time (a diff one each time it seems). not tooooo sure whats up with that!16:02
automagicallyandymccr: Always Trusty?16:02
andymccrnope16:02
andymccrwas xenial the time before16:02
andymccrautomagically: was actually xenial lxb build the first time, now its trusty ovs build.16:03
automagicallyHmm, so I saw that Trusty OVS failure: http://logs.openstack.org/45/373445/7/check/gate-openstack-ansible-os_neutron-ansible-func_ovs-ubuntu-trusty/dacb502/console.html#_2016-09-21_14_50_22_924953 last night as well16:05
automagicallyAnd of course the failure has nothing to do with neutron or OVS16:06
andymccryeah! thats the one16:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-tests: Add test-install-openstack-hosts to test-prepare-host  https://review.openstack.org/37413216:06
andymccrthe other one i thinkwas just random, it failed on checking the network in func tests. which ive not seen before16:06
automagicallythe netns qdhcp check random failure is the one that has been pretty persistent16:07
automagicallyBut that lxc profile one is brand spanking new, first time I saw it was yesterday16:07
odyssey4mecloudnull I've confirmed that this is a simple Ansible 2.1.0 -> 2.1.1 regression: https://gist.github.com/odyssey4me/7cdcc70a60895a1280221e454cff10b616:08
cloudnullodyssey4me: maybe fixed at the head of the stable branch ?16:08
cloudnull"stable-2.1"16:09
odyssey4methe conditionally included file's tasks are not shown for 2.1.0 - https://gist.github.com/odyssey4me/7cdcc70a60895a1280221e454cff10b6#file-04-ansible-2-1-0-output-log-L5316:09
cloudnullv2.1.2 should be out in short order.16:09
cloudnullit looksl like they're on v2.1.2.0-0.3.rc316:09
odyssey4mebut are for 2.1.1: https://gist.github.com/odyssey4me/7cdcc70a60895a1280221e454cff10b6#file-05-ansible-2-1-1-output-log-L47-L5316:10
andymccrautomagically: annoying - also, the swift MR build is taking too long which is a fail. trying to debug that.16:10
odyssey4mecloudnull yep, I have a test review already for it16:10
odyssey4mewe can check the logs16:10
logan-re: neutron qdhcp namespace fails.. ive seen it across all OS/tests pretty consistently for months now. I did some checking on it locally on a while back and it seemed to be a race condition possibly relating to the neutron service restarts. The dhcp agent is not setting up the subnet consistently.16:10
logan-if you run the neutron tests locally you should see it 50+% of the time16:10
odyssey4mecloudnull https://review.openstack.org/35116516:11
*** KLevenstein has quit IRC16:11
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-os_ceilometer: Ansible 2.1.1 role testing  https://review.openstack.org/35356116:11
mhaydenodyssey4me: since i haven't been around to provide gifs in a while -> https://twitter.com/majorhayden/status/77862777984366592216:13
evrardjplogan-: We've seen that too16:14
odyssey4mecloudnull so it appears that our strategy plugin is helping, but it doesn't cover everything: http://logs.openstack.org/65/351165/22/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-trusty/ae3979d/console.html#_2016-09-21_12_25_53_11943416:14
andymccrlogan-, evrardjp: is there anything we can add to testing to make that not affect our neutron role gate? - e.g. add a check/wait or something to avoid the race condition16:14
evrardjpso basically the network is created but is subject to race conditions when the subnet is created16:14
evrardjpandymccr: not really16:14
evrardjpI checked with john16:14
cloudnullit does not , we pulled a lot of the functionality back in the final version16:15
evrardjphe said basically wait16:15
odyssey4memhayden w00t!16:15
evrardjpI think there was a patch for that16:15
evrardjplet me verify this16:15
andymccrok - in the meantime i'll try recreate this lxc issue which i havnt seen affecting the main gate.16:15
*** pcaruana has quit IRC16:15
evrardjpso logan- what I've seen is that dhcp port doesn't come up, neutron dhcp-agent-list-hosting-net for the net doesn't list anything16:16
evrardjpit comes from a scheduler issue and should be solved by doing other actions on the same subnet16:16
evrardjpso maybe we should enfore the creation of a router or something16:17
logan-is that a failure on neutron server's part by not assigning the dhcp agent to the subnet, or the dhcp agent's fail on not picking up the new create16:17
*** pcaruana has joined #openstack-ansible16:17
evrardjplogan-: apparently neutron fails to scheduler the whole thing16:17
logan-if its the former, maybe the dhcp agent is in state=down at the time so the server does not see an available agent to assign to16:17
evrardjpI didn't got the chance to investigate further16:17
evrardjplogan-: we check the avilability of the agents16:18
evrardjpbefore going further16:18
evrardjphttps://github.com/openstack/openstack-ansible-os_neutron/blob/master/tests/test-neutron-functional.yml#L4316:18
evrardjpif the agent is listed there with a smile it should be fine16:18
logan-gotcha16:19
evrardjpwe could try to add a few delays16:19
cloudnullodyssey4me: we could do instections on iterables when the item is not specifically present in the conditional?16:19
evrardjplike wait a few seconds before creating net / subnet16:19
evrardjpand then creating a router16:19
cloudnullthat would catch a few more tasks16:19
evrardjpthat would solve everything16:19
evrardjpbut it's because the whole thing is messy16:19
evrardjpor at least that's what we saw at first sight16:20
cloudnullbut in this case "http://logs.openstack.org/65/351165/22/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-trusty/ae3979d/console.html#_2016-09-21_12_25_53_119434" there's not much we can do16:20
cloudnullthat is a register, and even in a skip state a registered item is still retuned.16:20
cloudnullthe registered var has a return of {"state": "skipped"}16:21
evrardjplogan-: to really solve the issue, we would need a way to reproduce it somewhere, and check why neutron can't schedule the action on the agent16:21
evrardjpsomehow*16:21
logan-i can build a few vms and get a fail so we have some logs to dig thru16:23
asettleodyssey4me: I have successfully conned the Rackspace team editor to look at the OSA guide *thumbs up* :D16:24
evrardjplogan-: try on xenial16:24
*** d3n14l1 has quit IRC16:24
evrardjpit seems more enclined to fail16:24
logan-ok16:24
evrardjp:p16:24
odyssey4mecloudnull jmccrory the ansible bug report: https://github.com/ansible/ansible/issues/1768716:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Revert Ansible version to 2.1.0  https://review.openstack.org/37423916:30
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server: Remove test-install-openstack-hosts  https://review.openstack.org/37412316:31
*** galstrom is now known as galstrom_zzz16:31
*** adrian_otto1 has joined #openstack-ansible16:34
odyssey4mecloudnull boo, I think the strategy implementation may be interfering with using Ansible 2.1.0 :/ http://logs.openstack.org/39/374239/2/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-trusty/eebf59b/console.html#_2016-09-21_15_54_56_64665916:35
stevellepalendae: are you planning to rebase that inventory patch set today? was going to try to look at it this afternoon16:36
cloudnullodyssey4me: that looks like an issue in the rabbitmq module from Ansible16:36
cloudnull"The error was: AttributeError: 'list' object has no attribute 'startswith'"16:37
cloudnullthat said , i never tested this with 2.1.016:37
*** admin0 has quit IRC16:39
* cloudnull is spinning an env now16:39
*** retreved has quit IRC16:41
odyssey4methanks cloudnull16:42
*** retreved has joined #openstack-ansible16:42
*** d3n14l1 has joined #openstack-ansible16:42
palendaestevelle, Yeah; merge problem should be fixed, I'm adding docs now and I should be good with my planned changes16:44
*** shanec_ has joined #openstack-ansible16:46
*** retreved has quit IRC16:47
*** adrian_otto1 has quit IRC16:49
qwangmhayden: could you help review https://review.openstack.org/#/c/371761/? Thanks.16:49
*** d3n14l1 has quit IRC16:51
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins: Human readable logs should be removed  https://review.openstack.org/37429116:53
openstackgerritNish Patwa(nishpatwa_) proposed openstack/openstack-ansible-tests: Implemented git clone of roles.  https://review.openstack.org/37429216:54
*** jlockwood has quit IRC16:56
openstackgerritNish Patwa(nishpatwa_) proposed openstack/openstack-ansible-tests: Implemented git clone of roles.  https://review.openstack.org/37429216:56
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Add export host option for inventory-manage script  https://review.openstack.org/37179816:57
*** jlockwood has joined #openstack-ansible16:57
palendaestevelle, sulo ^ should be mostly ready. I'll look at your question about ethX_addresses though, sulo16:57
palendaeActually, what JSON did you see those in, sulo?16:58
sulopalendae: /etc/openstack_deploy/openstack_inventory.json16:59
sulothx16:59
palendaeinteresting17:00
palendaefrom head or mitaka?17:00
palendaeI don't see them in mine17:00
palendaehttps://gist.github.com/nrb/43dbcc2f7c5d7f1208ab5a2590dbb38e is from an AIO one I just made17:00
palendaeWith head of master17:00
sulothis is mitaka17:01
odyssey4mecloudnull and we have an answer from Ansible: http://docs.ansible.com/ansible/playbooks_roles.html#dynamic-versus-static-includes17:04
*** dmsimard has quit IRC17:05
cloudnullwat?17:06
odyssey4mecloudnull yeah, trying to fathom it now: https://github.com/ansible/ansible/issues/1768717:07
cloudnullso we can add "static: false" to the include and all will be well?17:08
odyssey4meso apparently we need to force the task to use dynamic inclusion by setting 'static: no' and the conditional will only be triggered once17:08
odyssey4melemme try this out17:08
*** dmsimard has joined #openstack-ansible17:10
cloudnullodyssey4me: setting ANSIBLE_TASK_INCLUDES_STATIC=true within the openstack-ansible.rc should do the needful17:11
cloudnullhttps://github.com/ansible/ansible/blob/devel/lib/ansible/constants.py#L19317:11
odyssey4mecloudnull do we want to be selective about it - or global about it?17:12
cloudnullin the integrated gate, i'd say global17:12
cloudnullwell, the integrated repo17:12
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151017:12
cloudnullI really don't see the benifit of static vs non-static includes.17:13
odyssey4meyeah, I tend to agree17:13
cloudnulland if that brings back the functionality we saw in 2.1.0, then +117:13
odyssey4mefor sure - let me push up a patch and let's see what happens with it.17:14
*** jlockwood has quit IRC17:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Force Ansible to use dynamic includes  https://review.openstack.org/37430517:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible: Force Ansible to use dynamic includes  https://review.openstack.org/37430517:21
odyssey4mecloudnull hmm, that doesn't appear to make sense - the default is 'False', and we're told to set 'static: False' on the include task... We're now setting 'static: True' are we not?17:21
*** itsuugo has quit IRC17:22
cloudnullso maybe the global default is false?17:22
cloudnullbut the task is being evaluated to true because of our when?17:23
*** itsuugo has joined #openstack-ansible17:23
cloudnullwhich would then mean we have to specifically force it to be false?17:23
cooljfrom that link on differences between static and dynamic tasks: "Tags which only exist inside a dynamic include will not show up in –list-tags output." -- setting it globally means no tags would show up with --list-tags?17:23
*** BjoernT has quit IRC17:23
openstackgerritMerged openstack/openstack-ansible: Update all SHAs for 14.0.0  https://review.openstack.org/37256917:24
odyssey4mecoolj only tags which are in an included file as I understand it17:24
cooljodyssey4me: ah i see17:25
mgariepyodyssey4me, cloudnull is there a reason for rdo repo to be enabled for gate-openstack-ansible-openstack-ansible-aio-centos-7-nv ?17:28
mgariepyhttp://logs.openstack.org/31/370831/4/experimental/gate-openstack-ansible-openstack-ansible-aio-centos-7-nv/aa62290/logs/openstack/instance-info/host_repo_info_10-01-07.log.txt.gz17:28
*** retreved has joined #openstack-ansible17:28
odyssey4memgariepy I believe that the RDO packages should be used instead of EPEL. RDO has everything that OpenStack needs and is more actively maintained for OpenStack purposes.17:29
odyssey4meSo ideally if we have EPEL anywhere, we should switch to using RDO.17:29
*** retreved has quit IRC17:29
*** retreved has joined #openstack-ansible17:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic: os_ironic mysql password variable not updated  https://review.openstack.org/37235517:31
*** admin0 has joined #openstack-ansible17:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ironic: Update rootwrap filter copy for easier maintenance  https://review.openstack.org/37340717:32
odyssey4mecloudnull if I read this right, then we want the include task to be dynamic... which is supposed to be the default behaviour17:38
odyssey4meso the only way we're going to get it working as we expect it to is to set 'static: no' on each include task17:40
*** lorid has joined #openstack-ansible17:40
loridhaving issue running lxc-host-setup.yml on new openstack environment; erroring on apt-get on haproxy node -- i cannot run apt-get on that node it fails connection to repo17:42
loridany advise would be appreciated17:42
odyssey4melorid did you previously setup the environment with the repo container, then destroyed the container? if so they you have apt proxy configuration which you must remove17:43
cloudnullodyssey4me:  it looks that wya.17:43
cloudnull:|17:43
cloudnulland i'm not sure how that would be handled in the meta  deps17:43
odyssey4mecloudnull it probably won't help the meta deps at all17:44
odyssey4mebut implementing it for all includes in the roles would certainly help cut down deploy time17:44
odyssey4mein the roles and playbooks17:45
loridodyssey4me - yes i did have the environment and had an issue with neutron containers/db - i did destroy and am trying to reinstall17:45
*** jamesden_ has quit IRC17:45
odyssey4meOK, I should get home. It's late already. I will get cracking on patching all the roles up tomorrow.17:46
*** pcgab has joined #openstack-ansible17:47
odyssey4meIf anyone happens to get going on doing some of them today, please use the 'bp/ansible-2-1-support' topic17:48
openstackgerritMerged openstack/openstack-ansible-os_barbican: Add openstack_hosts to the role requirements  https://review.openstack.org/37419617:48
loridodyssey4me- is the apt proxy config on the haproxy node and how do i remove17:48
*** jamesden_ has joined #openstack-ansible17:49
openstackgerritMerged openstack/openstack-ansible-os_ironic: Ansible 2.1.1 role testing  https://review.openstack.org/35360417:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift: Force Ansible to use dynamic includes  https://review.openstack.org/37431417:53
odyssey4mecloudnull ^ that's a tester17:53
odyssey4meIIRC the swift execution is a pretty long one due to the conditional includes - this gives us a point of comparison17:53
*** jamesden_ has quit IRC17:53
odyssey4meok I'm out - relocating17:57
odyssey4meI *might* return, but likely not.17:57
*** kstev has joined #openstack-ansible17:57
*** jamesden_ has joined #openstack-ansible17:59
*** hughmFLEXin has quit IRC17:59
*** hughmFLEXin has joined #openstack-ansible18:00
andymccrautomagically: im just gonna recheck on that neutron gate - i ran 12 individual cloud installs and they all worked fine. My only other port of call is to adjust the test-install-neutron to match the neutron repo (pre-moving to central repo) but honestly that makes no real sense.18:01
*** admin0 has quit IRC18:01
*** dragonmaster has joined #openstack-ansible18:03
*** dragonmaster has quit IRC18:04
*** lorid has quit IRC18:04
logan-andymccr evrardjp: https://drive.google.com/open?id=0B3i22g444_bhMG5WMG9tREVfVEk <- logs from a neutron dhcp fail18:05
*** jamesden_ has quit IRC18:05
*** dragonmaster has joined #openstack-ansible18:06
*** itsuugo has quit IRC18:11
*** jamesden_ has joined #openstack-ansible18:12
*** itsuugo has joined #openstack-ansible18:13
openstackgerritMerged openstack/openstack-ansible-os_ironic: os_ironic mysql password variable not updated  https://review.openstack.org/37235518:13
*** dragonmaster has quit IRC18:20
*** gouthamr has quit IRC18:31
*** sdake has quit IRC18:39
openstackgerritMerged openstack/openstack-ansible-os_swift: Store dedicated replication conditions in var  https://review.openstack.org/37413118:42
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151018:42
*** itsuugo has quit IRC18:42
*** itsuugo has joined #openstack-ansible18:44
*** klamath has quit IRC18:47
*** poopcat has joined #openstack-ansible18:49
*** ig0r_ has joined #openstack-ansible18:51
*** gouthamr has joined #openstack-ansible18:51
*** sdake has joined #openstack-ansible18:56
*** hughmFLEXin has quit IRC18:56
*** hughmFLEXin has joined #openstack-ansible18:57
*** asettle has quit IRC18:58
evrardjplogan-: I will check that right now18:58
openstackgerritNish Patwa(nishpatwa_) proposed openstack/openstack-ansible-tests: Implemented git clone of roles.  https://review.openstack.org/37429218:59
openstackgerritTravis Truman (automagically) proposed openstack/openstack-ansible-openstack_hosts: Remove rolename var from tox test  https://review.openstack.org/37433219:00
evrardjpat first it looks like it's the same issue: Unable to schedule network fcd56832-f2f1-45e4-8322-468ee1d37494: no agents available; will retry on subsequent port and subnet creation events.19:03
evrardjpDo you want me to add a patchset that adds timers and create a router?19:04
evrardjplike we could test connectivity between two networks, it makes sense too19:04
evrardjpFor me it's a neutron bug, so we may need to have ppl to work there instead of trying to have a more resilient test19:04
evrardjpbut I'm maybe wrong, it's maybe a timing issue, or it could be anything, with all the warning we have I wouldn't be surprised19:05
openstackgerritNish Patwa(nishpatwa_) proposed openstack/openstack-ansible-tests: Implemented git clone of roles.  https://review.openstack.org/37429219:05
evrardjpI'm off for today, please give me feedback for tomorrow :)19:05
logan-yeah that seems like a strange bug since the task right before this checks to see if the agent is up in the services list19:05
evrardjplogan-: I think it's a timing issue19:06
*** itsuugo has quit IRC19:06
evrardjpbecause we hit quite fast on the neutron subnet create after the net create19:06
evrardjpbecause the neutron cli gives info back directly where I think the reality would be different19:07
evrardjpso neutron just gives back info from its db, not from actual state19:07
evrardjpbut that's entirely supposition19:07
openstackgerritMarc Gariépy proposed openstack/openstack-ansible: fix centos bootstrap  https://review.openstack.org/37083119:07
*** itsuugo has joined #openstack-ansible19:08
evrardjpanyway, I'm off!19:08
logan-cya. ill try to dig into it more but im a bit tight on time today19:08
logan-would be interesting to look thru the neutron scheduling a little bit and see how it determines the service state that is different than checking the agent list19:08
logan-but a short wait might just be the best way to get the gate working reliably for now, if it works :)19:09
openstackgerritMerged openstack/openstack-ansible-plugins: Human readable logs should be removed  https://review.openstack.org/37429119:10
*** catintheroof has joined #openstack-ansible19:12
openstackgerritNish Patwa(nishpatwa_) proposed openstack/openstack-ansible-tests: Implemented git clone of roles.  https://review.openstack.org/37429219:13
*** johnmilton has quit IRC19:24
*** hughmFLEXin has quit IRC19:26
*** admin0 has joined #openstack-ansible19:28
*** hughmFLEXin has joined #openstack-ansible19:28
*** AnarchyAo has joined #openstack-ansible19:32
*** johnmilton has joined #openstack-ansible19:37
*** mfisch has quit IRC19:37
Matiasstevelle: gnocchi needs the rados python lib symlink in place inside the venv before in can run the DB sync; there are 2 distinct ways of doing it, what would you recommend? 1) copy the task which makes the symlink to the os_gnocchi role (it already exists in the ceph_client role); or 2) use a life-cycle variable in the os_gnocchi role to only unpack the venv in a first run of the role, after that19:40
Matiasthe os-gnocchi-install playbook would run ceph_client, then run os_gnocchi role again19:40
*** smatzek has quit IRC19:40
stevelleMatias: conforming to the same way it is done for cinder makes sense to me19:41
stevellethat's symlink iirc19:41
stevelleseems like a playbook pre_task to me19:42
Matiasstevelle: the difference is that cinder does not need the symlink *before* the os_cinder role19:42
Matiasit can afford to install ceph just after cinder is already installed19:42
matttMatias: that symlink stuff is really gross19:43
Matiasstevelle: if we simply run ceph_client as-is before os_gnocchi, it can't install the symlinks because the venv does not exist yet (or may be replaced if redeploying)19:43
*** lorid has joined #openstack-ansible19:43
stevelleit probably needs to be a role change for that reason, just wishing we could do differently19:44
Matiaswe could create a tasks/gnocchi_ceph_python_libs.yml which the symlink stuff and conditionally include before DB sync19:46
Matiasi'm actually testing this solution now19:46
Matiasbut there's the alternative of running os_gnocchi twice, and controlling with a life-cycle var19:46
Matiasbut does not seem so clean also19:46
stevelleMatias: what about something like the way we handle conditional install in keystone: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tasks/keystone_install_apt.yml19:46
Matiasand would have less chances of being backported to stable :P19:46
*** michaelgugino has quit IRC19:47
*** smatzek has joined #openstack-ansible19:47
Matiasyep, I think this is the most clean way to do it by now19:49
Matiasmattt: it's not pretty :(19:49
*** mt_ has joined #openstack-ansible19:49
*** hughmFLEXin has quit IRC19:50
*** smatzek has quit IRC19:50
*** smatzek has joined #openstack-ansible19:51
*** jamesden_ has quit IRC19:53
openstackgerritNish Patwa(nishpatwa_) proposed openstack/openstack-ansible-tests: Implemented git clone of roles.  https://review.openstack.org/37429219:54
*** hughmFLEXin has joined #openstack-ansible19:55
stevellemy primary objection to a life-cycle is that the ceph stuff would be an optional stage in a life-cycle and that seems like a bad idea to introduce. therein lies madness like Ant builds19:56
stevellethe swift one was bad enough19:56
*** mt_ has quit IRC19:57
stevellemutating that to a 3-way logic is worse19:57
Matiasyes, too much madness to avoid repeating 2 ceph tasks19:58
Matiasops19:58
Matias2 ansible tasks19:58
*** shanec_ has quit IRC19:59
stevellewith the proposal for Ocata to do more life-cycle oriented deployments we should be able to solve both of those more generally20:02
*** jamesden_ has joined #openstack-ansible20:03
*** hughmFLEXin has quit IRC20:05
*** catintheroof has quit IRC20:08
*** hughmFLEXin has joined #openstack-ansible20:22
openstackgerritCharles Farquhar proposed openstack/openstack-ansible-repo_build: Evaluate /etc/environment during repo building  https://review.openstack.org/37437920:25
openstackgerritMichael Gugino proposed openstack/openstack-ansible-ceph_client: [WIP] Deploy files for multiple ceph clusters  https://review.openstack.org/37438020:28
*** kstev has quit IRC20:34
*** Jeffrey4l has quit IRC20:35
*** Jeffrey4l has joined #openstack-ansible20:37
*** jamesden_ has quit IRC20:42
*** lorid has quit IRC20:46
Matiasstevelle: got gnocchi + ceph :D20:46
stevelleAll we need now is for gnocchi 3.0 release20:47
*** askb has joined #openstack-ansible20:55
*** coreywright has left #openstack-ansible20:55
*** shanec_ has joined #openstack-ansible20:55
*** shanec_ has quit IRC21:00
*** shanec_ has joined #openstack-ansible21:01
cloudnullstevelle: /me holding my breath21:03
cloudnull:)21:03
Matiasgoing to dinner, see you guys later :)21:05
*** woodard has quit IRC21:08
*** itsuugo has quit IRC21:16
*** itsuugo has joined #openstack-ansible21:17
*** retreved_ has joined #openstack-ansible21:29
*** itsuugo has quit IRC21:31
*** retreved_ has quit IRC21:32
*** retreved has quit IRC21:32
*** itsuugo has joined #openstack-ansible21:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift: Use openstack-ansible-tests repository for Swift  https://review.openstack.org/37151021:32
openstackgerritMichael Gugino proposed openstack/openstack-ansible-ceph_client: [WIP] Deploy files for multiple ceph clusters  https://review.openstack.org/37438021:34
*** gouthamr has quit IRC21:34
*** itsuugo has quit IRC21:42
*** itsuugo has joined #openstack-ansible21:42
*** karimb has quit IRC21:44
mrdaMorning OSA21:44
* mrda notes there's been some busy bees overnight21:44
*** ig0r_ has quit IRC21:45
palendaeMorning mrda21:47
mrdahey palendae21:48
*** jheroux has quit IRC21:48
*** schwicht has quit IRC21:49
palendaeI've got a fun pathc incoming21:49
palendaeOnce I get it passing my local test21:49
* mrda thinks it's probably not fun21:50
palendaeEh21:50
openstackgerritMichael Gugino proposed openstack/openstack-ansible-ceph_client: [WIP] Deploy files for multiple ceph clusters  https://review.openstack.org/37438021:55
*** itsuugo has quit IRC21:55
*** itsuugo has joined #openstack-ansible21:56
*** admin0 has quit IRC21:59
*** itsuugo has quit IRC22:01
palendaeIt'll make later patches less stressful22:01
*** jperry has quit IRC22:02
*** itsuugo has joined #openstack-ansible22:02
openstackgerritCharles Farquhar proposed openstack/openstack-ansible-os_swift: [WIP] Add support for swift3 middleware  https://review.openstack.org/37441622:04
*** spotz is now known as spotz_zzz22:07
*** spedione is now known as spedione|AWAY22:08
*** itsuugo has quit IRC22:10
*** klamath has joined #openstack-ansible22:10
*** itsuugo has joined #openstack-ansible22:10
*** adrian_otto has joined #openstack-ansible22:20
*** itsuugo has quit IRC22:21
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Add debug logging to dynamic inventory  https://review.openstack.org/37442022:22
*** itsuugo has joined #openstack-ansible22:23
*** adrian_otto has quit IRC22:25
*** MrDanDan has joined #openstack-ansible22:25
openstackgerritMichael Gugino proposed openstack/openstack-ansible-ceph_client: [WIP] Deploy files for multiple ceph clusters  https://review.openstack.org/37438022:27
palendaeSo https://review.openstack.org/#/c/374420/ should help with the "How the hell does this thing work?" question on the inventory script22:27
*** adrian_otto has joined #openstack-ansible22:28
openstackgerritMichael Gugino proposed openstack/openstack-ansible-ceph_client: [WIP] Deploy files for multiple ceph clusters  https://review.openstack.org/37438022:29
*** thorst has joined #openstack-ansible22:31
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Add debug logging to dynamic inventory  https://review.openstack.org/37442022:37
*** smatzek has quit IRC22:37
openstackgerritMerged openstack/openstack-ansible: Fix deprecation warning for undefined variables  https://review.openstack.org/37420722:37
*** thorst has quit IRC22:41
openstackgerritNolan Brubaker proposed openstack/openstack-ansible: Add export host option for inventory-manage script  https://review.openstack.org/37179822:41
palendaestevelle, ^ adds release note and addresses your question on iteritems22:41
*** thorst has joined #openstack-ansible22:41
stevelledoh, I missed the release note22:42
palendaeMe too22:42
palendaeCaught it before reviewers did ;)22:42
*** markvoelker has quit IRC22:43
* stevelle is a sad reviewer22:45
*** thorst has quit IRC22:46
*** adrian_otto has quit IRC22:47
*** itsuugo has quit IRC22:51
*** itsuugo has joined #openstack-ansible22:52
*** thorst has joined #openstack-ansible22:54
*** hblah has joined #openstack-ansible22:56
*** itsuugo has quit IRC22:57
*** itsuugo has joined #openstack-ansible22:58
*** thorst has quit IRC22:59
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Modify the run-playbooks script to run faster  https://review.openstack.org/37442923:00
*** itsuugo has quit IRC23:02
*** Mudpuppy has quit IRC23:04
*** pcgab has left #openstack-ansible23:04
*** AnarchyAo has quit IRC23:04
*** jamielennox is now known as jamielennox|away23:04
*** itsuugo has joined #openstack-ansible23:04
*** asettle has joined #openstack-ansible23:04
*** cfarquhar has quit IRC23:06
*** asettle has quit IRC23:09
*** itsuugo has quit IRC23:10
*** itsuugo has joined #openstack-ansible23:11
*** hughmFLEXin has quit IRC23:11
*** TxGirlGeek has quit IRC23:16
*** itsuugo has quit IRC23:16
*** itsuugo has joined #openstack-ansible23:17
*** klamath has quit IRC23:17
*** Mudpuppy has joined #openstack-ansible23:17
*** itsuugo has quit IRC23:22
*** itsuugo has joined #openstack-ansible23:22
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Modify the run-playbooks script to run faster  https://review.openstack.org/37442923:26
*** itsuugo has quit IRC23:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible: Modify the run-playbooks script to run faster  https://review.openstack.org/37442923:33
*** itsuugo has joined #openstack-ansible23:34
*** jamielennox|away is now known as jamielennox23:43
*** markvoelker has joined #openstack-ansible23:44
*** itsuugo has quit IRC23:46
*** itsuugo has joined #openstack-ansible23:47
*** markvoelker has quit IRC23:49
*** galstrom_zzz is now known as galstrom23:50
*** gouthamr has joined #openstack-ansible23:52
*** smatzek has joined #openstack-ansible23:55
*** itsuugo has quit IRC23:55
*** itsuugo has joined #openstack-ansible23:56
*** shanec_ has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!