Wednesday, 2017-08-09

*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879300:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906600:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915200:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932700:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)00:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)00:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]00:10
*** maeca has quit IRC00:13
*** bfournie has quit IRC00:27
*** dparkes has quit IRC00:30
*** ecerquei has joined #tripleo00:36
*** mdnadeem has joined #tripleo00:40
*** mdnadeem has quit IRC00:41
*** mdnadeem has joined #tripleo00:41
*** limao has joined #tripleo00:44
*** owalsh has quit IRC00:48
*** jpena|off is now known as jpena00:49
*** owalsh has joined #tripleo00:50
*** gvrangan has joined #tripleo00:51
*** psahoo has joined #tripleo00:54
*** owalsh_ has joined #tripleo00:54
*** owalsh has quit IRC00:56
*** owalsh_ is now known as owalsh00:58
*** pradk has joined #tripleo00:58
*** chem has quit IRC01:00
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879301:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906601:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915201:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932701:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)01:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)01:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)01:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]01:10
*** dparkes has joined #tripleo01:16
*** funzo has quit IRC01:25
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814801:26
*** owalsh_ has joined #tripleo01:26
*** jlabarre has quit IRC01:27
*** jlabarre has joined #tripleo01:27
*** owalsh- has joined #tripleo01:30
*** owalsh has quit IRC01:30
*** owalsh- is now known as owalsh01:30
*** owalsh_ has quit IRC01:33
*** bfournie has joined #tripleo01:37
*** bfournie has quit IRC01:38
itlinuxhi pradk: I just paged you on pv channel..01:41
*** Goneri has joined #tripleo01:43
*** jpena is now known as jpena|off01:44
*** gvrangan has quit IRC01:49
openstackgerritMerged openstack/tripleo-quickstart master: Remove vars from multinode common config which can be overriden  https://review.openstack.org/48615401:50
*** dparkes has quit IRC01:54
*** Goneri has quit IRC02:00
*** mdnadeem has quit IRC02:02
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879302:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906602:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915202:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932702:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)02:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)02:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]02:10
*** zshi has quit IRC02:11
*** mdnadeem has joined #tripleo02:12
*** zshi_laptop has joined #tripleo02:12
*** zshi has joined #tripleo02:13
*** pradk has quit IRC02:19
*** ecerquei has quit IRC02:26
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: tripleo-ci: transform delorean URL to use AFS mirrors when possible  https://review.openstack.org/49152202:30
openstackgerritMerged openstack/instack-undercloud master: Install pankoclient on undercloud  https://review.openstack.org/49004402:43
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Adjust for new pcs output.  https://review.openstack.org/49042202:43
openstackgerritMerged openstack/tripleo-quickstart master: Use stdout_lines instead of stdout for subnode inventory  https://review.openstack.org/48339602:43
*** dparkes has joined #tripleo02:45
*** shreshtha_ has quit IRC02:54
*** cmyster has joined #tripleo03:00
*** cmyster has quit IRC03:00
*** cmyster has joined #tripleo03:00
*** jlabarre has quit IRC03:03
*** jlabarre has joined #tripleo03:04
*** yamahata has quit IRC03:06
*** daidv has quit IRC03:10
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879303:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,Fix committed] - Assigned to Arx Cruz (arxcruz)03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906603:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915203:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932703:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)03:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)03:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]03:10
*** links has joined #tripleo03:15
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Clear up debian element documentation  https://review.openstack.org/49197103:15
*** gvrangan has joined #tripleo03:26
*** dparkes has quit IRC03:29
*** gkadam has joined #tripleo03:33
*** ratailor has joined #tripleo03:37
*** limao has quit IRC03:47
*** limao has joined #tripleo03:48
*** gvrangan has quit IRC03:50
*** limao has quit IRC03:53
*** ykarel has joined #tripleo03:53
*** atoth has quit IRC04:01
*** shreshtha has joined #tripleo04:02
EmilienMstevebaker: just a reminder - usually we don't merge low/medium bugfixed in rc1 but sounds like the one you reported are important04:07
EmilienMI think that's fine, we can merge their bugfixes but just fyi, usually we track high/critical for rc104:07
EmilienMand keep the rest for queens-104:07
EmilienMit's called prioritization :D04:07
EmilienMwe have a ton of high/critical bugs already, my hope is we can get these fixed before the medium / low04:07
EmilienMif that makes sense04:08
EmilienMnow I shut up and leave irc :)04:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879304:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906604:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915204:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932704:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)04:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)04:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)04:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]04:10
*** limao has joined #tripleo04:26
*** gbarros has quit IRC04:26
*** limao has quit IRC04:30
*** agurenko has joined #tripleo04:31
*** skramaja has joined #tripleo04:36
openstackgerritMerged openstack/tripleo-heat-templates master: Don't curl metadata server in userdata example  https://review.openstack.org/48723004:41
*** nyechiel_ has joined #tripleo04:42
*** limao has joined #tripleo04:45
*** garyk has joined #tripleo04:51
*** limao has quit IRC04:59
*** limao has joined #tripleo05:01
*** marios has joined #tripleo05:03
*** shreshtha has quit IRC05:05
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879305:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906605:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915205:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932705:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)05:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)05:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]05:10
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] lvm testing of spanned vg  https://review.openstack.org/49198605:13
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] refactoring lvm creation into node objects  https://review.openstack.org/49198705:13
*** gvrangan has joined #tripleo05:17
openstackgerritSaravanan KR proposed openstack/tripleo-common master: Provide a list of unused user env parameters in plan  https://review.openstack.org/49175305:19
*** shreshtha has joined #tripleo05:21
*** dmacpher has joined #tripleo05:23
*** psachin has joined #tripleo05:24
*** sshnaidm has quit IRC05:28
*** sshnaidm has joined #tripleo05:31
*** jfrancoa has joined #tripleo05:37
*** janki has joined #tripleo05:37
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add 'discover and enroll nodes' workflow  https://review.openstack.org/48852605:49
*** yprokule has joined #tripleo05:51
*** cshastri has joined #tripleo05:51
*** lmiccini has joined #tripleo05:52
*** rcernin has joined #tripleo05:52
*** jprovazn has joined #tripleo05:57
*** ooolpbot has joined #tripleo06:14
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:14
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879306:14
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906606:14
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915206:14
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932706:14
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)06:14
*** ooolpbot has quit IRC06:14
*** pgadiya has joined #tripleo06:14
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)06:14
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)06:14
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]06:14
*** michapma has quit IRC06:15
*** dmacpher has quit IRC06:15
*** michapma has joined #tripleo06:15
*** udesale has joined #tripleo06:17
*** ykarel is now known as ykarel|afk06:19
openstackgerritMarios Andreou proposed openstack/tripleo-common master: Download and run upgrade/deploy_steps_playbooks for upgrade  https://review.openstack.org/49084706:34
*** masco has joined #tripleo06:34
*** tesseract has joined #tripleo06:35
honzai'm looking for reviewers for tripleo-common, gui logging, urgent, FFE is place https://review.openstack.org/#/c/469196/06:38
*** jaganathan has joined #tripleo06:49
*** ffiore has joined #tripleo06:50
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Notifications fixes  https://review.openstack.org/48759306:52
*** shreshtha_ has joined #tripleo06:59
*** shreshtha has quit IRC07:06
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879307:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906607:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915207:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932707:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)07:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)07:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]07:10
*** florianf has joined #tripleo07:13
*** lmiccini has quit IRC07:16
*** ebarrera has joined #tripleo07:24
*** pcaruana has joined #tripleo07:25
*** jlinkes has joined #tripleo07:25
*** amoralej|off is now known as amoralej07:26
*** mcornea has joined #tripleo07:29
*** udesale__ has joined #tripleo07:38
*** udesale has quit IRC07:39
*** shardy has joined #tripleo07:42
*** oidgar has joined #tripleo07:44
*** udesale has joined #tripleo07:51
*** udesale__ has quit IRC07:51
*** shardy has quit IRC07:53
*** hewbrocca_afk is now known as hewbrocca07:53
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Fix metadata_settings in containerized mongodb  https://review.openstack.org/49201407:54
*** chem has joined #tripleo07:54
openstackgerritAlfredo Moralejo proposed openstack/tripleo-quickstart-extras master: Add required variables for pike in validate-tempest  https://review.openstack.org/49201607:54
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879308:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906608:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915208:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932708:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)08:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)08:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]08:10
*** cylopez has joined #tripleo08:20
openstackgerritMerged openstack/tripleo-heat-templates master: Use number for KeystoneCronTokenFlushMaxDelay instead of string  https://review.openstack.org/49074808:20
*** ykarel|afk is now known as ykarel08:25
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Make network-isolation-v6 environment rendered for all roles  https://review.openstack.org/47448608:34
*** anshul has joined #tripleo08:34
*** limao has quit IRC08:34
*** limao has joined #tripleo08:35
*** limao has quit IRC08:35
*** limao has joined #tripleo08:35
*** oidgar has quit IRC08:41
*** limao has quit IRC08:41
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Enable TLS configuration for containerized RabbitMQ  https://review.openstack.org/49160008:42
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Enable TLS configuration for containerized RabbitMQ  https://review.openstack.org/49160408:44
*** mwhahaha has quit IRC08:47
*** chem has quit IRC08:47
*** shreshtha_ has quit IRC08:47
*** michapma has quit IRC08:47
*** psachin has quit IRC08:47
*** ratailor has quit IRC08:47
*** zshi_laptop has quit IRC08:47
*** mdnadeem has quit IRC08:47
*** psahoo has quit IRC08:47
*** tvignaud has quit IRC08:47
*** stevebaker has quit IRC08:47
*** apetrich has quit IRC08:47
*** toure has quit IRC08:47
*** jokke_ has quit IRC08:47
*** assassin has quit IRC08:47
*** cylopez has quit IRC08:47
*** owalsh has quit IRC08:47
*** jkilpatr has quit IRC08:47
*** brault has quit IRC08:47
*** Tyrantelf has quit IRC08:47
*** zoli has quit IRC08:47
*** amoralej has quit IRC08:47
*** jfrancoa has quit IRC08:47
*** gvrangan has quit IRC08:47
*** nyechiel_ has quit IRC08:47
*** hamzy has quit IRC08:47
*** fultonj has quit IRC08:47
*** colonwq has quit IRC08:47
*** dhill_ has quit IRC08:47
*** pblaho has quit IRC08:47
*** isq_ has quit IRC08:47
*** bcafarel has quit IRC08:47
*** fpan has quit IRC08:47
*** bandini has quit IRC08:47
*** rook has quit IRC08:47
*** dmsimard has quit IRC08:47
*** markmc has quit IRC08:47
*** eck` has quit IRC08:47
*** timothyb89 has quit IRC08:47
*** EmilienM has quit IRC08:47
*** udesale has quit IRC08:47
*** tesseract has quit IRC08:47
*** zshi has quit IRC08:47
*** itlinux has quit IRC08:47
*** ipsecguy_ has quit IRC08:47
*** spredzy has quit IRC08:47
*** saneax_-_ has quit IRC08:47
*** yolanda has quit IRC08:47
*** kbyrne has quit IRC08:47
*** dobson has quit IRC08:47
*** myoung has quit IRC08:47
*** jschlueter has quit IRC08:47
*** numans has quit IRC08:47
*** arxcruz has quit IRC08:47
*** saneax has quit IRC08:47
*** dsariel has quit IRC08:47
*** karthiks has quit IRC08:47
*** tristanC has quit IRC08:47
*** ansiwen has quit IRC08:47
*** tonyb has quit IRC08:47
*** lyarwood has quit IRC08:47
*** mhenkel has quit IRC08:47
*** hewbrocca has quit IRC08:47
*** ggillies has quit IRC08:47
*** ramishra has quit IRC08:47
*** leanderthal has quit IRC08:47
*** jpena|off has quit IRC08:47
*** lucas-afk has quit IRC08:47
*** sai has quit IRC08:47
*** Lokesh_Jain__ has quit IRC08:47
*** sseago has quit IRC08:47
*** greghaynes has quit IRC08:47
*** dtantsur|afk has quit IRC08:47
*** radez has quit IRC08:47
*** hexo_ has quit IRC08:47
*** StevenK has quit IRC08:47
*** akrzos has quit IRC08:47
*** zul has quit IRC08:47
*** percevalbot` has quit IRC08:47
*** Hazelesque has quit IRC08:47
*** florianf has quit IRC08:47
*** pgadiya has quit IRC08:47
*** rcernin has quit IRC08:47
*** gkadam has quit IRC08:47
*** links has quit IRC08:47
*** bswartz has quit IRC08:47
*** jaosorior has quit IRC08:47
*** remix_tj has quit IRC08:47
*** weshay_ has quit IRC08:47
*** mandre_mtg has quit IRC08:47
*** SlickNik has quit IRC08:47
*** dougbtv has quit IRC08:47
*** leseb has quit IRC08:47
*** mdbooth has quit IRC08:47
*** gchamoul has quit IRC08:47
*** larsks has quit IRC08:47
*** migi has quit IRC08:47
*** trown|outtypewww has quit IRC08:47
*** jlinkes has quit IRC08:47
*** pcaruana has quit IRC08:47
*** jlabarre has quit IRC08:47
*** d0ugal has quit IRC08:47
*** patrickeast has quit IRC08:47
*** mgkwill has quit IRC08:47
*** vkmc has quit IRC08:47
*** hrybacki has quit IRC08:47
*** v1k0d3n has quit IRC08:47
*** mgagne has quit IRC08:47
*** fungi has quit IRC08:47
*** leifmadsen has quit IRC08:47
*** fabbione has quit IRC08:47
*** CaptTofu has quit IRC08:47
*** NobodyCam has quit IRC08:47
*** portdirect has quit IRC08:47
*** jprovazn has quit IRC08:47
*** gfidente|afk has quit IRC08:47
*** rodrigods has quit IRC08:47
*** vpickard has quit IRC08:47
*** sdake_ has quit IRC08:47
*** artom has quit IRC08:47
*** mrunge has quit IRC08:47
*** jwb has quit IRC08:47
*** zaneb has quit IRC08:47
*** andreaf has quit IRC08:47
*** number80 has quit IRC08:47
*** samdoran has quit IRC08:47
*** alanmeadows has quit IRC08:47
*** ebarrera has quit IRC08:47
*** marrusl has quit IRC08:47
*** mmethot has quit IRC08:47
*** morazi has quit IRC08:47
*** strigazi has quit IRC08:47
*** PhilSliderS has quit IRC08:47
*** rnoriega has quit IRC08:47
*** bnemec has quit IRC08:47
*** kambiz has quit IRC08:47
*** chandankumar has quit IRC08:47
*** matbu has quit IRC08:47
*** dmanchad has quit IRC08:47
*** rasca has quit IRC08:47
*** jaganathan has quit IRC08:47
*** masco has quit IRC08:47
*** marios has quit IRC08:47
*** cmyster has quit IRC08:47
*** trozet has quit IRC08:47
*** therve has quit IRC08:47
*** afazekas has quit IRC08:47
*** rmcadams has quit IRC08:47
*** anshul has quit IRC08:47
*** ffiore has quit IRC08:47
*** yprokule has quit IRC08:47
*** agurenko has quit IRC08:47
*** rhallisey has quit IRC08:47
*** dciabrin has quit IRC08:47
*** lifeless has quit IRC08:47
*** jistr has quit IRC08:47
*** openstackgerrit has quit IRC08:47
*** social has quit IRC08:47
*** cinerama has quit IRC08:47
*** cshastri has quit IRC08:47
*** garyk has quit IRC08:47
*** dr_gogeta86 has quit IRC08:47
*** flaper87 has quit IRC08:47
*** soc_off_ has quit IRC08:47
*** bugzy has quit IRC08:47
*** stee_3_ has quit IRC08:47
*** jidar has quit IRC08:47
*** mburned_out has quit IRC08:47
*** beagles has quit IRC08:47
*** dsavineau has quit IRC08:47
*** pliu has quit IRC08:47
*** faceman has quit IRC08:47
*** adarazs_mtg has quit IRC08:47
*** rickflare has quit IRC08:47
*** Slower has quit IRC08:47
*** honza has quit IRC08:47
*** ChanServ has quit IRC08:47
*** dtrainor has quit IRC08:47
*** japestinho has quit IRC08:47
*** shadower has quit IRC08:47
*** tdasilva has quit IRC08:47
*** tbarron has quit IRC08:47
*** melwitt has quit IRC08:47
*** thrash|g0ne has quit IRC08:47
*** rajinir has quit IRC08:47
*** Ng has quit IRC08:47
*** atheurer has quit IRC09:00
*** sshnaidm has quit IRC09:30
*** openstack has joined #tripleo13:53
garykshardy: looking13:54
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Set virsh secret with an init step when using Ceph  https://review.openstack.org/49208213:54
jistrgfidente: ^ was that all we changed? step, detach, command, and /etc/nova mount?13:54
weshayFYI https://bugs.launchpad.net/tripleo/+bug/170963013:55
jistrgfidente: also maybe we could try what dprince suggested regarding the param names13:55
weshaygate-tripleo-ci-centos-7-scenario001-multinode-oooq-container13:55
weshayis 100% fail13:55
jistri mean values13:55
gfidentejistr in puppet profiles13:55
gfidentethe list_join uses ,13:56
gfidenteit should use .13:56
*** pgadiya has joined #tripleo13:56
garykshardy: any pointers for what to look for in /var/log/messages - i see a lot of erros about being unable to connect to rabbit13:57
jistrgfidente: not sure what you mean, can you point to the code?13:57
gfidenteack in comments ok13:57
jistrgfidente: oh i see13:57
jistrgfidente: updating13:58
openstackLaunchpad bug 1709630 in tripleo "gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container is failing 100% of time since 08-08-2017" [Critical,Triaged]13:58
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Set virsh secret with an init step when using Ceph  https://review.openstack.org/49208213:58
jistrgfidente: ^13:58
shardygaryk: look for "killed" when the OOM killer logs about killing a process - assuming the amount of RAM makes that likely of course13:59
gfidentejistr cool before deleting I want to try a few more combinations of the command13:59
shardyor track backwards from the start of the rabbit errors looking for the initial error13:59
gfidenteto make sure idempotency works13:59
jistrgfidente: sure thing14:00
*** janki has quit IRC14:00
*** ecerquei has joined #tripleo14:01
garyki see : Aug  9 13:39:44 undercloud systemd: rabbitmq-server.service: main process exited, code=killed, status=11/SEGV14:01
garyki will increase the memory and try again. thanks! very helpful14:01
*** gvrangan has quit IRC14:05
*** garyk has quit IRC14:07
abishopd0ugal: could you help us out with https://review.openstack.org/480587 ?14:07
abishopd0ugal: https://review.openstack.org/489239 (smaller change) relies on it14:07
d0ugalabishop: sure14:07
abishopthx!14:07
pabelangerThere is a networking-bagpipe patch in the gate right now, until we land: https://review.openstack.org/491878/ it is going to case a large number of gate resets today14:09
* mwhahaha flips tables14:09
*** owalsh_ has joined #tripleo14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170879314:10
openstackLaunchpad bug 1708793 in tripleo "tempest is no longer failing appropriately in oooq" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906614:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915214:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932714:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963014:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)14:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)14:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]14:10
openstackLaunchpad bug 1709630 in tripleo "gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container is failing 100% of time since 08-08-2017" [Critical,Triaged]14:10
*** pgadiya has quit IRC14:10
jistrgfidente: i have a new version ready as dprince suggested (get_param instead of hiera). Should i update the review and let's test the latest status?14:11
jistrso that we don't test sth that got -114:12
fultonjgfidente jistr anything i can do on this?14:12
*** hewbrocca_afk has joined #tripleo14:12
gfidentejistr sureyes14:12
*** owalsh has quit IRC14:12
fultonjso #1 ceph issue is libvirt secret and you're testing if https://review.openstack.org/#/c/492082 fixes it14:12
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Set virsh secret with an init step when using Ceph  https://review.openstack.org/49208214:13
jistrfultonj: yea that's my understanding :) can you please review? ^14:13
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/newton: Adds SSH Banner text into sshd_config  https://review.openstack.org/49215214:13
fultonjyes, looking at it14:14
*** udesale has joined #tripleo14:15
fultonji have fresh quickstart, i will test it now14:15
*** hewbrocca_afk has quit IRC14:16
jistrfultonj: we'll also add back the /etc/libvirt subdirs creation, so that we only make minimal changes14:18
*** hewbrocca_afk has joined #tripleo14:18
fultonjjistr: what review is that ^ ?14:19
jistrgfidente: i'll keep the parent dir creation there too though. If it already exists, it won't do anything.14:19
jistrfultonj: same one, it's at the bottom of docker/nova-libvirt.yaml14:19
*** udesale has quit IRC14:19
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Set virsh secret with an init step when using Ceph  https://review.openstack.org/49208214:19
mhenkelHi All, any os-net-config experts here?14:20
fultonjok, i see14:20
weshaySlower, /me looking for who may be able to look at https://bugs.launchpad.net/tripleo/+bug/170963014:21
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]14:21
*** hewbrocca_afk has quit IRC14:22
*** hewbrocca_afk has joined #tripleo14:23
*** gbarros has quit IRC14:25
*** cshastri has quit IRC14:25
*** gbarros has joined #tripleo14:26
*** agopi|away has joined #tripleo14:26
*** amoralej|lunch is now known as amoralej14:27
gfidentejistr so cherry-picking ps #514:27
openstackgerritwes hayutin proposed openstack/tripleo-ui master: DO NOT MERGE, used in CI ONLY  https://review.openstack.org/42202514:27
*** Goneri has quit IRC14:28
fultonjfyi: i have a deploy running w/ ps5 and will exmaine for presence of key after change runs14:29
*** hewbrocca_afk is now known as hewbrocca`14:29
jistrmhenkel: hi, unfortunately the two top contributors in terms of commits and LOC aren't here atm. Maybe someone else would be able to answer an os-net-config question (likely not me though :) )...14:29
*** hewbrocca` is now known as hewbrocca_afk14:30
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: update the dlrn-gate-check checkout to patch 5  https://review.openstack.org/49215314:30
*** hewbrocca_afk is now known as hewbrocca`14:30
jistrgfidente: ack14:30
*** owalsh_ is now known as owalsh14:31
gfidentefultonj if you have time I think MDS might need another update14:32
gfidentethen we can try to merge it14:32
fultonjgfidente: ok, saw your review. i will update now. thanks14:32
*** hewbrocca has quit IRC14:32
gfidentejistr also we need volunteers to merge the tripleo-admin submissions for deployed-server14:33
*** psachin has quit IRC14:33
*** ykarel is now known as ykarel|afk14:33
*** jkilpatr has quit IRC14:33
*** jkilpatr has joined #tripleo14:34
*** pblaho has quit IRC14:34
jistrgfidente: yea14:35
jistrcalling for volunteers to review/merge these!14:36
jistrhttps://review.openstack.org/#/q/topic:bug/170818014:36
* hewbrocca` has a brand new irc proxy14:38
*** hewbrocca` is now known as hewbrocca14:38
*** garyk has joined #tripleo14:39
hewbroccaEmilienM slagle et al ^^^ is critical...14:39
slagleactually it's "High"14:40
jistr:D14:41
hewbroccaheh14:42
slaglewould you like to join our bug triage team? spots are available :)14:42
*** trozet has joined #tripleo14:43
hewbroccaI think that would be a net subtraction from your triage efficiency...14:44
*** cylopez has quit IRC14:47
honzai'm looking for reviewers for tripleo-common, gui logging, urgent, FFE is place https://review.openstack.org/#/c/469196/14:48
*** pblaho has joined #tripleo14:48
honzain* place14:48
slaglejistr: reviewed14:52
jistrslagle: thanks!14:52
slaglejistr: i left a comment on the one patch last night about the SUBNODES_SSH_KEY, but i see now that you probably just copied that from the other script :)14:52
slagleso, ignore14:52
numansbeagles, hi, can you please have a look at this https://review.openstack.org/#/c/489875/. you had given +2 for this patch14:52
jistrslagle: yea the reason i went for it is to keep the existing interface on the CI side. We could as well export both vars in the CI though and get the special handling done in CI, which is probably better. Not something i'd like to block on though..14:53
numansstevebaker,  hi, can you please have a look at this https://review.openstack.org/#/c/489875/. you had given +2 for this patch14:53
gfidenteslagle but that will unblock some ceph-ansible ci14:54
gfidenteso it comes with much ascii hearts14:54
*** gregwork has joined #tripleo14:55
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add support for installing Ceph MDS via ceph-ansible  https://review.openstack.org/47942614:55
fultonjthanks slagle14:56
gfidentefultonj 984 is for manila14:56
fultonjyes14:57
fultonjid manila --> uid=984(manila) gid=981(manila) groups=981(manila),99(nobody)14:57
gfidentefultonj I mean, it goes on line 21114:57
gfidentenot 20114:57
mhenkeljistr: thanks, I am adding support for OpenContrail SDN controller interfaces and am wondering if the bring up order of the interfaces can be influenced14:57
mhenkele.g. first bringing up bonds, vlans etc14:58
*** ykarel|afk is now known as ykarel15:01
*** rlandy|meetup has joined #tripleo15:01
*** nyechiel has quit IRC15:01
gceramidmsimard: continuing here because of the meeting. Where is zuul-cloner cloning ZUUL_PROJECT then ? I already use prepare-workspace in my job, and since I'm checking a tripleo-ci change, it should clone it somewhere15:02
dmsimardin $WORKSPACE/$ZUUL_PROJECT15:02
dmsimard$ZUUL_PROJECT includes the namespace, so it should be $WORKSPACE/openstack-infra/tripleo-ci15:02
*** jkilpatr has quit IRC15:03
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Add support for installing Ceph MDS via ceph-ansible  https://review.openstack.org/47942615:03
gfidentefultonj ^^ ack +215:03
fultonjthanks15:03
jistrmhenkel: hm i don't know that. If you don't get an answer here then please ask at openstack-dev list with '[tripleo]' tag in subject. This is a dev question so it fits into the list's purpose.15:04
mhenkeljistr: thanks!15:05
*** maeca1 has joined #tripleo15:06
gceramidmsimard: ok15:06
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906615:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915215:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932715:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963015:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)15:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,In progress] - Assigned to James Slagle (james-slagle)15:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]15:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]15:10
*** maeca1 has quit IRC15:11
*** rlandy|meetup has quit IRC15:11
openstackgerritMerged openstack/tripleo-heat-templates master: Addition of Nuage as mechanism driver for ML2  https://review.openstack.org/47478815:11
*** limao has quit IRC15:13
openstackgerritMerged openstack/tripleo-common stable/ocata: Remove svg links  https://review.openstack.org/49157615:14
*** tesseract has quit IRC15:14
openstackgerritMarios Andreou proposed openstack/instack-undercloud master: Adds execution of post-upgrade validations on undercloud upgrade  https://review.openstack.org/47457815:16
openstackgerritMarios Andreou proposed openstack/instack-undercloud master: Adds pre-upgrade validations using the new pre-upgrade hook  https://review.openstack.org/48518415:16
*** links has quit IRC15:16
openstackgerritJiri Stransky proposed openstack/tripleo-quickstart-extras master: Make container varaibles defined for upgrades  https://review.openstack.org/49146315:20
*** ebarrera has quit IRC15:21
*** itlinux has joined #tripleo15:21
*** maeca has joined #tripleo15:24
*** maeca has quit IRC15:24
fultonjgfidente jistr: fyi my testing of https://review.openstack.org/#/c/492082 is delayed by an unreleated issue. On my controller docker-puppet.py couldn't start rabbit ; i'm re-running w/ "HOW_DIFF=True ; PROCESS_COUNT=1 ; CONFIG=/var/lib/docker-puppet/docker-puppet.json ; python /var/lib/docker-puppet/docker-puppet.py"15:25
gceramidmsimard: updated15:25
fultonjhttp://paste.openstack.org/show/617946/15:25
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574715:25
flaper87fultonj: did you have to do anything to ensure docker is running on the VM?15:27
flaper87fultonj: http://logs.openstack.org/59/471759/56/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/5b9abb6/logs/undercloud/var/log/mistral/executor.log.txt.gz15:27
flaper87but, it's weird, it should be running15:27
fultonjflaper87: docker is running on the VM15:28
gfidenteflaper87 docker service needs to be enabled15:28
gfidenteit's in docker.yaml15:28
fultonjquickstart built this undercloud last night with --release master15:28
fultonj--release master15:28
fultonj-tripleo-ci15:28
gfidenteflaper87 OS::TripleO::Services::Docker: ../puppet/services/docker.yaml15:29
fultonji deployed w/ env/docker.yaml15:29
* fultonj looks15:29
gfidenteyeah15:29
flaper87gfidente: it's enabled in my env15:30
gfidenteso that should do it15:30
gfidenteyou don't see it running?15:30
flaper87well, apparently nope15:30
flaper87http://logs.openstack.org/59/471759/56/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/5b9abb6/logs/undercloud/var/log/journal.txt.gz#_Aug_09_13_12_0615:30
*** oidgar has joined #tripleo15:30
flaper87it is running15:30
flaper87Aug 09 13:12:07 centos-7-2-node-citycloud-la1-10344310 dockerd-current[30487]: time="2017-08-09T13:12:07.475705370Z" level=info msg="API listen on /var/run/docker.sock"15:31
flaper87according to that line15:31
gfidenteyeah that's probably not the issue then15:31
flaper87it must be a perms issue15:31
flaper87jeez15:31
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive  https://review.openstack.org/49217815:33
*** atheurer has joined #tripleo15:33
flaper87gfidente: fultonj this is weird. We're basically using the same call for ansible-playbook15:33
flaper87the same become, become_user, etc15:34
*** rwsu has joined #tripleo15:34
*** ykarel_ has joined #tripleo15:34
jistrfultonj: in your paste Aug  9 14:58:49 localhost journal: INFO:__main__:Deleting /etc/hosts15:35
jistrthat doesn't sound right... i wonder why kolla tries to delete it15:35
flaper87unless kubespray is messing with me15:35
*** anshul has quit IRC15:36
ansiwenowalsh_: did you see that before: Error rendering template network/network.network.yaml : 'network' is undefined15:36
ansiwenowalsh_: while deploying overcloud15:37
*** ykarel has quit IRC15:37
beaglesansiwen, I ran into that myself at one point.. I ended up updating the undercloud to resolve15:37
ansiwenbeagles: again... thanks :-)15:38
beaglesansiwen, it was kind of time to update anyways and it looked like something that may have been tied to generated templates15:38
beaglesansiwen, there may be a specific package that you could update to avoid a complete update but I didn't bother sorting it out15:39
*** masco has joined #tripleo15:40
fultonjjistr: perhaps it was set up wrong during kolla_config?15:40
fultonjmy seuential re-run produced no errors in my console, but the same error in var log messages15:41
fultonjhttp://paste.openstack.org/show/617951/15:42
jistrflaper87: i think we're running kubespray too early (step 1). ceph-ansible runs in step 2. That might be the difference.15:42
*** jmelvin has quit IRC15:43
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive  https://review.openstack.org/49217815:43
*** ffiore has quit IRC15:45
jistrflaper87: nah ignore that, you said it actually was running..15:46
jistri mean docker was running15:47
*** jlabarre has quit IRC15:47
*** oidgar has quit IRC15:48
*** oidgar has joined #tripleo15:48
jistrflaper87: hm they even document running kubespray as non-root with `become` https://github.com/kubernetes-incubator/kubespray/blob/23565ebe62852c6bfe0d16ea790d0a08960fdec7/docs/cloud.md15:49
jistrso it should work..15:49
garykshardy: increasing the memory has helped. now accessing keystone fails. http://paste.openstack.org/show/617954/ - any hints?15:54
pabelangermwhahaha: bnemec: I can promote 491878 once it lands in gate. That will help reduce gate resets15:56
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574715:57
*** samdoran has quit IRC15:57
*** samdoran has joined #tripleo15:57
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: Add missing module documentation  https://review.openstack.org/49184515:58
*** oidgar has quit IRC15:58
jistrfultonj: hm i think it has to be a side effect of this: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/rabbitmq.yaml#L84-L8515:59
jistrmaybe the puppet-generated files contained /etc/hosts for some reason, and kolla tried to replace it15:59
openstackgerritJon Schlueter proposed openstack/tripleo-quickstart master: DNM: Testing fix for Bug 1605654  https://review.openstack.org/49141515:59
openstackbug 1605654 in neutron "TestNetworkBasicOps often times out running against tripleo" [Critical,Fix released] https://launchpad.net/bugs/1605654 - Assigned to Jakub Libosvar (libosvar)15:59
fultonjjistr: want me to open a bug on that?16:01
jistrfultonj: yes please, to make sure we persist the info in case it's reproducible16:01
fultonjjistr: ok i will opena bug16:01
jistrfultonj: thanks16:01
*** marios has quit IRC16:02
gfidentefultonj btw ps#5 seems to work fine here, I am trying to launch an instance to confirm16:04
fultonjjistr: it seems to stop the deploy but not break it; after running sequetially docker-puppet.py with no error i re-ran the same openstack overcloud deploy command and it's now past it and running the mistral workflow to install ceph16:04
fultonjgfidente: ok, do you see the secret in the container now?16:05
*** dtantsur is now known as dtantsur|brb16:05
fultonjgfidente: now that my deployment is running i will check too16:05
jistrflaper87: gfidente was right, it's missing https://review.openstack.org/#/c/471759/56/ci/environments/scenario006-multinode.yaml16:09
jistrflaper87: the enabled docker we saw was on undercloud. It's not enabled on overcloud, no mention of dockerd-current in /var/log/messages.16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906616:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915216:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932716:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963016:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)16:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,Fix committed] - Assigned to James Slagle (james-slagle)16:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]16:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]16:10
*** katkapilatova has left #tripleo16:10
*** ykarel_ is now known as ykarel|away16:12
*** pchavva has quit IRC16:12
*** limao has joined #tripleo16:14
*** lucasagomes is now known as lucas-afk16:14
*** jmelvin has joined #tripleo16:15
*** ykarel|away has quit IRC16:17
*** limao has quit IRC16:18
*** mjblack has joined #tripleo16:21
*** rwsu has quit IRC16:21
*** nyechiel has joined #tripleo16:26
*** florianf has quit IRC16:28
*** yprokule has quit IRC16:30
*** nyechiel_ has joined #tripleo16:30
*** nyechiel has quit IRC16:31
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Rework the getthelogs helper script for wget recursive  https://review.openstack.org/49217816:33
*** paramite has quit IRC16:33
*** fandrieu has quit IRC16:34
*** fandrieu has joined #tripleo16:35
*** rwsu has joined #tripleo16:38
*** rcernin has quit IRC16:41
openstackgerritAlfredo Moralejo proposed openstack/tripleo-quickstart master: Use images created by periodic pike job in pike configs  https://review.openstack.org/49220016:44
*** Goneri has joined #tripleo16:44
*** gvrangan has joined #tripleo16:45
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656716:45
openstackgerritGabriele Cerami proposed openstack/tripleo-quickstart master: pike release file: fix images url path  https://review.openstack.org/49220116:46
*** hewbrocca is now known as hewbrocca_afk16:47
*** mcornea has quit IRC16:49
*** sshnaidm is now known as sshnaidm|off16:50
EmilienMhewbrocca_afk: ack16:52
*** nyechiel_ has quit IRC16:56
*** masco has quit IRC16:58
*** pchavva has joined #tripleo16:58
*** jkilpatr has joined #tripleo16:59
*** eck`gone is now known as eck`17:05
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906617:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170915217:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932717:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963017:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1709152 in tripleo ocata "tripleo-common docs job broken on stable/ocata" [Critical,Fix committed] - Assigned to James Slagle (james-slagle)17:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]17:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]17:10
*** trown is now known as trown|lunch17:11
honzai'm getting undercloud install errors in ci, thoughts?  keep rechecking?  http://logs.openstack.org/08/469608/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/ab43a49/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-08-09_13_13_2817:12
*** jpena|off is now known as jpena17:12
*** dtantsur|brb is now known as dtantsur17:18
*** pkovar has quit IRC17:19
*** cylopez has joined #tripleo17:21
*** mdnadeem has joined #tripleo17:26
*** mdnadeem has quit IRC17:26
*** bogdando has quit IRC17:27
*** ebarrera has joined #tripleo17:28
honzabnemec: quick question about your patch to instack-undercloud patch where you moved mistral workbook loading from bash to python; are the mistral workbooks loaded when the 98-undercloud-setup file is executed?17:30
honzabnemec: i have a patch where i run a workflow from the cli; the code is right after those workbooks were loaded before your change17:31
honzabnemec: for reference, my patch is here https://review.openstack.org/#/c/469608/3 (fails ci)17:32
bnemechonza: No, they won't be now.  But we really shouldn't be adding more code to 98-undercloud-setup.17:32
bnemecThe mistral stuff should never have been there in the first place either.17:32
vkmchey guys!17:33
vkmcI'm trying to test an environment file17:33
vkmcand Mistral is returning17:34
vkmcProcessing templates in the directory /tmp/tripleoclient-Ez0AXl/tripleo-heat-templates17:34
vkmcCould not fetch contents for file:///home/stack/tripleo-heat-templates/docker/post.yaml17:34
honzabnemec: ok, cool, i get it now (I had a better look at your patch); I'll follow suit with my code, thanks17:34
vkmcis there a way to test environment files that I'm aware of?17:34
*** jpena is now known as jpena|off17:35
*** gkadam has joined #tripleo17:36
bnemechonza: Sure, let me know if you have any questions.17:37
*** jkilpatr has quit IRC17:38
vkmcjistr, ^17:39
*** eck` is now known as eck`gone17:39
*** jkilpatr has joined #tripleo17:42
*** rcernin has joined #tripleo17:42
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656717:43
*** yamahata has joined #tripleo17:44
*** jlabarre has joined #tripleo17:45
*** Goneri has quit IRC17:50
*** arxcruz is now known as arxcruz|off17:50
*** salmankhan has quit IRC17:58
*** cshastri has joined #tripleo18:00
shardyvkmc: can you share the cli args you're using, and the contents of the environment under test?18:01
shardyvkmc: the most likely reason is you've got a path mismatch between --templates foo and -e notfoo/env.yaml18:01
*** MVenesio has quit IRC18:01
*** MVenesio has joined #tripleo18:02
shardyif the referenced resource_registry templates in notfoo/env.yaml are j2 rendered (e.g don't exist in --templates but there's a j2.yaml file) then both paths need to match, e.g copy env.yaml under the --templates path18:02
*** jpena|off is now known as jpena18:02
shardywe should probably add some client validation to help highlight that I think18:03
*** Goneri has joined #tripleo18:05
vkmcsure... so, it's a specific backend for manila18:05
vkmcthis is the yaml file... http://paste.openstack.org/show/617968/18:06
vkmcthe original one is this https://github.com/openstack/tripleo-heat-templates/blob/master/environments/manila-netapp-config.yaml18:06
vkmcand I'm calling openstack overcloud deploy as follows18:07
vkmcopenstack overcloud deploy --templates -e /usr/share/openstack-tripleo-heat-templates/environments/docker.yaml -e ~/docker_registry.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/services-docker/manila.yaml -e ~/manila-netapp-config.yaml -e ~/manila_netapp.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/docker-ha.yaml18:07
vkmcshardy, ^18:07
vkmcremoving -e /usr/share/openstack-tripleo-heat-templates/environments/services-docker/manila.yaml since it's included in manila-netapp-config18:07
*** oidgar has joined #tripleo18:08
vkmcs/removing/I tried removing/g18:08
vkmcstill no luck18:08
*** gfidente is now known as gfidente|backin218:08
shardyvkmc: Ok you have two environment files not under the same path as --templates (which defaults to /usr/share/openstack-tripleo-heat-templates)18:09
shardyvkmc: can you paste the contents of the second one too please?18:09
vkmcI also tried putting it under /usr/share/openstack-tripleo-heat-templates18:10
vkmcwith the same result18:10
shardyand ~/docker_registry.yaml18:10
vkmcsure18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906618:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932718:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963018:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)18:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]18:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]18:10
*** Goneri has quit IRC18:10
*** jrist has quit IRC18:11
shardyCould not fetch contents for file:///home/stack/tripleo-heat-templates/docker/post.yaml18:11
shardyvkmc: that implies that you're referencing tripleo-heat-templates/docker/post.yaml from one of the environment files in /home/stack18:11
shardywhich won't work because post.yaml is rendered from /usr/share/openstack-tripleo-heat-templates18:12
shardyif you make a copy of /usr/share/openstack-tripleo-heat-templates to /home/stack/tripleo-heat-templates18:12
shardythen pass --templates /home/stack/tripleo-heat-templates and make all of the -e paths reference that directory tree too18:12
shardythen I think it should work18:12
shardythe problem is when you mix different paths on the same CLI18:13
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574718:13
vkmcdocker_registry.yaml http://paste.openstack.org/show/617970/18:13
vkmcvery well18:14
vkmcso the call should be...18:14
shardyHmm, I don't see the post.yaml in any of the /home/stack environments..18:14
vkmc--templates /home/stack/tripleo-heat-templates and all the -e pointing to templates contained there18:14
shardyso it could be another issue, unless I've just missed it18:14
shardyvkmc: yes, that will at least rule out the situation I mentioned18:15
vkmcshardy, awesome, I'll try that out18:15
fultonjjistr: https://bugs.launchpad.net/tripleo/+bug/170968918:15
openstackLaunchpad bug 1709689 in tripleo "kolla rabbitmq container setup should not try to delete /etc/hosts" [Medium,Triaged] - Assigned to Jiří Stránský (jistr)18:15
*** dtantsur is now known as dtantsur|afk18:15
pabelangerbnemec: mwhahaha: I enqueue and promoted 491878 in gate. Everything behind it should no longer have problems with networking-bagpipe18:17
pabelangerhopefully it passes all its jobs18:17
mwhahahawe can only dream18:17
pabelangerwe're stopping image uploads to infracloud, to help improve the bandwidth also have email out to HPE18:18
pabelangerI think that is mostly the issue ATM for landing patches18:18
*** trown|lunch is now known as trown18:18
mwhahahacool18:19
pabelangergate-tripleo-ci-centos-7-undercloud-containers is still high on failures, going to look into logstash and see if there is a pattern18:19
mwhahahai noticed a bunch of throughput timeouts18:19
vkmcshardy, no luck18:19
vkmc(undercloud) [stack@undercloud tripleo-heat-templates]$ openstack overcloud deploy --templates ~/tripleo-heat-templates/ -e ~/tripleo-heat-templates/environments/docker.yaml -e ~/docker_registry.yaml -e ~/tripleo-heat-templates/environments/manila-netapp-config.yaml -e ~/manila_netapp.yaml -e ~/tripleo-heat-templates/environments/docker-ha.yaml18:19
vkmctripleo-heat-templates is a git repo with the changes in place18:19
*** atoth has quit IRC18:20
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Convert network templates to be rendered via j2  https://review.openstack.org/49221818:20
shardyvkmc: Hmm, we match the paths in tripleoclient, could it be the ~ confising it, or is that definitely getting expanded by the shell?18:22
vkmchm... let's put the whole path18:22
vkmcs/whole/absolute/g18:22
shardyvkmc: the other thing you can try is to pass --no-cleanup and check for the rendered file in the tmpdir created by tripleoclient18:23
shardybasically we download all the rendered templates to a tmpdir, then rewrite the environment file abspaths to match18:23
*** shreshtha_ has joined #tripleo18:24
vkmcgreat, I can do that18:24
shardyvkmc: sorry I've got to drop now but I hope you figure it out :)18:24
weshaybnemec, question.. if the tempest test fails, and the job passes isn't that fairly critical?18:24
vkmcshardy, thanks for the help :)18:24
weshayre: 170879318:24
*** shardy has quit IRC18:24
*** nyechiel_ has joined #tripleo18:26
bnemecweshay: Yes, as I noted it's a critical bug.  But the appropriate people are already working on it and it's not blocking anything so I don't think an alert is necessary.18:26
*** shreshtha has quit IRC18:26
bnemecUnless we want people to stop merging things until it's fixed, I guess.18:27
bnemecAt which point it becomes a blocker.18:27
bnemecBut I haven't heard that proposed as yet.18:27
openstackgerritHonza Pokorny proposed openstack/instack-undercloud master: Add an hourly cron trigger for tripleo-ui logging  https://review.openstack.org/46960818:27
weshaythey just need to be careful atm until we get the fix merged.. which getting things through the gate has been tough and ongoing for a few days18:27
*** cshastri has quit IRC18:28
*** jcoufal has quit IRC18:29
zzzeekhow do I use my own release .yml file instead of one of the ones in config/release with tripleo-quickstart ?18:30
zzzeekpeople who might know  ^^^ bnemec weshay lyarwood EmilienM sorry for the pings18:33
*** dbecker has joined #tripleo18:33
weshayzzzeek, just update the config file.  If you are using an already created python virt-env then source it and run python setup.py install18:34
weshayto get the config in the right place..18:34
zzzeekweshay: you mean the main config file, not one in config/release right18:34
weshayif you are not using a pre-existing virt-env the file will be placed in the right spot and quickstart.sh will just use it if -R calls it18:34
zzzeekweshay: ok...preexisting virt-env, i have to tell it that also right18:35
zzzeekweshay: oh maybe i shouldnt call -X :)18:35
zzzeekding18:35
*** gfidente|backin2 is now known as gfidente|dinner18:35
weshayyour flight is now ready for take off :)18:35
* weshay southwest airlines humor18:36
weshayEmilienM, ^18:36
*** pchavva has quit IRC18:37
*** gkadam has quit IRC18:38
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175918:38
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud  https://review.openstack.org/47175918:40
*** nyechiel_ has quit IRC18:46
openstackgerritVictoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share for HA  https://review.openstack.org/48268018:47
openstackgerritLokesh Jain proposed openstack/tripleo-heat-templates stable/ocata: Addition of Nuage as mechanism driver for ML2  https://review.openstack.org/49222418:48
bandinifolks is zuul/jenkins having issues or just slow? I see a bunch of reviews +Aed for 15h without merging (https://review.openstack.org/491824 or https://review.openstack.org/475457)18:53
bandinidciabrin: ^18:55
*** ecerquei has quit IRC18:56
*** dbecker has quit IRC19:02
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906619:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932719:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963019:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)19:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]19:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]19:10
pabelangerEmilienM: mwhahaha: bnemec: the containers multinode job is still hitting mirror.centos.org for centos-openstack-ocata: http://logs.openstack.org/82/491782/1/gate/gate-tripleo-ci-centos-7-containers-multinode/c17c3cc/logs/undercloud/home/jenkins/repo_setup.log.txt.gz#_2017-08-09_18_31_1419:13
pabelangerEmilienM: mwhahaha: bnemec: who would be best to fix that?19:14
mwhahahagood question19:14
*** MVenesio has quit IRC19:14
mwhahahathat's probably covered in tripleo-quickstart-extras19:14
*** jlabarre has quit IRC19:15
*** MVenesio has joined #tripleo19:16
*** MVenesio has quit IRC19:18
mwhahahapabelanger: that's got the local mirror in that file19:21
mwhahahapabelanger: http://logs.openstack.org/82/491782/1/gate/gate-tripleo-ci-centos-7-containers-multinode/c17c3cc/logs/undercloud/home/jenkins/repo_setup.log.txt.gz#_2017-08-09_18_31_1319:21
mwhahahaso it looks like we miss swapping out the mirror for ceph/storage/virt repos19:22
pabelangerya19:22
*** ebarrera has quit IRC19:24
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574719:25
*** akrivoka has quit IRC19:26
mwhahahapabelanger: in our configs we're supposed to be using NODEPOOL_MIRROR_HOST19:28
mwhahahapabelanger: do you have an example of what /etc/ca/mirror_info.sh has in it?19:28
mwhahahapabelanger: https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/master.yml#L27-L3619:29
pabelangermwhahaha: ya, we created it with http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh#n8419:32
pabelangerlet me pastebin an example19:32
*** garyk has quit IRC19:32
pabelangerhttp://paste.openstack.org/show/617979/19:33
pabelangerfrom tripleo-test-cloud-rh119:33
mwhahahamy only assumption is that the code to pull that in isn't right19:34
*** amoralej is now known as amoralej|off19:34
mwhahahaodd it looks right to me19:36
mwhahahai'll have to dig in a bit deeper19:36
pabelangerugh, 491878 failed a job19:37
pabelangerhttp://logs.openstack.org/78/491878/3/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/9fa1eff/logs/undercloud/home/jenkins/failed_deployments.log.txt.gz19:37
pabelangerhow can I tell which means are being used for a heat deployment?19:37
pabelangernever had to debug that before19:38
mwhahahaError: Execution of '/usr/bin/yum -d 0 -e 0 -y install fence-agents-all' returned 1: Error downloading packages:\n  1:librados2-10.2.7-0.el7.x86_64: [Errno 256] No more mirrors to try.19:38
mwhahahawhat do you mean?19:38
pabelangerI'm not to familiar how heat works in this case, what was that comment run? on subnode-2?19:41
pabelangerbasically want to confirm the yum.conf file for that yum command19:41
mwhahahahttp://logs.openstack.org/78/491878/3/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/9fa1eff/logs/subnode-2/etc/yum.repos.d/19:42
mwhahahathat one was using the mirrors19:43
mwhahahahttp://logs.openstack.org/78/491878/3/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/9fa1eff/logs/subnode-2/etc/yum.repos.d/delorean-current.repo.txt.gz19:43
mwhahahathat was just a puppet run via heat so all normal stuff, the yum conf is -^19:43
pabelangerokay ya, so we likely had a networking blip in rackspace19:44
mwhahahawtf so that job you linked was the containers job19:44
mwhahahabut it has ocata configured19:44
*** gvrangan has quit IRC19:45
mwhahahapabelanger: are you guys pre-configuring ocata in the images?19:45
*** dparkes has joined #tripleo19:46
mwhahahapabelanger: i think those yum repos are the ones in the image and not the one's we're configuring19:47
pabelangermwhahaha: let me check19:47
mwhahahawe're not purging the existing yum configs19:47
*** funzo has joined #tripleo19:47
pabelangermwhahaha: Ya, we still do: https://github.com/openstack-infra/system-config/blob/master/install_puppet.sh#L16619:48
pabelangermwhahaha: so ya, that needs to be purged19:48
pabelangerlet me see if we can remove that step19:48
pabelangerI am not sure we need to do that any more19:48
mwhahahathat'll probably break a bunch of jobs19:48
*** gbarros has quit IRC19:49
pabelangerI think we are better now that we removed puppet from our images, but ya. We'll have to test it19:49
pabelangerwe actually could disable it for now, and force jobs to opt into it. Like we did for EPEL19:49
mwhahahathat'd probably be a good idea19:50
pabelangerIIRC, it is because we need to install openvswich19:51
mwhahahawe could add something into our CI to purge the configs or at least disable them all19:51
mwhahahathis is a time when being declaritive makes it easier than trying to cover all the unknown possibilities :D19:52
*** rwsu_ has joined #tripleo19:53
pabelangerYa, that is a good first step on yourside for sure19:54
*** jprovazn has quit IRC19:55
mwhahahahttps://github.com/ansible/ansible-modules-extras/issues/168019:55
mwhahahaheh that's what i want for ci :D19:55
mwhahahawonder if it ever made it into ansible19:55
mwhahahadoesn't look like it :/19:56
*** rwsu has quit IRC19:57
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574719:58
*** jlabarre has joined #tripleo20:04
*** sbrzozow has quit IRC20:04
*** liverpooler has quit IRC20:04
*** gbarros has joined #tripleo20:06
*** gbarros has quit IRC20:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906620:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932720:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963020:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]20:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]20:10
openstackgerritAndreas Karis proposed openstack/tripleo-heat-templates master: Case insentitive MAC address matching in OsNetConfigMappings  https://review.openstack.org/49224420:12
openstackgerritAndreas Karis proposed openstack/tripleo-heat-templates master: Case insentitive MAC address matching in OsNetConfigMappings  https://review.openstack.org/49224420:14
openstackgerritLokesh Jain proposed openstack/tripleo-heat-templates stable/newton: Addition of Nuage as mechanism driver for ML2  https://review.openstack.org/49224520:14
*** oidgar has quit IRC20:16
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Move common multinode role setup from tripleo-ci  https://review.openstack.org/48740820:23
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add featureset for 3nodes multinode job  https://review.openstack.org/48615520:23
*** links has joined #tripleo20:24
mwhahahatrown: quickstart question for you20:24
trownmwhahaha: sure20:25
mwhahahatrown: so the repo-setup role has a problem where it currently can't clear the existing configured repos. The problem comes with the use of package provided repos20:25
mwhahahatrown: what do you think would be the best way to idempotently disable any unmanaged repos20:25
*** jfrancoa has quit IRC20:25
pabelangermwhahaha: okay, I see a potential issue with buildlogs reverse proxy, working on a patch. Hopefully that will result is better downloads20:26
mwhahahatrown: i was thinking yum-config-manager --disable "*" in the beginning but package provided repos won't get reinstalled20:26
mwhahahatrown: for context i'm talking about https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/templates/repo_setup.sh.j220:26
trownmwhahaha: ya that is tough20:27
mwhahahamaybe we need to just reinstall if the package was already installed20:28
mwhahahaseems like a problem in general with package provided repos20:28
trownya20:28
trowncould try to just always uninstall them before installing20:29
*** ansmith has quit IRC20:30
trownmwhahaha: in what situtation do we need to clear existing repos? upgrades?20:33
mwhahahaCI20:33
mwhahahathe images have repos on them20:33
mwhahahatrown: scroll up to see context20:34
trownmwhahaha: oh it is in the infra provided image20:36
mwhahahayea20:36
mwhahahathe problem is that we can't explicitly be sure what repos are and are not enabled when using quickstart. we've just always assumed it was an emptyset or just some basics that don't conflict20:37
trownmwhahaha: for that we could just specifically remove that repo at the beginning of CI run (before quickstart runs)20:37
mwhahahayea i was trying to see if there was a better way in quickstart so we could be more explicit20:38
trownya it could be nice to solve generically for future cases... seems hard though :P20:38
mwhahahawell doesn't help we're using shell scripts for this20:39
* mwhahaha would point to already established config management patterns that handle this just fine20:39
* mwhahaha would also note they don't start with the letter A20:39
* mwhahaha stops trolling20:39
trowntradeoffs to anything :P20:40
*** gfidente|dinner is now known as gfidente20:43
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574720:44
mwhahahaargh this package stuff is also the problem20:44
mwhahahabecause it doesn't work with the infra mirrors20:44
trownya the repo urls are hardcoded... we could change to no use the packages... but then if the urls change we get broken20:49
mwhahahaso it looks like our ci configs skip packages20:49
mwhahahaso i'm adding a flag to disable existing which is fine if you use 100% generic20:49
mwhahahaso maybe this works out after all20:50
*** markmc` has joined #tripleo20:53
*** jlabarre has quit IRC20:53
*** nyechiel_ has joined #tripleo20:53
*** athomas has quit IRC20:54
*** markmc` has quit IRC20:54
*** markmc has quit IRC20:55
*** markmc has joined #tripleo20:56
*** links has quit IRC20:56
*** jpena is now known as jpena|off20:56
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add flag to disable existing repositories  https://review.openstack.org/49228920:56
mwhahahatrown, pabelanger -^ i think this might do it for CI20:57
stevebakermorning20:57
*** trown is now known as trown|outtypewww20:59
bnemecDammit.  Bugs for pike-rc1 keep coming in as fast as I can close/re-target them. :-(20:59
*** bfournie has quit IRC20:59
* mwhahaha turns the hose back on21:00
*** dr_gogeta86 has quit IRC21:00
*** jkilpatr has quit IRC21:01
*** toure is now known as toure|gone21:01
*** rbrady has quit IRC21:01
*** markmc has quit IRC21:02
*** markmc has joined #tripleo21:03
*** lblanchard has quit IRC21:08
*** catintheroof has quit IRC21:09
*** arxcruz|off is now known as arxcruz21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906621:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932721:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963021:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)21:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]21:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]21:10
*** markmc has quit IRC21:10
*** leitan has quit IRC21:10
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use tasks for rhel registration  https://review.openstack.org/49188121:10
*** abishop has quit IRC21:13
*** markmc has joined #tripleo21:14
gfidentefultonj the issue in https://bugs.launchpad.net/tripleo/+bug/170968221:19
openstackLaunchpad bug 1709682 in tripleo "Configuration Updates which used ceph-ansible workflow fail" [High,Triaged] - Assigned to Giulio Fidente (gfidente)21:19
*** nyechiel_ has quit IRC21:20
gfidentecomes when updating after an initial stack failure?21:20
fultonjgfidente: yes21:20
gfidenteok I might have found something then21:20
fultonjoh?21:20
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Disable existing repositories in tripleo-ci  https://review.openstack.org/49228921:23
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Disable existing repositories in tripleo-ci  https://review.openstack.org/49228921:23
*** agopi|away has quit IRC21:24
*** ansmith has joined #tripleo21:25
*** derekh has quit IRC21:29
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: Set file mode permission of Ceph keyrings  https://review.openstack.org/49230321:30
fultonjgfidente: ^21:30
gfidentegrrat21:31
gfidente*great21:31
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test  https://review.openstack.org/47574721:36
Slowergcerami: are we getting container builds?21:49
Sloweror rather, where are we with the whole promoted containers business?21:51
weshaySlower, https://review.rdoproject.org/zuul/ see the openstack-experimental pipeline there21:54
*** itlinux has quit IRC21:54
mwhahahaweshay: https://review.openstack.org/#/c/492289/ the rdo 3rdparty seems to be using rax mirrors (which seems odd), are using the upstream image or something for those?21:54
weshaymwhahaha, /me looks21:55
mwhahahaweshay: the logs are hard to read but i was able to pull out the repo list and like delorean is coming back with baseurl = http://mirror.dfw.rax.openstack.org:8080/rdo/centos7/6d/4f/6d4fc217095f07e0c13cf2db99b18add461f8bb1_9077dc9321:55
mwhahahaweshay: which should only happen if we're running on an infra node and it has /etc/ci/mirror_infra.sh21:56
weshayso rdo 3rd party is running from software factory21:56
weshayrdo software factory21:57
mwhahahaare they using upstream images? :D21:59
*** jmelvin has quit IRC21:59
weshaymwhahaha, I don't believe they are.. they are using the same DIB, same process though21:59
mwhahahawho do we poke about that then?22:00
weshaymwhahaha, the infra dfg folks.. alan, david, javier22:00
* weshay is looking for the github version of the config22:01
Slowerweshay: is there a way to use those containers with quickstart?22:01
weshaySlower, those jobs are pushing to the rdo registry, and yes although the osp fires this week have killed that for me22:02
Slowerand ovb if that matters22:02
*** limao has joined #tripleo22:02
mwhahahait's the upstream-image-tweaks22:03
*** SlickNik has quit IRC22:03
mwhahahastupid internets22:03
* mwhahaha throws things at centurylink22:03
mwhahahayea it's the image22:04
mwhahahaupstream-centos-7 include the upstream mirror stuff22:04
*** SlickNik has joined #tripleo22:05
*** trozet has quit IRC22:05
*** dparkes_ has joined #tripleo22:06
*** dparkes has quit IRC22:07
*** limao has quit IRC22:07
openstackgerritDamien Ciabrini proposed openstack/puppet-tripleo master: Enable TLS configuration for containerized HAProxy  https://review.openstack.org/49159922:08
Slowerweshay: so you're saying there's a way to do it or not? :) (run quickstart with different images)22:09
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Enable TLS configuration for containerized HAProxy  https://review.openstack.org/49160222:10
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906622:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932722:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963022:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]22:10
*** SlickNik has quit IRC22:10
weshaySlower, I'm here for ya man22:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]22:10
Slowerhaha :) thanks weshay :)22:10
Sloweris that documented someplace? :)22:10
* Slower sucks at quickstart22:10
Slowerslowly improving but basically22:11
*** SlickNik has joined #tripleo22:11
weshaySlower, for your reference https://review.openstack.org/#/c/475747/22:12
weshayhttps://review.openstack.org/#/c/491922/1/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j222:12
weshayis the only change in prep-containers that gcerami is using other than updated variables22:12
weshaySlower, https://review.openstack.org/#/c/475743/32/config/release/tripleo-ci/promotion-testing-hash-master.yml22:12
*** atheurer has quit IRC22:12
weshaydocker_registry_host: trunk.registry.rdoproject.org22:13
weshaydocker_registry_namespace: tripleo22:13
weshaydelorean_hash_label: &promotion-testing-tag tripleo-ci-testing22:13
weshaydocker_image_tag: *promotion-testing-tag22:13
weshaymwhahaha, yikes http://logs.openstack.org/89/492289/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/ed3052e/logs/undercloud/home/jenkins/install_packages.sh.log.txt.gz22:17
gceramiSlower: weshay sorry I'm almost sleeping22:17
weshaygcerami, go to sleep22:17
gceramiSlower: we haave a way to use the images in quickstart22:17
weshaymwhahaha, that must be killing the centos repos22:17
gceramiSlower: last test failed because it was not searching for the right tag22:17
gceramiSlower: with the lasest patch, it should work.22:17
weshaySlower, while I have your attention I have a patch on pacemaker w/ containers as well22:18
gceramiSlower: but the latest build were blocked by test on the dlrn api that should lead to hashpromotion22:18
mwhahahaweshay: yes we're not properly defining all repos22:19
*** rcernin has quit IRC22:20
gceramiweshay: dlrn api just set success22:21
gceramisent*22:21
gceraminow building containers images again.22:22
*** jkilpatr has joined #tripleo22:22
gceramigoing to sleep, will check the child job status tomorrow (if it gets there)22:22
gfidentedo you guys know if in ci logs there is somewhere an output of the keystone endpoints?22:24
*** gcerami is now known as gcerami|Zz22:25
weshaygfidente, like an openstack catalog list.. check postci22:28
gfidenteweshay yeah thanks22:28
weshaymwhahaha, so are you expecting the centos repos to be resetup?22:29
weshaymwhahaha, I think if you disable everything except centos we should be ok22:29
*** jkilpatr has quit IRC22:29
mwhahahaweshay: yes i was22:32
mwhahahaweshay: clearly that is not the case. this is not helping out CI cause because it means we aren't using the local mirrors for core packages22:33
mwhahahaso we've always been (and sill do) use mirror.centos in infra22:33
* mwhahaha will fix tomorrow22:33
weshaymwhahaha, that is not traditionally how it's worked in upstream, but it could.. but it has issues when the centos guys change the repos22:33
mwhahahai thought that was the point of all the infra provided ubuntu/pypi mirrors22:33
mwhahahai'm pretty sure devstack jobs pull as much as possible from the local mirrors22:34
mwhahahaotherwise why has all this effort gone into building these mirrors: http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh#n8422:34
mwhahaha:D22:34
mwhahahathat being said we should be more explicit in our repo configs so that we can account for all the package sources22:35
mwhahahawe've magically gotten this downstream22:36
weshaymwhahaha, ya.. rhos-release does it all22:36
weshayit's a much more complicated scenario upstream22:37
*** bugzy has quit IRC22:37
*** stee_3_ has quit IRC22:37
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Use quotes for gnocchi-upgrade command  https://review.openstack.org/49231522:37
weshaymwhahaha, which devstack repos are you gunning for22:37
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Move Ceph RGW from scenario004 to scenario001  https://review.openstack.org/49156622:37
mwhahahaweshay: yea well in our case it's centos/ceph/kvm i think to cover the basics. the rest we conf in oooq22:39
* mwhahaha will deal with it later22:39
weshayk22:39
*** dparkes has joined #tripleo22:41
*** jkilpatr has joined #tripleo22:42
*** dparkes_ has quit IRC22:42
*** dougbtv has quit IRC22:45
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Use quotes for gnocchi-upgrade command  https://review.openstack.org/49231522:46
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: Adds pacemaker update_tasks for Pike minor update workflow  https://review.openstack.org/48656722:46
*** itlinux has joined #tripleo23:00
openstackgerritAthlan-Guyot sofer proposed openstack/python-tripleoclient master: Dump update tasks.  https://review.openstack.org/49232123:01
*** bugzy has joined #tripleo23:07
*** stee_3 has joined #tripleo23:08
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170906623:10
openstackLaunchpad bug 1709066 in tripleo "[CI] Upgrade job down: AnsibleUndefinedVariable: 'docker_registry_namespace' is undefined" [Critical,In progress] - Assigned to Jiří Stránský (jistr)23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170932723:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/170963023:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1709327 in tripleo "CI: extremely long times of overcloud deploy in multinode jobs" [Critical,Triaged]23:10
openstackLaunchpad bug 1709630 in tripleo "docker run gnocchi_db_sync is failing in gate-tripleo-ci-centos-7-scenario001-multinode-oooq-container" [Critical,Triaged]23:10
itlinuxhello all.. any suggestions on this error http://paste.openstack.org/show/617993/23:13
openstackgerritMerged openstack/puppet-tripleo master: Use clustercheck credentials to poll galera state in container  https://review.openstack.org/48927923:13
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Use quotes for gnocchi-upgrade command  https://review.openstack.org/49231523:19
*** itlinux has quit IRC23:21
*** dmacpher has joined #tripleo23:35
*** gfidente has quit IRC23:36
*** chem has quit IRC23:47
*** chem has joined #tripleo23:47
*** trozet has joined #tripleo23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!