Tuesday, 2017-09-19

mnaseri think i might have a clue at the root cause of tripleo gate problem00:00
mnaserhttp://paste.openstack.org/show/621372/00:00
mnaserthe self.instances stuff works, i wrote a small .rb file and it functionally shows the write stuff00:00
mnaserhttps://review.openstack.org/#/c/501669/4/lib/puppet/provider/nova.rb00:01
mnaseri suspect the cause here is "#{Puppet::Util.which('nova-manage')} #{args.join(' ')}"00:01
mnaserim guessing the questionmarks and the ampersand is fucking things up00:01
mnaserwoops, forgive my language there :>00:02
mnasercommand (Array<String>, String) — the command to execute. If it is an Array the first element should be the executable and the rest of the elements should be the individual arguments to that executable.00:02
*** ebarrera has quit IRC00:03
mnaseri think we should be doing the array stuff instead of args.join00:03
*** oanson has quit IRC00:08
*** oanson has joined #tripleo00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691400:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727400:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727900:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754500:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795900:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]00:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]00:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]00:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)00:10
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: Update Gentoo element for element changes  https://review.openstack.org/50384400:11
openstackgerritMohammed Naser proposed openstack/tripleo-heat-templates master: DNM, change to test lp 1717545  https://review.openstack.org/50494700:12
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] https://launchpad.net/bugs/171754500:12
mnaserthats an attempt00:14
larsks If anyone's around...how do I "bundle exec rake spec" a single spec00:16
larsks?00:16
larsksJust adding a path (bundle exec rake spec path/to/spec.rb) doesn't seem to do it.00:17
*** chlong has joined #tripleo00:20
larsksAh SPEC_OPTS="-P path/to/spec.rb"00:28
*** dmacpher has quit IRC00:47
*** bfournie has joined #tripleo00:51
*** bfournie has quit IRC00:52
*** tiswanso has joined #tripleo00:58
*** ipsecguy has quit IRC01:08
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691401:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727401:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727901:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754501:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795901:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]01:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]01:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]01:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)01:10
*** jwb has quit IRC01:16
*** tiswanso has quit IRC01:19
*** tiswanso has joined #tripleo01:20
*** thrash is now known as thrash|g0ne01:21
*** cshastri has joined #tripleo01:21
*** sshnaidm has joined #tripleo01:22
*** apetrich has quit IRC01:23
*** liverpooler has quit IRC01:24
*** apetrich has joined #tripleo01:25
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook  https://review.openstack.org/50493901:25
*** yamahata has quit IRC01:29
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Actually sort mount-point list  https://review.openstack.org/50481901:30
*** dmacpher has joined #tripleo01:37
*** itlinux has joined #tripleo01:48
*** chlong has quit IRC02:03
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691402:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727402:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727902:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754502:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795902:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]02:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]02:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]02:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)02:10
*** ipsecguy has joined #tripleo02:15
openstackgerritMerged openstack/python-tripleoclient stable/pike: Add --set argument to prepare command  https://review.openstack.org/49774502:19
mnaserhttps://review.openstack.org/#/c/504977/ - please have a look to resolve tripleo gates02:30
*** ramishra has joined #tripleo02:30
*** itlinux has quit IRC02:37
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: test image update with loop  https://review.openstack.org/50499202:40
*** sshnaidm is now known as sshnaidm|off02:41
-openstackstatus- NOTICE: Gerrit is being restarted to feed its insatiable memory appetite02:42
*** tzumainn has joined #tripleo02:57
*** tzumainn has quit IRC03:02
*** daidv has joined #tripleo03:07
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691403:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727403:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727903:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754503:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795903:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]03:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]03:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]03:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)03:10
*** tongl has joined #tripleo03:30
*** rlandy|brb is now known as rlandy03:32
*** dbecker has quit IRC03:54
*** tzumainn has joined #tripleo03:57
*** ykarel has joined #tripleo04:01
*** tzumainn has quit IRC04:01
*** itlinux has joined #tripleo04:03
*** ykarel_ has joined #tripleo04:03
*** ykarel has quit IRC04:05
*** dbecker has joined #tripleo04:07
*** aditya_r has joined #tripleo04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691404:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727404:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727904:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754504:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795904:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]04:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]04:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]04:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)04:10
*** udesale has joined #tripleo04:16
*** shreshtha has joined #tripleo04:21
*** pdeore has joined #tripleo04:27
*** janki has joined #tripleo04:32
*** dmacpher has quit IRC04:35
*** itlinux has quit IRC04:36
*** skramaja has joined #tripleo04:39
jankiHi. Can I get +1 for workflow for https://review.openstack.org/#/c/498383/ plz04:42
*** aditya_ra has joined #tripleo04:56
*** aditya_r has quit IRC04:59
*** marios has joined #tripleo05:00
*** aditya_ra has quit IRC05:04
*** agurenko has joined #tripleo05:04
*** aditya_r has joined #tripleo05:04
jaosoriorjanki: I could but... gotta check if the gate isn't broken anymore05:09
jaosoriorjanki: it's been broken for days05:09
jaosoriorjanki: is it working yet?05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691405:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727405:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727905:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754505:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795905:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]05:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]05:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]05:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)05:10
jankijaosorior, not sure. I did see someone asking about it yesterday here.05:10
jaosoriorjanki: well, http://tripleo.org/cistatus.html05:10
jaosoriorseems pretty broken to me05:11
*** skramaja_ has joined #tripleo05:12
*** skramaja has quit IRC05:14
jankijaosorior, ya....05:14
jaosoriorjanki: soo.... no +W yet :(05:15
jankijaosorior, lets see tomorrow. this is important for ODL deployment :(05:15
jaosoriorjanki: this might be a fix though https://review.openstack.org/#/c/50497705:17
*** mdnadeem has joined #tripleo05:18
*** abregman has joined #tripleo05:25
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-docs master: Add step for overcloud DNS setup in TLS everywhere doc  https://review.openstack.org/50505805:27
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Only inject cloud-init in CentOS 7.3  https://review.openstack.org/50485005:32
*** dpawar has joined #tripleo05:35
openstackgerritzenghui.shi proposed openstack/tripleo-specs master: Tripleo PTP (Precision Time Protocol) support  https://review.openstack.org/48322705:37
*** masco has joined #tripleo05:39
*** sshnaidm|off has quit IRC05:40
*** psahoo has joined #tripleo05:43
*** aditya_r has quit IRC05:43
*** aditya_r has joined #tripleo05:44
*** abregman has quit IRC05:45
*** ratailor has joined #tripleo05:47
*** ykarel_ is now known as ykarel05:53
*** jfrancoa has joined #tripleo05:58
*** udesale has quit IRC05:59
*** jtomasek has joined #tripleo06:00
*** udesale has joined #tripleo06:00
*** jfrancoa has quit IRC06:05
*** abishop has quit IRC06:05
*** rbrady has quit IRC06:05
*** afazekas has quit IRC06:05
*** brault has quit IRC06:05
*** numans has quit IRC06:05
*** jproqueDell has quit IRC06:05
*** StevenK has quit IRC06:05
*** vila_grcalka has quit IRC06:05
*** dr_gogeta86 has quit IRC06:05
*** spredzy has quit IRC06:05
*** Tengu has quit IRC06:05
*** tdasilva has quit IRC06:05
*** mwhahaha has quit IRC06:05
*** melwitt has quit IRC06:05
*** rajinir has quit IRC06:05
*** Ng has quit IRC06:05
*** Tengu has joined #tripleo06:05
*** melwitt has joined #tripleo06:05
*** StevenK has joined #tripleo06:05
*** afazekas has joined #tripleo06:05
*** dr_gogeta86 has joined #tripleo06:05
*** dr_gogeta86 has quit IRC06:05
*** dr_gogeta86 has joined #tripleo06:05
*** rbrady has joined #tripleo06:05
*** rbrady has joined #tripleo06:05
*** abishop has joined #tripleo06:05
*** Ng has joined #tripleo06:05
*** ChanServ sets mode: +v Ng06:05
*** melwitt is now known as Guest3664106:06
*** numans has joined #tripleo06:06
*** mwhahaha has joined #tripleo06:06
*** panda|bbl has quit IRC06:08
*** mrunge has quit IRC06:08
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: App config and I18n selectors refactor  https://review.openstack.org/49414106:09
*** mrunge has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691406:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727406:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727906:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754506:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795906:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]06:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]06:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]06:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)06:10
*** jfrancoa has joined #tripleo06:10
*** brault has joined #tripleo06:10
*** jproqueDell has joined #tripleo06:10
*** vila_grcalka has joined #tripleo06:10
*** spredzy has joined #tripleo06:10
*** tdasilva has joined #tripleo06:10
*** rajinir has joined #tripleo06:10
*** panda has joined #tripleo06:11
*** mnaser has quit IRC06:12
*** mnaser has joined #tripleo06:13
*** mnaser has joined #tripleo06:13
*** tongl has quit IRC06:15
*** jprovazn has joined #tripleo06:19
*** jchhatbar has joined #tripleo06:22
*** jchhatbar has quit IRC06:23
*** jchhatbar has joined #tripleo06:23
*** janki has quit IRC06:24
*** janki has joined #tripleo06:28
*** jchhatbar has quit IRC06:31
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: Added a new role definition for SR-IOV Compute role  https://review.openstack.org/50199906:35
*** jlinkes has joined #tripleo06:37
*** paramite has joined #tripleo06:38
*** pgadiya has joined #tripleo06:38
*** jaganathan has joined #tripleo06:41
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Format and send the retry-limit reached message  https://review.openstack.org/50438706:41
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Handle nodes that failed to start introspection  https://review.openstack.org/50490706:41
*** ccamacho has joined #tripleo06:49
*** florianf has joined #tripleo06:49
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: docker: add logging(source & groups)  https://review.openstack.org/49952906:50
ccamachomorning folksd06:56
*** dpawar has quit IRC06:58
*** ebarrera has joined #tripleo07:01
jankimarios, you there?07:03
*** jprovazn has quit IRC07:06
*** abregman has joined #tripleo07:07
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691407:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727407:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727907:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754507:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795907:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]07:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]07:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]07:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)07:10
*** tmorin has joined #tripleo07:10
*** anshul has joined #tripleo07:14
*** yprokule has joined #tripleo07:14
*** iranzo has joined #tripleo07:15
*** rcernin has joined #tripleo07:18
*** skramaja_ is now known as skramaja_afk07:21
*** pcaruana has joined #tripleo07:22
*** dpawar has joined #tripleo07:22
jbadiapajaosorior, are you around?07:24
*** tesseract has joined #tripleo07:24
-openstackstatus- NOTICE: Post jobs are not executed currently, do not tag any releases07:25
*** ChanServ changes topic to "Post jobs are not executed currently, do not tag any releases"07:25
*** liverpooler has joined #tripleo07:31
*** dpawar has quit IRC07:32
*** cschwede has joined #tripleo07:34
*** dpawar has joined #tripleo07:34
*** jpena|off is now known as jpena07:35
*** amoralej|off is now known as amoralej07:36
*** threestrands has quit IRC07:36
*** ffiore has joined #tripleo07:36
jaosoriorjbadiapa: yep07:37
jaosoriorjbadiapa: what's up?07:37
*** fandrieu_ has joined #tripleo07:39
*** fandrieu has quit IRC07:39
*** fandrieu_ is now known as fandrieu07:39
jbadiapajaosorior, I saw your question regarding the -1 on the https://review.openstack.org/#/c/499529/ late in the evening,07:39
jaosoriorright07:40
jbadiapaI set -1 because lars had blocked the the patch before, so I wanted to talked to him to unlocked07:41
jaosoriorok07:41
jaosoriorjbadiapa: so what did he say?07:41
jaosoriorowalsh: any idea what could cause this http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_06_59_03_212 ?07:41
jbadiapajaosorior, he had implemented a transformation for avoid setting the logs on every docker service, that's why he blocked to patch.07:43
jaosorioroh07:43
jaosoriorjbadiapa: so... is the patch still valid then? or should it be abandoned in favor of this transformation?07:44
*** janki is now known as janki|lunch07:45
jbadiapajaosorior, the new implementation is using that approach and making the logs visible on the docker service, so it's valid and needed  when docker fluentd will merge07:45
jaosoriorjbadiapa: got a link to it?07:46
jbadiapathe patch we were talking about https://review.openstack.org/#/c/499529/07:46
jbadiapait depends on the dcoker fluentd patch07:47
jbadiapajaosorior, https://review.openstack.org/#/c/467072/07:47
jaosoriorjbadiapa: checking it out07:47
jbadiapajaosorior, lars transformation https://review.openstack.org/#/c/502501/07:47
jaosoriorjbadiapa: yep. Was following the depends-on rabbit hole :D07:48
*** sid1 has joined #tripleo07:49
jaosoriorjbadiapa: is this something we want to add to the defaul roles file? https://review.openstack.org/#/c/467072/2207:49
jaosorioroh07:49
jaosoriorit's there already07:49
jaosoriorgreat07:49
openstackgerritMichele Baldessari proposed openstack/tripleo-specs master: Instance HA Specification  https://review.openstack.org/38910307:49
jaosoriorjbadiapa: well, it looks good to me; I assume you already tried it out locally, right?07:50
jaosoriorjbadiapa: or should I try to deploy it?07:50
jbadiapayes, it worked07:51
jaosoriorjbadiapa: I saw a lot of folks only +1ed the transformation patch, any idea why?07:52
jaosorioroooh yeah07:52
jaosoriorunit tests07:52
jbadiapajaosorior, Emilien was requesting some unit test07:52
jaosoriorjbadiapa: any idea if those are coming soon?07:52
*** egonzalez has joined #tripleo07:52
*** fzdarsky has joined #tripleo07:53
jbadiapaI hope so, lars was working on them07:53
*** sid2 has joined #tripleo07:54
jaosoriorjbadiapa: well, if you want we could pair up and work on those.07:54
*** mrunge has quit IRC07:54
*** sid1 has quit IRC07:55
jbadiapajaosorior, It would be great, but I have to warm you that I do not have much idea about puppet07:57
*** mcornea has joined #tripleo07:57
jaosoriorjbadiapa: no worries07:57
*** mrunge has joined #tripleo07:57
jaosoriorjbadiapa: ok, gimme some minutes and I'll be back.07:58
jbadiapajaosorior, np07:58
*** d0ugal has quit IRC08:01
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Allow Sensu to connect to RabbitMQ cluster  https://review.openstack.org/49514908:01
chandankumarHello08:02
chandankumarHow can i run featureset006 on rdocloud using ovb?08:03
chandankumarit is giving https://paste.fedoraproject.org/paste/Kpy4Ke8~~C6crk2lruNUDQ08:03
chandankumarerror08:03
*** shardy has joined #tripleo08:04
*** d0ugal has joined #tripleo08:09
jaosoriorshardy: hey! good morning! any idea what could cause this http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_06_59_03_212 ?08:09
*** janki|lunch is now known as janki08:09
jankimandre, hey, you there?08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691408:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727408:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727908:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754508:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795908:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]08:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]08:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]08:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)08:10
*** jpich has joined #tripleo08:11
*** ykarel is now known as ykarel|lunch08:11
*** bogdando has joined #tripleo08:11
shardyjaosorior: it looks like it failed building the config drive, is there a hard limit on the size of that?08:12
shardyhttp://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/df.txt.gz08:12
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Correct template names from ocata to pike.  https://review.openstack.org/50046508:12
shardythat shows it as full08:12
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Change template names to queens  https://review.openstack.org/50045108:12
shardydoes that job inject a bunch of data via user-data for cloud-init?08:13
openstackgerritMerged openstack/tripleo-docs master: Add step for overcloud DNS setup in TLS everywhere doc  https://review.openstack.org/50505808:13
jankishardy, hey. I have 1 more question about minor update - would there be nay donwtime?08:16
jaosoriorshardy: it does inject stuff into cloud-init08:17
jaosoriorshardy: not a lot, but it does.08:17
jaosoriorshardy: it wasn't failing until last week though, so  I wonder if something changed.08:17
shardyjanki: the idea is you update one node at a time, so it's a rolling update and no downtime (other than restarting the services on each controller potentially)08:17
shardyjanki: basically it's the same as the old update from a downtime perspective, where we'd update packages and restart services08:17
shardynow we just update containers and restart those instead08:17
jaosoriorshardy: what's extra that we do inject is just this https://github.com/openstack/novajoin/blob/master/files/cloud-config-novajoin.json which is 1.5K08:18
shardybut previously it was done via yum_update.sh, now it's done via update_tasks followed by the normal deploy steps08:18
jaosoriorjbadiapa: alright, bluejeans?08:18
shardyjaosorior: ack, yeah I guess something changed but I'm not sure what tbh08:18
jankishardy, any specific minutes that we can guess that. I am suspecting the time puppet takes to configure the services08:18
shardyjanki: well the service is up while we run puppet etc, it's only down while we restart the container08:19
shardyso in theory the downtime on each node is less than before08:19
shardywhere we'd stop everything then run puppet to bring it back up08:19
shardyI don't have any comparative benchmarks though08:19
jankishardy, like a minute or 2 or something?08:19
shardyif anyone has time to do some testing those would be useful numbers08:19
jbadiapajaosorior, sure08:20
shardyjanki: I don't have any comparative benchmarks08:20
shardyif the exact time is important, you'll have to test it08:20
*** jprovazn has joined #tripleo08:20
shardybut it should be at least as good (probably better) than our old minor update without containres08:20
shardyin theory bouncing each container should be very fast08:21
*** aufi has joined #tripleo08:21
jankishardy, ahh, ohk. Maybe I can try measuring it once I have the setup and figure out the steps08:21
shardyjanki: yeah, if you do then please share the results, I'm sure other folks will ask similar questions08:21
shardyI've just not had time to test it myself yet08:22
jankishardy, sure will do08:22
shardymcornea, marios: ^^ aware of any testing ref downtime for minor updates yet?08:22
mariosshardy: same shardy matbu is the only one with a green run on the very latest workflow afaik (it was being updated last week) so not sure there are that many folks with numbers yet :)08:23
mariosyprokule: may have run it (end to end update? time estimate?)08:23
mariosshardy: janki the initial stack update takes 15mins ish (depending on hardware) to get the ansible playbooks08:24
socialmarios: hey08:24
socialmarios: https://review.openstack.org/#/c/487488/12/tripleoclient/v1/overcloud_update.py08:24
yprokulemarios: so far images ain't updated08:24
yprokulemarios: yesterday's issue08:24
socialmarios: the container file just gets uploaded to swift but do we merge it into environment? We need to update stack parameters there08:24
shardymarios: ack, I think the query was about service downtime, which I assume is negligble provided the LB fails over when we take each service down?08:25
shardymarios: I wasn't too clear re the pacemaker managed things in that case but I assume it's at least equivalent to our old model08:25
*** mrunge has quit IRC08:26
mariosjanki: shardy: running them not sure .. the update_playbooks right now don't have much (just yum update) so that one should be pretty fast... then the deployment steps playbook so that one at the moment should take the 'longest' i guess (there will be more update tasks but pacemaker ones are still being reviewed https://review.openstack.org/486567)08:26
mariosyprokule: social ack08:26
*** mrunge has joined #tripleo08:26
mariosyprokule: yeah i suspected it was something like that (we discussed briefly yesterday) so it may just be that the env file isn't being passed through to the stack update even though matbu added the cli param08:26
shardymarios: ack - for non pacemaker things I think most of the deploy steps time isn't actually taking services down, we spend time generating config and pulling images, then bounce the services at the end of each step08:27
shardysimilar to the systemctl approach with packages I guess08:27
jankishardy, marios so it should be the time deployment steps take? won't puppet tasks be taking time. we need to configure services inside new containers08:27
shardyjanki: we don't run puppet in the container where the service runs08:28
shardywe run a container with puppet inside, then write out the config files08:29
mariossocial: can you add a comment on the review so we can update it (tried pinging matbu on hangout to see if his travel adventures are over but haven't heard yet )08:29
shardythen afterwards we run another container and pass those config files in08:29
shardyjanki: so the downtime is unrelated to how long it takes to run puppet08:29
shardywhich may be an improvement on the old model in some cases08:29
shardyjanki: the downtime for each service is basically just how long it takes paunch/docker to restart the container08:30
socialmarios: we found typo in our flow :)08:30
mariossocial: i think it is related to what yprokule was saying i.e. indeed we need to wire the --container-registry-file08:30
socialmarios: the process is very error firendly08:30
jankishardy, ohk....let me try to measure it and I will share the results08:30
jankishardy, marios thanks for all the explanation. its really helpful :)08:31
mariosnp janki thanks to shardy :)08:31
shardyjanki: if you want to simulate it, you can change TRIPLEO_CONFIG_HASH in the json file we write from docker_puppet.py08:32
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-puppet.py#L37808:32
shardysee /var/lib/tripleo-config/hashed-docker-container-startup-config-step_*.json'08:33
*** jaosorior has quit IRC08:33
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps-tasks.yaml#L5308:33
shardyjanki: you could then re-run paunch like in the deploy steps ^^08:33
shardyand you should see just the container where the config hash changed get restarted08:34
paramiteHey guys, just wanted to ask here. For ~last two weeks my deployments sometimes fails with https://paste.fedoraproject.org/paste/~Dbojk3wcEUxHV7MB7fxKA . The solution for this is to re-run deployment few times and in the end it passes. Is this a known issue or should I create a bug?08:34
*** jaosorior has joined #tripleo08:34
shardythat doesn't quite simulate the case where there's a new image, but it should give you an estimate08:34
*** aditya_r is now known as aditya_r|lunch08:34
jankishardy, i will give that a try. thanks for pointing08:35
shardyparamite: it looks like a bug, what errors are there starting the nova services?08:35
paramiteshardy, this is a whole output: https://paste.fedoraproject.org/paste/8~ys6skHK~h8YS1n~VFkXQ08:36
shardyparamite: sorry it's failing running docker-puppet.py - I'd try running that manually perhaps08:36
paramiteshardy, didn't find any other error than that08:37
paramiteshardy, ok, will do that when I will hit it again08:37
bandinijaosorior: thoughts on my last comments re https://review.openstack.org/#/c/489132/ ?08:38
shardyparamite: http://paste.openstack.org/show/621399/ looks like the relevant part, I think we shouldn't be trying to connect to any db when running docker-puppet, as it's supposed to apply only the puppet tags that write the config files08:41
shardyparamite: so it probably is a bug I think - I'm unclear why it's not persistent though08:41
shardyparamite: perhaps owalsh or lyarwood may have some ideas - I've not seen that issue before myself08:41
jaganathand0ugal, shardy, please look into https://review.openstack.org/#/c/486425/08:43
paramiteshardy, yeah the problem is not persistent. Usually 3 reruns and deployment passes08:43
shardyparamite: weird, maybe you could try running docker-puppet just for that service, and/or in single process mode trying to reproduce08:45
shardyhttps://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/tips_tricks.html#debugging-docker-puppet-py08:45
paramiteshardy, ack, will do next time it hit's me. I've did rerun deploy before asking unfortunately08:46
*** ykarel|lunch is now known as ykarel08:47
openstackgerritMerged openstack/tripleo-common stable/ocata: Remove machine-id from image  https://review.openstack.org/49368508:48
*** udesale has quit IRC08:50
lyarwoodshardy / paramite ; odd, I can't think why puppet-nova would call out to ovs-vsctl like that, owalsh might have more insight.08:51
shardylyarwood: ack, thanks for looking anyway :)08:51
chandankumararxcruz: hello08:52
*** mrch has joined #tripleo08:54
*** iranzo has quit IRC08:57
*** udesale has joined #tripleo09:03
openstackgerritJan Provaznik proposed openstack/tripleo-quickstart master: Increase default size of extra disks to 3G  https://review.openstack.org/50512209:03
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Allow log path transformation in fluentd glue  https://review.openstack.org/50250109:04
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add unit tests for fluentd profile  https://review.openstack.org/50512409:04
*** udesale has quit IRC09:05
*** udesale has joined #tripleo09:05
*** milan has joined #tripleo09:07
jaosoriorbandini: so, the issue with the ansible based approach is that currently if we do it via "host_prep_tasks" or "upgrade_tasks" (or however those are actually called), they09:10
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691409:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727409:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727909:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754509:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795909:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]09:10
jaosoriorthey're ran on each node individually09:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]09:10
*** udesale__ has joined #tripleo09:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]09:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)09:10
jaosoriorbandini: so we would need to generate the key via heat, or before that if we want them to be the same09:10
openstackgerritJan Provaznik proposed openstack/tripleo-common master: Allow nfs-ganesha setup in ceph-ansible workbook  https://review.openstack.org/50512609:10
bandinijaosorior: right. but if we create the key via heat and never use it *except* on upgrade, how would that sound for you?09:10
jaosoriorbandini: that's fine for me09:10
bandinijaosorior: ack09:11
*** udesale has quit IRC09:12
*** salmankhan has joined #tripleo09:12
*** skramaja_afk is now known as skramaja09:13
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: [WIP] Add all services to multinode-containers-scenarios  https://review.openstack.org/50187209:14
openstackgerritSiyi Luo proposed openstack/tripleo-quickstart master: Update the documentation link for doc migration  https://review.openstack.org/50512709:15
tmorinHi EmilienM, yolanda, rnoriega_ : had you seen my question yesterday about  gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet , that systematically fails since last Thursday and prevents us from merging anything in networking-bgpvpn... ?09:21
*** achadha has joined #tripleo09:22
*** abregman is now known as abregman|mtg09:24
shardytmorin: Is it due to https://bugs.launchpad.net/tripleo/+bug/1717550 perhaps?09:25
openstackLaunchpad bug 1717550 in tripleo "Repositories have unresolved dependencies in centos 7.4" [Critical,In progress] - Assigned to Lars Kellogg-Stedman (larsks)09:25
*** aditya_r|lunch is now known as aditya_r09:26
shardythere's a fix posted, I'm testing it locally right now, hopefully we can merge it asap09:26
*** achadha has quit IRC09:26
tmorinshardy: I don't know, here are the logs of a failed run: http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/09:28
sri_shardy: Hi , I am trying to deploy overcloud with multi nic,  In my setup, I've 10 physical servers with two nics attached, and I've deployed undercloud in physical server, all other servers running one kvm for server with two nics attached, So I am trying to use first nic for provisining and second nic for external. I've used (cybertron/tripleo-scripts) GUI tool to generate a heat templates https://pasteboard.co/GL4dvIf.png. I am not09:28
sri_ after deploying overcloud second nic in my vms not getting any IP address. this is all of my configuration http://paste.openstack.org/show/621403/09:28
tmorinshardy: how can I tell if the failure is related to bug 1717550 ?09:28
openstackbug 1717550 in tripleo "Repositories have unresolved dependencies in centos 7.4" [Critical,In progress] https://launchpad.net/bugs/1717550 - Assigned to Lars Kellogg-Stedman (larsks)09:28
tmorinshardy: looking at the logs it seems that perhaps tempest tests are failing on undercloud ( end of http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/quickstart_install.txt.gz ): is this something possible ?09:30
shardytmorin: yeah it doesn't seem to be the same issue, sec digging through the logs09:30
shardyhttp://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/undercloud/home/jenkins/tempest_output.log.txt.gz09:32
shardytmorin: yeah seems to be a tempest failure09:32
tmorinshardy: yes, I see this as well09:32
*** gfidente has joined #tripleo09:33
*** gfidente has quit IRC09:33
*** gfidente has joined #tripleo09:33
tmorinshardy: this perhaps would be the root: http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/subnode-2/var/log/nova/nova-api.log.txt.gz#_2017-09-19_08_08_27_38209:34
shardytmorin: yeah that doesn't look too good09:35
shardyhttp://tripleo.org/cistatus.html shows that job has passed recently though which is surprising09:35
* shardy wonders why the nova-api logs refer to a mysql config file..?!09:36
tmorinshardy: it's not what I see (all blue/orange since last Friday) or am I looking at the wrong place ?09:36
*** tosky has joined #tripleo09:37
shardyhttp://tripleo.org/cistatus.html has a pass of scenario004-multinode-oooq at 2017-09-19 06:18:2909:37
tmorinshardy: nova sqlalchemy instantiates a pymysql that parses my.cnf (to know the parameters to access the DB I guess ?)09:37
tmorinshardy: the problematic job is gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet09:38
shardytmorin: aha, that sounds... ugly09:38
tmorinshardy: not gate-tripleo-ci-centos-7-scenario004-multinode-ooq09:38
shardyI thought we gave nova a connection string instead, that coupling seems less than ideal09:38
shardybut thanks for clarifying09:38
tmorinI googled and found this : https://github.com/PyMySQL/PyMySQL/issues/54809:38
tmorinshardy: ^ .. which has mentions of tripleo in comments btw09:38
shardytmorin: so is gate-tripleo-ci-centos-7-scenario004-multinode-ooq a different scenario 004?09:39
tmorinshardy: yes, it must look at this file for other things, suprising indeed09:39
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Listen for messages from internal introspect workflow  https://review.openstack.org/50403509:39
shardytmorin: Ok well bandini ^^ reported that so lets ask him about it :)09:39
shardyhttps://github.com/openstack/puppet-tripleo/commit/28853dba9d3d1f5f7fcbca58963489789641ae0409:40
* bandini appears09:40
bandinitmorin: what's the question exactly?09:41
tmorinbandini: looking at the cause for sytematical failure of gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet since last Friday09:41
shardypuppet-tripleo-8.0.0-0.20170914233515.9939df4.el7.centos.noarch in http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/rpm-qa.txt.gz09:42
shardyso should have your patch bandini?09:42
tmorinshardy: yes, I found bug 1663181 as well09:42
openstackbug 1663181 in tripleo "Longer term fix for VIP failover issue and clash with cellsv2" [High,Fix released] https://launchpad.net/bugs/1663181 - Assigned to Michele Baldessari (michele)09:42
tmorinwell no 1663181 is not directly related, although mentioned in https://github.com/openstack/puppet-tripleo/commit/28853dba9d3d1f5f7fcbca58963489789641ae0409:43
shardybandini: in the scrollback there's a link to the CI job where nova-api breaks trying to parse my.cnf09:43
shardythat's going to be fun when someone deploys nova-api on a different node to the DB cluster09:43
*** fandrieu has quit IRC09:44
shardybut anyway ;)09:44
openstackgerritBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/pike: Change to boolean for boolean type params  https://review.openstack.org/50513909:44
bandinishardy: the problem is described exactly here https://bugs.launchpad.net/tripleo/+bug/1717545/comments/1409:44
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]09:44
bandinishardy: apparently https://review.openstack.org/#/c/504977/ fixes it09:44
bandinitmorin: ^09:45
shardybandini: ack, thanks for the info :)09:46
bandininp ;)09:46
pandayeah, the revert did not work properly, and it wouldn't be merged anyway09:46
chandankumarpanda: hello09:47
chandankumarpanda: How i can featureset006 scenario jobs using ovb on rdocloud?09:47
chandankumarpanda: each time i am hitting this erro https://paste.fedoraproject.org/paste/r5g-qFmMELvrsh7N0K~-UQ09:48
pandachandankumar:can you paste the complete command ?09:50
tmorinbandini: I'm happy if there is a fix in flight, but the relation between effects and fix is not obvious without digging09:50
tmorinbandini, shardy: I'll follow https://review.openstack.org/#/c/504977/ and recheck when it merges09:50
chandankumarpanda: bash devmode.sh -n -o -d -c featureset00609:50
openstackgerritJanki Chhatbar proposed openstack/tripleo-common master: Add ODL repo to override template  https://review.openstack.org/50291509:50
bandinitmorin: ack. If you need additional explanation as to what the heck is going on there, do let me know09:51
chandankumarpanda: i tried this also export CONFIG=ovb-ha-multiple-nics and then run the command09:51
chandankumareach time same error09:51
*** salmankhan has quit IRC09:53
*** salmankhan has joined #tripleo09:53
pandachandankumar: featureset006 is not compatible with OVB, it's a multinode scenario09:56
chandankumarah09:56
tmorinbandini, shardy: what would have been nice, in an ideal world, would have been to file a bug in networking-bgpvpn and networking-l2gw (people affected by failures of the job) so that the people there can track resolution progress09:57
openstackgerritMerged openstack/tripleo-validations master: Fix name of controller token validation  https://review.openstack.org/50055509:57
openstackgerritMerged openstack/puppet-tripleo stable/newton: Migrate Swift ring handling from tripleo-heat-templates to puppet-tripleo  https://review.openstack.org/50381009:58
shardytmorin: yeah that's a good idea - it was tagged with ci, but we could do better for sure10:00
shardytmorin: I think what we're missing is a matrix of which jobs run where, as I don't think it would necessarily be clear to everyone that scenario004 runs in the gate for that repo10:01
shardywithout digging in project-config etc10:01
*** aditya_r has quit IRC10:03
*** aditya_r has joined #tripleo10:05
bandiniright, I had no idea either (but am not too versed in CI)10:06
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Add compute-feature-enabled.attach_encrypted_volume to True  https://review.openstack.org/49992810:09
tmorinshardy: yep, agreed, the info is in zuul/layout.xml but needs to be crossed with other tools to achieve that...10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691410:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727410:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727910:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754510:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795910:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]10:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]10:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]10:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)10:10
shardytmorin: yeah, or perhaps per-scenario tags in launchpad or something10:10
*** abregman|mtg is now known as abregman10:18
*** aditya_r has quit IRC10:20
*** fandrieu has joined #tripleo10:20
jaosoriorpanda: any idea if something changed in OVB or in the jobs lately? I'm getting errors such as this: http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_06_59_03_21210:21
*** fandrieu_ has joined #tripleo10:22
*** mrunge has quit IRC10:23
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Set Ceph pgp_num after pg_num  https://review.openstack.org/50515310:24
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add unit tests for fluentd profile  https://review.openstack.org/50512410:24
*** fandrieu has quit IRC10:25
*** fandrieu_ is now known as fandrieu10:25
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Set Ceph pgp_num after pg_num  https://review.openstack.org/50515310:25
*** mrunge has joined #tripleo10:25
skramajashardy marios is there any open items regarding upgrade o->p.. i hit with a gnochi related issues earlier and turned out to disable telemetry altogether.. now step1 is complete. failing on computedpdk upgade (step2)..10:28
skramajashardy: marios this is error i am getting10:29
skramajaERROR! the playbook: overcloud-compute-0/tripleo-JbK7PV-config/upgrade_steps_playbook.yaml could not be found10:29
skramajalooks like the upgrade_steps_playbook.yaml file is not found in the config downloaded folder..10:30
*** udesale__ has quit IRC10:32
*** udesale has joined #tripleo10:32
*** jtomasek has quit IRC10:33
*** jtomasek has joined #tripleo10:34
bandiniskramaja: does your python-tripleoclient have https://review.openstack.org/#/c/485732/ ?10:36
bandiniI hit that issue as well and my tripleoclient package did not have that review (which then fixed things)10:36
skramajathanks bandini, i dont have this patch. gonna apply and try it.10:38
skramajabandini: any other related patches that you are aware of?10:38
bandiniskramaja: not off the top of my head, no10:38
*** hjensas has quit IRC10:39
skramajathanks bandini. will try with it.10:39
*** hjensas has joined #tripleo10:39
mariosskramaja: o/ sorry was on a call reading back10:40
mariosskramaja: so if there is no upgrade steps playbook then you may be missing some tht patch  (can you do openstack stack output show RoleConfig OK?)10:41
mariosskramaja: && that patch bandini points out for client10:41
*** jkilpatr has quit IRC10:42
skramajamarios: i am going to try with this patch and will update you for the command..10:42
*** tzumainn has joined #tripleo10:43
pandajaosorior: not in upstream, that I know of. The images changed to centos 7.410:43
*** chem has joined #tripleo10:43
*** oidgar has joined #tripleo10:47
*** timothyb89 has quit IRC10:48
openstackgerritJose Luis Franco proposed openstack/python-tripleoclient stable/pike: Increase timeout in get_deprecated_parameters workflow  https://review.openstack.org/50516610:50
*** thrash|g0ne is now known as thrash10:50
*** iranzo has joined #tripleo10:50
*** iranzo has quit IRC10:50
*** iranzo has joined #tripleo10:50
*** marios has quit IRC10:53
*** udesale has quit IRC10:54
*** udesale has joined #tripleo10:55
*** iranzo is now known as iranzo|AFK10:56
*** iranzo|AFK is now known as iranzo10:57
*** dtantsur|afk is now known as dtantsur10:58
*** salmankhan has quit IRC10:58
*** salmankhan has joined #tripleo10:58
*** morazi has quit IRC11:00
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates master: Update panko port in env ssl yaml files to correct one  https://review.openstack.org/50095711:08
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691411:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727411:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727911:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754511:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795911:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]11:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]11:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]11:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)11:10
*** abregman is now known as abregman|mtg11:12
*** cshastri has quit IRC11:13
*** jaganathan has quit IRC11:13
*** jkilpatr has joined #tripleo11:15
*** abishop has quit IRC11:18
*** aufi has quit IRC11:18
*** ffiore has quit IRC11:20
*** sri_ has quit IRC11:23
*** sri_ has joined #tripleo11:27
*** pdeore has quit IRC11:27
*** jjoyce|gone is now known as jjoyce11:27
*** sri_ has quit IRC11:30
*** aufi has joined #tripleo11:32
dtantsurmwhahaha: hi! could you please review these blueprints for queens too: https://blueprints.launchpad.net/tripleo/+spec/ansible-deploy and https://blueprints.launchpad.net/tripleo/+spec/ironic-direct-deploy11:36
*** abregman|mtg is now known as abregman11:36
*** kopec_piotr has joined #tripleo11:37
dtantsurI may have a few more coming; all are mostly integration work and have low impact on stability and other features11:37
kopec_piotrHi all, I have a simple question: in undercloud.conf paramete undercloud_admin_host should be set to IP/FQDN from the provisioning network and undercloud_public_host  should be set to IP/FQDN from the external network, correct?11:39
*** jpena is now known as jpena|lunch11:40
jaosoriorkopec_piotr: they use the same network. those parameters will result in the keystone endpoints (if SSL is used) that will be terminated by HAProxy.11:41
jaosoriorkopec_piotr: note that it'll only affect the undercloud.11:41
*** aufi has quit IRC11:44
kopec_piotrjaosorior: ok, I thought that overcloud nodes are using those endpoints to get configuration (from undercloud's swift, i guess)11:45
*** pgadiya has quit IRC11:45
*** dpawar has quit IRC11:46
*** morazi has joined #tripleo11:46
jaosoriorkopec_piotr: undercloud.conf is for the undercloud deployment.11:46
jaosoriorkopec_piotr: you modify or customize your overcloud configuration via heat parameters11:47
*** rbowen has joined #tripleo11:47
jaosoriorkopec_piotr: so, for instance, lets say that you want to use TLS in the public endpoints, and use IP addresses, you would modify a parameter called EndpointMap, with a file such as this one https://github.com/openstack/tripleo-heat-templates/blob/master/environments/tls-endpoints-public-ip.yaml11:48
jaosoriorkopec_piotr: if you would want to use hostnames instead of IPs for the public endpoints, and TLS, you would use a file such as this one https://github.com/openstack/tripleo-heat-templates/blob/master/environments/tls-endpoints-public-dns.yaml11:49
*** jaganathan has joined #tripleo11:49
*** nyechiel has joined #tripleo11:50
*** shreshtha has quit IRC11:54
*** shreshtha has joined #tripleo11:54
*** abishop has joined #tripleo11:56
*** marios has joined #tripleo11:57
*** adarazs is now known as adarazs_brb11:57
kopec_piotrjaosorior: ok, make sense, however I still don't get why I am getting this error https://pastebin.com/9JmdBcur on overcloud nodes during deployment11:57
*** dpawar has joined #tripleo11:57
*** aufi has joined #tripleo11:57
jaosoriorthat's funky11:58
jaosoriorkopec_piotr: are you sure that comes from an overcloud deployment?11:58
jaosorioroh wait11:58
jaosoriorreading again11:58
jaosoriorkopec_piotr: well, that could be several things11:58
jaosoriorkopec_piotr: I suppose you're deploying with network isolation, right?11:59
kopec_piotr jaosorior:  correct11:59
jaosoriorkopec_piotr: why are those undercloud endpoints resolving to an IP in the external network?11:59
jaosoriorkopec_piotr: I suggest you use an address in the ctlplane or provisioning network.12:00
jaosorioryou generally don't want to give accessibility to the undercloud from the external network, since it contains a lot of sensitive information.12:00
*** adarazs_brb is now known as adarazs12:01
jaosoriorbrb12:02
*** jaosorior has quit IRC12:02
*** nyechiel has quit IRC12:03
*** bfournie has joined #tripleo12:04
*** panda is now known as panda|lunch12:05
*** liverpooler has quit IRC12:06
*** liverpooler has joined #tripleo12:08
mnaserhttp://status.openstack.org/zuul/ -- could anyone here abandon/unabandon the changes above the stack to change puppet-nova #50497712:08
mnaserthey will fail and they're just gonna add another 4-6 hours before anything merges12:08
*** bfournie has quit IRC12:08
mnasermwhahaha when/if you're around ^ :>12:09
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691412:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727412:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727912:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754512:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795912:10
*** ooolpbot has quit IRC12:10
*** ffiore has joined #tripleo12:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]12:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]12:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]12:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)12:10
*** jschlueter is now known as jschlueter|afk12:11
*** raildo has joined #tripleo12:13
*** dprince has joined #tripleo12:16
*** MVenesio has joined #tripleo12:19
*** rlandy has joined #tripleo12:19
*** pchavva has joined #tripleo12:20
*** shreshtha has quit IRC12:22
*** trown|outtypewww is now known as trown12:23
*** skramaja has quit IRC12:25
*** atoth has joined #tripleo12:25
*** jaganathan has quit IRC12:26
*** pblaho has joined #tripleo12:26
*** aputtur has joined #tripleo12:30
mcorneashardy: hi! I have a question about deprecated_params in  https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L167-L172 - in case we have custom roles what should we set them to? let's say in case there's a custom compute role called ComputeAlt?12:31
*** sid2 has quit IRC12:35
*** sid1 has joined #tripleo12:37
*** jschlueter|afk is now known as jschlueter12:37
*** sshnaidm has joined #tripleo12:38
*** jaganathan has joined #tripleo12:38
*** amoralej is now known as amoralej|lunch12:39
*** bfournie has joined #tripleo12:41
*** ansmith has joined #tripleo12:41
*** jpena|lunch is now known as jpena12:42
*** suuuper has joined #tripleo12:43
*** sshnaidm has quit IRC12:47
*** leitan has joined #tripleo12:48
*** catintheroof has joined #tripleo12:49
*** pblaho has quit IRC12:52
jistrflaper87: hi, i just gave a try to the kube installation patch and i'm getting [error=Size of 'output' is 4907KB which exceeds the limit of 4096KB, action=tripleo.ansible-playbook, task=deploy_kubernetes] -- have you seen that before?12:53
jistrlooks like ansible stdout is too long so mistral refuses to save it12:53
*** tmorin has quit IRC12:53
*** pblaho has joined #tripleo12:55
*** jmelvin has joined #tripleo12:55
jistri guess ceph-ansible could potentially that too  /cc gfidente fultonj12:55
*** cdearborn has joined #tripleo12:56
*** jcoufal has joined #tripleo12:56
gfidentejistr whohooo12:57
gfidentewe're using verbosity: 012:57
gfidentefwiw12:57
*** Goneri has joined #tripleo12:57
gfidentebut I remember mistral was a string12:57
gfidentemistral db type I mean12:57
jistrack thanks, i'll try setting that locally too12:57
fultonjjistr: yes, if you crank up verbosity you run that risk12:58
*** ratailor has quit IRC12:58
fultonjwe need a better fix, verbosity=0 is a workaround12:58
gfidente:D12:58
gfidentenow we're talking12:58
d0ugalShould I put up a patch to increase the db col?12:58
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add feature sets for containerized overcloud and network isolation  https://review.openstack.org/50381212:58
fultonjd0ugal: that would be great12:58
d0ugaljistr: do you have a traceback from the mistral logs?12:59
jistrd0ugal: http://paste.openstack.org/show/621419/13:00
d0ugalthanks.13:01
jistrthank you :)13:01
openstackgerritRonelle Landy proposed openstack/tripleo-common master: DO NOT MERGE - Add no-op change for containers update testing  https://review.openstack.org/49889813:03
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add redux-form-validators dependency  https://review.openstack.org/50490213:03
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Refactor Register nodes dialog to use redux-form  https://review.openstack.org/50490313:03
*** jaganathan has quit IRC13:04
fultonjhas anyone recently installed quickstart? when I do I have a package conflict: http://paste.openstack.org/show/62142113:04
larsksfultonj: https://bugs.launchpad.net/tripleo/+bug/171755013:05
openstackLaunchpad bug 1717550 in tripleo "Repositories have unresolved dependencies in centos 7.4" [Critical,In progress] - Assigned to Lars Kellogg-Stedman (larsks)13:05
fultonjthanks larsks13:05
openstackgerritChenghui Yu proposed openstack/puppet-tripleo master: Update openstackdocstheme to latest version  https://review.openstack.org/50522413:05
jistrre ansible logs, we might also move the ansible logs elsewhere (ARA?) if/when we move towards the `config download` method rather than executing via Heat, but nevertheless 4KB seems quite limiting stdout capture that should be generally usable13:06
gfidentejistr I think that's what slagle is proposing as well13:07
jistr*... quite limiting for stdout capture ...13:07
*** abregman has quit IRC13:08
jistryea i read that. I like the idea. It's kind of a prerequisite to be able to do the SW part of split stack outside heat. IIUC we cannot really go for `config download` + external execution, unless we move 100% of the SW config to support this.13:09
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691413:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727413:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727913:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754513:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795913:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged]13:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]13:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]13:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)13:10
*** amoralej|lunch is now known as amoralej13:11
*** kopec_piotr has left #tripleo13:11
shardyfultonj: note that if you apply locally you have to use --no-clone and rm -fr ~/.quickstart13:11
*** kopec_piotr has joined #tripleo13:12
*** kopec_piotr has left #tripleo13:12
fultonjshardy: ok, i'll try that13:12
hamzyI am now seeing "ERROR heat.engine.resource ResourceInError: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500"13:12
hamzyhow do I debug this heat failure further? http://paste.openstack.org/show/621424/13:12
slaglejistr: yea that's what i'm working on atm fwiw13:13
*** bfournie has quit IRC13:13
hamzymwhahaha, ?13:13
jistrgfidente: i was wondering if we want to pull the extraconfig playbooks (ceph-ansible, kubespray) into a "common main ansible run", or maybe execute ansible-playbook from ansible-playbook. So far i'm leaning towards the latter. It seems a bit weird to nest it like this, but imo it's better than munging too many unrelated playbooks together (e.g. it might be better to separate inventories, extra_vars etc.13:13
jistrbetween those playbooks)13:13
slaglejistr: i'd rather not build upon the model of Heat->Mistral if we can avoid it. is there anything in the kubernetes install steps that require it to be interleaved in the templates?13:13
fultonjhamzy: i do this http://blog.johnlikesopenstack.com/2016/01/check-nova-scheduler-if-triple-o-tells.html?q=no+valid+host+found13:13
shardyhamzy: https://docs.openstack.org/ironic/latest/admin/troubleshooting.html#nova-returns-no-valid-host-was-found-error may help?13:14
shardyhamzy: normally it means either the ironic nodes are in the wrong state (not available, in maintenance mode), or you have a mismatch with your flavors and/or node/profile tagging13:14
hamzythere are no ironic errors13:14
gfidentejistr slagle man I am looking forward13:15
hamzyironic deployed both baremetal nodes13:15
gfidentefor those days when we deploy the openstack services via apb13:15
gfidenteand pull in from heat only composable tasks describing which plyabook to run13:15
jistrslagle: flaper87 might know better but i think at the very least we need docker stood up, and we do it via puppet/services/docker.yaml (see the service list https://review.openstack.org/#/c/471759/66/ci/environments/scenario006-multinode.yaml )13:15
gfidenteso then ceph-ansible will be just leading the group :D13:15
fultonjshardy: i figure i would also need to use a modified version of oooq w/ larsks's patch13:15
fultonjuntil it lands13:15
shardyhamzy: well no valid host means ironic couldn't find a valid host - if that error came from an overcloud deploy, it means there was a lack of valid hosts13:15
shardyhamzy: were you trying to scale out an existing deployment?13:15
*** gbarros has joined #tripleo13:16
shardyhamzy: failing that I'd check those docs and the nova-scheduler logs13:16
hamzyshardy, https://fedoraproject.org/wiki/User:Hamzy/TripleO_mixed_undercloud_overcloud_try713:17
slaglejistr: ack. i'm hoping flaper87 will reply to my mail with how the future apb stuff would fit into that model :)13:17
*** udesale has quit IRC13:17
*** mjturek has joined #tripleo13:17
jistrslagle: btw WDYT about the way we should be executing the "inner playbooks"? pulling them into one big ansible-playbook run, or executing multiple separate (nested?) ansible-playbook runs?  (re what i wrote at xx:13 above)13:18
*** chlong has joined #tripleo13:19
gfidenteslagle jistr I think has to be a subcall to ansible-playbook13:19
gfidentebecause ceph-ansible and kubernetes13:19
*** toure_biab is now known as toure|ptg13:19
gfidenteneed a differently formatted inventory file13:19
*** toure|ptg is now known as toure13:19
jistrright, that's what i was thinking13:19
gfidenteso I was thinking about adding per-service IPs into validations inventory build13:19
gfidenteto see if we can share one13:20
shardyhamzy: I don't think the heat-engine error corresponds to the overcloud deploy error, that says overcloud.ComputeAllNodesValidationDeployment.0 failed, which means there's probably something up with the networking so it can't ping the gateway listed in the output13:20
slaglejistr: yea, i think separate ansible-playbook is fine. it's what we talked about at ptg for the ceph-ansible case13:20
fultonj+1 on supporting diff inventories13:20
shardyPing to 172.16.0.18 failed. Retrying...13:20
shardythat's why it failed13:20
hamzyshardy, could it also be because the heat didn't create a VM that uses the address of 172.16.0.18?13:21
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default  https://review.openstack.org/47241213:21
jistrok cool re separate inventories (and extra_vars, etc.)13:21
*** mjturek has quit IRC13:21
*** bfournie has joined #tripleo13:22
slagleis there an ansible module for ansible-playbook? :)13:22
slagleif not, it could be a separate execution13:22
jistri looked, but didn't find one13:22
slagleor just done via "command" module13:22
jistrat least not among the builtins13:22
*** abregman has joined #tripleo13:23
shardyhamzy: I suspect it's the port for the tenant network on the controller?13:24
shardyhamzy: each node tried to ping the relevant IP on the controller to ensure the isolated networks aren't broken13:25
*** aditya_r has joined #tripleo13:25
jistrslagle: yea imo command would be fine to start with, and we could expand on it (e.g. write a playbook module if there indeed is none -- i haven't searched for 3rd party one yet13:25
jistr)13:25
shardyhamzy: I think that's in the default range gor the Tenant network13:25
shardysee environments/network-environment.yaml13:25
*** panda|lunch is now known as panda13:25
hamzyshardy, "openstack subnet list" does show "| 02e2adf9-cfe9-4452-bbaf-5ee09226d3dd | tenant_subnet       | 6a0be84a-26af-4383-a65a-fe14d97d941a | 172.16.0.0/24  |"13:26
shardyhamzy: Ok, so I'd start digging there, log onto the compute node and check the tenant network is up, I guess it's not because the ping fails13:26
owalshshardy, paramite, lyarwood: https://paste.fedoraproject.org/paste/8~ys6skHK~h8YS1n~VFkXQ line 334 looks suspect, OOM possibly?13:27
*** gbarros has quit IRC13:27
*** owalsh is now known as owalsh_biab13:27
shardyowalsh_biab: Hmm yeah that's definitely a good thing to check, thanks!13:28
*** toure is now known as toure_biab13:28
*** tiswanso has quit IRC13:33
*** abregman has quit IRC13:36
gfidenteslagle should do it the hard way13:37
gfidenteand start writing the module first!13:37
*** mjturek has joined #tripleo13:37
gfidenteI'll send chocolate13:37
*** abregman has joined #tripleo13:37
*** dtantsur is now known as dtantsur|lunch13:38
*** dpawar has quit IRC13:39
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui master: Exclude outdated validation results from list  https://review.openstack.org/50121413:41
*** jobewan has joined #tripleo13:44
hamzyshardy, there seems to be a vlan for that network http://paste.openstack.org/show/621427/ do you know how to show more information on it?13:45
slaglegfidente: come on man, you know chocolate is not the way to bribe me13:50
openstackgerritChenghui Yu proposed openstack/puppet-pacemaker master: Update openstackdocstheme to latest version  https://review.openstack.org/50526713:52
*** dmarlin has quit IRC13:52
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add centos base yum repo to upgrade role  https://review.openstack.org/50526813:52
gfidenteslagle I think if we let this go unseen it's better now13:54
mwhahahameeting in 6 mins, please update the agenda if you have something https://etherpad.openstack.org/p/tripleo-meeting-items13:54
*** masco has quit IRC13:54
atothmwhahaha, is meeting here or on the openstack meeting channel now?13:57
mwhahahahere13:57
atoththanks13:57
*** lblanchard has joined #tripleo13:58
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add centos base yum repo to upgrade role  https://review.openstack.org/50526813:58
*** dsariel has quit IRC14:00
mwhahaha#startmeeting tripleo14:00
mwhahaha#topic agenda14:00
mwhahaha* review past action items14:00
mwhahaha* one off agenda items14:00
mwhahaha* bugs14:00
mwhahaha* Projects releases or stable backports14:00
mwhahaha* CI14:00
mwhahaha* Specs14:00
openstackMeeting started Tue Sep 19 14:00:29 2017 UTC and is due to finish in 60 minutes.  The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
mwhahaha* open discussion14:00
mwhahahaAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:00
mwhahahaHi everyone! who is around today?14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: tripleo)"14:00
openstackThe meeting name has been set to 'tripleo'14:00
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:00
beagleso/14:00
shardyo/14:00
fultonjo/14:00
jpicho/14:00
slaglehi14:00
atotho/14:00
marioso/14:00
oidgaro/14:01
jfrancoao/14:01
*** shreshtha has joined #tripleo14:01
rascao/14:01
trowno/14:01
cdearborno/14:01
gfidenteo/14:01
*** owalsh_biab is now known as owalsh14:02
mwhahaha#topic review past action items14:02
openstackgerritJanki Chhatbar proposed openstack/tripleo-common master: Add healthcheck for ODL container  https://review.openstack.org/50486414:02
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:02
mwhahahadrop alert on Bug 1713832 and ping storage/zaqar people to investigate14:02
openstackbug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] https://launchpad.net/bugs/1713832 - Assigned to Marios Andreou (marios-b)14:02
mwhahahaso we dropped the alert but I think it's still open14:02
mwhahahathe last update points to https://bugs.launchpad.net/swift/+bug/171517714:02
openstackLaunchpad bug 1715177 in OpenStack Object Storage (swift) "Container cache management is racy" [Medium,Confirmed]14:02
mariosmwhahaha: yeah i had a look and therve had a lead at some point but we still didn't find the root14:02
*** Guest36641 is now known as melwitt14:03
mariosmwhahaha: i can revisit though i didn't look there all of last week14:03
matbuo/14:03
mwhahahamarios: it looks like it's a swift problem so we should poke the storage folks14:03
mariosmwhahaha: is it still relatively infrequent? (1/day?) /me fetches elastic recheck query14:03
mwhahahayea i don't think it's happening as much as it used to14:03
chemo/14:03
marioshttp://status.openstack.org/elastic-recheck/#1713832 this one14:03
*** thrash has quit IRC14:04
mwhahahalooks like it's still a problem so we just need to track it in swift14:04
*** mrch has quit IRC14:04
mwhahahamoving on to the next item14:04
mwhahahashardy to look into version impacts in ci jobs related to Bug 171436114:04
openstackbug 1714361 in tripleo "Mistral on gates is old and does not have the required patches" [Critical,Fix released] https://launchpad.net/bugs/1714361 - Assigned to Alex Schultz (alex-schultz)14:04
mwhahahashardy: i think we fixed that with the priority on repos14:05
shardymwhahaha: Yeah I think we did that14:05
mwhahahamwhahaha to retarget rc2 bugs if not release critical - i believe this was done but I will double check today14:05
mwhahahashardy to look at how to reduce # of services deployed on ovb14:05
thervemwhahaha, I found the issue, but it's stuck lacking tests14:05
mwhahahatherve: ok let me know if there's anything we can do to help14:06
shardymwhahaha: I made a start on that but need to revisit14:06
mwhahahashardy: ok14:06
mwhahaha#action shardy to look at how to reduce # of services deployed on ovb (continued)14:06
thervemwhahaha, https://review.openstack.org/50097814:06
shardy#link https://review.openstack.org/#/c/500942/ WIP ovb testing14:06
mwhahahathat's it on the past action items14:07
thervemwhahaha, Maybe they can relax the constraints so that we merge the fix14:07
mwhahahatherve: since that's the upstream swift stuff they'd have to sign off on that unfortunately.14:07
*** thrash has joined #tripleo14:08
*** thrash has joined #tripleo14:08
therveYeah14:08
shardycschwede: ^^14:08
thervemwhahaha, We could disable the cache middleware in swift, but it might makes things slow(er)14:08
mwhahahatherve: since this is on the undercloud, how much perf impact?14:08
thervemwhahaha, Hard to know really...14:09
therveWe use quite a bit between the templates and zaqar14:09
jtomaseko/14:09
cschwedeshardy: will have another look later today, thx!14:09
adarazso/14:09
mwhahahaok moving on14:10
mwhahaha#topic one off agenda items14:10
mwhahaha#link https://etherpad.openstack.org/p/tripleo-meeting-items14:10
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)"14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691414:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727414:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727914:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754514:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795914:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)14:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]14:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]14:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec)14:10
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Parse pcs auth output with all pcs versions  https://review.openstack.org/50528414:10
*** monashington has joined #tripleo14:10
tdasilvamwhahaha, shardy: regarding the swift issue, couldn't the client be modified to make sure to create the container first?14:10
*** monashington has left #tripleo14:10
mariosmwhahaha: for https://bugs.launchpad.net/tripleo/+bug/1717274 weshay posted https://review.openstack.org/#/c/505268/14:10
thervetdasilva, It does create the container first :)14:10
mwhahahamarios: ok i'll take a look after the meeting14:11
mariosmwhahaha: seems to just be missing base repo for the ethtool package which is a dependency (yum update fails)14:11
thervetdasilva, I didn't get a nice workaround for it, but I'm opened to suggestions14:11
mariosmwhahaha: thanks (kudos jpena who called that last week already see comment #2 )14:11
tdasilvatherve: can you share the client side code?14:12
thervetdasilva, https://github.com/openstack/zaqar/blob/master/zaqar/storage/swift/utils.py#L4514:12
mwhahahamoving on14:14
mwhahaha#topic bugs14:14
mwhahaha#link https://launchpad.net/tripleo/+milestone/queens-114:14
*** openstack changes topic to "bugs (Meeting topic: tripleo)"14:14
mwhahahawe're into queens so please take a look at the bugs since we're going for stability this cycle14:14
*** ratailor has joined #tripleo14:14
mwhahahaany specific bugs people wish to talk about (besides that upgrade bug)14:15
*** jprovazn has quit IRC14:16
mwhahahai'll take that as a no14:16
mwhahaha#topic projects releases or stable backports14:17
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)"14:17
mwhahahaAnyoen have any backports they need reviews on?14:17
trownis infra still hosed wrt releases?14:18
mwhahahai believe so14:18
mwhahahai saw mention of that this morning14:18
tdasilvatherve: ack, taking a look14:18
mwhahahaspeaking of things that are hosed14:19
mwhahaha#topic CI14:19
*** openstack changes topic to "CI (Meeting topic: tripleo)"14:19
trownlol14:19
mwhahahathe puppet-nova fix for the nova_manage command is in the gate14:19
mwhahahaso that should merge soon (~30 mins)14:20
mwhahahaso that should clear up some of the failures14:20
mwhahahaany other outstanding issues that folks can talk about?14:20
*** tongl has joined #tripleo14:20
trownonly other issue is in the periodic pipeline we are setting up on rdo infra14:20
mwhahahai saw there some bugs around images in the pipeline14:21
mwhahahahas that been addressed?14:21
trownneeds a new infra image, but that is blocked by some new project that was created without a repo14:21
trownhttps://git.openstack.org/cgit/openstack/networking-lagopus14:21
mwhahahanice14:21
trownwhen that resolves we can rebuild the image in rdoproject and hopefully get the pipeline working14:22
mwhahahaany other CI items?14:23
mwhahahasounds like no14:24
mwhahaha#topic specs14:24
mwhahaha#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:24
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:24
mwhahahaplease take some time to review any open specs14:24
mwhahahaalso retarget specs that might still be pointed to pike14:24
mwhahahaadditionally if there were any larger items from the PTG that probably should have a spec, now would be the time to propose it14:25
mwhahahaanyone have a specific spec they would like to point out?14:25
*** jwb has joined #tripleo14:26
*** tongl has quit IRC14:27
mwhahahamoving on14:28
mwhahaha#topic open discussion14:28
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:28
mwhahahaanything else?14:28
mwhahahaif not i'll close in 2 mins14:28
mnaserthoughts on moving logic of containerized deployments up to the puppet modules for the services specifically?14:29
mwhahahaprobably not14:29
mwhahahaat the moment we only really using the providers for the config generation14:29
mnaserso the actual docker container is created/deployed without puppet?14:30
mwhahahayea we're using kolla for the container build process but puppet for the config of the containers14:30
mwhahahaand then we have a tool for running the containers themselves14:31
mnasermmkay.  i was hoping we can work together so to have service_name => docker type of thing14:31
*** psahoo has quit IRC14:31
mnaseri wanna see what a poc looks like first but it was just an idea :>14:31
mwhahahathat might simplify what we have14:31
mwhahahabut we don't actually use the serivce items anymore14:32
mwhahahahttps://github.com/openstack/tripleo-heat-templates/blob/b5c18ded6a6122053fb3a6557c063a44a90e41b9/docker/docker-puppet.py14:33
shardymnaser: https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps-tasks.yaml shows the overview of our deploy steps now14:33
shardywe use ansible to drive a tool called paunch, which consumes some json files and starts docker containers14:33
shardyso it's kind of moving in the direction of only using puppet for config generation at this point14:34
shardy(it is also used for some bootstrapping)14:34
shardymnaser: always good to discuss any ideas tho :)14:35
mnaseri think containers are here to stay (kolla or whatever) but there is many ways of orchestrating them, given you have a ton of existing puppet infra, it might be easier than you having to maintain one more tool14:35
*** ykarel has quit IRC14:35
mnaseri'm sure it'll present a few challenges but i plan to take sometime to do a poc of a simpler puppet service and then show it and see what it looks like (and gather feedback)14:36
*** janki has quit IRC14:36
*** shreshtha has quit IRC14:36
mnaserideally i'd love to see it adopted by tripleo so catering to that use case and avoiding duplicating effort would be nice :>14:36
shardymnaser: yeah, understood - in this case paunch was derived from some code we already had in the heat docker-cmd hook14:37
shardymnaser: seeing the poc would be good, but it does kinda sound like a different direction than where we're headed at this point14:37
mnasergotcha, i'll take feedback anyways "this is where we shot ourself in the foot when we were taking this approach" is helpful :)14:37
mwhahahagood questions14:39
mwhahahaanything else?14:39
*** jrist has quit IRC14:41
mwhahahaok thanks everyone14:41
mwhahaha#endmeeting14:41
*** openstack changes topic to "Post jobs are not executed currently, do not tag any releases"14:41
openstackMeeting ended Tue Sep 19 14:41:17 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:41
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-09-19-14.00.html14:41
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-09-19-14.00.txt14:41
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-09-19-14.00.log.html14:41
*** raildo has quit IRC14:44
*** jaosorior has joined #tripleo14:48
*** sid2 has joined #tripleo14:49
jaosoriormwhahaha: hey, you around?14:50
*** jprovazn has joined #tripleo14:50
mwhahahajaosorior: do i have to be? :D14:50
*** sid1 has quit IRC14:51
jaosoriormwhahaha: lol14:51
jaosoriormwhahaha: hey, I tried doing some unit tests https://review.openstack.org/#/c/505124/ and it's failing saying that the fluentd class is missing14:51
jaosoriormwhahaha: any idea why? is there a dependency missing or something of the sort?14:51
mwhahahajaosorior: because it's not it Puppetfile_extras14:51
jaosoriorI onticed that the fluentd repo is missing from Puppetfile_extras, would that be an issue?14:51
mwhahahajaosorior: also it won't work14:52
mwhahahajaosorior: i talked with larsks last night14:52
mwhahahathere are problems14:52
jaosorior:(14:52
jaosoriorwhy won't it work?14:52
mwhahahajaosorior: we need https://review.openstack.org/#/c/505002/14:52
*** achadha has joined #tripleo14:52
*** achadha has quit IRC14:52
mwhahahajaosorior: the fluentd module uses the $fact[...] array and the version of rspec-puppet we use doesn't properly populate it14:52
jaosoriorouh14:53
mnasertripleo gate fix is in - https://review.openstack.org/#/c/504977/14:53
mwhahahajaosorior: so it's complicated14:53
*** achadha has joined #tripleo14:53
jaosoriormwhahaha: ok, thanks for the explanation14:53
jaosoriormwhahaha: also, what do you think of https://review.openstack.org/#/c/505192/ ?14:53
jaosoriormwhahaha: an operator at the PTG was mentioning that our defaults are wrong; so I decided to give it a go at changing them.14:54
mwhahahajaosorior: sounds good14:54
jaosoriorgreat14:55
jaosoriorfinally14:55
jaosoriormwhahaha, beekneemech: The TLS everywhere gate is broken :(14:55
mnaserhttps://review.openstack.org/#/c/505294/ and https://review.openstack.org/#/c/505295/ will help fix the stable periodic jobs14:55
mwhahahajaosorior: well un break it :D14:56
jaosoriormwhahaha, beekneemech: I submitted this https://review.openstack.org/#/c/504850/ to address one of the issues14:56
jaosoriormwhahaha, beekneemech: BUT, now I'm running into some nova issue where it breaks trying to allocate the config-drive14:56
*** beekneemech is now known as bnemec14:56
* bnemec notes that it's not Friday anymore14:56
mwhahahajaosorior: might that be related to the puppet-nova thing?14:56
mwhahahamnaser: http://logs.openstack.org/92/505192/1/check/gate-puppet-openstacklib-puppet-beaker-rspec-centos-7/01076c2/console.html#_2017-09-19_12_07_01_496405 we're using the kilo repo for puppet-openstacklib for some reason14:57
jaosoriormwhahaha, bnemec: Which is this http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/0905689/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_11_59_32_85414:57
jaosoriormwhahaha: I actually have a depends-on with the nova patch.14:57
mnasermwhahaha beaker :(14:57
*** anshul has quit IRC14:57
mnasergonna bet that the acceptance has the wrong release14:57
mnaserlets ee14:57
mwhahahamnaser: yea its in rabbitmq_spec14:57
jaosoriormwhahaha, bnemec: Any idea what would cause an exception like that? I'm quite stuck :(14:58
mnasermwhahaha ill push up a fix14:58
mwhahahajaosorior: you check the ironic logs?14:58
jaosoriormwhahaha: yeah, it complains something about the vif14:58
jaosoriormwhahaha: http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/0905689/logs/undercloud/var/log/ironic/app.txt.gz#_2017-09-19_11_59_34_78614:59
* mwhahaha points at dtantsur|lunch 14:59
bnemecjaosorior: AttributeError: 'Env' object has no attribute 'domain'15:00
jaosoriorbnemec: huh?15:00
jaosoriorwhaaa15:00
jaosoriorwhere?15:00
bnemecFrom http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/0905689/logs/undercloud/var/log/novajoin/novajoin-server.txt.gz15:00
*** ecerquei has joined #tripleo15:00
jaosoriordafuq15:00
jaosoriorthat shouldn't be an issue15:00
*** dmarlin has joined #tripleo15:00
jaosorioraaah15:01
jaosoriorregression maybe15:01
jaosoriorlet me investigate15:01
bnemecFrom right above where you linked: Error from dynamic vendordata service join at http://192.168.24.1:9090/v1/: Internal Server Error (HTTP 500): InternalServerError: Internal Server Error (HTTP 500)15:01
jaosoriorbnemec: thanks dude!15:01
bnemecnp15:01
*** ccamacho has quit IRC15:03
*** trown is now known as trown|brb15:03
mnaserjaosorior / mwhahaha - https://review.openstack.org/#/c/505299/15:03
mnaseryou can rebase to that and it should fix it15:04
*** rbowen has quit IRC15:07
*** trown|brb is now known as trown15:08
jaosoriorbnemec: also https://review.openstack.org/#/c/505192/ :D that was what we were talking about that in the hallway last week. I forgot the name of the dude that you were talking to though.15:08
mnasermwhahaha also, there seems to be no gate-tripleo-ci scenario jobs for puppet-nova .. we would have caught that issue had there been one, is there a reason why there isn't one?15:09
*** rbowen has joined #tripleo15:09
*** aditya_r has quit IRC15:09
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691415:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727415:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727915:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754515:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795915:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)15:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]15:10
*** aditya_r has joined #tripleo15:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]15:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]15:10
mwhahahamnaser: i'm not aware of any reason why not other than perhaps ci capacity reasons15:10
mnaserwe should probably add a job just to avoid this sort of breakage in the future again, could someone add at least 1 job (i mean, we're running scenarios for gnocchi but not nova, if anything id prefer nova getting gating in terms of priority :p)15:11
mwhahahayea let me take a look15:11
mwhahahai thought we were15:11
bnemecjaosorior: Sean probably?  I actually don't remember for sure myself. :-)15:11
bnemecETOOMANYNAMES15:11
jaosoriorlol15:11
jaosoriorwe'll call him Sean then15:12
jaosorioror billy bob, you decide15:12
bnemecAlthough in this case it's more that I don't remember who else was actually there, not that I don't remember their name.15:12
mwhahahapfft names15:13
mwhahaha"that guy"15:13
bnemecThere's a reason I rarely use people's names in conversation.15:13
mwhahahaditto15:13
jaosoriorusing the word "dude" tends to work for me :D you don't have to remember anything15:13
bnemecThat way if I forget, nobody knows.15:13
bnemecGets a little awkward if you have to introduce people though...15:13
mwhahahamnaser: so we had the ovb job on puppet-nova. it seems like that should have covered it or was it only in scenario multinode jobs15:14
mnasermwhahaha only scenario ones were failing at the time but i recall soemone saying something along the lines of that job not running tempest so not catching it.. i dont know tripleo ci as well15:15
mwhahahamnaser: oh so it was only showing up in tempest15:15
mnaserhttps://review.openstack.org/#/c/501669/ the failing test passed here so i dont know15:16
*** toure_biab is now known as toure15:17
mwhahahamnaser: yea ovb doesn't run tempest15:17
*** ebarrera has quit IRC15:17
mwhahahabnemec: any reason why we shouldn't switch ovb to use tempest?15:18
mwhahahabnemec: seems like it actually tests things better or is it a timing/resource thing15:18
bnemecmwhahaha: Time has always been the reason.  I don't know how what we're doing with tempest now compares to the pingtest though.15:19
*** ccamacho has joined #tripleo15:21
bnemecOn the other hand the ovb jobs are already timing out, so how much worse could it be?15:21
* bnemec also enjoys poking bears in his free time ;-)15:21
jaosoriorlol15:21
saidsneddon: hey, i have the storagenetworkvlanid and storageipsubnet defined in the template for a compute node but stack create fails on this 2017-09-19 15:05:41Z [0]: CREATE_FAILED  Resource CREATE failed: resources.StoragePort: Resource CREATE failed: Unable to find network wi│····················································15:22
saith name or id 'storage'15:22
saiany pointers?15:22
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Change default network isolation type to multi-nic  https://review.openstack.org/47670415:23
*** raildo has joined #tripleo15:24
*** mdnadeem has quit IRC15:24
mwhahahasai: what version15:24
saimwhahaha: osp1115:24
mwhahahasai: do you not have the OS:Tripleo::Network::Storage defined anywhere? https://github.com/openstack/tripleo-heat-templates/blob/stable/ocata/environments/network-isolation.yaml#L815:25
* mwhahaha guesses with the best of them15:25
*** monashington has joined #tripleo15:27
bandinimwhahaha: if you have a min https://review.openstack.org/#/c/505284/ (note that tripleo does not use that puppet-pacemaker code, but it needs merging to fix CI). Thanks ;)15:27
saimwhahaha: thanks a lot looks like the network-isolation file wasnt being passed to the deploy command, that could have caused this right?15:28
bnemecsai: Yes15:28
saibnemec: thanks!15:28
* sai helping a firend out..15:29
saiso i guess the first question i should have asked for is the deploy command15:29
* sai keeps that in mind15:29
*** MVenesio has quit IRC15:30
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui master: Exclude outdated validation results from list  https://review.openstack.org/50121415:31
*** aufi has quit IRC15:32
*** jaosorior has quit IRC15:32
*** ffiore has quit IRC15:33
*** gbarros has joined #tripleo15:35
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Change default network isolation type to multi-nic  https://review.openstack.org/47670415:35
*** iranzo is now known as iranzo|AFK15:35
*** raildo has quit IRC15:39
openstackgerritMerged openstack/puppet-pacemaker master: Parse pcs auth output with all pcs versions  https://review.openstack.org/50528415:41
*** gbarros has quit IRC15:42
*** jaganathan has joined #tripleo15:44
*** aditya_r is now known as aditya_r|dinner15:44
openstackgerritAlex Schultz proposed openstack/tripleo-puppet-elements stable/newton: Add remove-machine-id element  https://review.openstack.org/50530515:46
openstackgerritAlex Schultz proposed openstack/tripleo-common stable/newton: Remove machine-id from image  https://review.openstack.org/50531015:48
*** tongl has joined #tripleo15:53
*** DrBacchus has joined #tripleo15:53
*** fandrieu has quit IRC15:54
*** rbowen has quit IRC15:54
*** raildo has joined #tripleo15:55
*** agurenko has quit IRC15:56
*** gbarros has joined #tripleo15:59
*** florianf has quit IRC15:59
*** dtantsur|lunch is now known as dtantsur16:00
*** DrBacchus has quit IRC16:00
*** rbowen has joined #tripleo16:01
*** agurenko has joined #tripleo16:01
*** dprince has quit IRC16:02
*** oidgar has quit IRC16:03
*** yprokule has quit IRC16:03
*** egonzalez has quit IRC16:03
*** dprince has joined #tripleo16:04
dtantsurmwhahaha: anything I can help with?16:04
*** suuuper has quit IRC16:05
mwhahahadtantsur: I don't think so anymore. looks like we figured out the vif errors being seen are possibly unrelated. thanks though16:05
*** jmelvin has quit IRC16:06
*** rbowen has quit IRC16:06
*** rbowen has joined #tripleo16:07
dtantsurah, cool16:07
dtantsurmwhahaha: then please check the blueprint I posted earlier today :)16:08
mwhahahadtantsur: which one?16:08
dtantsurmwhahaha: https://blueprints.launchpad.net/tripleo/+spec/ansible-deploy and https://blueprints.launchpad.net/tripleo/+spec/ironic-direct-deploy (for queens)16:08
mwhahahadtantsur: ok i'll take a look. I remember the ironic ansible one but wasn't sure the status of it16:09
*** ratailor has quit IRC16:09
mwhahahadtantsur: so you're good on those two for this cycle?16:09
dtantsurmwhahaha: yeah, should be easy wins, both. most of the work is in ironic, and most of it is done already16:10
mwhahahadtantsur: ok16:10
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691416:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727416:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727916:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754516:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795916:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)16:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]16:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]16:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]16:10
*** hamzy has quit IRC16:11
*** oidgar has joined #tripleo16:11
*** itlinux has joined #tripleo16:11
*** monashington has quit IRC16:14
dsneddonsai: You probably aren't instantiating all the networks. See the file in TripleO Heat templates environments/network-isolation.yaml to see how networks are instantiated. Include that file with the deployment to include all networks, or edit the file to modify which ports are created for which roles. Then take a look at the environments/network-environment.yaml to see how those subnets are defined.16:15
*** dmacpher has joined #tripleo16:15
*** iranzo|AFK has quit IRC16:16
*** dmacpher has quit IRC16:17
*** milan has quit IRC16:18
*** mjturek has quit IRC16:19
*** agurenko has quit IRC16:19
*** stee_3_ has joined #tripleo16:21
*** bugzy_ has joined #tripleo16:21
*** bugzy has quit IRC16:24
*** stee_3 has quit IRC16:24
*** monashington has joined #tripleo16:27
*** rwsu has quit IRC16:28
*** nyechiel has joined #tripleo16:28
*** rwsu has joined #tripleo16:30
*** rwsu has joined #tripleo16:30
*** achadha has quit IRC16:31
*** jfrancoa has quit IRC16:31
*** thrash is now known as thrash|lunch16:32
Ngdprince: I think you should get a specially engraved one :D http://amzn.to/2xeFsKt16:32
dprinceNg: Yes!16:35
*** mjturek has joined #tripleo16:35
*** tongl has quit IRC16:35
*** dprince has quit IRC16:35
*** jmelvin has joined #tripleo16:36
*** jpich has quit IRC16:36
*** aditya_r|dinner has quit IRC16:37
*** aditya_r has joined #tripleo16:37
*** pcaruana has quit IRC16:38
*** abregman has quit IRC16:41
*** monashington has quit IRC16:42
saidsneddon: thanks! bnemec and mwhahaha helped me with it. The deploy command was wrong, wasnt passing entwork-isolation.yaml16:43
*** trown is now known as trown|lunch16:49
*** jpena is now known as jpena|away16:49
*** bogdando has quit IRC16:51
*** rcernin has quit IRC16:52
*** tesseract has quit IRC16:52
*** achadha has joined #tripleo16:54
*** yamahata has joined #tripleo16:55
jistrflaper87: fyi if you still keep hacking on kubernetes installation, you'll probably need this to make kubelet work: https://github.com/kubernetes-incubator/kubespray/pull/167716:55
jistrwith it the kubespray playbook finised for me16:56
*** dprince has joined #tripleo16:56
*** aditya_ra has joined #tripleo16:57
*** nmathew has joined #tripleo16:57
dprincemwhahaha: hi, why marking this as low? https://blueprints.launchpad.net/tripleo/+spec/containerized-undercloud16:57
mwhahahadprince: because that's a nice to have but honestly not a requirement for queens16:58
*** achadha has quit IRC16:58
mwhahahadprince: we talked about this at the ptg16:58
nmathew@shardy, one question16:58
*** achadha has joined #tripleo16:58
*** aditya_ra has quit IRC16:59
*** aditya_ra has joined #tripleo16:59
nmathew@shardy, will you be able to look at this jinja2 template http://paste.openstack.org/show/uIrvvqhoZd5d5MMmHWl9/16:59
mwhahahadprince: a containerized undercloud isn't a requirement, the fully containerized overcloud is. there are more peices to containerizing the undercloud (and replace existing undercloud install) that I don't think we'll fully get in queens.16:59
*** aditya_ra has joined #tripleo17:00
nmathew@shardy, code around {% if role.name == CsdnComputeConfig[roledata].name %}17:00
*** aditya_r has quit IRC17:00
*** aditya_ra has quit IRC17:01
*** liverpooler has quit IRC17:02
*** aditya_r has joined #tripleo17:02
dprincemwhahaha: "containerized undercloud isn't a requirement" doesn't exactly align w/ the goals of the containers squad fwiw17:05
dprincemwhahaha: full containerization in queens is the goal I think17:05
mwhahahadprince: at no point did i say no17:05
*** hamzy has joined #tripleo17:05
dprincemwhahaha: perhaps this needs more clarification17:05
mwhahahadprince: low means make progress and lets see if we can get it17:05
mwhahahadprince: my understanding is that the overcloud is the fully containerized target17:05
dprincemwhahaha: right, my understanding was the ask is full containerization17:06
*** eck` is now known as eck`gone17:06
mwhahahadprince: if your progress to fully containerized overcloud brings undercloud, excellent17:06
*** eck`gone has quit IRC17:06
*** dalvarez has quit IRC17:06
dprincemwhahaha: I would have left it a medium fwiw17:06
mwhahahadprince: that's not my understanding for this cycle. containerizing the undercloud needs more work and testing than I think we have17:07
mwhahahadprince: we can move it up to medium, it's just a option.17:07
dprincemwhahaha: containerizing the undercloud I think should have been done first17:07
dprincemwhahaha: much of the testing, in particular the scenarios could be accomplished on a single VM upstream17:08
dprincemwhahaha: I would argue we are already paying a cost for not having done this first17:08
* dprince thinks it really is a bigger deal than it seems17:08
mwhahahadprince: i don't disagree and would like to see more effort on that17:08
*** radez has quit IRC17:09
mwhahahadprince: infra would also like to see that :D so let's get some additional progress on testing that we can do on the undercloud jobs17:09
mwhahahadprince: does your undercloud-containers job run tempest?17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691417:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727417:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727917:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754517:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795917:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)17:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]17:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]17:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]17:10
*** jpena|away has quit IRC17:10
*** amoralej has quit IRC17:10
dprincemwhahaha: no, it doesn't yet. but like the puppet CI jobs it could if we wire in the right services17:10
mwhahahadprince: so that seems like a good way to check that the containerized undercloud is working right and gets us additional service coverage w/ a single node17:11
mwhahahadprince: do you think the containers squad could make some progress on that in the next 2-3 weeks?17:12
dprinceperhaps. The existing arch could be used for this even17:15
*** eck`gone has joined #tripleo17:15
mwhahahai'm not expecting a full array of tests17:15
mwhahahajust like one basic one to prove the concept17:15
mwhahahathen we can itterate the rest of the cycle17:15
mwhahahajust like a basic tempest test per service that we deploy17:16
*** fzdarsky is now known as fzdarsky|afk17:17
*** ccamacho has quit IRC17:18
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script  https://review.openstack.org/50102817:18
*** eck`gone is now known as eck`17:19
*** jlinkes has quit IRC17:19
*** ecerquei has quit IRC17:24
*** anshul has joined #tripleo17:24
* mwhahaha wanders off to lunch17:24
*** udesale has joined #tripleo17:27
*** milan has joined #tripleo17:28
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Check that network interface exsits before adjusting MTU  https://review.openstack.org/50441917:29
*** dalvarez has joined #tripleo17:30
*** udesale has quit IRC17:31
*** marios has quit IRC17:32
*** ecerquei has joined #tripleo17:32
*** sid2 has quit IRC17:32
*** tosky has quit IRC17:34
*** nyechiel has quit IRC17:41
*** nmathew has quit IRC17:41
*** liverpooler has joined #tripleo17:42
*** mjturek has quit IRC17:42
*** shardy has quit IRC17:44
*** mcornea has quit IRC17:44
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Add option for innodb_flush_log_at_trx_commit = 2 for Galera only  https://review.openstack.org/49679017:48
openstackgerritMerged openstack/python-tripleoclient stable/pike: Increase timeout in get_deprecated_parameters workflow  https://review.openstack.org/50516617:48
*** MVenesio has joined #tripleo17:49
*** tosky has joined #tripleo18:02
mwhahahai like how stable/ocata upgrade jobs are passing and i don't think we changed anything18:02
*** aditya_r has quit IRC18:06
*** akrivoka has quit IRC18:08
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691418:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727418:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727918:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754518:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795918:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)18:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]18:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]18:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]18:10
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add more debug information to the logs  https://review.openstack.org/50535318:13
*** salmankhan has quit IRC18:14
*** salmankhan has joined #tripleo18:15
*** liverpooler has quit IRC18:15
*** thrash|lunch is now known as thrash18:17
*** salmankhan has quit IRC18:20
*** itlinux has quit IRC18:22
*** trown|lunch is now known as trown18:22
*** iranzo has joined #tripleo18:23
*** rhallisey has quit IRC18:24
*** rhallisey has joined #tripleo18:24
*** cdearborn_ has joined #tripleo18:26
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Change to boolean for boolean type params  https://review.openstack.org/50513918:28
*** liverpooler has joined #tripleo18:31
*** liverpooler has quit IRC18:31
*** liverpooler has joined #tripleo18:32
openstackgerritSai Sindhur Malleni proposed openstack/tripleo-heat-templates master: Use conditional to set heat-engine workers  https://review.openstack.org/48123618:33
*** jaganathan has quit IRC18:33
*** iranzo has quit IRC18:35
weshaymwhahaha, we need this cherry picked to pike right? https://review.openstack.org/#/c/504977/18:36
mwhahahaweshay: there's an open one yea18:36
mwhahahaweshay: https://review.openstack.org/#/c/505295/118:36
mwhahahaweshay: along with the original patch https://review.openstack.org/#/c/50529418:36
weshaythanks18:36
*** rbowen has quit IRC18:40
*** dtantsur is now known as dtantsur|afk18:40
*** rbowen has joined #tripleo18:41
*** cdearborn has quit IRC18:43
*** mjturek has joined #tripleo18:44
openstackgerritMerged openstack/python-tripleoclient stable/pike: Add -n/--networks-data option  https://review.openstack.org/50400818:47
*** abregman has joined #tripleo18:52
*** cschwede has quit IRC18:55
*** itlinux has joined #tripleo18:59
weshaythings seem to moving back to green afaict.. http://zuul-status.tripleo.org/?queue=check19:01
*** paramite has quit IRC19:04
*** mjturek has quit IRC19:05
itlinuxhello guys does anyone have any suggestions on this error http://paste.openstack.org/show/621472/19:06
itlinuxthanks19:06
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691419:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727419:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727919:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754519:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795919:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)19:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]19:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]19:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]19:10
*** dsariel has joined #tripleo19:12
openstackgerritSai Sindhur Malleni proposed openstack/tripleo-heat-templates master: Bump fs.inotify.max_user_instances for scale  https://review.openstack.org/50538119:13
*** pchavva has quit IRC19:17
*** aputtur has quit IRC19:17
*** mjturek has joined #tripleo19:19
*** jrist has joined #tripleo19:26
*** jrist has joined #tripleo19:26
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: add more debug information to the logs  https://review.openstack.org/50535319:26
*** bugzy_ is now known as bugzy19:28
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: use tempest in fs001 vs ping test  https://review.openstack.org/50444419:31
openstackgerritJustin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Disruption detection and some stack update roles  https://review.openstack.org/49795019:34
*** jtomasek has quit IRC19:35
*** rbowen has quit IRC19:35
*** rhallisey has quit IRC19:38
*** rhallisey has joined #tripleo19:38
*** rbowen has joined #tripleo19:39
*** radez has joined #tripleo19:51
*** raildo has quit IRC19:57
*** rhallisey has quit IRC20:02
*** ecerquei has quit IRC20:03
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691420:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727420:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727920:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754520:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795920:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)20:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]20:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]20:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]20:10
*** mjturek has quit IRC20:12
mwhahahaweshay: do we know if https://bugs.launchpad.net/tripleo/+bug/1717959 is resolved since that repo is now created?20:13
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]20:13
weshaymwhahaha, last time I looked today it was not, the jobs kick every 4 hours will check now20:14
*** rcernin has joined #tripleo20:14
mwhahahadoesn't look like it20:15
weshaymwhahaha, still there https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-pike/113/console20:15
* weshay asks in rdo channel20:15
*** raildo has joined #tripleo20:17
*** jkilpatr has quit IRC20:18
*** gbarros has quit IRC20:20
*** dtrainor has quit IRC20:22
*** dtrainor has joined #tripleo20:23
weshaymwhahaha, we'll know next build, a new image has uploaded20:25
mwhahahak20:26
-openstackstatus- NOTICE: Zuul and Gerrit are being restarted to address issues discovered with the Gerrit 2.13 upgrade. review.openstack.org will be inaccessible for a few minutes while we make these changes. Currently running jobs will be restarted for you once Zuul and Gerrit are running again.20:28
*** mjturek has joined #tripleo20:29
*** jprovazn has quit IRC20:30
*** ansmith has quit IRC20:33
*** _milan_ has joined #tripleo20:37
*** milan has quit IRC20:38
*** Goneri has quit IRC20:42
*** jkilpatr has joined #tripleo20:42
*** jrist has quit IRC20:43
*** salmankhan has joined #tripleo20:45
*** leitan has quit IRC20:47
*** thrash is now known as thrash|g0ne20:48
*** leitan has joined #tripleo20:48
*** leitan has joined #tripleo20:48
*** leitan has quit IRC20:49
*** leitan has joined #tripleo20:49
*** catintheroof has quit IRC20:50
*** catintheroof has joined #tripleo20:50
*** oneswig has joined #tripleo20:50
*** catintheroof has quit IRC20:51
*** bfournie has quit IRC20:52
*** jcoufal has quit IRC20:53
*** leitan has quit IRC20:53
*** tongl has joined #tripleo20:55
*** itlinux has quit IRC20:56
*** itlinux has joined #tripleo20:56
*** itlinux has quit IRC20:58
*** itlinux has joined #tripleo20:59
dprincemwhahaha: hi, are you aware of a gerrit outage?21:06
dprincemwhahaha: http://tripleo.org/cistatus.html is empty21:07
mwhahahayou mean the message before yours indicating they are restarting gerrit?21:07
dprinceah, sorry. I got dissconnected21:07
mwhahaha<+openstackstatus> NOTICE: Zuul and Gerrit are being restarted to address issues discovered with the Gerrit 2.13 upgrade. review.openstack.org will be inaccessible for a few minutes while we make these changes. Currently running jobs will be restarted for you once Zuul and Gerrit are running again.21:07
mwhahaha:D21:07
dprincemwhahaha: thanks21:08
dprincemwhahaha: I figured that could be the only cause of it21:08
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691421:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727421:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727921:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754521:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795921:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)21:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]21:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]21:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]21:10
*** trown is now known as trown|outtypewww21:10
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/pike: Run gnocchi statsd and metrcd at step 5  https://review.openstack.org/50540321:10
*** stee_3_ has quit IRC21:11
*** stee_3 has joined #tripleo21:12
*** achadha has quit IRC21:14
*** mjturek has quit IRC21:14
*** achadha has joined #tripleo21:15
*** lblanchard has quit IRC21:16
*** abishop has quit IRC21:21
*** itlinux has quit IRC21:21
*** atoth has quit IRC21:22
*** achadha has quit IRC21:24
*** achadha has joined #tripleo21:25
*** itlinux has joined #tripleo21:25
*** anshul has quit IRC21:27
*** abregman has quit IRC21:28
*** noslzzp has quit IRC21:31
*** rhallisey has joined #tripleo21:33
*** ebarrera has joined #tripleo21:33
*** noslzzp has joined #tripleo21:35
*** mkovacik__ has joined #tripleo21:36
*** dougbtv__ has joined #tripleo21:36
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Move neutron api services to ControllerOpenstack  https://review.openstack.org/50541521:37
*** _milan_ has quit IRC21:39
*** raildo has quit IRC21:40
*** jistr has quit IRC21:41
*** noslzzp has quit IRC21:41
*** noslzzp has joined #tripleo21:44
openstackgerritIan Main proposed openstack/tripleo-docs master: Update containerized deployment docs.  https://review.openstack.org/50541621:44
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Move neutron api services to ControllerOpenstack  https://review.openstack.org/50541521:45
*** dsariel has quit IRC21:45
*** morazi has quit IRC21:47
*** salmankhan has quit IRC21:49
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Move neutron api services to ControllerOpenstack  https://review.openstack.org/50541521:50
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Check that network interface exsits before adjusting MTU  https://review.openstack.org/50441921:53
*** jistr has joined #tripleo22:01
*** cdearborn_ has quit IRC22:03
*** jcoufal has joined #tripleo22:05
*** jcoufal has quit IRC22:06
*** noslzzp has quit IRC22:07
*** noslzzp has joined #tripleo22:09
*** dprince has quit IRC22:09
*** rlandy is now known as rlandy|bbl22:09
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691422:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727422:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727922:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754522:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795922:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)22:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]22:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]22:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]22:10
*** MVenesio has quit IRC22:12
*** noslzzp has quit IRC22:13
*** noslzzp has joined #tripleo22:15
*** rhallisey has quit IRC22:15
*** oneswig has quit IRC22:16
*** chem has quit IRC22:18
*** noslzzp has quit IRC22:18
*** noslzzp has joined #tripleo22:21
*** chlong has quit IRC22:21
*** tongl has quit IRC22:23
*** jwb has quit IRC22:24
*** noslzzp has quit IRC22:25
*** achadha has quit IRC22:26
*** achadha has joined #tripleo22:26
*** achadha has quit IRC22:27
*** achadha has joined #tripleo22:28
*** noslzzp has joined #tripleo22:28
*** zshi has quit IRC22:31
*** achadha has quit IRC22:32
*** achadha has joined #tripleo22:32
*** noslzzp has quit IRC22:33
*** zshi has joined #tripleo22:34
-openstackstatus- NOTICE: Gerrit is being restarted to address some final issues, review.openstack.org will be inaccessible for a few minutes while we restart22:34
*** noslzzp has joined #tripleo22:35
*** achadha_ has joined #tripleo22:35
*** noslzzp has quit IRC22:35
*** _milan_ has joined #tripleo22:37
*** achadha has quit IRC22:37
*** achadha has joined #tripleo22:37
*** mkovacik__ has quit IRC22:39
*** dciabrin has quit IRC22:39
*** achadha_ has quit IRC22:39
*** dciabrin has joined #tripleo22:41
*** achadha has quit IRC22:42
*** catintheroof has joined #tripleo22:45
*** openstackgerrit has quit IRC22:47
*** itlinux has quit IRC22:49
*** dmarlin has quit IRC22:52
*** gfidente has quit IRC22:53
*** ansmith has joined #tripleo22:54
*** ebarrera has quit IRC22:59
*** achadha has joined #tripleo23:00
*** ebarrera has joined #tripleo23:05
*** achadha has quit IRC23:05
*** ebarrera has quit IRC23:05
*** brian83 has joined #tripleo23:07
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171691423:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727423:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171727923:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171754523:10
openstackLaunchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged]23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171795923:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin)23:10
openstackLaunchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged]23:10
openstackLaunchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged]23:10
openstackLaunchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged]23:10
*** rcernin has quit IRC23:11
*** tosky has quit IRC23:23
*** jmelvin has quit IRC23:25
*** jobewan has quit IRC23:36
*** mkovacik__ has joined #tripleo23:36
*** _milan_ has quit IRC23:39
*** ChanServ changes topic to "open discussion (Meeting topic: tripleo)"23:42
-openstackstatus- NOTICE: Gerrit is once again part of normal puppet config management. Problems with Gerrit gitweb links and Zuul post jobs have been addressed. We currently cannot create new gerrit projects (fixes in progress) and email sending is slow (being debugged).23:42
*** threestrands has joined #tripleo23:51
rookanyone around that can help diagnose a mistral error?23:58
rookwhile executing openstack baremetal configure boot, i get23:58
rookWaiting for messages on queue '6057b641-d969-438f-8609-b76bc6e78b14' with no timeout.23:59
rook[u'dictionary update sequence element #0 has length 1; 2 is required']23:59
rookThis is with 97 nodes23:59
rooknot that this should matter23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!