Tuesday, 2016-09-06

rdogerrithguemar created config: Enable newton-distgit-cbs-* jobs on projects moved to integrated  http://review.rdoproject.org/r/205900:02
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-mitaka-current @ http://tinyurl.com/zsd5jkc |#| Build failure on centos7-mitaka/current: glance: http://trunk.rdoproject.org/centos7-mitaka/report.html00:03
rdogerritMerged config: Move zaqar-distgit to integrated projects  http://review.rdoproject.org/r/205800:04
rdogerritMarcus Furlong created openstack/ceilometer-distgit: Remove hardcoded central and compute polling options  http://review.rdoproject.org/r/206000:12
*** TSCHAK has quit IRC00:13
*** saneax is now known as saneax-_-|AFK00:22
rdogerrithguemar proposed config: Enable newton-distgit-cbs-* jobs on projects moved to integrated  http://review.rdoproject.org/r/205900:24
rdogerritMerged config: Enable newton-distgit-cbs-* jobs on projects moved to integrated  http://review.rdoproject.org/r/205900:26
number80Yes \o/00:26
*** pilasguru has joined #rdo00:37
*** limao has joined #rdo00:41
*** pilasguru has quit IRC00:41
rdobot[sensu] RESOLVED: master.monitoring.rdoproject.org - check-delorean-mitaka-current @ http://tinyurl.com/zsd5jkc |#| No build failures detected: http://trunk.rdoproject.org/centos7-mitaka/report.html00:56
*** MrDanDan has quit IRC00:57
*** paragan has quit IRC01:05
*** pilasguru has joined #rdo01:06
*** ashw has quit IRC01:06
*** severion has joined #rdo01:16
*** v1k0d3n has quit IRC01:16
*** READ10 has joined #rdo01:24
*** v1k0d3n has joined #rdo01:26
*** severion has quit IRC01:26
*** alexismonville has quit IRC01:53
*** akshai has joined #rdo01:56
dhill_FYI https://bugzilla.redhat.com/show_bug.cgi?id=137332101:58
openstackbugzilla.redhat.com bug 1373321 in openstack-selinux "Can't deploy an overcloud because selinux blocks neutron_t to access unlabeled_t files (nsfs)" [High,New] - Assigned to lhh01:58
*** kenhui has joined #rdo02:13
*** dyasny has joined #rdo02:17
*** akshai_ has joined #rdo02:29
*** kenhui has quit IRC02:30
*** akshai has quit IRC02:32
*** rhallisey has quit IRC02:33
*** pilasguru has quit IRC02:34
*** crossbuilder has joined #rdo02:39
*** crossbuilder_ has quit IRC02:40
*** limao has quit IRC02:41
*** limao has joined #rdo02:43
*** dyasny has quit IRC02:46
*** limao has quit IRC02:46
*** limao has joined #rdo02:46
*** jhershbe has joined #rdo02:48
*** akshai_ has quit IRC02:52
*** jhershbe_ has joined #rdo02:53
*** jhershbe_ has quit IRC02:58
*** puzzled has quit IRC02:58
*** jhershbe has quit IRC02:59
*** paragan has joined #rdo03:04
*** paragan has joined #rdo03:04
*** zhugaoxiao has quit IRC03:14
*** zhugaoxiao has joined #rdo03:14
*** pilasguru has joined #rdo03:31
*** gildub has joined #rdo03:33
*** gildub_ has joined #rdo03:33
*** pilasguru has quit IRC03:35
*** vimal has joined #rdo03:37
*** yfried has joined #rdo03:38
*** READ10 has quit IRC03:42
*** coolsvap_ has joined #rdo03:52
*** kaminohana has quit IRC03:53
*** yfried has quit IRC03:56
*** sdake has joined #rdo04:05
*** v1k0d3n has quit IRC04:06
*** v1k0d3n has joined #rdo04:06
*** v1k0d3n has quit IRC04:09
*** v1k0d3n has joined #rdo04:10
*** pgadiya has joined #rdo04:17
*** v1k0d3n has quit IRC04:17
*** Alex_Stef has joined #rdo04:19
*** vimal has quit IRC04:21
*** sdake has quit IRC04:25
*** pilasguru has joined #rdo04:32
*** abregman has joined #rdo04:37
*** pilasguru has quit IRC04:37
*** links has joined #rdo04:39
*** vimal has joined #rdo04:42
*** jamesd has joined #rdo04:44
*** k4n0 has joined #rdo04:44
jamesdawesome job love the installer... working much better than ubuntu's conjure solution....04:44
*** Amita has joined #rdo04:48
*** sdake has joined #rdo04:50
*** ekuris has joined #rdo04:51
*** lkuchlan has joined #rdo04:53
*** anilvenkata has joined #rdo05:00
*** sdake has quit IRC05:01
*** sdake has joined #rdo05:10
*** yfried has joined #rdo05:12
*** sdake has quit IRC05:17
*** Son_Goku has quit IRC05:18
*** King_InuYasha has joined #rdo05:18
*** King_InuYasha is now known as Son_Goku05:18
*** jaosorior has joined #rdo05:21
*** cwolferh has joined #rdo05:22
*** jprovazn has joined #rdo05:22
*** florianf has joined #rdo05:30
*** chandankumar has joined #rdo05:34
*** pilasguru has joined #rdo05:34
*** gildub has quit IRC05:34
*** gildub_ has quit IRC05:35
*** gildub has joined #rdo05:35
*** pilasguru has quit IRC05:38
*** snarwade has quit IRC05:44
*** snarwade has joined #rdo05:44
*** oshvartz has joined #rdo05:46
*** saneax-_-|AFK is now known as saneax05:48
atom_konsole\05:52
*** atom_ has quit IRC05:53
*** mcornea has joined #rdo05:54
*** abregman has quit IRC05:56
*** abregman has joined #rdo05:57
*** ganesh has joined #rdo05:59
*** ganesh is now known as Guest5890605:59
*** Guest58906 is now known as gkadam05:59
*** mosulica has joined #rdo06:04
*** hynekm has joined #rdo06:06
*** martinkopec has joined #rdo06:06
*** anshul has joined #rdo06:17
*** jlibosva has joined #rdo06:17
*** jlibosva has quit IRC06:22
*** KarlchenK has joined #rdo06:23
*** nyechiel_ has joined #rdo06:24
*** satya4ever has joined #rdo06:26
*** ihrachys has joined #rdo06:29
flepiedgood morning06:29
*** tshefi has joined #rdo06:31
*** KarlchenK has quit IRC06:33
*** pilasguru has joined #rdo06:35
*** smeyer has joined #rdo06:37
*** KarlchenK has joined #rdo06:38
*** pilasguru has quit IRC06:40
*** iranzo has joined #rdo06:46
rdogerritBen Kero created config: Add multinode testing for tripleo undercloud  http://review.rdoproject.org/r/206106:46
*** KarlchenK has quit IRC06:47
*** pcaruana has joined #rdo06:48
*** gildub has quit IRC06:49
*** gildub has joined #rdo06:50
*** gildub has quit IRC06:51
*** gildub has joined #rdo06:52
*** zoli_gone-proxy is now known as zoliXXL06:57
*** tesseract- has joined #rdo07:00
*** v1k0d3n has joined #rdo07:01
*** gildub has quit IRC07:02
*** gildub has joined #rdo07:02
*** v1k0d3n has quit IRC07:06
number80o/07:06
*** jlibosva has joined #rdo07:06
*** jlibosva has quit IRC07:07
*** jpena|off is now known as jpena07:08
jpenagood morning!07:10
*** ihrachys has quit IRC07:12
*** ihrachys has joined #rdo07:12
chandankumarjpena: number80 flepied Good Morning :-)07:15
*** ifarkas_afk is now known as ifarkas07:16
*** jlibosva has joined #rdo07:18
*** leanderthal|afk is now known as leanderthal07:19
chandankumardmellado: Good Morning :-)07:21
*** edannon has joined #rdo07:21
dmelladoo/07:22
dmelladomorning everyone07:22
*** fzdarsky has joined #rdo07:22
*** ihrachys has quit IRC07:23
*** jdennis1 has joined #rdo07:24
*** jdennis has quit IRC07:25
*** zoliXXL is now known as zoli|brb07:28
*** jpich has joined #rdo07:30
*** jbadiapa has joined #rdo07:32
*** garrett has joined #rdo07:34
*** aufi has joined #rdo07:34
*** gszasz has joined #rdo07:35
*** abregman has quit IRC07:35
*** mflobo has joined #rdo07:37
*** pilasguru has joined #rdo07:37
*** zoli|brb is now known as zoliXXL07:37
*** gildub has quit IRC07:38
openstackgerritMerged openstack/packstack: Allow members from the _member_ group to manage swift  https://review.openstack.org/36580007:42
openstackgerritMerged openstack/packstack: Allow members from the _member_ group to manage swift  https://review.openstack.org/36580407:42
*** apevec has joined #rdo07:44
*** pilasguru has quit IRC07:44
*** Son_Goku has quit IRC07:46
*** dbecker has joined #rdo07:49
*** abregman has joined #rdo07:52
*** MrDan has joined #rdo08:00
*** dbecker has quit IRC08:02
*** abregman has quit IRC08:04
*** abregman has joined #rdo08:05
apevecEmilienM, looks like we have worked-in-devstack situation? https://review.rdoproject.org/r/205708:07
jpenaapevec: have you seen https://review.openstack.org/365772?08:07
*** jistr is now known as jistr|dentist08:07
apevecafaict scenario002 configures mongodb same as one upstream job which passes fine...08:07
apevecjpena, hmm, so how is that passing?08:08
apevecaah I see commit msg08:08
jpenathat review changes the zaqar test to usa API v208:08
jpenabut I've checked one of the zaqar reviews and they seem to use that same job with v1 without problems :-?08:09
apevecplease add those notes to etherpad08:09
*** ohamada has joined #rdo08:11
apevecjpena, ok, so we can't really pick this p-o-i change before it's merged, weirdo jobs are doing master checkout...08:14
jpenaapevec: yes, I think so08:14
jpenathere's no way we can make a change in review.rdo depend on an review.openstack.org change, and anyway the job will just clone the repo08:15
*** derekh has joined #rdo08:15
apevecright... but there might be a way to override TESTS list in weirdo job?08:15
apevecneed dmsimard|pto to s/|pto// later :)08:15
apevecchange is actually just this https://review.openstack.org/#/c/365772/3/run_tests.sh08:16
*** lucas-dinner is now known as lucasagomes08:16
apevecor not, TESTS is not inherited from env :(08:16
*** karimb has joined #rdo08:17
*** MrDan has quit IRC08:18
*** mvk has quit IRC08:22
*** ihrachys has joined #rdo08:23
*** nyechiel_ has quit IRC08:31
flepiedapevec: could we apply the 2 patches on the packages to test the result?08:33
*** ushkalim has joined #rdo08:33
apevecp-o-i change for puppet scenario002 cannot be applied, what's the other one?08:34
apevecah puppet-keystone for credential_setup ?08:35
apevechmm, that shouldn't be needed with keystone pinned to milestone 308:35
apevecit also defaults to False08:36
apevecbut we now also have 58. tripleo issue08:36
apevecjlibosva, ^ any ideas about ctlplane (issue 58. in https://etherpad.openstack.org/p/delorean_master_current_issues ) ?08:37
apevecserver.networks['ctlplane'][0] for server in nova.servers.list()08:37
apevecdid cli output change?08:38
*** bcafarel has joined #rdo08:38
jlibosvaapevec: looking08:39
flepiedapevec: why the scenario002 fix cannot be applied?08:39
apevecflepied, weirdo jobs checkout upstream master of puppet-openstack-integration, it's not packaged08:39
apevecwe could redirect to a temp fork though08:40
*** pnavarro has joined #rdo08:40
flepiedapevec: so it doesn't sound useful to me if we don't test the package08:40
apevecjpena, ^ would that be just weirdo job change?08:40
jlibosvaapevec: is there more info? eg. link to used script or logs from job?08:41
apevecflepied, it's testing RDO packages with upstream job unchanged08:41
*** dgurtner has joined #rdo08:41
jlibosvaapevec: note it's nova client08:41
apevecbut yeah tempest and puppet is from upstream source08:41
apevecjlibosva, yeah08:41
apevecget-overcloud-nodes.py is a script produced by tripleo-quickstart08:42
jpenaapevec: maybe we could just do a sed, let me check08:42
jpenasomething like -> sed 's/TestManageQueue/v2.test_queues.TestManageQueue/' run_tests.sh08:43
jpenaafter cloning08:43
apevecI'll take any non-kosher today :)08:44
jpenanow I have to find where it clones the repo, it's done in an ansible playbook08:44
jpenaohhh, actually it could just be a patch to weirdo itself08:44
jpenamuch better, we can use Depends-On08:44
*** nyechiel_ has joined #rdo08:45
*** athomas has joined #rdo08:46
*** abregman has quit IRC08:46
rdogerritJavier Peña created rdo-infra/ansible-role-weirdo-puppet-openstack: TEST (do not merge) Patch zaqar tests for puppet-openstack-integration  http://review.rdoproject.org/r/206208:49
jpenaapevec: let's see if ^^ is enough08:49
*** mvk has joined #rdo08:51
apevecgood that dmsimard|pto is not around yet, he'd probably freak out :)08:53
jpenanumber80: I've found a few cases where the packages we have (either in CentOS base or our dependency repo) have lower versions than requested by global-requirements.txt -> https://review.rdoproject.org/etherpad/p/dependency-bumps has the ones08:53
apevecignore pytz08:53
apevecrhel has backports so version is irrelevant08:54
jpenaapevec: mmm that's making some specs in upstream rpm-packaging complain, because we don't rm requirements.txt there :-/08:54
apevecwe should sell this removal in rpm-packaging CC number8008:55
apevecit's repeating rpm deps08:55
*** onystrom has joined #rdo08:55
apevecdouble is trouble :)08:55
*** karimb has quit IRC08:56
*** abregman has joined #rdo08:59
*** karimb has joined #rdo09:00
*** k4n0 has quit IRC09:01
*** florianf has quit IRC09:02
rdogerritJavier Peña proposed openstack/zaqar-distgit: DO NOT MERGE reproducing zaqar tempest failure in rdo ci  http://review.rdoproject.org/r/205709:03
*** florianf has joined #rdo09:04
*** nyechiel_ has quit IRC09:10
*** nmagnezi has joined #rdo09:13
number80jpena: ack09:13
*** limao has quit IRC09:19
*** chandankumar has quit IRC09:19
*** paragan has quit IRC09:21
*** jistr|dentist is now known as jistr09:23
*** chandankumar has joined #rdo09:25
jpenaapevec: so thinking about the upstream rpm-packaging project, our options to get a working gate job are either convince them to remove *requirements.txt files in all specs, or have a small dependency repo just to allow them to build (with those overrides and some other dependencies, which would only be used to build)09:25
*** aderyugin has joined #rdo09:26
jpenaactually, we might need the small dependency repo anyway (for stuff like debootstrap which we may not want to have in openstack-newton)09:26
jpenahey, Depends-On works with weirdo patches \o/09:26
jpenahttps://review.rdoproject.org/jenkins/job/gate-weirdo-dlrn-master-puppet-scenario002/11/console09:27
*** nyechiel_ has joined #rdo09:28
*** MrDan has joined #rdo09:32
number80jpena: cross-projects or cross-gerrit?09:33
*** nyechiel_ has quit IRC09:33
jpenanumber80: if you mean weirdo patches, it's cross-projects09:34
number80jpena: ok, the other option would be surprising :)09:34
number80btw, debootstrap is in common09:34
number80though not tagged09:35
*** mvk has quit IRC09:38
*** mcornea is now known as mcornea|afk09:41
*** toanju has joined #rdo09:41
*** shardy_afk has joined #rdo09:43
*** saneax is now known as saneax-_-|AFK09:43
*** shardy has joined #rdo09:44
*** sdake has joined #rdo09:45
*** ushkalim has quit IRC09:50
*** k4n0 has joined #rdo09:51
flepiedapevec: who is looking at the undercloud issue 58?09:52
*** saneax-_-|AFK is now known as saneax09:52
*** akrivoka has joined #rdo09:55
*** v1k0d3n has joined #rdo09:57
*** mvk has joined #rdo09:58
apevecflepied, I've asked jlibosva to have a look since "networks was mentioned but issue seems to be in novaclient09:58
*** dtantsur|afk is now known as dtantsur09:59
apevecjlibosva, btw I forgot to paste you, the script is https://github.com/openstack/tripleo-quickstart/blob/master/roles/tripleo-inventory/templates/get-overcloud-nodes.py.j210:00
apevecso looks like novaclient output changed?10:00
*** v1k0d3n has quit IRC10:01
*** pgadiya has quit IRC10:02
*** janki has joined #rdo10:02
*** ushkalim has joined #rdo10:03
*** sshnaidm|afk is now known as sshnaidm10:10
*** pgadiya has joined #rdo10:10
*** Son_Goku has joined #rdo10:11
*** pgadiya has quit IRC10:15
jlibosvaapevec: thanks, looking10:16
jlibosvaok, I'm not much smarter from that :D10:16
*** nyechiel_ has joined #rdo10:16
*** pgadiya has joined #rdo10:17
jlibosvaapevec: is it more likely that the network name has changed? do you have logs what was returned from nova api during this call?10:17
*** nyechiel_ has quit IRC10:22
*** Son_Goku has quit IRC10:22
dtantsurfolks, what repo is http://buildlogs.centos.org/centos/7/cloud/x86_64/tripleo_images/mitaka/delorean/ build from?10:26
dtantsur(I suspect it would be helpful to put README there with a link...)10:26
*** kaminohana has joined #rdo10:27
*** karimb has quit IRC10:27
*** KarlchenK has joined #rdo10:27
*** mcornea|afk is now known as mcornea10:27
*** zoliXXL is now known as zoli|lunch10:28
*** paramite has joined #rdo10:31
*** karimb has joined #rdo10:33
*** sdake has quit IRC10:33
*** chandankumar1 has joined #rdo10:35
*** pgadiya has quit IRC10:35
*** athomas has quit IRC10:37
*** akrivoka has quit IRC10:38
*** paragan has joined #rdo10:38
*** chandankumar has quit IRC10:39
*** athomas has joined #rdo10:41
*** abregman is now known as abregman|brb10:41
*** pblaho has joined #rdo10:43
*** pilasguru has joined #rdo10:43
*** pilasguru has quit IRC10:47
*** KarlchenK has quit IRC10:47
*** pgadiya has joined #rdo10:51
*** abregman|brb is now known as abregman10:52
*** chandankumar1 is now known as chandankumar10:54
*** karimb has quit IRC10:58
jpenaapevec: experimental tests worked with the zaqar fix -> https://review.rdoproject.org/jenkins/job/experimental-weirdo-dlrn-master-puppet-scenario002/2/10:58
*** dprince has joined #rdo11:00
*** karimb has joined #rdo11:04
*** toanju has quit IRC11:06
*** shardy_afk has quit IRC11:11
*** rhallisey has joined #rdo11:13
rdogerrithguemar created openstack/stevedore-distgit: Use pypi.io for Source0 URL  http://review.rdoproject.org/r/206311:16
*** Son_Goku has joined #rdo11:18
*** karimb has quit IRC11:21
*** k4n0 has quit IRC11:22
*** lucasagomes is now known as lucas-hungry11:22
*** jhershbe has joined #rdo11:22
*** jhershbe_ has joined #rdo11:23
*** thrash|g0ne is now known as thrash11:28
*** alexismonville has joined #rdo11:31
*** Son_Goku has quit IRC11:33
*** gildub has joined #rdo11:35
*** dpeacock has joined #rdo11:38
*** jkilpatr has joined #rdo11:41
*** v1k0d3n has joined #rdo11:41
*** fragatina has joined #rdo11:42
*** dprince has quit IRC11:43
*** fragatina has quit IRC11:43
*** dprince has joined #rdo11:43
*** pilasguru has joined #rdo11:45
*** pkovar has joined #rdo11:46
*** v1k0d3n has quit IRC11:46
*** mflobo has left #rdo11:47
*** Son_Goku has joined #rdo11:47
*** jpena is now known as jpena|lunch11:48
*** pilasguru has quit IRC11:49
EmilienMhello11:53
*** abregman has quit IRC11:53
EmilienMapevec: yes, indeed zaqar was broken11:53
*** abregman has joined #rdo11:54
flepiedEmilienM: is fixed now?11:55
flepiedis it fixed now?11:55
EmilienMflepied: patch to unblock situation are in our gate11:56
EmilienMit's about to merge in a few min11:56
flepiedEmilienM: do you have the URL of the review?11:56
EmilienMflepied: https://review.openstack.org/#/c/365103/11:56
flepiedthx EmilienM11:56
EmilienMflepied: and https://review.openstack.org/#/c/365772/11:57
flepiedok I see, thx11:58
*** ushkalim has quit IRC12:00
*** amuller has joined #rdo12:00
*** jeckersb_gone is now known as jeckersb12:01
*** zoli|lunch is now known as zoliXXL12:03
*** jeckersb is now known as jeckersb_gone12:03
*** yfried has quit IRC12:04
*** trown|outtypewww is now known as trown12:06
*** jayg|g0n3 is now known as jayg12:08
*** saneax is now known as saneax-_-|AFK12:08
*** toanju has joined #rdo12:08
*** pgadiya has quit IRC12:10
*** aortega has joined #rdo12:11
*** maeca1 has joined #rdo12:12
*** akrivoka has joined #rdo12:12
*** ushkalim has joined #rdo12:13
*** fragatina has joined #rdo12:13
*** karimb has joined #rdo12:14
*** saneax-_-|AFK is now known as saneax12:15
*** gildub has quit IRC12:18
*** akrivoka has quit IRC12:19
*** akrivoka has joined #rdo12:20
*** fragatina has quit IRC12:22
*** unclemarc has joined #rdo12:23
*** k4n0 has joined #rdo12:23
weshayapevec, greetings.. for the test day.. are the master and newton delorean trunk repos still the same? should we use one or the other?12:23
*** kgiusti has joined #rdo12:23
*** dneary has joined #rdo12:25
trownI don't think any projects have branched yet, so they should be the same12:26
*** lucas-hungry is now known as lucasagomes12:27
*** pgadiya has joined #rdo12:28
*** rlandy has joined #rdo12:30
EmilienMtrown: libraries are branched12:31
EmilienMhttps://github.com/openstack/python-tripleoclient/tree/stable/newton12:31
EmilienMhttps://github.com/openstack/python-novaclient/tree/stable/newton12:31
EmilienMhttps://github.com/openstack/oslo.config/tree/stable/newton12:31
trownoh, well then we want to use newton for test day12:32
trownthanks EmilienM12:32
weshayFYI.. rdo infra scrum agenda https://review.rdoproject.org/etherpad/p/rdo-infra-scrum12:32
*** zoliXXL is now known as zoli|brb12:32
*** fultonj has joined #rdo12:32
number80weshay: master-head == pure master, master == newton-uc12:33
rdogerritMerged openstack/stevedore-distgit: Use pypi.io for Source0 URL  http://review.rdoproject.org/r/206312:36
*** jdennis1 has quit IRC12:37
jruzickaI'm in a mood for analyzing/visualising some data, anything like that needs doing?12:37
*** myoung|afk is now known as myoung12:37
jruzickaalso, what about verwatch, number8012:38
number80jruzicka: had no time to finish12:38
* number80 is building like crazy12:39
jruzickanumber80, yeah right, want me to finish that for you? :)12:39
*** steveg_afk has joined #rdo12:39
number80jruzicka: I need to publish that code first, it's completely different beast12:39
*** anilvenkata has quit IRC12:39
number80it's mostly a frozen flask app12:40
jruzickaack12:40
*** ashw has joined #rdo12:40
*** dmsimard|pto is now known as dmsimard12:43
*** ChanServ sets mode: +o dmsimard12:43
trownuh oh dmsimard is back... everyone look busy12:43
dmsimardhello #rdo12:43
rbowenHi, dmsimard12:43
dmsimardapevec, jpena|lunch: what's that about weirdo stuff ? need a hand ?12:43
trownhola dmsimard12:43
dmsimardHow's everyone doing ?12:44
EmilienMdmsimard: hey !12:45
EmilienMdmsimard: everything was broken, then fixed then broken then fixed then broken and now it's fixed12:45
dmsimardEmilienM: oh, so business as usual then ?12:45
EmilienMyeah12:45
weshayheh12:46
*** pilasguru has joined #rdo12:46
weshaythat's our DOD.. was it fixed.. aye, check.  Is it broken now.. aye. OK we're done :)12:47
EmilienMapevec: https://dashboards.rdoproject.org/rdo-dev12:47
EmilienMapevec: how comes tripleo CI is green?12:47
EmilienMapevec: did you pin keystone to not have keystone credential setup required?12:47
weshayEmilienM, https://review.openstack.org/#/c/365802/12:47
sshnaidmhow and where do I submit a bug for RDO regarding wrong delorean.repo file?12:47
EmilienMweshay: ah ok12:48
*** jpena|lunch is now known as jpena12:48
*** sasha2 has joined #rdo12:48
EmilienMweshay: i'm still curious how it passed12:48
weshaysshnaidm, for anything regarding RDO you can use bugzilla, community, RDO12:48
*** furlongm_ is now known as furlongm12:48
EmilienMweshay: tripleo doesn't handle the keystone credential setup yet12:48
*** jaosorior has quit IRC12:48
rbowenSo, what do y'all think, are we going to have a promotion in time for test day on the 8th?12:48
*** v1k0d3n has joined #rdo12:48
*** noslzzp has joined #rdo12:49
*** vimal has quit IRC12:49
sshnaidmweshay, is bugzilla the main bugtracker in RDO?12:49
weshayrbowen, if the tripleo promotion from last night is legit, I think so12:49
*** jaosorior has joined #rdo12:49
*** gkadam has quit IRC12:49
weshayrbowen, we finally have a file server stood up, but it's temporary12:49
rbowenweshay: Oh, excellent. I was looking at dashboards.rdo and it said 10 days.12:49
*** jaosorior has quit IRC12:49
chandankumardmsimard: rbowen EmilienM Hola!12:50
dmsimardsshnaidm: something that is related to delorean (dlrn) should be filed here: https://github.com/openstack-packages/dlrn/issues12:50
weshayrbowen, RDO has not yet passed, working on that today w/ trown and adarazs12:50
dmsimardsshnaidm: dlrn doesn't have a bugzilla component.12:50
*** pcaruana has quit IRC12:50
weshayEmilienM, that has was pointed out by apevec as the one he wanted for the testday12:50
sshnaidmdmsimard, it's wrong repo url in delorean.repo file, I'm not sure it's related to dlrn tool..12:50
dmsimardsshnaidm: the delorean.repo file is generated by dlrn, yes.12:51
*** jaosorior has joined #rdo12:51
*** pilasguru has quit IRC12:51
sshnaidmdmsimard, ok, thanks12:51
dmsimardsshnaidm: but anyway, can you show me what you mean ?12:51
jpenadmsimard: we were doing some dirty stuff to weirdo, but just for testing (https://review.rdoproject.org/r/2062) :)12:51
jpenawelcome back, btw ;)12:51
*** yfried has joined #rdo12:51
dmsimardjpena: yay \o/12:54
*** vaneldik has joined #rdo12:56
jpenadmsimard: now that you're back, with fresh ideas, I have something in mind about DLRN but I'm not sure if we can make it work12:57
jpenadmsimard: I see we're wasting a lot of time in our builders just refreshing the git repos and checking for updated commits, so maybe we could do it the other way around: have a job in the post pipeline for repos in review.rdoproject.org that just connects to the proper dlrn instance and triggers the build of that specific package12:58
dmsimardjpena: you can do anything you want, sky is the limit and don't let your imagination be stopped by boundaries, you will overcome them! </overlyencouraging>12:58
dmsimardjpena: that's a middleground between what we have now and what I wanted to do12:58
sshnaidmdmsimard, http://buildlogs.centos.org/centos/7/cloud/x86_64/rdo-trunk-master/delorean.repo - shouldn't it contain "buildlogs.centos.org" instead of "trunk.rdoproject.org" there?12:58
number80sshnaidm: it's the same, redirection12:59
dmsimardjpena: which is to decentralize the dlrn instance builds into POST pipeline triggers that would rsync wherever relevant12:59
dmsimardnumber80: it's not12:59
jpenadmsimard: yes, that was my other idea12:59
jpenaand have dlrn rebuild the repo, but in both cases we have the issue of having the jenkins server connect from the internet to inside the ci.centos.org infra13:00
*** lkuchlan has quit IRC13:00
*** vaneldik has quit IRC13:00
dmsimardnumber80: it's kind of funny if you use the delorean.repo from buildlogs, you don't actually use buildlogs but rather the public instance13:00
weshayrlandy, mtg13:01
*** ushkalim has quit IRC13:01
jpenasshnaidm: that's *the* issue we need to fix if we want to use the CDN but still download that file. So that file is created by the DLRN code while building the repo, and its contents should be those. However, when we promote a repo we should comment it out and set another baseurl13:02
dmsimardjpena: we can solve that by a pull rather than a push13:02
dmsimardjpena: not unlike how tripleo is doing for symlink promotions13:02
dmsimardjpena: have the dlrn instance pull from the public internet rather than have the public internet push to it13:02
sshnaidmjpena, dmsimard so can I submit an issue about this?13:03
dmsimardsshnaidm: it's a known issue although not formalized, you can go ahead13:03
jpenasshnaidm: however, that's a problem if we have more than one repo (tripleo-ci, current-passed-ci) using the same hashed repo, so the best solution would be to configure the CI jobs to use the buildlogs URLs instead of downloading delorean.repo13:03
jpenadmsimard: how can we do that (without polling)?13:03
*** _elmiko is now known as elmiko13:04
dmsimardjpena: could be a remote parameterized job, exactly like the tripleo job13:04
*** trozet has quit IRC13:04
dmsimardsec13:04
sshnaidmjpena, these repo files are downloaded to images etc, we can't just use url13:04
*** zoli|brb is now known as zoliXXL13:05
*** Goneri has joined #rdo13:07
*** kenhui has joined #rdo13:08
number80dmsimard: \o/13:10
* number80 is having fun w/ newton-rdo forking13:10
number80too much things to check13:10
dmsimardhas upstream started branching newton upstream ?13:12
*** nmagnezi_ has joined #rdo13:12
*** pgadiya has quit IRC13:13
rdogerritBen Kero proposed config: Add multinode testing for tripleo undercloud  http://review.rdoproject.org/r/206113:13
*** ushkalim has joined #rdo13:13
number80dmsimard: yes, last week13:14
dmsimardEmilienM: have you started branching stable/newton too ?13:14
dmsimardI guess we also need to branch packstack13:14
*** nmagnezi has quit IRC13:14
*** vaneldik has joined #rdo13:15
*** akshai has joined #rdo13:18
*** sreichar has joined #rdo13:19
*** trozet has joined #rdo13:19
*** jpena is now known as jpena|off13:19
*** lon_T2 has quit IRC13:20
*** lon has quit IRC13:20
*** lon has joined #rdo13:21
EmilienMdmsimard: no13:24
EmilienMi'll branch once our final release is out13:24
EmilienMIt will happen at October 3 I think13:25
*** eharney has joined #rdo13:25
*** puzzled has joined #rdo13:27
dmsimardjpena|off: can we do 209.132.178.27 -> images.rdoproject.org ?13:27
*** jpena has joined #rdo13:28
*** _degorenko|afk is now known as degorenko13:28
dmsimardok13:28
*** yfried has quit IRC13:31
*** jpena has quit IRC13:35
*** jpena|off is now known as jpena13:36
jpenadmsimard: I'm on it13:36
rdogerrithguemar created openstack/oslo-config-distgit: Fix Source0 URL  http://review.rdoproject.org/r/206513:38
dmsimardjpena: ty13:40
*** jmelvin has quit IRC13:41
*** jmelvin has joined #rdo13:41
*** saneax is now known as saneax-_-|AFK13:42
*** pblaho has quit IRC13:43
*** pblaho has joined #rdo13:44
*** pblaho has quit IRC13:44
*** ashw has quit IRC13:45
*** pblaho has joined #rdo13:45
*** pilasguru has joined #rdo13:48
*** ashw has joined #rdo13:48
*** aludwar has joined #rdo13:48
*** ashw has quit IRC13:48
*** ashw has joined #rdo13:49
*** Alex_Stef has quit IRC13:51
*** pilasguru has quit IRC13:52
rdogerritrdo-trunk created openstack/ceilometer-distgit: openstack-ceilometer: failed to build a60b004  http://review.rdoproject.org/r/206713:54
rdogerritBen Kero proposed config: Add multinode testing for tripleo undercloud  http://review.rdoproject.org/r/206113:54
*** hynekm has quit IRC13:56
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-newton-current @ http://tinyurl.com/gud2vup |#| Build failure on centos7-master/current: ceilometer: http://trunk.rdoproject.org/centos7-master/report.html14:00
*** chandankumar has quit IRC14:00
rdogerritMerged openstack/heat-templates-distgit: python-heat-agent subpackage for simple agent bootstrap  http://review.rdoproject.org/r/190914:00
*** chandankumar has joined #rdo14:01
rdogerritJavier Peña proposed openstack/ceilometer-distgit: Add binary ceilometer-upgrade  http://review.rdoproject.org/r/206714:04
rdogerritPradeep Kilambi created openstack/ceilometer-distgit: rename dbsync to upgrade  http://review.rdoproject.org/r/206814:05
*** Son_Goku has quit IRC14:06
number80jpena, pradk: duplicate work detected14:08
*** eggmaster has joined #rdo14:08
number80pradk: recommended way is to reuse the review opened by DLRN14:08
pradknumber80, :) jpena was first lets use his.. i'll abandon14:08
number80ack14:09
*** jcoufal has joined #rdo14:09
EmilienMapevec: all blockers merged puppet CI is promoted now14:09
*** trozet has quit IRC14:12
*** ekuris has quit IRC14:12
*** trozet has joined #rdo14:13
*** yfried has joined #rdo14:14
dmsimardEmilienM: yay14:15
*** nmagnezi_ has quit IRC14:15
dmsimardnumber80: did we make any progress in tempest stuff last week? Eager to unblock designate14:16
*** michchap has quit IRC14:17
number80dmsimard: discussion ongoing on the list14:17
dmsimardah, haven't caught up on emails yet14:17
*** links has quit IRC14:21
*** oshvartz has quit IRC14:22
*** mengxd has joined #rdo14:24
*** kaminohana has quit IRC14:24
*** zigo has quit IRC14:25
*** janki has quit IRC14:26
*** michchap has joined #rdo14:26
*** akshai has quit IRC14:27
*** zigo has joined #rdo14:32
*** zigo is now known as Guest3914714:33
*** Ryjedo has joined #rdo14:34
*** akshai has joined #rdo14:37
*** Guest39147 has quit IRC14:39
*** zigo_ has joined #rdo14:42
*** edannon has quit IRC14:43
*** sdake has joined #rdo14:44
*** richm has joined #rdo14:46
*** shaunm has joined #rdo14:46
*** zigo_ has quit IRC14:47
*** zigo_ has joined #rdo14:48
*** pilasguru has joined #rdo14:49
*** pilasguru has quit IRC14:54
jruzickawhat URL should I reference as RDO CloudSIG repos? Something stable that points to the actual repos?14:55
jruzickaapevec, number80, chandankumar ^14:55
*** anshul has quit IRC14:56
rbowenhttp://rdoproject.org/repos right?14:56
rbowenOh, wait ... no.14:56
*** sreichar has quit IRC14:56
*** ifarkas is now known as ifarkas_afk14:57
miscsomething in https :)14:57
*** blinky42 has quit IRC14:57
*** jbrooks has joined #rdo14:58
jruzickamight be nice to add a page explaining what these are linking14:58
rbowenhttp://trunk.rdoproject.org/ should always point to the right things.14:58
miscare package on trunk signed ?14:58
*** blinky42 has joined #rdo14:59
jruzickarbowen, but it only mentions trunk.rdoproj while CloudSIG repos are http://mirror.centos.org/centos/7/cloud/x86_64/15:00
jpenajruzicka: for actual reports, we should use http://mirror.centos.org/centos/7/cloud/x86_6415:00
jpenathose are the signed rpms, anything under trunk.rdoproject.org is not signed15:00
*** pradk has quit IRC15:00
*** pilasguru has joined #rdo15:01
jpenaI need to leave now (doctor), will check back this evening15:01
jruzickajpena, I see, so that is just a mirror of trunk.r.o+ singning? Any CI between? how often is it mirrored?15:01
jruzickajpena, sure thing15:01
*** ushkalim has quit IRC15:02
jpenajruzicka: no, what's in mirror.centos.org is built using the CBS, trunk.rdo.o is built using DLRN15:02
jpenai'm pretty sure amoralej created a nice diagram for that15:02
jruzickayeah, right :)15:02
*** rodrigods has quit IRC15:02
*** rodrigods has joined #rdo15:02
jruzickaso it seems there is no page explaining that15:02
jpenahttps://www.rdoproject.org/images/documentation/rdo-full-workflow-high-level-no-buildlogs.png?146479462315:02
jpenahttps://www.rdoproject.org/documentation/rdo-packaging/ has something, it could be expanded15:03
*** jpena is now known as jpena|away15:03
jruzickayeah I considered that, but that's packager docs, we should have user facing page explaining what it is and pointing to up to date links15:04
jruzickamuch like trunk.r.o15:04
*** smeyer has quit IRC15:04
*** zoliXXL is now known as zoli|mtg15:05
*** toanju has quit IRC15:06
*** mosulica has quit IRC15:07
*** karimb has quit IRC15:07
*** wrongosaurus has joined #rdo15:11
*** agrajag has quit IRC15:14
*** agrajag has joined #rdo15:14
*** dtrainor has quit IRC15:15
*** dtrainor has joined #rdo15:15
*** aufi has quit IRC15:17
*** thrash is now known as thrash|biab15:18
number80jruzicka: http://mirror.centos.org/centos/7/cloud/x86_64/15:19
number80but simpler is to install centos-release-openstack package from extras15:19
*** pradk has joined #rdo15:20
*** oshvartz has joined #rdo15:20
*** zigo_ is now known as zigo15:20
*** fragatina has joined #rdo15:20
rdogerritMerged openstack/oslo-config-distgit: Fix Source0 URL  http://review.rdoproject.org/r/206515:21
rdogerritDavid Moreau Simard proposed config: Add DLRN-rpmbuild for upstream python-tripleoclient  http://review.rdoproject.org/r/191115:24
*** vaneldik has quit IRC15:25
*** fragatina has quit IRC15:27
*** Amita has quit IRC15:27
dmsimardbkero: were you the one that added https://github.com/openstack/puppet-openstack-integration/blob/master/run_tests.sh#L18 ? I forget15:27
dmsimardand git blame is not picking up the right thing15:28
EmilienMweshay, trown: can you guys join #openstack-release ?15:29
wrongosaurushi, whats the catch in running WeiRDO?15:34
*** tshefi has quit IRC15:34
wrongosaurusseems like there are other things in documentation than in git repo15:35
*** martinkopec has quit IRC15:37
dmsimardwrongosaurus: hi o/15:37
dmsimardwrongosaurus: what are you trying to do ? :)15:37
*** matbu is now known as matbu|bbl15:38
wrongosaurusrun it, namely there should be run-test.sh15:38
wrongosaurusbut it isn't15:39
wrongosaurusi'm new to this, so I need to orient a bit15:39
dmsimardwrongosaurus: weirdo is just an ansible wrapper to run upstream packstack and puppet-openstack integration jobs15:39
wrongosaurusI thought I'll edit ansible hosts file, and weirdo would install and test packstack for me15:39
wrongosaurusfor example15:39
rdogerritMerged openstack/ceilometer-distgit: Add binary ceilometer-upgrade  http://review.rdoproject.org/r/206715:40
*** vaneldik has joined #rdo15:40
bkerodmsimard: I was15:40
dmsimardwrongosaurus: right, so this is an example of how to run weirdo on "localhost" https://gist.github.com/dmsimard/8d14ceb5a4d3a41a1879d25decb6c16215:41
dmsimardwrongosaurus: you can edit that small script and put your own target in the inventory file if you'd like15:41
wrongosaurusnice15:41
*** pcaruana has joined #rdo15:42
wrongosaurusi'll try to point it to KVM, so it wouldn't mange my machine15:42
dmsimardwrongosaurus: I have to step away for lunch but you can find me here if you have any questions, I'm the author :)15:42
wrongosaurusthanks a lot!15:42
wrongosaurusi'll have more questions later :)15:42
dmsimardwrongosaurus: weirdo won't set up a VM for you, it needs a target to deploy on (so Ansible can connect to it).. that target can be localhost (as per the example) or whatever host/vm you want15:43
dmsimardbkero: k I'll have a question for you after lunch :)15:43
wrongosaurusmy centos VM is already installed15:43
bkerodmsimard: sounds good15:43
* bkero taking a small nap after 6am meeting :)15:43
*** thrash|biab is now known as thrash15:44
*** sdake has quit IRC15:44
*** vaneldik has quit IRC15:45
*** sreichar_ has joined #rdo15:45
*** mengxd has quit IRC15:45
rdogerrithguemar created openstack/oslo-serialization-distgit: Fix Source0 URL  http://review.rdoproject.org/r/206915:47
rdogerrithguemar created openstack/oslo-serialization-distgit: Add missing %upstream_version fallback macro  http://review.rdoproject.org/r/207015:47
*** leanderthal is now known as leanderthal|afk15:48
EmilienMapevec: so keystone is currently pinned?15:53
flepiedEmilienM: yes: https://github.com/redhat-openstack/rdoinfo/blob/master/rdo.yml#L33015:56
EmilienMflepied: ok. It should be good to unpin it for puppet ci but it will fail in tripleo Ci because tripleo doesn't use the new keystone bootrap tool yet15:57
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-newton-current @ http://tinyurl.com/gud2vup |#| Build failure on centos7-master/current: ceilometer: http://trunk.rdoproject.org/centos7-master/report.html15:57
EmilienMayoung, shardy: I would like to warn you on this topic15:58
EmilienMRDO is currently pinning keystone to newton-3 because a change in keystone made keystone credential setup required15:58
ayoungEmilienM, ++15:58
EmilienMpuppet-keystone does support this feature but it's not enabled in tripleo15:58
EmilienMand enabling it in tripleo is not easy, because we need to generate credential on one node and then export it on other keystone nodes15:58
EmilienMjaosorior: fyi ^15:59
flepiedEmilienM: I suppose we'll unpin after the test days15:59
EmilienMI have no idea how to implement it15:59
EmilienMbut if we don't do it, we won't be able to run final keystone newton on tripleo15:59
jaosoriorEmilienM: thanks for the info15:59
EmilienMwe should really fix that thing as high prio16:00
EmilienMI have a workaround in mind16:00
EmilienMayoung: what do you think if we set a static (randomly generated) value in the credential files16:01
EmilienMayoung: we wouldn't have any rotation though, but we don't care now16:01
ayoungEmilienM, give me 10 minutes16:01
jaosoriorEmilienM: ayoung, me and the team are currently in a meeting.16:01
EmilienMah ok16:01
*** imcsk8 has quit IRC16:01
*** imcsk8 has joined #rdo16:02
*** garrett has quit IRC16:02
apevecEmilienM, imho this is backward incompatible change as ayoung acknowledged and should be fixed in keystone16:02
*** KarlchenK has joined #rdo16:02
EmilienMayoung, jaosorior: we could use https://bugs.launchpad.net/tripleo/+bug/1619758 to track it16:03
openstackLaunchpad bug 1619758 in OpenStack Identity (keystone) "Credential Encryption breaks deployments without Fernet" [Undecided,In progress] - Assigned to Adam Young (ayoung)16:03
EmilienMapevec: yes16:03
EmilienMapevec: this is terrible from keystone to do this change at the end of cycle16:04
stevemarEmilienM: keystone meeting in 2 hours, not much on the agenda, we can talk about it there16:06
EmilienMstevemar: ok16:06
EmilienMstevemar: this is really problematic16:06
rdobot[sensu] RESOLVED: master.monitoring.rdoproject.org - check-delorean-newton-current @ http://tinyurl.com/gud2vup |#| No build failures detected: http://trunk.rdoproject.org/centos7-master/report.html16:06
stevemarEmilienM: i can tell :(16:07
*** mcornea has quit IRC16:07
stevemarEmilienM: i suppose you still want your credentials to work too, so running the setup will fix your CI but you guys dont have a way to rotate keys16:08
*** abregman has quit IRC16:08
EmilienMstevemar: in /etc/keystone/credential-keys/ what is diff between 0.txt and 1.txt?16:08
EmilienMstevemar: rotation will be a future feature16:08
chandankumarnumber80: jruzicka EmilienM dmsimard rbowen apevec dmellado Good night, see you tomorrow :-)16:08
rbowenGood night chandankumar16:08
EmilienMnow we need to generate it and put it on the keystone nodes16:08
EmilienMstevemar: for example http://logs.openstack.org/72/365772/3/gate/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/9c5389d/logs/etc/keystone/credential-keys/16:09
*** rpioso has joined #rdo16:09
*** chandankumar has quit IRC16:10
stevemarEmilienM: i assume 0.txt is the primary key and 1.txt is the secondary16:11
lbragstadstevemar other way around16:11
lbragstadthe key with the highest index is the primary key16:11
lbragstadmeaning it is the key used to encrypt all new credentials16:11
EmilienMok, if I have one key, is it enough?16:11
lbragstadEmilienM yes16:11
EmilienMi'm going to use Puppet to generate it.16:12
EmilienMwhat is the formula to generate a key? is there a python/shell command I can use?16:12
lbragstadEmilienM the `keystone-manage credential_setup` command is going to leave you with a 0 and 1 key in your credential key repository16:12
lbragstadEmilienM absolutely16:12
lbragstadEmilienM its just a couple lines of python - let me find you an example16:12
*** kenhui has quit IRC16:14
lbragstadEmilienM https://github.com/pyca/cryptography/blob/master/src/cryptography/fernet.py#L4616:14
EmilienMlbragstad: ok. My first step is to enable it on undercloud : https://review.openstack.org/366240 as we don't need export/collect and rotations.16:14
EmilienMlbragstad: thanks a lot16:14
*** derekh is now known as derekh_afk16:14
*** satya4ever has quit IRC16:14
lbragstadEmilienM you should be able to generate keys all day using - http://cdn.pasteraw.com/o3lppn5zitxkexmnq0yld2l4juuzl2p16:14
lbragstadEmilienM then it's just a process of making sure they get named properly (i.e. 0 or 1 or 2, etc... )16:15
EmilienMlbragstad: so what I'm going to do is to 1) generate 2 values 2) use Puppet to write the 1.txt and 2.txt files everywhere Keystone runs, set the credential key path in /etc/keystone.conf with Puppet but NOT run keystone-manage credential_setup16:15
EmilienMlbragstad: what do you think?16:15
lbragstadEmilienM that would certainly work, but is there any reason to not run keystone-manage credential_setup?16:16
lbragstadonce you set the key_repository location `CONF [credential] key_repository`16:16
lbragstad?16:16
EmilienMlbragstad: because if I run it on multinode, it will generate different keys16:17
EmilienMlbragstad: I want to keep control on the content of keys so I can put the right keys on all keystone nodes16:17
EmilienMuntil we find a better mechanism in tripleo16:17
*** nyechiel_ has joined #rdo16:17
lbragstadEmilienM ah - right16:17
EmilienMok I'll prepare a prototype16:18
EmilienMlbragstad: thanks for your help16:18
lbragstadEmilienM so the keys that you're generating are going to be the only keys used across all nodes, right?16:18
EmilienMlbragstad: right, for now16:18
lbragstadok16:18
EmilienMlbragstad: we can add rotations later, as a new feature16:18
EmilienMbut I want to iterate so we can use latest keystone16:18
*** jhershbe_ has quit IRC16:18
lbragstadEmilienM i guess one thing you could do would be to name the files 0 and 1 so that it behaves exactly like keystone-manage credential_setup16:19
*** jhershbe has quit IRC16:19
EmilienMlbragstad: ok perfect I'll do that16:19
lbragstadEmilienM then it would be completely transparent16:19
EmilienMyeah16:19
*** rhallisey has quit IRC16:21
EmilienMayoung, jaosorior: FYI here's a summary of what i'm doing now https://bugs.launchpad.net/keystone/+bug/1619758/comments/316:21
openstackLaunchpad bug 1619758 in OpenStack Identity (keystone) "Credential Encryption breaks deployments without Fernet" [Undecided,In progress] - Assigned to Adam Young (ayoung)16:21
lbragstadEmilienM we have some logic in keystone to make it so that if there is a key named 0 in the repository - we won't overwrite those keys https://github.com/openstack/keystone/blob/b47f10290ed83415149f3d2ab6b0dc64646e578a/keystone/common/fernet_utils.py#L15116:22
ayoungEmilienM, not on the nodes16:22
ayoungwe need these synced between nodes, which is why in my POC I did it on the undercloud16:22
EmilienMayoung: if we use puppet to manage the file, it will be synced.16:22
EmilienMI'll use our password generation mechanism16:22
*** rhallisey has joined #rdo16:22
ayoungEmilienM, use the Keystone-manage command16:23
*** hynekm has joined #rdo16:23
EmilienMno..16:23
EmilienMyou didn't understand the problem here16:23
jaosoriorEmilienM: so you're talking about generating a random key in heat, and passing that to puppet via hiera?16:23
EmilienMjaosorior: yes16:23
EmilienMjaosorior: but with File resource.16:23
EmilienMjaosorior: exactly, you got it16:23
jaosoriorayoung: that's very similar to the approach you had mentioned. I think it's the right way to do it.16:23
EmilienMjaosorior: that's the only way we can get it working super fast16:23
*** zoli|mtg is now known as zoli|gone16:23
jaosoriorayoung: it's not as complete as using a secret-storage tool such as custodia. But as you mentioned, that's not ready yet :/16:24
EmilienMwell, nothing is ready yet :-(16:24
ayoungEmilienM, jaosorior I really need to finish this team meeting before I can pay full attention.  Sorry16:24
*** zoli|gone is now known as zoli_gone-proxy16:24
jaosoriorEmilienM: when you have something let me know and I'll give it priority to review16:25
EmilienMjaosorior: yep16:25
EmilienMI'm on it now16:25
*** dbecker has joined #rdo16:25
*** akshai has quit IRC16:26
lbragstadEmilienM feel free to ping me if you want another set of eyes on the review - I'd be happy to review it from a fernet perspective.16:27
*** hynekm has quit IRC16:27
*** dtantsur is now known as dtantsur|afk16:28
EmilienMlbragstad: ok, I appreciate your help16:28
EmilienMI have an idea how to do it, in tripleoclient16:28
lbragstadEmilienM anytime16:28
ayoungEmilienM, we can generate on the undercloud using the keystione mechanism16:28
*** akshai has joined #rdo16:29
*** stevemar has quit IRC16:31
*** hynekm has joined #rdo16:32
*** derekh_afk is now known as derekh16:35
*** READ10 has joined #rdo16:36
* EmilienM brb lunch16:37
*** nyechiel_ has quit IRC16:38
dmsimardwrongosaurus: so you're interested in testing Packstack ? As in, testing it actually works ? Or do you want to test Packstack from an end user perspective ?16:38
jaosoriorayoung: we'll also need it for the undercloud's keystone. That's why Emilien is aiming to do it via heat16:41
*** READ10 has quit IRC16:41
jaosoriorayoung: so EmilienM actually has a submission for generating the keys for the undercloud's keystone using the supported mechanism (which is already even supported via puppet)16:41
*** fragatina has joined #rdo16:42
*** fragatina has quit IRC16:43
*** lucasagomes is now known as lucas-dinner16:44
*** fragatina has joined #rdo16:44
*** KarlchenK has quit IRC16:46
rdogerritJakub Ruzicka created rdopkg: pkgenv: fix traceback on unknown gerrit chain  http://review.rdoproject.org/r/207116:47
*** weshay is now known as weshay_bbiab16:47
*** pradk has quit IRC16:47
*** hynekm has quit IRC16:48
*** gszasz has quit IRC16:49
*** mflobo has joined #rdo16:51
*** fragatina has quit IRC16:52
*** ihrachys has quit IRC16:55
*** sdake has joined #rdo16:57
*** jcoufal_ has joined #rdo16:58
*** hogepodge has quit IRC16:58
*** jpich has quit IRC16:59
*** trown is now known as trown|lunch17:00
*** anshul has joined #rdo17:00
*** jcoufal has quit IRC17:01
*** fzdarsky is now known as fzdarsky|afk17:01
*** paragan has quit IRC17:01
imcsk8apevec: are you around?17:02
*** hogepodge has joined #rdo17:03
*** florianf has quit IRC17:04
*** ohamada has quit IRC17:05
*** florianf has joined #rdo17:10
*** sdake_ has joined #rdo17:12
*** MrDan has quit IRC17:12
EmilienMjaosorior: https://review.openstack.org/#/c/366240/17:14
EmilienMjaosorior: in the meantime17:14
EmilienMjaosorior: I'll change it later probably but it's good enough for this cycle.17:14
jaosoriorEmilienM: alright, I'll check it out tomorrow.17:15
EmilienMthanks17:15
*** sdake has quit IRC17:15
jaosoriorEmilienM: it's 8pm here and I'm about to leave. Sorry about that. But tomorrow morning I'll check it out.17:15
rdogerritMerged rdopkg: cbsbuild: make rpm module optional  http://review.rdoproject.org/r/197017:15
*** pradk has joined #rdo17:16
EmilienMjaosorior: don't be sorry17:16
EmilienMjaosorior: have a great evening dude17:16
EmilienMjaosorior: i'll email you and Adam about my progress17:16
*** pkovar has quit IRC17:24
*** stevemar has joined #rdo17:26
*** sdake_ has quit IRC17:28
*** sdake has joined #rdo17:29
*** akshai has quit IRC17:30
*** k4n0 has quit IRC17:31
*** fragatina has joined #rdo17:32
*** fragatina has quit IRC17:32
*** fragatina has joined #rdo17:33
*** paramite has quit IRC17:36
*** jaosorior has quit IRC17:36
*** florianf has quit IRC17:40
*** k4n0 has joined #rdo17:42
rdogerritPradeep Kilambi created rdoinfo: Add panko project  http://review.rdoproject.org/r/207217:43
*** richm has quit IRC17:43
*** MrDan has joined #rdo17:48
*** sdake has quit IRC17:49
dmsimardbkero: ohai17:49
dmsimardbkero: re: puppet manage modules17:49
bkerohi17:50
dmsimardbkero: I guess this is because you pre-install the modules somewhere ?17:50
bkerodmsimard: yes, exactly17:50
bkerootherwise p-o-i clobbers them17:50
dmsimardbkero: just noticed we don't leverage that with weirdo right now so while we're testing openstack projects from packages, the puppet modules are from source as per the Puppetfile17:50
dmsimardwith Packstack we're already using the appropriate switch to install puppet modules from packages17:51
bkerodmsimard: That seems like it could provide some easy test coverage.17:51
*** dbecker has quit IRC17:51
dmsimardBut p-o-i expects the modules in /etc/puppet/modules, right ? Do you pass a different argument to puppet apply to change the moduledir ?17:51
bkeroI believe they get symlinked17:52
bkerodmsimard: alternatively PUPPET_ARGS="--modulepath=/usr/share/openstack-puppet/modules"17:52
dmsimardhm, I don't think they get symlinked17:53
rdogerritjason guiditta created puppet/puppet-barbican-distgit: Add spec for puppet-barbican.  http://review.rdoproject.org/r/207317:53
dmsimardat least not according to https://review.rdoproject.org/r/gitweb?p=puppet/puppet-nova-distgit.git;a=blob;f=puppet-nova.spec;h=685b570a6a4c3c053ce9a9da231bd641982093b9;hb=HEAD17:53
*** anshul has quit IRC17:53
dmsimardjayg: interesting ^17:54
bkeroThat might have been happening in the test job17:54
jaygdmsimard: ?17:54
*** fragatina has quit IRC17:54
*** florianf has joined #rdo17:54
dmsimardbkero: what a coincidence, if p-o-i would be installing from packages they would fail right now because puppet-barbican isn't packaged yet17:54
jaygdid I do it wrong?17:54
dmsimardjayg: no, just an interesting coincidence17:54
jaygah, ok, yes, we started working on adding puppet-barbican late last week17:55
*** fragatina has joined #rdo17:55
jaygpuppet-ovn too, fwiw, patch coming shortly for that17:55
dmsimardjayg: tabs instead of spaces ?17:55
dmsimardis that generated by hand or scripted ?17:55
jaygscript, feel free to comment and I will clean it17:55
*** sdake has joined #rdo17:56
* jayg could try to fix script as well...17:56
*** rpioso has quit IRC17:56
bkerodmsimard: that's not to say that there shouldn't be p-o-i jobs using/testing the packages17:57
*** akshai has joined #rdo17:57
dmsimardbkero: well, it's fine that upstream installs from source -- p-o-i installs through puppet file and so does packstack17:58
dmsimardbkero: but with weirdo and RDO in mind, we're using those tests to test our packages17:58
rdogerritIgor Yozhikov created openstack/murano-distgit: Fix io.murano.zip creaton  http://review.rdoproject.org/r/207417:58
bkerodmsimard: p-o-i could test the puppet packages too17:59
bkerojust MANAGE_PUPPET_MODULES=false17:59
*** rpioso has joined #rdo18:00
*** Alex_Stef has joined #rdo18:03
dmsimardbkero: yup, and change the puppet args18:06
dmsimardty, will do that.18:06
rdogerritMerged config: Add DLRN-rpmbuild for upstream python-tripleoclient  http://review.rdoproject.org/r/191118:06
*** dgurtner has quit IRC18:07
*** athomas has quit IRC18:07
rdogerritjason guiditta proposed puppet/puppet-barbican-distgit: Add spec for puppet-barbican.  http://review.rdoproject.org/r/207318:07
*** kenhui has joined #rdo18:10
*** trown|lunch is now known as trown18:12
rdogerritjason guiditta created puppet/puppet-ovn-distgit: Add spec for puppet-ovn.  http://review.rdoproject.org/r/207518:12
rdogerritPradeep Kilambi proposed rdoinfo: Add panko project  http://review.rdoproject.org/r/207218:14
*** degorenko is now known as _degorenko|afk18:17
*** pradk has quit IRC18:18
*** sreichar has joined #rdo18:19
mwhahahahey i'm attempting to use the tripleo-quickstart stuff and i'm getting an ssl connection failure when it is trying to pull down https://trunk.rdoproject.org/centos7/delorean-deps.repo18:19
bkeromwhahaha: check your client's time?18:19
mwhahahamy time is fine18:19
number80dmsimard: can you help reviewing puppet-DLRN patchsets?18:20
number80https://review.rdoproject.org/r/#/q/project:rdo-infra/puppet-dlrn18:20
mwhahahaConnection failure: unknown error (_ssl.c:2988)18:20
rdogerritMerged openstack/oslo-serialization-distgit: Fix Source0 URL  http://review.rdoproject.org/r/206918:20
rdogerritMerged openstack/oslo-serialization-distgit: Add missing %upstream_version fallback macro  http://review.rdoproject.org/r/207018:20
rdogerritMerged openstack/heat-templates-distgit: python-heat-agent-puppet subpackage  http://review.rdoproject.org/r/191218:20
rdogerritMerged openstack/heat-templates-distgit: python-heat-agent-ansible subpackage  http://review.rdoproject.org/r/191318:20
mwhahahayay non descript python ssl errors18:20
number80there are a lot of them, and I'm not comfy to merge them based on my sole judgement18:20
bkerohuh18:20
mwhahahai can curl/wget all day long18:20
bkeromwhahaha: does your python grabbing library use python's cert store?18:20
bkeroThis cert is using the DST Root CA X3 and LetsEncrypt18:21
mwhahahano idea, what does ansible use by default18:21
*** fragatin_ has joined #rdo18:22
bkerono idea there18:22
mwhahahait's probably using my system one which probably does not have letsencrypt18:23
mwhahahawell if that was the case curl should fail18:23
bkeropython requests uses it's own cert store18:23
* mwhahaha sighs18:23
mwhahahabecause you know, we need more of those18:23
bkerogo tell it to the requests people18:24
number80jayg: puppet-xxx spec are missing %upstream_version, is it due to the generating script? If that's the case, I strongly suggest fixing it18:24
bkerohttp://docs.python-requests.org/en/master/user/advanced/ looks like there's a way to get it to use other certs with 'certifi'18:24
number80bkero: not necessarily18:24
mwhahaharequests was fine18:24
bkeronumber80: does the rpm gut that functionality or something?18:24
mwhahahai just pulled it in python ok, seems to be ansible related18:24
*** fragatina has quit IRC18:25
number80bkero: we patch requests to use system cert store18:25
bkeroah ok18:25
bkerobecause software18:25
*** jhershbe_ has joined #rdo18:25
number80actually, for secteam, it's a NACK to use bundled cert18:26
*** jhershbe has joined #rdo18:27
trownmwhahaha: howdy thanks for giving quickstart a go... where is it downloading that repo?18:27
number80though I'm more often the one poking at secteam than the reverse18:27
*** shardy has quit IRC18:27
mwhahahatrown: http://paste.openstack.org/show/567246/18:27
*** rhallisey has quit IRC18:28
trownmwhahaha: hmm, seems like another bug with devmode...18:29
*** rhallisey has joined #rdo18:30
trownmwhahaha: are you using devmode because the other images are super slow to download by chance?18:30
mwhahahano18:31
*** shaunm has quit IRC18:31
mwhahahai'm a glutton for punishment is seems18:31
*** brault has quit IRC18:32
*** brault has joined #rdo18:32
trownk, devmode needs some love... like we need to rethink how we are doing it entirely18:32
*** Alex_Stef has quit IRC18:32
mwhahahai already battled libvirt18:33
mwhahahalet me try w/o dev mode to see if i run into other issues18:34
trownthere are RDO images, but the place we were hosting them recently put a rate limiter up... https://review.openstack.org/#/c/359796/ will fix that18:34
*** pradk has joined #rdo18:35
trownyou could pull that patch, or just pass in '--extra-vars undercloud_image_url=http://images.rdoproject.org/master/delorean/current-tripleo/stable/undercloud.qcow2" to quickstart.sh18:37
trownasuming you are working on master, or find the appropriate image on images.rdoproject.org to pass in18:37
mwhahahaok thanks18:38
trownlet me know if you hit any other issues18:38
mwhahahaoh i've got a list18:38
trown:)18:38
* mwhahaha cries18:38
*** jhershbe has quit IRC18:44
*** jhershbe_ has quit IRC18:44
trowndmsimard: any chance you would want to push some JJB for me? https://review.gerrithub.io/#/c/29034518:46
*** priteau has joined #rdo18:48
rdogerritPradeep Kilambi created openstack/panko-distgit: Import panko spec and supporting files  http://review.rdoproject.org/r/207618:48
*** weshay_bbiab is now known as weshay18:51
*** mwhahaha has quit IRC18:53
*** mwhahaha has joined #rdo18:54
*** xb_ has quit IRC18:59
*** xb_ has joined #rdo19:01
*** Son_Goku has joined #rdo19:01
*** jprovazn has quit IRC19:05
*** fzdarsky|afk is now known as fzdarsky19:08
*** mflobo has quit IRC19:08
flepiedany idea about the timeout in the CI job tripleo-quickstart-promote-master-delorean-minimal_pacemaker ?19:08
*** akshai has quit IRC19:09
dmsimardnumber80: sorry was deep in my code editor didn't see notification. I will19:09
dmsimardtrown: looking19:10
dmsimardtrown: sure, I can push.19:10
trowndmsimard: I think weshay just did it19:10
trownthanks though19:10
dmsimardtrown: np, sorry about that,.19:10
*** pcaruana has quit IRC19:11
*** Guest78236 is now known as melwitt19:14
trownflepied: last I looked at that I could not reproduce it locally... but it took 3 hours to download the CI image. We should have images getting pushed to images.rdoproject.org for the next run so it will be easier to look at it again.19:14
flepiedtrown: nothing in the logs?19:15
*** dpeacock has quit IRC19:17
*** fragatin_ has quit IRC19:17
*** fragatina has joined #rdo19:18
trownflepied: ah most recent one is different19:19
trownflepied: it is just failing to complete the deploy in 90 minutes19:19
trownI guess we need to bump that ... again...19:20
flepiedtrown: should we raise the timeout?19:20
*** pradk- has joined #rdo19:20
*** k4n0 has quit IRC19:20
*** pradk has quit IRC19:21
trownnot sure really... doesnt seem like it should take 90 minutes19:21
*** alexismonville has quit IRC19:21
trownfrom the logs it looks like it was in Step5 of the deploy for 45 minutes before timing out... so it might just be hanging there19:22
*** pradk- is now known as pradk19:22
flepiedwhat is going on on step5?19:22
trownI think that is when all of the services get started19:24
trownEmilienM: step5 is when services are started?19:24
*** tesseract- has quit IRC19:25
*** hynekm has joined #rdo19:25
*** xb_ has quit IRC19:25
*** akshai has joined #rdo19:25
*** pnavarro has quit IRC19:26
trownI do see a bunch of "High CPU" messages in /var/log/messages on the controller at that time... https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal_pacemaker-109/overcloud-controller-0/var/log/messages.gz19:26
*** xb_ has joined #rdo19:27
mwhahahatrown: so i'm getting stuck when it tries to deploy the configs to the under cloud. it's saying data can't be sent to the remote host but i can ssh to the vm just fine. any thoughts?19:28
flepiedtrown: there are a lot of 'openstack-gnocchi-statsd.service holdoff time over'19:28
trownmwhahaha: hmm, what is your command line for quickstart.sh?19:30
*** mcornea has joined #rdo19:30
*** toanju has joined #rdo19:32
*** coolsvap_ has quit IRC19:32
*** mbound has joined #rdo19:32
mwhahahatrown: http://paste.openstack.org/show/567260/19:32
trownmwhahaha: ah... pinche localhost... ansible tries to be smart about localhost and use a local connection, and we have trouble keeping that working19:33
*** nmagnezi has joined #rdo19:34
trownmwhahaha: you can use 127.0.0.2 to workaround it... just make sure you can `ssh root@127.0.0.2` without password19:34
*** Son_Goku has quit IRC19:34
mwhahahano it works fine to localhost19:34
trownthat will use the normal ssh connection that is CI'd19:34
mwhahahait's when it tries to connect to the undercloud ip that it pulled out19:34
trownright but our inventory with proxied configuration to connect to the undercloud breaks19:35
rdogerritMerged rdo-infra/puppet-dlrn: Add option to define number of processes in workers  http://review.rdoproject.org/r/202619:35
dmsimardnumber80: reviewed, feel free to ping me anytime.. I'm not very good at keeping up with new reviews, I'll try and figure out a way to pay attention to them.19:35
mwhahahaugh ok let me see19:35
*** jlibosva has quit IRC19:35
flepiedtrown: found this error: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal_pacemaker-109/overcloud-controller-0/var/log/gnocchi/statsd.log.gz19:40
*** rcernin has joined #rdo19:41
flepiedtrown: EmilienM: gnocci-statsd could be badly configured? ^^19:41
trownflepied: hmm... that does seem like a bug, but I am a bit skeptical that brought things to a grinding halt19:42
flepiedtrown: I agree that's not the central part of the puzzle19:42
trownI am kicking a new run so we get an image to test with19:43
flepiedtrown: ok19:43
*** xb_ has quit IRC19:44
*** rbowen is now known as DrBacchus19:44
flepiedtrown: EmilienM: same thing for metricd19:45
*** xb_ has joined #rdo19:45
trownweshay: dmsimard, I killed liberty and mitaka promotes for this run... really need a master image so we have some chance to get a pass for Thurs.19:45
trownkilling some periodic jobs too19:46
*** sdake has quit IRC19:46
weshaycool19:47
*** weshay is now known as weshay_mtg19:47
*** rcernin has quit IRC19:48
*** pradk has quit IRC19:49
*** xb_ has quit IRC19:52
flepiedpradk: sileht: when you have time, could you take a look at issue 60 in RDO CI job?19:52
mwhahahatrown: so that appears not to work because it's still interpreting it as localhost19:54
trownmwhahaha: 127.0.0.2?19:55
mwhahahayea19:55
mwhahahawell maybe it did, gotta cleanup some stuff i guess19:55
*** eharney has quit IRC19:56
trownI know ansible will interpret 127.0.0.1 as localhost...19:57
trown127.0.0.2 has always been our workaround when we break ansible local connection though19:57
trownwhich has happened a number of times19:57
mwhahahaugh back to failing on libvirt image stuff19:58
*** brault has quit IRC19:58
*** [1]rpioso has joined #rdo19:58
*** brault has joined #rdo19:59
*** brault has quit IRC19:59
*** florianf has quit IRC20:00
*** mvk has quit IRC20:01
*** rpioso has quit IRC20:02
*** sdake has joined #rdo20:03
mwhahahatrown: nope exact same problem20:04
*** hynekm has quit IRC20:05
mwhahahaoh well i'll poke at it some more20:06
trownmwhahaha: I would suggest trying to make a fresh clone of tripleo-quickstart (or making sure you have HEAD of origin/master) and running `bash quickstart.sh --teardown all --no-clone --release master 127.0.0.2`20:07
trownthe --teardown all will remove all previous libvirt stuff that might be messing you up20:07
*** eharney has joined #rdo20:08
trownno-clone will use the git checkout you are in rather than cloning to ~/.quickstart/ which might have got out of date20:08
trownthose are the things that I can think of that might be causing issues20:08
*** alexismonville has joined #rdo20:10
*** jlibosva has joined #rdo20:13
mwhahahanew failures on that20:13
* mwhahaha sighs20:13
mwhahahahttp://artifacts.ci.centos.org/artifacts/rdo/images/master/delorean/stable/undercloud.qcow2.md5 doesn't existing by the way20:13
*** xb_ has joined #rdo20:13
*** jayg is now known as jayg|g0n320:14
*** jpena|away is now known as jpena|off20:15
trownmwhahaha: hmm, you must have stale checkout. I just merged the fix to use images.rdoproject.org instead of artifacts.ci.centos.org20:15
mwhahahai just updated20:15
trownthe second one is rate limited and will take 3+hours to download20:15
mwhahahatime to rm -rf / and try again20:15
dmsimardpabelanger: the upstream dlrn job is failing, troubleshooting20:16
dmsimardlooks like there's a hardcoded gerrit url somewhere20:17
*** pilasguru1 has joined #rdo20:17
*** jlibosva has quit IRC20:17
pabelangerdmsimard: Ooh, nice. Have a log file?20:17
dmsimardpabelanger: oh, wait, actually, that's not right20:18
dmsimardpabelanger: we forgot to create a new job to use the run_upstream_tests.sh script20:18
dmsimardpabelanger: but anyway, the console output: https://review.rdoproject.org/jenkins/job/DLRN-rpmbuild/2110/console20:19
dmsimardsubmitting a fix for the job now.20:19
*** pilasguru has quit IRC20:19
*** pilasguru1 is now known as pilasguru20:19
pabelangerdmsimard: okay, cool20:20
*** mflobo has joined #rdo20:21
trownhmm... image download from rdoproject.org is also going pretty slow... ugh...20:22
EmilienMflepied: back from dentist, looking now20:22
dmsimardtrown: os1, slow ?20:22
EmilienMtrown: flepied, FYI we're tracking down some telemetry issues20:22
EmilienMwith aodh and gnocchi20:22
flepiedEmilienM: are there any open bugs?20:23
trowndmsimard: not artifacts.ci.centos slow... but ya20:23
*** kgiusti has left #rdo20:23
dmsimardtrown: should really try to use the CDN :P20:23
EmilienMflepied: not afik20:24
dmsimardtrown: we tried to understand and fix the md5 mismatch issue while you were out but I wasn't too familiar with it20:24
trowndmsimard: there is a bug open about it... CDN is not usable without fixing that bug20:25
trownhttps://bugs.centos.org/view.php?id=1136720:25
EmilienMflepied: i'll look at it after my current task20:25
flepiedEmilienM: ok thx20:26
trowndmsimard: it is not simply that the md5 is slow to propogate (which is what I originally thought), but that the image sync operation is not atomic, so when an image is in the process of syncing downloads will fail20:26
dmsimardah20:26
trown*rather the md5 is too fast to propogate20:26
trownwe would use CDN in a heartbeat if it worked reliably20:27
trownthis whole OS1 thing was just to try to find some way to make quickstart actually usable again... after having a rate limiter put up with no warning20:28
trownthough it seems like OS1 is not going to be usable either at these speeds :(20:29
* trown would rather be being screamed at by an infant20:30
miscnumber80: ^ you can provide the infant ?20:32
miscinfant as a service20:33
trownlol20:33
trownI have an infant available :)20:33
trownthat does sound like a genius way to get someone to babysit for less than free20:33
*** Tenhi_ has joined #rdo20:35
mischave you tought about HA ?20:39
miscwho will scream if the first one start to sleep or be quiet ?20:39
*** ayoung has quit IRC20:41
*** Goneri has quit IRC20:41
*** aortega has quit IRC20:42
*** Tenhi_ has quit IRC20:42
*** hrw has quit IRC20:43
*** pradk has joined #rdo20:44
*** sreichar has quit IRC20:44
*** mflobo has quit IRC20:46
*** weshay_mtg is now known as weshay20:47
EmilienMpradk: have you seen this before https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal_pacemaker-109/overcloud-controller-0/var/log/gnocchi/statsd.log.gz ?20:50
pradklooking20:50
pradkEmilienM, hmm no.. looks like bad auth data in conf? .. can i look at the gnocchi.conf?20:51
EmilienMweshay, dmsimard: where is /etc/gnocchi and aodh ? https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal_pacemaker-109/overcloud-controller-0/etc/20:51
EmilienMpradk: ^20:51
dmsimardEmilienM, weshay, pradk: it's not here: https://github.com/redhat-openstack/ansible-role-tripleo-collect-logs/blob/master/defaults/main.yml20:52
weshayyup..20:52
weshaycan add it now20:52
EmilienMwe're hardcoding that?20:52
EmilienMbeurk20:52
EmilienMI know a way to not hardcode it20:52
pradk:)20:52
*** fzdarsky has quit IRC20:53
EmilienMhttps://github.com/openstack/puppet-openstack-integration/blob/master/copy_logs.sh#L45-L5220:53
EmilienMweshay: ^ use that snipper20:53
EmilienMsnippet20:53
EmilienMweshay: please add it, and re-run the job I want to see the config20:54
EmilienMpradk: it's probably something with swift config in gnocchi.conf20:54
pradkyea that would be my guess20:55
*** amuller has quit IRC20:56
*** xb_ has quit IRC21:00
rdogerritDavid Moreau Simard created config: Move dlrn job preparation to it's own builder  http://review.rdoproject.org/r/207721:02
rdogerritDavid Moreau Simard created config: Differentiate which DLRN test script to run based on Zuul pipeline  http://review.rdoproject.org/r/207821:02
*** sdake has quit IRC21:02
dmsimardpabelanger: ^21:02
dmsimardpabelanger: there were a couple ways to approach it but this is what I settled with21:02
*** trown is now known as trown|outtypewww21:02
dmsimardpabelanger: I would've probably preferred to use a job-template with DLRN-rpmbuild-downstream and DLRN-rpmbuild-upstream but that makes re-using the DLRN repositories built inside the gate more challenging21:03
*** unclemarc has quit IRC21:03
*** derekh has quit IRC21:05
*** jkilpatr has quit IRC21:05
*** nmagnezi has quit IRC21:05
dmsimardI kept in mind that we'll want to re-use this when implementing the new openstack-post pipeline to build after a merge and do things.21:07
*** xb_ has joined #rdo21:11
*** rhallisey has quit IRC21:12
*** mvk has joined #rdo21:13
*** brandor5 has joined #rdo21:14
rdogerritJavier Peña proposed rdo-infra/puppet-dlrn: Update redirects for current-tripleo and current-passed-ci  http://review.rdoproject.org/r/198221:15
rdogerritJavier Peña proposed rdo-infra/puppet-dlrn: Switch centos-newton worker to stable/newton  http://review.rdoproject.org/r/201621:16
*** dprince has quit IRC21:16
*** null_ref has joined #rdo21:17
rdogerritMerged config: Move dlrn job preparation to it's own builder  http://review.rdoproject.org/r/207721:19
*** aortega has joined #rdo21:20
*** mcornea has quit IRC21:23
rdogerritJavier Peña proposed rdo-infra/puppet-dlrn: Improve compatibility with current Puppet and puppetlabs_spec_helper  http://review.rdoproject.org/r/197521:26
rdogerritJavier Peña proposed rdo-infra/puppet-dlrn: Add new options for gitrepo driver  http://review.rdoproject.org/r/202921:29
*** jcoufal_ has quit IRC21:29
rdogerritJavier Peña proposed rdo-infra/puppet-dlrn: Allow entering a custom baseurl for a worker  http://review.rdoproject.org/r/187921:30
rdogerritJavier Peña proposed rdo-infra/puppet-dlrn: Allow entering a custom baseurl for a worker  http://review.rdoproject.org/r/187921:32
*** rhallisey has joined #rdo21:34
*** mbound has quit IRC21:40
dmsimardweshay, trown|outtypewww: pacemaker was the only failed job in the last run :( https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master/699/21:42
weshaydang21:42
*** ashw has quit IRC21:42
weshayhttps://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal_pacemaker-109/undercloud/home/stack/failed_deployment_list.log.gz21:43
weshaydiff error at least21:43
*** pradk has quit IRC21:43
dmsimardpabelanger: I think if we have your blessing on https://review.rdoproject.org/r/#/c/2078/ we can merge it and it'll work21:45
*** esmiurium has quit IRC21:46
*** brandor5 has left #rdo21:47
*** esmiurium has joined #rdo21:47
apevecweshay, is that with pinned newton3 hash and wasn't that supposed to be a different pipeline?21:50
weshaymaster is not pinned afaik21:51
apevecright, we wanted that tripleo-rdo pipeline for testday promotion21:51
apevecthat was the plan we agreed right?21:51
*** kenhui1 has joined #rdo21:52
*** stevemar has quit IRC21:52
dmsimardapevec: o/ hi21:52
dmsimardlong time no see :p21:52
*** kenhui has quit IRC21:52
apevecreall "see" will be only in BCN :)21:54
dmsimardtrue.21:54
*** jmelvin has quit IRC21:57
apevecweshay, ah so this was 816d https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master-current-tripleo/16/22:00
apevecand it failed22:00
*** rhallisey has quit IRC22:00
apevecweshay, what was the failure?22:00
weshaysec22:00
apevecCREATE aborted ?22:00
apevecwas that just job timeout?22:01
*** jlibosva has joined #rdo22:01
apevecTook 4 hr 19 min  !22:01
apevecthat looks like stuck somewhere22:01
dmsimardI'm out, catch you guys tomorrow o/22:02
number80Enjoy your evening!22:03
*** toanju has quit IRC22:03
number80(and thanks for reviewing puppet-DLRN patchsets)22:03
apevecor midnight :)22:04
weshayapevec, you looking at https://ci.centos.org/job/tripleo-quickstart-promote-master-delorean-minimal_pacemaker/109/console or a diff job22:04
weshayhttps://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-delorean-minimal_pacemaker-109/undercloud/home/stack/failed_deployment_list.log.gz22:05
weshaythat error is from heat.. not jenkins22:05
apevecweshay, I was looking at that other pipeline https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo-delorean-promote-master-current-tripleo/16/22:06
apevecyeah, it's aborted heat overcloud deploy22:06
*** jlibosva has quit IRC22:06
apevecunclear what aborted it?22:06
apevecmaybe jenkins timeout?22:06
apevechmm even minimal takes almost 3h22:07
weshayapetrich, deployment passed on the current-tripleo job https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal_pacemaker-5/undercloud/home/stack/overcloud_deploy.log.gz22:07
apevecso what's diff in rdo-delorean-promote ?22:08
* weshay makes sure I'm looking at the right log22:08
* number80 needs CI experts eyeballs22:08
number80cp: cannot stat ‘DLRN/logs/*’: No such file or directory22:09
number80https://review.rdoproject.org/jenkins/job/DLRN-rpmbuild/2114/console22:09
apevecjust bad luck picking slow ci.centos machines?22:09
number80apevec: twice in a row, that's really bad luck then :)22:09
rdogerritMerged rdoinfo: Add panko project  http://review.rdoproject.org/r/207222:09
weshayah.. no I wasn't.. same error as master https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal_pacemaker-11/undercloud/home/stack/failed_deployment_list.log.gz22:10
*** Goneri has joined #rdo22:10
apevecand Step5 - that's what trown and flepied discussed earlier?22:11
apevecthat's bad, so even 816d has problem w/ tripleo22:11
apevecbut why only pacemaker22:12
apevecis it not the same set of services?22:12
rdogerritMerged DLRN: Fallback to rpm-master when branch is *-rdo  http://review.rdoproject.org/r/202422:15
weshayapevec, was that discussion on #rdo?22:15
apevecweshay, offlist thread, I'm updating it22:16
apevecI wanted CI passed and discuss it on RDO meeting tomorrow22:16
*** priteau has quit IRC22:16
apevecunder testday readiness agenda topic22:16
*** jeckersb_gone is now known as jeckersb22:17
weshayk.. looks like high cpu and Sep  6 07:48:49 localhost systemd: Unit openstack-gnocchi-statsd.service entered failed state.22:17
apevecright, same as noted by flepied earlier here22:18
*** eharney has quit IRC22:18
apevecweshay, ahh you mean "that discussion" trown / flepied ?22:18
weshayya.. I see it22:18
apevecsorry, past midnight here22:18
weshaynp22:19
apevecI'll need few more shots22:19
weshay:)22:19
apevecso that's 60. in https://etherpad.openstack.org/p/delorean_master_current_issues22:19
*** kenhui has joined #rdo22:20
*** kenhui1 has quit IRC22:21
*** priteau has joined #rdo22:22
*** priteau has quit IRC22:26
*** vaneldik has joined #rdo22:26
EmilienMlbragstad: https://review.openstack.org/#/q/topic:keystone/credentials22:27
lbragstadEmilienM sweet - we have another plan too22:27
apevecweshay, ok, re-reading backchat, action was to add missing gnocchi logs and rerun the job?22:28
lbragstadEmilienM https://etherpad.openstack.org/p/keystone-credential-encryption-null-key22:28
lbragstadin case you haven't seen that yet22:28
lbragstadbut that should make your upgrade path a little easier22:28
weshayapevec, that should be merged22:28
* weshay looks22:28
*** alexismonville has quit IRC22:28
*** Goneri has quit IRC22:29
apevecweshay, is job re-run ?22:29
weshaymeh.. waiting on gate22:29
apevecah gate22:29
*** Son_Goku has joined #rdo22:30
EmilienMweshay: did you add gnocchi and aodh config ?22:30
EmilienMlbragstad: ok22:30
EmilienMlbragstad: so all I did is useless?22:31
lbragstadEmilienM nope - it will still be useful22:31
lbragstadbecause you'll forsure need it in the future22:31
EmilienMlbragstad: please review my stuff, it looks secure22:31
weshayEmilienM, it's in the gate right now22:31
lbragstadwhen you guys want to do key rotation22:31
*** jeckersb is now known as jeckersb_gone22:31
EmilienMlbragstad: it's a question?22:32
EmilienMweshay: where?22:32
EmilienMOH WOW22:32
EmilienMsorry22:32
EmilienMwhere is prad22:33
EmilienMtripleo got gnocchi/aodh working22:33
EmilienMweshay: I know why it fails in RDO22:33
rdogerrithguemar created openstack/oslo-context-distgit: Use pypi.io for Source0 URL  http://review.rdoproject.org/r/207922:34
EmilienMsee #tripleo22:34
*** apevec_ has joined #rdo22:34
EmilienMapevec: fyi22:35
rdogerrithguemar proposed openstack/oslo-context-distgit: Use pypi.io for Source0 URL  http://review.rdoproject.org/r/207922:36
*** apevec has quit IRC22:36
apevec_EmilienM, I lost connection, what was fyi?22:36
EmilienMapevec_: see my email22:37
rdogerritMerged openstack/panko-distgit: Import panko spec and supporting files  http://review.rdoproject.org/r/207622:41
apevec_EmilienM, ack22:42
apevec_weshay, so 816d is now abandonware... we'll need latest hash where all those puppet/THT fixes land22:43
EmilienMapevec_: also see https://review.openstack.org/#/q/branch:master+topic:keystone/credentials22:44
EmilienMapevec_: my work to come back on keystone trunk22:44
apevec_ack but let's keep keystone pinned to newton3 for now22:44
apevec_at least for testday repo22:45
EmilienMapevec_: yes, just fyi22:45
*** MrDan has quit IRC22:47
apevec_I see keystone folks have a plan https://etherpad.openstack.org/p/keystone-credential-encryption-null-key22:47
EmilienMwell, my stuff aims to fix us for short term22:48
apevec_and ayoung's proposed no-op will be abandoned? https://review.openstack.org/36508722:48
EmilienMthey might have a plan but release is very soon and we need a plan22:48
EmilienMif nobody comes up with code we'll fail to release newton on time22:48
EmilienMmy patches are not really ugly, we just don't manage the keys with keystone manage22:49
*** kaminohana has joined #rdo22:49
rdogerrithguemar proposed openstack/oslo-context-distgit: Use pypi.io for Source0 URL  http://review.rdoproject.org/r/207922:52
*** akshai has quit IRC22:53
*** aortega has quit IRC22:55
*** rlandy is now known as rlandy|bbl22:55
dhill_https://bugzilla.redhat.com/show_bug.cgi?id=1370653 affects also newton22:56
openstackbugzilla.redhat.com bug 1370653 in rdo-manager "Deploying overcloud fails at step4 of the controllers" [Unspecified,New] - Assigned to hbrock22:56
*** ayoung has joined #rdo23:10
*** sdake has joined #rdo23:10
apevec_dhill_, ^ this should be filed upstream tripleo (and RDO/rdo-manager component removed...)23:13
dhill_apevec_ what do you mean?23:13
apevec_that this is upstream issue, not RDO packaging23:13
dhill_oh23:13
apevec_in RDO bz we file only packaging issues23:13
dhill_ohhhhhh23:14
apevec_and rdo-manager is gone23:14
dhill_so23:14
dhill_the canonical bug report thing you mean?23:14
apevec_https://www.rdoproject.org/blog/2016/02/rdo-manager-is-now-tripleo/23:14
dhill_https://launchpad.net/ ?23:14
dhill_https://launchpad.net/tripleo ?23:15
rdogerrithguemar proposed rdopkg: Fix new-version release tag management  http://review.rdoproject.org/r/203923:15
apevec_http://tripleo.org/contributions/contributions.html#reporting-bugs23:15
apevec_dhill_, yes23:15
dhill_sorry then23:15
dhill_I didn't do it at the right place23:15
dhill_why are we having a BZ ?23:16
dhill_maybe everything should go in launchpad no?23:16
dhill_that would be less confusing for everybody23:16
*** kenhui has quit IRC23:17
*** mengxd has joined #rdo23:20
*** mengxd has quit IRC23:20
apevec_RDO strives to be pure upstream in RPM form but there might be still packaging issues specific to RDO23:20
*** dbecker has joined #rdo23:20
apevec_it's fine to file BZ initially but it should be moved to the right place once triaged23:20
*** akshai has joined #rdo23:22
dhill_cool23:23
dhill_ty23:23
dhill_apevec_23:23
dhill_apevec_ is openstack-selinux also upstream or is it RHEL specific?23:23
*** maeca2 has joined #rdo23:23
apevec_RHEL23:24
*** gildub has joined #rdo23:24
apevec_RDO/openstack-selinux is the right place23:24
dhill_ok23:24
dhill_ty23:24
*** maeca1 has quit IRC23:25
EmilienMapevec_: I got keystone credential working with my work23:26
EmilienMin tripleo23:26
EmilienMapevec_: when my stuff is merged we'll be able to try the unpin in rdo CI23:27
*** mengxd has joined #rdo23:28
apevec_EmilienM, was that with keyston pinned to newton3? credentials change is later23:28
apevec_current-tripleo has .0b3 keystone23:29
EmilienMapevec_: the feature is still available23:29
EmilienMwe'll need credentials after b323:29
EmilienMin other words, my stuff is required to run latest keystone23:30
rdogerritMerged rdo-infra/puppet-dlrn: Update redirects for current-tripleo and current-passed-ci  http://review.rdoproject.org/r/198223:32
*** akshai has quit IRC23:33
*** mengxd has quit IRC23:35
*** mengxd has joined #rdo23:36
*** iranzo has quit IRC23:38
*** mengxd has quit IRC23:38
*** mengxd has joined #rdo23:41
EmilienMapevec_: it's in gate now.23:44
*** mengxd has quit IRC23:48
*** jlibosva has joined #rdo23:49
*** kenhui has joined #rdo23:49
*** jlibosva has quit IRC23:54
*** mengxd has joined #rdo23:56
*** mengxd has quit IRC23:57
*** mengxd has joined #rdo23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!