Wednesday, 2018-01-10

*** apetrich has quit IRC00:00
*** apetrich has joined #rdo00:01
*** mary_grace has quit IRC00:01
rdogerritrdo-trunk created rdoinfo master: Bump rdoinfo pike tags to latest upper-constraints  https://review.rdoproject.org/r/1125900:04
rdogerritrdo-trunk created rdoinfo master: Bump rdoinfo queens-uc tags to latest upper-constraints  https://review.rdoproject.org/r/1126000:04
rdogerritrdo-trunk created rdoinfo master: Promote CBS tags update for newton-release  https://review.rdoproject.org/r/1126100:04
rdogerritrdo-trunk proposed rdoinfo master: Promote CBS tags update for ocata-release  https://review.rdoproject.org/r/1119600:05
rdogerritrdo-trunk created rdoinfo master: Promote CBS tags update for pike-release  https://review.rdoproject.org/r/1126200:06
*** mary_grace has joined #rdo00:08
*** rlandy has quit IRC00:24
rdogerritrdo-trunk created openstack/nova-distgit newton-rdo: Update to 14.1.0  https://review.rdoproject.org/r/1126300:34
tristanCweshay: dmsimard: well we just need to add "grafana" and "influxdb" to the arch file and re-run sfconfig, it shouldn't take more than 10 minutes. We just need to figure out where to run those services00:35
*** andymccr has quit IRC00:36
*** andymccr has joined #rdo00:40
*** MrAbaddon has joined #rdo00:44
*** rdogerrit has quit IRC00:45
*** wolverineav has quit IRC00:49
*** andymccr has quit IRC00:51
*** dneary_ has joined #rdo00:53
*** jlabarre has quit IRC00:54
*** Son_Goku has quit IRC00:55
*** andymccr has joined #rdo00:55
*** dneary has quit IRC00:56
*** amuller has quit IRC00:58
*** Son_Goku has joined #rdo00:59
*** jayg is now known as jayg|g0n300:59
*** Son_Goku has quit IRC01:01
*** Son_Goku has joined #rdo01:05
*** numans has quit IRC01:16
*** numans has joined #rdo01:17
*** daidv has quit IRC01:18
*** daidv has joined #rdo01:19
*** MrAbaddon has quit IRC01:22
*** Son_Goku has quit IRC01:22
*** Son_Goku has joined #rdo01:25
*** Son_Goku has quit IRC01:34
*** MrAbaddon has joined #rdo01:34
*** liujiong has joined #rdo01:36
*** rdogerrit has joined #rdo01:38
rdogerritEmilien Macchi proposed rdoinfo master: Bump rdoinfo pike tags to latest upper-constraints  https://review.rdoproject.org/r/1125901:38
*** Son_Goku has joined #rdo01:38
rdogerritEmilien Macchi proposed rdoinfo master: Promote CBS tags update for pike-release  https://review.rdoproject.org/r/1126201:38
rdogerritMerged rdoinfo master: Promote CBS tags update for ocata-release  https://review.rdoproject.org/r/1119601:40
*** Eran_Kuris has quit IRC01:42
*** Eran_Kuris has joined #rdo01:42
*** d0ugal has quit IRC01:43
*** Son_Goku has quit IRC01:50
*** Son_Goku has joined #rdo01:52
*** rfolco has joined #rdo01:58
*** d0ugal has joined #rdo02:02
*** dsneddon has quit IRC02:17
*** Son_Goku has quit IRC02:32
*** thrash is now known as thrash|g0ne02:33
*** Son_Goku has joined #rdo02:36
*** athomas has quit IRC02:42
*** athomas has joined #rdo02:43
*** Son_Goku has quit IRC02:46
*** Son_Goku has joined #rdo02:51
*** paragan has joined #rdo02:56
*** sasha2 has quit IRC03:05
*** Son_Goku has quit IRC03:10
*** shreshtha has joined #rdo03:15
*** Son_Goku has joined #rdo03:17
rdogerritMerged rdoinfo master: Promote CBS tags update for newton-release  https://review.rdoproject.org/r/1126103:19
*** shreshtha has quit IRC03:21
*** shreshtha has joined #rdo03:21
*** Son_Goku has quit IRC03:30
*** jistr has quit IRC03:31
rdogerritMerged rdoinfo master: Bump rdoinfo queens-uc tags to latest upper-constraints  https://review.rdoproject.org/r/1126003:33
rdogerritMerged rdoinfo master: Bump rdoinfo pike tags to latest upper-constraints  https://review.rdoproject.org/r/1125903:33
rdogerritrdo-trunk created openstack/oslo-serialization-distgit pike-rdo: Update to 2.20.2  https://review.rdoproject.org/r/1126403:34
*** chlong has joined #rdo03:34
*** shadower has quit IRC03:42
*** Son_Goku has joined #rdo03:54
*** udesale has joined #rdo03:59
*** mary_grace has quit IRC04:01
*** mary_grace has joined #rdo04:01
*** mary_grace has quit IRC04:02
*** liujiong has quit IRC04:24
*** mary_grace has joined #rdo04:28
*** rdobot has joined #rdo04:36
*** ChanServ sets mode: +v rdobot04:36
*** links has joined #rdo04:37
*** julim has quit IRC04:39
*** liujiong has joined #rdo04:39
*** links has quit IRC04:40
*** janki has joined #rdo04:41
*** Son_Goku has quit IRC04:43
*** links has joined #rdo04:46
*** shreshtha has quit IRC04:54
*** ykarel has joined #rdo04:58
*** coolsvap has joined #rdo04:59
*** shreshtha has joined #rdo05:00
*** imcleod has quit IRC05:02
*** karthiks has joined #rdo05:10
*** artom_ has quit IRC05:11
*** paragan has quit IRC05:20
*** paragan has joined #rdo05:22
EmilienMchandankumar: tripleo ci promotion is also broken now https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/477bf19/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-01-10_03_04_0205:25
EmilienMweshay: ^05:26
*** mary_grace has joined #rdo05:26
EmilienMchandankumar: it breaks all the promotion jobs https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master/291121b/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-01-10_02_48_0905:28
* EmilienM out05:30
*** mary_grace has quit IRC05:30
EmilienMchandankumar: https://bugs.launchpad.net/tripleo/+bug/174236705:34
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)05:34
*** mary_grace has joined #rdo05:34
*** artom has joined #rdo05:37
*** mary_grace has quit IRC05:39
*** mary_grace has joined #rdo05:43
*** lkuchlan has joined #rdo05:47
*** shep__ has quit IRC05:48
EmilienMchandankumar: if you can have a look, that would be great, thanks! See you tomorrow05:50
*** dpawar has joined #rdo05:57
*** rbartal has joined #rdo05:58
*** mary_grace has quit IRC06:01
*** jbadiapa has quit IRC06:02
*** karthiks has quit IRC06:04
*** oanson has joined #rdo06:06
*** racedo has joined #rdo06:10
*** racedo has quit IRC06:10
ykarelEmilienM, chandankumar poi also broken06:15
*** chlong has quit IRC06:16
*** oanson has quit IRC06:18
chandankumarholy shit!06:19
*** oanson has joined #rdo06:22
*** jbadiapa has joined #rdo06:26
*** pcaruana has joined #rdo06:27
*** dbecker_ has quit IRC06:30
*** jbadiapa has quit IRC06:30
*** owlbot has quit IRC06:32
*** pcaruana has quit IRC06:33
*** pcaruana has joined #rdo06:34
*** karthiks has joined #rdo06:34
*** fragatina has quit IRC06:36
ykarelchandankumar, EmilienM consistent repo is not in sync, checking why06:36
*** dbecker_ has joined #rdo06:43
*** shreshtha has quit IRC06:43
ykarelthere is no current FTBFS, still consistent is not in sync with current.06:44
*** shreshtha has joined #rdo06:44
*** shreshtha has quit IRC06:46
*** shreshtha has joined #rdo06:46
*** sbulage has joined #rdo06:49
*** mosulica has joined #rdo06:49
*** agurenko has joined #rdo06:51
ykarelchandankumar, EmilienM the issue is https://github.com/rdo-packages/ironic-tempest-plugin-distgit doesn't exist06:54
*** ykarel_ has joined #rdo06:57
*** udesale__ has joined #rdo06:57
*** udesale has quit IRC06:59
*** ykarel has quit IRC07:00
*** mary_grace has joined #rdo07:00
*** egonzalez has joined #rdo07:02
*** lkuchlan has quit IRC07:07
*** masber has quit IRC07:08
*** matbu has quit IRC07:08
*** absubram has joined #rdo07:13
*** dpawar has quit IRC07:14
*** rcernin has quit IRC07:15
*** sbonazzo has joined #rdo07:16
*** sbulage is now known as sbulage|lunch07:18
*** jbadiapa has joined #rdo07:18
*** udesale has joined #rdo07:19
*** udesale has quit IRC07:20
*** oidgar has joined #rdo07:20
*** udesale__ has quit IRC07:21
*** matbu has joined #rdo07:21
*** lkuchlan has joined #rdo07:22
chandankumarnumber80: jpena|off amoralej|off https://review.rdoproject.org/r/#/c/10513/607:23
chandankumarironic-tempest-plugin distgit missing from github.com/rdo-packages07:23
chandankumarDLRN does not build the package07:23
chandankumarplease have a look07:23
*** ykarel__ has joined #rdo07:24
rdogerritMerged rdoinfo master: Promote CBS tags update for pike-release  https://review.rdoproject.org/r/1126207:24
*** ykarel_ has quit IRC07:27
*** emalikov has joined #rdo07:30
*** sileht has quit IRC07:31
rdogerritYatin Karel created rdoinfo master: Use review.rdoproject.org instead of github.com  https://review.rdoproject.org/r/1126507:31
*** dpawar has joined #rdo07:31
rdogerritYatin Karel proposed rdoinfo master: Use review.rdoproject.org instead of github.com  https://review.rdoproject.org/r/1126507:31
ykarel__chandankumar, Temp fix ^^, looking now why projects are not created in github and what syncs it with review.rdoproject.org07:33
chandankumarykarel__: ack merging it07:35
*** owlbot has joined #rdo07:36
*** threestrands has quit IRC07:36
rdogerritMerged rdoinfo master: Use review.rdoproject.org instead of github.com  https://review.rdoproject.org/r/1126507:37
ykarel__chandankumar, we might need a dummy commit in ironic-tempest-plugin if it's not there dlrn build in some time07:42
ykarel__https://trunk.rdoproject.org/centos7-master/report.html07:42
*** amoralej|off is now known as amoralej07:42
amoralejgood morning07:42
*** owlbot has quit IRC07:43
*** ykarel__ is now known as ykarel|lunch07:43
rdogerritYatin Karel created openstack/ironic-tempest-plugin-distgit rpm-master: Dummy commit to force build  https://review.rdoproject.org/r/1126607:43
*** lkuchlan has quit IRC07:44
ykarel|lunchamoralej, good morning07:44
ykarel|lunchcan you check why project is not created in github.com07:44
amoralejwhich one?07:44
ykarel|lunchironic-tempest-plugin-distgit07:44
amoralejok, lemme check07:44
amoralejyes, it doesn't07:45
amoraleji'll create it07:45
ykarel|lunchis it manual?07:45
amoralejyes07:46
amoralejwe use a script07:46
amoralejbut it's executed manually when we create a new project in review.r.o07:46
*** lkuchlan_wfh has joined #rdo07:47
amoralejykarel|lunch, it's created now07:49
*** owlbot has joined #rdo07:50
*** lkuchlan_wfh has quit IRC07:53
*** matbu has quit IRC07:54
*** rgogunskiy has joined #rdo07:57
*** KarlchenK has joined #rdo07:59
*** avivgt has joined #rdo08:03
*** gkadam has joined #rdo08:04
ykarel|lunchOk, Thanks08:06
*** lkuchlan has joined #rdo08:07
ykarel|lunchamoralej, can you rekick https://ci.centos.org/view/rdo/view/weirdo-pipelines/view/weirdo-promote-puppet/08:08
*** shardy has joined #rdo08:09
amoralejykarel|lunch, done08:10
*** pgadiya has joined #rdo08:11
*** jtomasek has joined #rdo08:11
*** clecomte has joined #rdo08:12
*** hseipp has joined #rdo08:12
*** sbulage|lunch is now known as sbulage08:13
*** tesseract has joined #rdo08:14
*** dsneddon has joined #rdo08:17
*** florianf has joined #rdo08:18
*** jparrill has joined #rdo08:18
*** agurenko has quit IRC08:19
*** KarlchenK has quit IRC08:19
*** karthiks has quit IRC08:20
*** karimb has joined #rdo08:21
*** agurenko has joined #rdo08:21
*** jlibosva has joined #rdo08:25
*** aufi has joined #rdo08:30
*** fzdarsky has joined #rdo08:31
*** dmacpher has joined #rdo08:32
*** karthiks has joined #rdo08:32
*** cshastri has joined #rdo08:34
*** KarlchenK has joined #rdo08:36
*** ykarel|lunch is now known as ykarel08:37
*** ragiman has joined #rdo08:40
*** KarlchenK has quit IRC08:44
*** karthiks has quit IRC08:44
*** jpena|off is now known as jpena08:45
jpenagood morning08:46
*** hseipp has quit IRC08:47
number80o/08:47
*** michealb has joined #rdo08:49
*** hseipp has joined #rdo08:49
*** racedo has joined #rdo08:51
*** jaosorior has joined #rdo08:54
*** jistr has joined #rdo08:57
*** karthiks has joined #rdo08:59
*** MrAbaddon has quit IRC09:00
*** jpich has joined #rdo09:02
amoralejykarel, puppet promotion passed09:02
ykarelamoralej, yes checked09:02
*** mosulica has quit IRC09:04
rdogerritYatin Karel created rdoinfo master: Revert "Use review.rdoproject.org instead of github.com"  https://review.rdoproject.org/r/1126809:05
ykarelamoralej, chandankumar ^^09:05
*** owalsh has quit IRC09:09
*** arif-ali has quit IRC09:10
*** owalsh has joined #rdo09:10
*** chem has joined #rdo09:10
rdogerritMerged openstack/oslo-serialization-distgit pike-rdo: Update to 2.20.2  https://review.rdoproject.org/r/1126409:11
*** lkuchlan has quit IRC09:13
*** jpich has quit IRC09:14
ykarelamoralej, have you looked for the failure in scenario002 for swift revert09:14
amoralejykarel, that's the same issue as in the past, right?09:14
amoraleji just wanted to check we can gate it09:14
*** mosulica has joined #rdo09:14
ykarelamoralej, no09:15
ykareli think it was some other issue09:15
ykarelchecking again09:15
chemamoralej: hi, happy everything.09:15
chemamoralej: I have a question about repo priority.  It seems that it causes a bug during the o->p where some critical packages are not updated, here's the review that explain it all https://review.openstack.org/#/c/532370/09:15
amoralejykarel, ok09:15
amoralejykarel, was any fix applied in p-o-i or puppet-swift?09:16
amoralejchem, lemme check09:16
ykarelamoralej, in p-o-i it was applied09:16
chemamoralej: ack thanks09:17
ykarelamoralej, https://review.openstack.org/#/c/518509/09:17
*** jpich has joined #rdo09:17
amoralejchem, we need priorities09:17
amoralejchem where are you getting the initial issue?09:18
chemamoralej: oki, but then a lot of packages are not updated because of that as delorean has older package than pike-testing09:18
chemamoralej: this one https://bugs.launchpad.net/tripleo/+bug/1735697 for instance09:18
openstackLaunchpad bug 1735697 in tripleo "O->P fails during AllNodesPostUpgradeSteps.ControllerDeployment_Step1 on haproxy docker." [Critical,Triaged] - Assigned to Sergii Golovatiuk (sgolovatiuk)09:18
chemamoralej: we don't have the right puppet-pacemaker package (but a lot other are too old on delorean relative to pike-testing)09:19
amoralejwhen using delorean repos09:19
amoralejbuildlogs should only be used for dependencies09:19
amoralejall the rest should be installed from delorean09:19
amoralejthere should not be newer packages in buildlogs that in delorean09:20
amoralejlet me see puppet-pacemaker09:20
*** sileht has joined #rdo09:20
chemamoralej: ack.09:20
amoralejchem puppet-pacemaker in https://trunk.rdoproject.org/centos7-pike/current-passed-ci/ is puppet-pacemaker-0.6.1-0.20171103172230.9a46ecd.el7.centos.noarch.rpm09:21
amoralejand in https://buildlogs.centos.org/centos/7/cloud/x86_64/openstack-pike/?C=M;O=A it's puppet-pacemaker-0.6.0-1.e0f9c42git.el7.noarch.rpm09:22
amoralejthat's correct09:22
ykarelamoralej, older logs do not exist. But i remember earlier swift services were started but right now they can't start09:22
amoralejykarel, are there any logs?09:22
chemamoralej: well it's not somehow, as the 20171103172230 doesn't have the puppet packame pike code09:23
chemamoralej: while the e0f9c42git has09:23
rdogerritMerged openstack/ceilometer-distgit pike-rdo: Update to 9.0.4  https://review.rdoproject.org/r/1124609:23
ykarelamoralej, current logs are here: https://logs.rdoproject.org/48/11248/1/experimental/gate-weirdo-dlrn-master-puppet-scenario002/Zb21dbebd531343ceab4d932b25656ece/weirdo-project/puppet.txt.gz and older logs do not exist at logs.rdoproject.org09:23
chemamoralej: if you're in the middle of something I can wait ... in less than 1hours I will have an env for you to check, that may be easier ?09:24
amoralejchem, so the actual problem is that puppet-pacemaker in pike delorean is missing some patch?09:24
amoralejchem, yes please, logs links in https://bugs.launchpad.net/tripleo/+bug/1735697 are not longer available09:25
openstackLaunchpad bug 1735697 in tripleo "O->P fails during AllNodesPostUpgradeSteps.ControllerDeployment_Step1 on haproxy docker." [Critical,Triaged] - Assigned to Sergii Golovatiuk (sgolovatiuk)09:25
ykarelamoralej, puppet-pacemaker is pinned in rdo: https://github.com/redhat-openstack/rdoinfo/blob/master/rdo.yml#L128209:25
chemamoralej: basically all the pike related one09:26
amoralejchem, what does "all" mean?09:26
amoralejall the pike?09:26
chemamoralej: checking the logs (all means everything needed to handle the new bundle pacemaker architecture related to container)09:26
amoralejchem, puppet-pacemaker doesn't have stable/pike branch so we pin it to a specific commit09:28
amoralejwe may need to update the pin09:28
amoralejwhat commit do you need?09:28
chemamoralej: oki, make sense.  I'm going to check with pidone team and get back with a proper answer.09:29
amoralejhttps://github.com/redhat-openstack/rdoinfo/blob/master/rdo.yml#L128209:29
amoralejchem, but what surprises me is that commit  e0f9c42git has something that is not in puppet-pacemaker-0.6.1-0.20171103172230.9a46ecd.el7.centos.noarch.rpm09:30
amoralejas 9a46ecd is newer09:30
*** jpich has quit IRC09:31
*** lucas-afk is now known as lucasagomes09:31
chemamoralej: it is and when I use that I don't have the issue anymore09:31
chemamoralej: advice from pidone "take the latest tip as of today"09:33
chemamoralej: I guess it would it help if we create the the stable/pike there09:34
amoralejcan you send a review to update the pin?09:34
amoralejto rdoinfo09:34
*** michealb has quit IRC09:35
chemamoralej: oki, trying and getting back to you if I can't make sense of that sentence :)09:35
amoralejykarel, "Ring file /etc/swift/object.ring.gz not found, probably it hasn't been written yet"09:36
amoralejcschwede, we are doing some tests unpining swift with p-o-i and we are hitting ^09:36
rdogerritJavier Peña proposed openstack/oslo-messaging-distgit rpm-master: Switch doc builds back to sphinx-build  https://review.rdoproject.org/r/1125709:36
amoralejcschwede, https://logs.rdoproject.org/48/11248/1/experimental/gate-weirdo-dlrn-master-puppet-scenario002/Zb21dbebd531343ceab4d932b25656ece/weirdo-project/puppet.txt.gz09:36
amoralejis that a new issue?09:36
ykarelamoralej, cschwede i have reproduced it locally,09:37
ykarelif you need access let me know09:37
amoralejswift.common.exceptions.EmptyRingError: There are no devices in this ring, or all devices have been deleted09:37
ykarelyes same i can see locally running: /usr/bin/swift-ring-builder /etc/swift/object.builder09:38
*** hewbrocca_afk is now known as hewbrocca09:39
*** arif-ali has joined #rdo09:40
*** liujiong has quit IRC09:40
*** rbartal has quit IRC09:40
cschwedeamoralej: looking09:42
*** derekh has joined #rdo09:42
*** ykarel has quit IRC09:44
*** ykarel has joined #rdo09:44
*** jpich has joined #rdo09:44
cschwedeamoralej, ykarel: yep, that's a new one. looking for a fix.09:46
ykarelcschwede, Ok09:46
*** avivgt has quit IRC09:46
*** jfrancoa has joined #rdo09:46
ykarelcschwede, if you need environment access let me know09:47
*** mcornea has joined #rdo09:48
rdogerritJavier Peña proposed openstack/oslo-versionedobjects-distgit rpm-master: Switch doc builds back to sphinx-build  https://review.rdoproject.org/r/1125609:48
*** fzdarsky has quit IRC09:48
chemamoralej: wrong channel09:48
rdogerritMerged rdoinfo master: Revert "Use review.rdoproject.org instead of github.com"  https://review.rdoproject.org/r/1126809:52
*** KarlchenK has joined #rdo09:55
rdogerritJavier Peña proposed openstack/oslo-rootwrap-distgit rpm-master: Switch doc builds back to sphinx-build  https://review.rdoproject.org/r/1125509:56
amoralejchem, you need to update https://github.com/redhat-openstack/rdoinfo/blob/master/rdo.yml#L1282 whith the commit you want to use for pike09:57
cschwedeamoralej, ykarel: there is a lp already for this issue: https://bugs.launchpad.net/swift/+bug/1737068 however, it's not yet fixed, i'm looking into it09:57
openstackLaunchpad bug 1737068 in OpenStack Object Storage (swift) "ringbuilder traceback when displaying ring with all devices removed" [Low,Fix released]09:57
amoralejcschwede, so the patches in that LP doesn't actually fix it?09:58
cschwedeamoralej: nope09:58
*** jpich has quit IRC09:59
rdogerritAlfredo Moralejo proposed rdoinfo master: Remove under-review tag of rsdclient project  https://review.rdoproject.org/r/1119710:01
*** avivgt has joined #rdo10:02
*** kopecmartin has joined #rdo10:04
*** stevebaker has quit IRC10:06
*** dmellado has quit IRC10:06
*** rdobot has quit IRC10:07
*** dmellado has joined #rdo10:07
*** apevec has joined #rdo10:11
*** agurenko has quit IRC10:12
*** agurenko has joined #rdo10:13
*** tosky has joined #rdo10:14
*** emalikov has quit IRC10:14
*** ccamacho has joined #rdo10:15
*** jpich has joined #rdo10:18
*** threestrands has joined #rdo10:21
*** sbulage is now known as sbulage|brb10:22
*** emalikov has joined #rdo10:22
*** dtantsur|afk is now known as dtantsur10:24
*** fzdarsky has joined #rdo10:25
apevecinteresting tidbit of info: rdoinfo/rdo.yml has 122 contributors10:28
apevecamoralej, jpena - why can't github mirror repo creation be automated?10:29
*** coolsvap has quit IRC10:29
amoralejapevec, i think there is an use story about it10:29
apevecbtw I still think we should get off github...10:29
amoralejit's probably a matter of priorizing it10:29
apevecok10:29
*** paragan has quit IRC10:31
chemamoralej: oki, I was trying to make sense of all this, as the version in rdo.yml would be more than enough10:31
jpenaapevec: we had https://tree.taiga.io/project/morucci-software-factory/us/105 for it. For the github project creation, it should be doable as a post job for the config repo. However, it will require some checks10:32
chemamoralej: so on the env, I have this installed somehow https://ptpb.pw/Gmh-10:32
* jpena adds it to the short-term to-do10:32
*** jpich has quit IRC10:32
amoralejchem, ok i know what's the problem10:33
chemamoralej: it is the tip of stable/0.6.x so that would match what's in rdo.yml but the naming is strange to me (it's not puppet-pacemaker-0.5.0 something)10:33
chemamoralej: ah :)10:33
*** MrAbaddon has joined #rdo10:34
amoralejthey have not push any tag in master after branching 0.610:34
amoralejso we are getting 0.6.1 both in master and in branch stable 0.6.x10:34
amoralejso the newer commit wins10:34
*** gszasz has joined #rdo10:34
*** fzdarsky has quit IRC10:34
amoralejlet me double check one thing...10:34
*** stevebaker has joined #rdo10:35
amoralejyeah, that's the problem10:35
amoralejchem, the best solution is to push a new tag 0.7.0 or something like that in master10:36
amoralejand build it10:36
amoralejin the trunk or in the commit we are building10:36
rdogerritMerged rdoinfo master: Remove under-review tag of rsdclient project  https://review.rdoproject.org/r/1119710:36
amoralejchem, can you request them tu push it?10:36
chemamoralej: so there is some work underway it seems https://github.com/openstack/puppet-pacemaker/commit/b21823aa86f80511b63fdd59533b7a7077c8ac5610:37
chemamoralej: I don't yet know how to do it, but will make sure it happens soon10:37
chemamoralej: then we will need to update rdo.yml with source-branch: stable/0.7.x and then it will build a 0.7.0 package and we will be happy :) right ?10:38
cschwedeamoralej, ykarel: re swift errors from above - i opened another bug: https://bugs.launchpad.net/swift/+bug/1742417 and proposed two patches: https://review.openstack.org/#/c/532482/ and https://review.openstack.org/#/c/532484/10:38
openstackLaunchpad bug 1742417 in OpenStack Object Storage (swift) "swift-ring-builder exit code changed from 0 to 1 for empty rings" [Undecided,New]10:38
amoralejchem, could you propose to move the pin to that commit?10:38
apevechmm, DLRN should use version from metadata.json, lemme check10:38
amoralejapevec, yes10:38
amoralejbut we have a previous commit pinned10:39
apevecso what's the problem?10:39
apevecon master?10:39
amoralejyes10:39
amoralejthere was not pre-release10:39
amoralejin master10:39
amoralejand the 0.7.0 was releases port pike GA10:39
amoralejso we have 0.6.110:39
amoralejam i explaining it clear?10:40
chemamoralej: hum I see if we get to that commit, then we get new metadata.json and it automatically will build the rigth version number10:40
amoralejexactly10:40
apevecwait, queens-uc: is not pinned for puppet-pacemaker?10:40
amoralejapevec, we are talking about pike10:41
amoralejthe problem is the update from ocata to pike10:41
apevecah, I thought issue is upgrade to master(Queens)10:41
apevecso ocata is pinned to stable/0.6.x branch10:42
apevecwhy is pike not also on branch?10:42
*** rdobot has joined #rdo10:43
*** ChanServ sets mode: +v rdobot10:43
amoralejbecause at pike development cycle it was following master10:43
amoralejso moving to stable branch10:43
amoralejin GA was actually moving back10:43
amoralejso we pinned in master10:43
amoralejand in fact, i think they need commits in master10:43
amoralejchem ^ is that correct?10:45
chemamoralej: as I see it the current commit would be good enought, but the version (0.6.0) was preventing the upgrade from ocata as the ocata one as a later date in its branch10:46
apevecI see there isn't stable/0.7.x10:46
amoralejchem, exactly10:47
chems/as/has/10:47
amoralejchem can you send the update to rdo.yml?, i can do it if not10:48
chemamoralej: doing it right now10:48
amoralejok10:48
apevecyou can just move it to the commit bumping to 0.7.0 in metadata.json10:48
*** stevebaker has quit IRC10:48
apevecor latest master if maintainers say that's ok10:48
apevecfor Pike10:48
rdogerritAlfredo Moralejo proposed rdoinfo master: Update the openstack-macros package in -testing  https://review.rdoproject.org/r/1108710:49
*** dmellado has quit IRC10:49
amoralejapevec, jpena, number80 don't merge anything in rdoinfo until https://review.rdoproject.org/r/#/c/11087/ is merged10:49
amoralejto avoid more rebases10:49
jpenaack10:49
amoralejif jobs fail i'll ninja merge it10:49
apevecamoralej, we can10:49
amoralejwe are not testing it in the gate jobs anyway10:49
apevec't avoid those rebases?10:50
apevecit was discussed at one point to change merge policy?10:50
amoralejapevec, it has some problems10:50
amoralejwe discussed it in a meeting10:50
amoraleji think i have some notes...10:50
chemamoralej: I'm resolving a slight mail issue, the patch will be there in a few moments10:50
*** jpich has joined #rdo10:51
amoralejapevec, the problem is that, at some point we need to test reviews to rdoinfo sequentially10:52
amoralejand as we don't run deployment jobs in gate, only in check10:52
amoralejwe can't10:52
*** anilvenkata_ has quit IRC10:53
rdogerritUser sathlan created rdoinfo master: Bump puppet-pacemaker for pike.  https://review.rdoproject.org/r/1126910:53
chemamoralej: ^10:53
rdogerritSagi Shnaidman proposed config master: Send notifications when jobs start in OpenStack pipelines  https://review.rdoproject.org/r/1081310:53
rdogerritUser sathlan proposed rdoinfo master: Bump puppet-pacemaker for pike.  https://review.rdoproject.org/r/1126910:53
amoralejapevec some notes https://etherpad.openstack.org/p/rdoinfo-rebases10:53
rdogerritMerged config master: Send notifications when jobs start in OpenStack pipelines  https://review.rdoproject.org/r/1081310:54
*** mosulica has quit IRC10:55
*** rgogunskiy has quit IRC10:57
*** avivgt has quit IRC10:58
*** avivgt has joined #rdo10:58
*** sbulage|brb is now known as sbulage11:02
*** lkuchlan has joined #rdo11:03
*** pkovar has joined #rdo11:03
*** mosulica has joined #rdo11:03
*** stevebaker has joined #rdo11:04
*** anilvenkata_ has joined #rdo11:07
*** egallen has joined #rdo11:08
*** Son_Goku has joined #rdo11:11
ykarelcschwede, Thanks11:12
*** dmellado has joined #rdo11:23
*** mosulica has quit IRC11:29
*** bsurfer has quit IRC11:29
*** dmellado has quit IRC11:32
*** dmellado has joined #rdo11:34
*** mosulica has joined #rdo11:35
*** d0ugal has quit IRC11:39
*** shreshtha has quit IRC11:41
chandankumarnumber80: apevec ykarel i will be skipping today's meeting11:42
*** paragan has joined #rdo11:43
ykarelnumber80, chandankumar apevec amoralej me too11:43
*** jkilpatr has quit IRC11:44
jpenall11:47
*** morazi has quit IRC11:51
*** ccamacho has quit IRC11:52
*** hewbrocca is now known as hewbrocca_afk11:53
*** ccamacho has joined #rdo11:56
*** d0ugal has joined #rdo11:57
number80ack11:58
number80fill the agenda if you have topics you want to be discussed11:58
*** shardy is now known as shardy_lunch12:03
*** SoR has joined #rdo12:04
rdogerritJon Schlueter created openstack/mox3-distgit rpm-master: move openstack-macros to top level BR  https://review.rdoproject.org/r/1127012:05
SoRHello all, could you tell me where I can find older version of https://www.rdoproject.org/install/upgrading-rdo/ (I'm interested in Liberty to Mitaka upgrade)?12:05
*** jayg|g0n3 is now known as jayg12:09
*** Eran_Kuris has quit IRC12:09
*** MrAbaddon has quit IRC12:10
*** absubram has quit IRC12:10
*** MrAbaddon has joined #rdo12:14
*** jkilpatr has joined #rdo12:16
*** mosulica has quit IRC12:16
jpenaapevec: looking at github project creation automation, I see we have a user called "rdoproject" in the rdo-packages organization. Do you own that user?12:17
*** bfournie has quit IRC12:18
*** bfournie has joined #rdo12:19
*** rgogunskiy has joined #rdo12:20
*** pgadiya has quit IRC12:20
*** mosulica has joined #rdo12:21
*** bfournie has quit IRC12:24
*** rhallisey has joined #rdo12:24
number80Duck: would you consider to go at the Tokyo openstack ops meetup? Since you're local => https://wiki.openstack.org/wiki/Operations/Meetups12:26
*** lucasagomes is now known as lucas-hungry12:27
*** janki has quit IRC12:27
*** julim has joined #rdo12:27
apevecjpena, not that I remember, but my mem is not reliable12:31
apevec...Joined GitHub on July 6, 201612:32
number80possibly me12:33
apevechttps://github.com/rdo-packages/puppet-oslo-distgit/commit/743d913504d62a71a767378dd9331f67c707da8f12:34
*** jlabarre has joined #rdo12:34
apevecthat was SF ?12:34
number80Seems it was12:34
number80mhu: ^12:34
apevecand https://github.com/rdo-packages/murano-distgit/commit/167023e201e35883ae8d75b0151ea96c0297c1cf12:34
apevecthat's only two commits by that user12:34
* number80 created users rdo-something but was supposed to remove them access12:35
*** sbulage is now known as sbulage|brb12:35
*** mosulica has quit IRC12:37
*** mosulica has joined #rdo12:38
Ducknumber80: not alone, I know nothing about OpenStack :-)12:39
Ducknumber80: I come back end of february after FOSDEM & co & vacation, so maybe the October one would do12:39
Duckplease come12:40
number80Duck: ack12:40
Ducklet's go together12:40
number80well, I wanted to see japanese autumn12:40
Duckperfect12:40
Ducklet's mail and organize12:41
* number80 has plenty of vacations12:41
*** wolverineav has joined #rdo12:42
*** atoth has joined #rdo12:42
*** emalikov has quit IRC12:44
*** shardy_lunch is now known as shardy12:47
rdogerritJavier Peña created config master: [WIP] Automate GitHub repo creation for new project distgits  https://review.rdoproject.org/r/1127112:48
*** jpena is now known as jpena|lunch12:48
*** fzdarsky has joined #rdo12:53
*** fzdarsky has quit IRC12:56
*** nijaba is now known as nbarcet12:57
*** links has quit IRC12:58
*** bfournie has joined #rdo12:59
*** gfidente has joined #rdo13:00
*** gfidente has quit IRC13:00
*** gfidente has joined #rdo13:00
*** amoralej is now known as amoralej|lunch13:00
*** morazi has joined #rdo13:00
*** mosulica has quit IRC13:00
*** hseipp has quit IRC13:01
*** mosulica has joined #rdo13:04
*** ccamacho has quit IRC13:04
*** ccamacho has joined #rdo13:04
*** rbartal has joined #rdo13:05
*** imcleod has joined #rdo13:05
*** dneary__ has joined #rdo13:07
*** dneary_ has quit IRC13:09
*** mosulica has quit IRC13:10
*** rbartal has quit IRC13:12
*** sbulage|brb is now known as sbulage13:13
*** mvk has quit IRC13:14
*** mary_grace has joined #rdo13:14
*** mosulica has joined #rdo13:14
*** janki has joined #rdo13:15
*** dprince has joined #rdo13:16
*** emalikov has joined #rdo13:18
*** mary_grace has quit IRC13:21
*** lucas-hungry is now known as lucasagomes13:22
*** rbartal has joined #rdo13:24
*** thrash|g0ne is now known as thrash13:27
*** shardy is now known as shardy_mtg13:28
*** emalikov has quit IRC13:29
*** pradk has quit IRC13:29
mhunumber80, doesn't ring a bell at all13:31
*** daidv has quit IRC13:32
*** wolverineav has quit IRC13:33
*** amuller has joined #rdo13:34
*** emalikov has joined #rdo13:34
*** rlandy has joined #rdo13:34
*** mosulica has quit IRC13:38
*** wolverineav has joined #rdo13:41
*** ykarel is now known as ykarel|away13:43
*** mosulica has joined #rdo13:43
EmilienMapevec: why did you close https://bugs.launchpad.net/tripleo/+bug/174236713:43
openstackLaunchpad bug 1742367 in tripleo "No module named ironic_tempest_plugin.plugin" [Critical,Fix released] - Assigned to chandan kumar (chkumar246)13:43
EmilienMapevec: are you sure we don't have this problem in promotion jobs?13:43
*** trown|outtypewww is now known as trown13:45
*** mosulica has quit IRC13:47
*** pchavva has joined #rdo13:48
*** ykarel|away has quit IRC13:49
*** jpena|lunch is now known as jpena13:51
rdogerritMerged openstack/neutron-lib-distgit rpm-master: Add python-keystoneauth1 as a requirement  https://review.rdoproject.org/r/1121913:51
*** mosulica has joined #rdo13:51
*** dpawar has quit IRC13:51
*** mary_grace has joined #rdo13:51
rdogerritJavier Peña proposed config master: [WIP] Automate GitHub repo creation for new project distgits  https://review.rdoproject.org/r/1127113:54
*** mosulica has quit IRC13:55
*** mary_grace has quit IRC13:59
*** shardy_mtg is now known as shardy13:59
chandankumarjpena: amoralej|lunch https://review.rdoproject.org/r/#/c/11161/14:00
*** mosulica has joined #rdo14:01
*** jmelvin has joined #rdo14:03
*** Son_Goku has quit IRC14:03
*** sasha2 has joined #rdo14:04
chandankumarplease have a look14:05
chandankumari will push of the spec file by night14:06
chandankumarapevec: number80 i will be back in 3 hours, see ya :-)14:08
*** lkuchlan has quit IRC14:08
*** lkuchlan has joined #rdo14:09
number80see ya !14:10
EmilienMapevec: nevermind my comment, I saw ykarel comment14:11
*** kgiusti has joined #rdo14:11
*** Goneri has joined #rdo14:19
*** mvk has joined #rdo14:22
*** mary_grace has joined #rdo14:25
apevecEmilienM, yeah, I would not close without evidence in the comments14:26
EmilienMapevec: let's go mud14:26
*** dhill_ has quit IRC14:27
apevecBTW swift has hit another issue after unpinning14:27
*** dhill_ has joined #rdo14:27
apevecthat shows why such pins must not stay longer than a week or so14:28
*** mary_grace has quit IRC14:30
*** trown is now known as trown|brb14:32
*** pradk has joined #rdo14:34
*** Eran_Kuris has joined #rdo14:35
rbowenAre any of you folks 1) based in Brno and 2) attending FOSDEM?14:36
*** Son_Goku has joined #rdo14:36
rbowenOr, alternately, 1) attending DevConf.cz14:36
*** jmlowe has quit IRC14:39
*** coolsvap has joined #rdo14:40
number80Meeting in 20 min, agenda => https://etherpad.openstack.org/p/RDO-Meeting14:40
jruzickarbowen, 1) yes, 2) no alt1) I could if I had a mission. so why?14:40
rbowenjruzicka: I was looking for someone to bring me the leftover TripleO bookmarks, but misc has already volunteered to do so. :)14:44
jruzickarbowen, allright :)14:45
rbowenEliska is getting ccamacho's new bookmarks printed for DevConf, and I expect there will be some leftovers.14:45
*** eharney has joined #rdo14:48
*** trown|brb is now known as trown14:48
number80I was about to joke that misc is Brno-based, but it seems not to be a joke anymore /o\14:53
*** dpawar has joined #rdo14:55
*** dpawar has quit IRC14:55
*** rgogunskiy has quit IRC14:56
*** pabelanger has quit IRC14:56
*** pabelanger has joined #rdo14:56
*** amoralej|lunch is now known as amoralej14:59
rdogerritRicardo Noriega created openstack/networking-l2gw-tempest-plugin-distgit rpm-master: Enabling documentation package for Neutron L2GW Tempest Plugin  https://review.rdoproject.org/r/1127414:59
-openstackstatus- NOTICE: Gerrit is being restarted due to slowness and to apply kernel patches14:59
*** mary_grace has joined #rdo15:00
*** openstackgerrit has quit IRC15:01
*** absubram has joined #rdo15:02
number80Meeting time15:02
number80#startmeeting RDO meeting - 2018-01-1015:03
openstackMeeting started Wed Jan 10 15:03:07 2018 UTC and is due to finish in 60 minutes.  The chair is number80. Information about MeetBot at http://wiki.debian.org/MeetBot.15:03
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:03
*** openstack changes topic to " (Meeting topic: RDO meeting - 2018-01-10)"15:03
openstackThe meeting name has been set to 'rdo_meeting___2018_01_10'15:03
number80#topic roll call15:03
*** openstack changes topic to "roll call (Meeting topic: RDO meeting - 2018-01-10)"15:03
jpenao/15:03
amoralejo/15:03
bcafarelo/15:03
number80agenda is here: https://etherpad.openstack.org/p/RDO-Meeting15:03
number80#chair jpena amoralej bcafarel15:03
openstackCurrent chairs: amoralej bcafarel jpena number8015:03
mfedosino/15:03
jruzickao/15:03
mary_graceo/15:03
number80#chair mfedosin jruzicka mary_grace15:03
openstackCurrent chairs: amoralej bcafarel jpena jruzicka mary_grace mfedosin number8015:03
number80Let's start15:04
number80#topic DLRN Fedora Rawhide builder issues15:04
*** openstack changes topic to "DLRN Fedora Rawhide builder issues (Meeting topic: RDO meeting - 2018-01-10)"15:05
number80jpena: ^15:05
*** Son_Goku has quit IRC15:05
jpenawe're having trouble with the Fedora builder for RDO Trunk since a few days ago15:05
jpenaTL;DR: since we're running it on CentOS, mock will try to populate the initial buildroot using yum15:05
jpenaand that does not work well with some updated packages, that use rich dependencies "(xxx if yyy)"15:05
jpenaThe only fix I can think of is to separate this builder to its own VM running on Fedora, since there is no way to have dnf on centos (at least I'm not aware of any)15:06
*** absubram has quit IRC15:06
jpenaideas?15:06
number80jpena: is EPEL enabled for DLRN builders?15:06
jpenanumber80: usually no15:06
*** absubram has joined #rdo15:06
number80alternative is to get dnf from EPEL and tell mock to use dnf15:07
jpenaI haven't found dnf on epel :?15:08
number80You may just enable EPEL for dnf + deps15:08
amoralejthat means dnf in the dlrn server15:08
amoralejright?15:09
amoralejand use it for everything?15:09
amoralejor how that works?15:09
jpenalet me check, I tried it yesterday but I couldn't get dnf from epel15:09
amoralejwe could selectively use dnf or yum?15:09
*** Son_Goku has joined #rdo15:09
number80it may have been removed, I'll investigate that after meeting15:10
number80amoralej: mock allows you to choose default package manager, you may even change the command run in recent mock versions15:10
amoralejnice15:10
jpenaamoralej: we can choose per-worker, it's a mock option15:10
amoralejusing a fedora builder sounds as a good solution, anyway15:11
amoralejfor fedora builders15:11
number80jpena: even better, CentOS has a specific repo => https://seven.centos.org/2017/10/yum-4-is-available-for-testing/15:11
jpenaoh15:11
* jpena checks15:11
*** dpawar has joined #rdo15:11
number80(dnf was removed from EPEL since it was old version and no updates)15:12
*** jbrooks has quit IRC15:12
*** egallen has quit IRC15:13
jpenanumber80: it looks like installing yum4 brings a new rpm version, too15:14
*** jbrooks has joined #rdo15:14
*** egallen has joined #rdo15:14
jpenaI'm not sure if we should use a testing version in the RDO Trunk builder :-/15:14
number80jpena: well, just pointing alternatives, a stable fedora builder should be fine15:15
amoralejI'd +1 to have a new builder15:15
number80+115:15
number80So does someone disagree with having a new builder?15:15
number80(let's use lazy consensus here)15:16
jpenacool then :)15:16
amoralejjpena we could do redirects from the main builder for fedora repos for the failover case15:16
jruzickanew rpm version?! whooo15:16
number80#info jpena will be working on a new DLRN fedora builder15:16
jpenaamoralej: yes. Worst case, fedora repos are not that important yet15:17
amoralejcyeah15:17
jruzickahaving fedora builder sounds useful anyway.15:17
number80let's change topic15:20
*** rbartal has quit IRC15:20
number80#topic Move Q3 test day to Feb 8, 9 (conflict with FOSDEM)15:20
*** openstack changes topic to "Move Q3 test day to Feb 8, 9 (conflict with FOSDEM) (Meeting topic: RDO meeting - 2018-01-10)"15:20
jschluetero/15:21
dmsimard\o15:21
number80So rbowen asked us if we're okay to move M3 test day to the next week15:21
number80#chair jschlueter dmsimard15:21
openstackCurrent chairs: amoralej bcafarel dmsimard jpena jruzicka jschlueter mary_grace mfedosin number8015:21
amoralejsounds good to me15:21
number80As amoralej and I will be at FOSDEM and CentOS dojo, so we're unlikely to be available15:21
number80So again, lazy consensus rule, is anyone against it?15:22
jpena+115:22
jruzickathere's no force binding it to that specific date, no? so let's do it when we have most testers :)15:22
number80jruzicka: well, the only reason we set dates is to make sure we won't miss them :)15:23
jruzickamissing them for sure isn't that much better :)15:23
number80*nods*15:23
number80then, let's say we agreed to do that change15:24
number80#agreed Move M3 test days to Feb 8, 915:24
chandankumar\o/15:24
number80So the next thing is to decide who'll take the action to announce it?15:24
number80#chair chandankumar15:24
openstackCurrent chairs: amoralej bcafarel chandankumar dmsimard jpena jruzicka jschlueter mary_grace mfedosin number8015:24
rbowenSorry, I'm here.15:25
number80no worries15:25
number80#chair rbowen15:25
openstackCurrent chairs: amoralej bcafarel chandankumar dmsimard jpena jruzicka jschlueter mary_grace mfedosin number80 rbowen15:25
number80rbowen: so I guess you'll take the announce action (or maybe mary_grace) ?15:25
*** numans has quit IRC15:26
mary_gracego for it, rbowen15:26
rbowenSorry, so many distractions today.15:27
number80#action rbowen will announce the M3 test days change to Feb 8, 915:27
rbowenYes, I'll take care of that. :-)15:27
number80so next topic ^^15:27
number80#topic [Octavia] Providing service VM images in RDO15:27
*** openstack changes topic to "[Octavia] Providing service VM images in RDO (Meeting topic: RDO meeting - 2018-01-10)"15:27
number80bcafarel: ^15:27
bcafarelthanks :)15:28
*** numans has joined #rdo15:28
bcafarelinitial mail sent today: https://lists.rdoproject.org/pipermail/dev/2018-January/008482.html (and thread)15:28
bcafarelbasically octavia amphora (the service VMs) currently need to be built/updated/uploaded manually by the user15:28
number80https://lists.rdoproject.org/pipermail/dev/2018-January/008482.html15:28
number80(reposting link for logs)15:29
bcafarelit would be great to have that image built and provided in the repo, apevec had some nice feedback/questions already15:30
*** emalikov has quit IRC15:30
*** morazi has quit IRC15:30
jruzickaoh yeah, it looks like a lot of work that could be done automatically once as opposed to every user needing to do it manually.15:30
number80bcafarel: technically, it can be a zuul job we can host15:31
amoralejyes, part of the promotion pipeline15:31
*** agurenko has quit IRC15:31
*** joelinux_ has joined #rdo15:32
bcafarelthat was what I was thinking looking at https://www.rdoproject.org/what/promotion-pipeline/ yes15:32
amoralejbcafarel, does puppet-openstack-integration cover octavia?15:32
amoralejor in any tripleo scenario?15:32
bcafarelcurrently I think none, there is work in progress though15:32
bcafarel^ beagles: around?15:33
*** joelinux has quit IRC15:33
amoralejbcafarel, about distribution, do you plan on including the images in a rpm?15:33
bcafarelamoralej: if the rpm can be included in the repo, that would be great15:34
amoraleji see several advantadges15:35
amoralejone is that it provides versioning15:35
amoralejwe could use creation timestamp15:35
amoralejas release or something like that15:35
number80Seems that Manila is also interested to jump in the bandwagon15:35
number80(from the mailing list)15:35
amoralejand second is that we could use yum repos to distribute15:35
amoralejbcafarel, how long takes images to be created and how big are they?15:36
*** egallen has quit IRC15:36
*** morazi has joined #rdo15:36
tbarronnumber80: up to this point we've not gotten much traction further downstream b/c of considerations around image maintenance/distribution15:36
tbarronbut maybe octavia will pioneer here and reduce friction :)15:37
bcafarelamoralej: on my laptop, ~5min (with "warm" DIB cache)15:37
bcafareltbarron: do you mean I opened a can of worms? :)15:37
tbarronbcafarel: dunno, we'll see :)15:37
number80tbarron: yes, having another use case makes it more worthwhile to work on this area15:38
number80So may I suggest that we continue the discussion on the mailing-list?15:38
*** Son_Goku has quit IRC15:38
number80(we can have follow-up topic next week)15:38
amoralejyes, i think ML is the best option, there are many details to figure out15:38
number80ack15:38
bcafarelsounds good yep15:39
number80#topic rdopkg is now available for testing in F25+ and EPEL715:39
*** openstack changes topic to "rdopkg is now available for testing in F25+ and EPEL7 (Meeting topic: RDO meeting - 2018-01-10)"15:39
number80jruzicka: ^15:39
jruzickasomeone asked me howto install rdopkg15:39
*** jkilpatr has quit IRC15:39
jruzickaso when you're on Fedora, it's:15:39
number80https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2017-b2c3f7fabb15:39
jruzickardopkg install rdopkg15:39
jruzicka:)15:39
number80recursive install?15:40
*** fzdarsky has joined #rdo15:40
jruzicka:D15:40
jruzickasry15:40
jschlueterjruzicka: what type of cleanup should we do if we already had it installed via epel?15:40
jruzickadnf install rdopkg15:40
jruzickarecursive instal and self-consciousness are on longer term TODO15:40
jschlueterany recommendations for cleanup?15:40
number80lol15:40
number80#info how to install rdopkg? just dnf/yum it!15:41
jruzickaEPEL was borked and noone noticed because reasons but there is a working build now15:41
rdogerritMerged openstack/rsdclient-distgit rpm-master: Fix sphinx-build leftovers removal command  https://review.rdoproject.org/r/1125215:41
chandankumarjruzicka: i hope we should have somehting like pip install -u pip -> rdopkg install -u rdopkg15:41
jruzicka#info EPEL 7 rdopkg build in testing: https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2017-b2c3f7fabb15:42
jruzickafeel free to test and +1/-1 to autopush to stable15:42
jruzicka#info for cleanup, nuke jruzicka/rdopkg copr repo15:43
*** dustins has joined #rdo15:43
number80Thanks jruzicka !15:44
number80Next topic15:44
jruzickajschlueter, you installed from epel even though pyOpenSSL req isn't met? heh, magic :)15:44
number80#topic FOSDEM openstack booth volunteers15:44
*** openstack changes topic to "FOSDEM openstack booth volunteers (Meeting topic: RDO meeting - 2018-01-10)"15:44
jschlueterjruzicka: from way back15:44
number80rbowen is looking for booth volunteers so please sign up!15:44
number80https://etherpad.openstack.org/p/fosdem-201815:44
number80link ^15:44
amoraleji'll add myself15:44
rbowenAt the moment, the OpenStack table at FOSDEM is manned by myself and Erwan. That's not going to work out.15:44
rbowenIt's just an hour, and it's answering questions that tend to be at a very basic level, like What's OpenStack.15:45
jruzickaI'm not going to FOSDEM this year, sorry :(15:45
jruzickaI'd help otherwise.15:45
*** janki has quit IRC15:45
rbowenSo if you or any of your colleagues will be there, please shame them into participating.15:45
rbowenThanks.15:45
number80Well, Adrien signed up so we should be enough15:45
rbowenAlso, dress warmly.15:46
rbowen</end of topic>15:46
number80Thanks :)15:46
number80#topic PTG interviews with Rich15:47
*** openstack changes topic to "PTG interviews with Rich (Meeting topic: RDO meeting - 2018-01-10)"15:47
number80rbowen ^15:47
rbowenAmazingly, it's time for another PTG. I do video interviews at the PTG. You can see examples at http://youtube.com/rdocommunity  If you want to talk about your project, watch various mailing lists for signup announcements.15:47
rbowenIdeally, interviews are multiple people that represent a particular project, preferably spanning more than one organization.15:47
*** egallen has joined #rdo15:48
rbowenTopic is "what's new in Queens, and what's coming in Rocky", typically.15:48
chemamoralej: wondering if anything is stoping https://review.rdoproject.org/r/#/c/11269/ from landing ?15:48
rbowenAnyways, there should be a signup sheet as soon as I get confirmation from Erin Disney that they expect to have space for me.15:48
number80Well, a significant part of the RDO Eng. team will be here, if you want a behind the scene interview with us15:48
amoralejchem, we are in a meeting, gimme 10 minutes15:48
rbowennumber80: That would be great!15:48
chandankumarrbowen: i will let my presence by tomorrow15:48
rbowenGood.15:49
rbowenThat's all I've got. Hopefully more info next week.15:49
number80So I guess we're good now15:49
number80#topic next week meeting chair15:49
*** openstack changes topic to "next week meeting chair (Meeting topic: RDO meeting - 2018-01-10)"15:49
number80since the holiday jumbo-mumbo ended up, so who wants the chair now?15:50
chandankumarnumber80: i will take care of that15:50
number80good15:50
number80#info chandankumar is chairing next week meeting15:50
number80Thanks!15:50
*** ushkalim_ has joined #rdo15:50
number80#topic open floor15:50
*** openstack changes topic to "open floor (Meeting topic: RDO meeting - 2018-01-10)"15:50
number80So before we close the meeting, anyone wants to bring another topic?15:51
chandankumarSo last year 2017 in last meeting i have sent a mail related to Add your things which make RDO awesome in year 201715:51
rbowenThere's a new newsletter: http://rdoproject.org/newsletter/2018/january/15:51
chandankumarStill received no reply15:51
rbowenShare it with your friends and family.15:51
chandankumar#link https://rdo.fsn.ponee.io/thread.html/1e8105a4c9bc869d1d2754f1cf307c7b342abf5b7a89ffcde8f2832c@%3Cdev.lists.rdoproject.org%3E15:51
rbowenchandankumar: It was mentioned in the newsletter, too. Hopefully someone will read that.15:51
chandankumarplease take some time, reply to this email so that i can work on drafting blogpost15:52
number80Ack15:52
chandankumarthat's it from my side.15:52
*** egallen has quit IRC15:53
number80Ok, thanks!15:54
*** Eran_Kuris has quit IRC15:54
number80Well, let's see you next week, ladies and gentlemen!15:54
number80#endmeeting15:54
*** openstack changes topic to "RDO: An OpenStack Distribution for CentOS/RHEL | Community meeting is held here every Wednesday at 15:00UTC | Please read our IRC community guidelines: https://www.rdoproject.org/community/irc-etiquette/ | Logged at http://eavesdrop.openstack.org/irclogs/%23rdo/"15:54
openstackMeeting ended Wed Jan 10 15:54:33 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:54
openstackMinutes:        http://eavesdrop.openstack.org/meetings/rdo_meeting___2018_01_10/2018/rdo_meeting___2018_01_10.2018-01-10-15.03.html15:54
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/rdo_meeting___2018_01_10/2018/rdo_meeting___2018_01_10.2018-01-10-15.03.txt15:54
openstackLog:            http://eavesdrop.openstack.org/meetings/rdo_meeting___2018_01_10/2018/rdo_meeting___2018_01_10.2018-01-10-15.03.log.html15:54
amoralejthanks number80 for chairing15:54
*** jkilpatr has joined #rdo15:55
amoralejchem, we are having infra issues and can't run gate jobs15:55
amoralejwe are working with RDO Cloud team to get it fixed15:55
amoralejasap15:55
number80I think dmanchad requested if we can close the ticket15:57
*** egonzalez has quit IRC15:58
*** jmlowe has joined #rdo16:00
*** egallen has joined #rdo16:00
rdogerritrdo-trunk created openstack/magnum-distgit rpm-master: openstack-magnum: failed to build 65b47b5  https://review.rdoproject.org/r/1127516:01
rbowenegallen: We were just talking about you.16:04
*** imcleod has quit IRC16:04
rbowenegallen: It's just you and me staffing the OpenStack booth at FOSDEM, so far. :D16:04
*** egonzalez has joined #rdo16:04
*** rbartal has joined #rdo16:06
*** egallen has quit IRC16:08
*** egallen has joined #rdo16:10
*** avivgt has quit IRC16:11
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: magnum: http://trunk.rdoproject.org/centos7-master/report.html16:12
rdogerritMerged rdoinfo master: Update the openstack-macros package in -testing  https://review.rdoproject.org/r/1108716:13
rdogerritAlfredo Moralejo proposed rdoinfo master: Bump puppet-pacemaker for pike.  https://review.rdoproject.org/r/1126916:13
*** jkilpatr has quit IRC16:16
*** fultonj has quit IRC16:16
*** lkuchlan has quit IRC16:17
*** mpeterson has quit IRC16:19
chemamoralej: thanks a lot, again :)16:20
rdogerritwes hayutin created config master: remove non-containerized scen jobs from pike  https://review.rdoproject.org/r/1127616:21
*** mpeterson has joined #rdo16:21
*** kopecmartin has quit IRC16:22
*** mosulica has quit IRC16:24
*** sbonazzo has left #rdo16:25
*** jkilpatr has joined #rdo16:28
*** jamiec has quit IRC16:29
*** dpawar has quit IRC16:30
*** dpawar has joined #rdo16:31
*** rbartal has quit IRC16:31
*** gvrangan has joined #rdo16:31
*** gvrangan_ has joined #rdo16:32
*** jehane has joined #rdo16:33
*** morazi has quit IRC16:34
*** dpawar has quit IRC16:35
*** mary_grace has quit IRC16:35
*** gvrangan has quit IRC16:36
jpenaykarel: around? It looks like the magnum gate is broken16:36
*** fultonj has joined #rdo16:39
*** rhallisey has quit IRC16:39
*** rhallisey has joined #rdo16:39
*** sbulage is now known as sbulage|afk16:41
*** anilvenkata_ has quit IRC16:41
rdogerritMerged rdo-infra/rdo-container-registry master: give the ability to mock the SSL certificates  https://review.rdoproject.org/r/1088616:43
*** mary_grace has joined #rdo16:43
rdogerritMerged rdo-infra/rdo-container-registry master: run_tests.sh: use the local SSL certificate  https://review.rdoproject.org/r/1098316:44
*** dmacpher has quit IRC16:44
rdogerritMerged config master: remove non-containerized scen jobs from pike  https://review.rdoproject.org/r/1127616:45
EmilienMweshay: ^ done16:46
*** d0ugal has quit IRC16:46
amoralejEmilienM, weshay we'll stop supporting non-containerized deployments in pike post-GA?16:46
amoralejwe use it to gate packages in rdoinfo16:47
*** jaosorior has quit IRC16:47
EmilienMimho we should really follow what we do upstream16:47
EmilienMand in upstream, we switched all jobs to containerized jobs16:47
*** imcleod has joined #rdo16:47
EmilienMwe kept OVB non containerized, which is a fair amount of testing16:47
EmilienMbut scenarios went ahead16:48
amoralejok, i'll switch to ovb then16:48
amoralejbtw, EmilienM i have to fix tripleo jobs in rdoinfo for master16:48
*** racedo has quit IRC16:48
*** mary_grace has quit IRC16:48
amoralejand weshay ^16:48
EmilienMamoralej: need my help?16:48
amoraleji'll ask for ideas in oooq16:49
amoralejyes i do need it16:49
EmilienMwhat can I do exactly?16:49
amoraleji'm not sure if we can modify images on the fly16:49
*** egallen has quit IRC16:49
amoralejor i do have to re-create containers16:49
amoralejto include the gated packages16:49
amoralejwe need to inject packages from a temporary repo in the images16:49
amoralejin the container images, i mean16:50
*** jlibosva has quit IRC16:50
amoraleji know there was some work in progres in oooq to do that16:50
chandankumaramoralej: regarding tempest plugins tags, i have started speaking with team, cinder -> yes16:51
amoralejnice16:51
EmilienMamoralej: you need to talk with weshay and rlandy about that, they are making it happen in quickstart16:52
*** mary_grace has joined #rdo16:52
*** gvrangan_ has quit IRC16:52
*** mary_grace has quit IRC16:52
*** KarlchenK has quit IRC16:52
*** oidgar has quit IRC16:53
amoralejanyway i like the idea of creating all containers if it doesn't take very long to increase coverage of new packages16:53
amoralejEmilienM, weshay ^ wdyt?16:53
amoralejwhen bumping deps in master, i mean16:53
*** mcornea has quit IRC16:53
*** aufi has quit IRC16:53
*** ragiman has quit IRC16:54
weshayamoralej, creating all the containers in the tripleo promotion job... sure let's propose it on openstack-dev or devel.rdo16:55
amoralejweshay, not in promotion job16:56
amoraleji mean in the rdoinfo gate16:56
amoralejto test new dependencies before pushing them to the repo16:56
weshayamoralej, ok.. using the same playbook that dmsimard wrote?16:56
amoralejyeah, unless there is a better way to do it16:57
amoralejthat i'm not aware16:57
amoralejso, idea is to create them in the undercloud and use it from a registry running in the same undercloud16:57
amoralejis that easy/feasible?16:57
amoralejfrom oooq perspective16:57
rlandyamoralej: weshay:  are we talking about the container update work? to include a change?16:58
EmilienMyeah it's a good idea16:58
*** paragan has quit IRC16:58
weshayrlandy, no.. amoralej is talking about packaging tests16:59
amoralejweshay, rlandy, i'll write it in a etherpad or something to make more clear what we need16:59
weshayamoralej, k.. did you get my message re: linking to your rpm build pipeline presentation17:00
weshay?17:00
amoralejweshay, nop, sorry, where?17:02
*** imcleod has quit IRC17:02
*** egallen has joined #rdo17:04
*** ushkalim_ has quit IRC17:06
*** egonzalez has quit IRC17:06
jpenadoes anyone know which IRC channel do cliff devs hang on?17:07
*** jmelvin has quit IRC17:08
EmilienMjpena: #openstack-keystone17:08
EmilienMor17:08
chandankumarjpena: #openstack-sdks17:08
EmilienMno17:08
sshnaidmdmsimard, hi, can you please comment on https://review.rdoproject.org/r/#/c/11253/ ? is Tristan right there?17:08
larsksjpena: I was going to say #openstack-dev or -infra.17:08
chandankumarhttps://github.com/openstack/governance/blob/master/reference/projects.yaml#L252217:09
EmilienMther eis a channel for osc17:09
*** pblaho has quit IRC17:09
*** hseipp has joined #rdo17:09
jpenaok, I'll try with openstack-sdks17:09
EmilienMchandankumar got it :-)17:09
jpenathanks!17:09
*** jfrancoa has quit IRC17:09
*** amuller has quit IRC17:10
*** pcaruana has quit IRC17:11
rdogerritJavier Peña proposed config master: [WIP] Automate GitHub repo creation for new project distgits  https://review.rdoproject.org/r/1127117:14
dmsimardsshnaidm: that's the implementation from an (automated)) software perspective, there's nothing preventing us from "manually" sending data to influx.17:14
dmsimardNeed to afk lunch etc, brb17:14
sshnaidmdmsimard, I suppose we'll need a dedicated db for that17:14
sshnaidmdmsimard, and credentials.. maybe17:15
*** numans has quit IRC17:16
*** fzdarsky has quit IRC17:16
*** egallen_ has joined #rdo17:18
*** lucasagomes is now known as lucas-afk17:19
*** egallen has quit IRC17:19
*** egallen_ is now known as egallen17:19
*** numans has joined #rdo17:19
trownsshnaidm: do you understand ^ ... are we moving forward with our own influxdb setup?17:19
trownsshnaidm: I am a bit lost on that17:20
*** almondjoy has joined #rdo17:22
sshnaidmtrown, me too.. let's wait for dmsimard to explain17:23
rdogerritDamien Ciabrini created rdoinfo master: Bump requirement for puppet-systemd from Pike onwards  https://review.rdoproject.org/r/1128217:24
*** bfournie has quit IRC17:26
*** egonzalez has joined #rdo17:29
*** jamiec has joined #rdo17:29
*** egallen has quit IRC17:29
*** rhallisey has quit IRC17:29
*** rhallisey has joined #rdo17:30
*** pblaho has joined #rdo17:33
*** jpich has quit IRC17:36
*** florianf has quit IRC17:37
*** gvrangan has joined #rdo17:38
*** zerick has joined #rdo17:39
*** almondjoy has quit IRC17:40
*** zerick has quit IRC17:41
*** zerick has joined #rdo17:42
*** gvrangan has quit IRC17:43
*** amuller has joined #rdo17:43
rdogerritMerged rdoinfo master: Bump puppet-pacemaker for pike.  https://review.rdoproject.org/r/1126917:45
*** jackNemrod has joined #rdo17:45
*** zerick has quit IRC17:45
*** egonzalez has quit IRC17:46
dtantsurchandankumar: JFYI the ironic_tempest_plugin remove from ironic tree was just approved17:46
*** zerick has joined #rdo17:46
*** gkadam has quit IRC17:47
*** jmelvin has joined #rdo17:49
*** sbulage|afk has quit IRC17:50
*** cshastri has quit IRC17:51
*** arif-ali has quit IRC17:57
*** derekh has quit IRC18:00
*** gfidente has quit IRC18:03
*** jackNemrod has quit IRC18:05
*** bfournie has joined #rdo18:08
*** amuller has quit IRC18:09
*** karthiks has quit IRC18:12
*** alee has quit IRC18:12
*** jpena is now known as jpena|off18:14
*** trown is now known as trown|lunch18:17
*** thrash is now known as thrash|biab18:17
*** coolsvap has quit IRC18:18
*** numans has quit IRC18:19
*** jkilpatr has quit IRC18:19
*** jkilpatr has joined #rdo18:20
*** numans has joined #rdo18:22
miscdmsimard: did you heard about anything regarding rackspace and the openstack infra  (like them stopping sponsorship ?)18:23
amoralejdciabrin, so you need to update puppet-systemd in all releases?18:25
amoralejare you cherry-picking the fix to old releases?18:26
*** openstack has joined #rdo18:31
*** ChanServ sets mode: +o openstack18:31
dciabrinamoralej, yes it's available in puppet-systemd's master and in rdo trunk only18:31
dciabrinamoralej, how would I propose a cherry pick instead? updating the specfile and pushing a review in rdoproject.org?18:32
amoralejok, let's get feedback from puppeteers18:32
amoralejdciabrin, yes, we could do that, i'm not sure how clean is the cherry pick18:32
*** gvrangan has joined #rdo18:36
*** tesseract has quit IRC18:36
amoralejdciabrin, i've also added some comments about all the steps to get updated puppet-systemd in all repos if we finally move on18:37
amoralejit can't be done all in one step18:37
amoralejunfortunatelly18:37
amoralejchem, we have puppet-pacemaker-0.7.0 in pike repo18:39
amoralejnow we've broken update from pike -> master :)18:39
*** morazi has joined #rdo18:40
jruzickarbowen, https://github.com/redhat-openstack/website/pull/115118:40
*** jmlowe has quit IRC18:40
*** jkilpatr has joined #rdo18:40
*** jmlowe has joined #rdo18:41
*** imcleod has joined #rdo18:42
dciabrinamoralej, ack i'll read it after dinner :)18:44
*** sshnaidm is now known as sshnaidm|afk18:48
*** gszasz has quit IRC18:50
*** gvrangan has quit IRC18:50
*** MrAbaddon has quit IRC18:51
*** mvk has quit IRC18:57
apevecamoralej, hmm, b/c of timestamp...19:05
apeveclet's just send dummy commit to rpm-master ?19:05
*** shardy has quit IRC19:08
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: magnum: http://trunk.rdoproject.org/centos7-master/report.html19:09
*** pkovar has quit IRC19:09
amoralejapevec, first let's wait for https://review.openstack.org/#/c/532603/19:10
amoralejso that dlrn uses calculates version 0.7.119:10
*** choirboy is now known as choirboy|afk19:11
*** fultonj has quit IRC19:11
number80pradk: we got feedback on https://review.rdoproject.org/r/#/c/11171/119:11
number80I think that we might have to close https://bugzilla.redhat.com/show_bug.cgi?id=1512796 as cantfix ...19:12
openstackbugzilla.redhat.com bug 1512796 in openstack-gnocchi "On manual installation of Gnocchi packages with the WSGI app, app.log is unwriteable and prevents services from functioning" [Medium,New] - Assigned to pkilambi19:12
pradknumber80, hmm ok19:12
pradkyea perhaps we just document it in the release docs19:12
number80pradk: well, I left the review opened if you want to exchange a little bit more about it19:12
pradkthx19:13
number80but yeah, sounds reasonable to document it19:13
*** jobewan has joined #rdo19:17
rdogerritPradeep Kilambi created openstack/heat-distgit rpm-master: Drop python-ceilometerclient requirement  https://review.rdoproject.org/r/1128419:18
amoralejpradk, i see ceilometerclient is still required in aodh19:18
amoralejat least19:18
amoralejhttps://github.com/openstack/aodh/blob/master/requirements.txt#L2419:19
pradkamoralej, yea i guess the upstream folks missed it.. i'll clean that up as well19:19
rdogerritMerged openstack/mox3-distgit rpm-master: move openstack-macros to top level BR  https://review.rdoproject.org/r/1127019:20
rdogerritMerged openstack/os-win-distgit rpm-master: Remove oslo-sphinx build requirement  https://review.rdoproject.org/r/1096019:20
rdogerritMerged openstack/oslo-rootwrap-distgit rpm-master: Switch doc builds back to sphinx-build  https://review.rdoproject.org/r/1125519:20
rdogerritMerged openstack/oslo-messaging-distgit rpm-master: Switch doc builds back to sphinx-build  https://review.rdoproject.org/r/1125719:22
*** thrash|biab is now known as thrash19:22
*** fultonj has joined #rdo19:24
*** jparrill has quit IRC19:28
jschlueterdhellmann, pradk: how do we retire python-ceilometerclient upstream when it's still used/referenced in heat, aodh, rally and mistral ...19:29
*** MrAbaddon has joined #rdo19:30
jschlueterI would have thought a project would have had to have not been referenced/used for a full cycle before it could be retired19:31
rdogerritPradeep Kilambi created openstack/mistral-distgit rpm-master: Drop ceilometerclient requirement  https://review.rdoproject.org/r/1128519:31
pradk^^ that should take care of mistral19:33
*** mvk has joined #rdo19:33
*** trown|lunch is now known as trown19:35
*** dbecker_ has quit IRC19:38
number80I'll be off for 30 min19:39
*** rlandy has quit IRC19:43
rdogerritPradeep Kilambi proposed openstack/heat-distgit rpm-master: Drop python-ceilometerclient requirement  https://review.rdoproject.org/r/1128419:44
*** amuller has joined #rdo19:46
*** rlandy has joined #rdo19:48
*** jtomasek has quit IRC19:49
*** zerick has quit IRC19:51
*** zerick_ has joined #rdo19:51
*** dtantsur is now known as dtantsur|afk19:53
jschlueterpradk: https://review.openstack.org/#/c/526246/ for aodh20:00
*** jparrill has joined #rdo20:02
*** jackNemrod has joined #rdo20:04
EmilienMchandankumar: could you please join #puppet-openstack, it would help20:09
*** thrash has quit IRC20:10
number80o/20:10
chandankumarEmilienM: yup20:17
EmilienMapevec: could you join #tripleo please20:23
EmilienMapevec: or here, do we need alert on https://bugs.launchpad.net/tripleo/+bug/1729569 ? AFIU we didn't unpin swift yet20:23
openstackLaunchpad bug 1729569 in tripleo "Periodic jobs using swift as glance backend failing" [Critical,In progress] - Assigned to Christian Schwede (cschwede)20:23
*** imacdonn has quit IRC20:32
*** imacdonn has joined #rdo20:33
*** almondjoy has joined #rdo20:34
*** choirboy|afk is now known as choirboy20:36
*** thrash has joined #rdo20:38
*** thrash has quit IRC20:38
*** thrash has joined #rdo20:38
pradkseeing this: docker pull failed: Get https://trunk.registry.rdoproject.org/v1/_ping: dial tcp 38.145.32.81:443: getsockopt: connection refused20:39
bnemecpradk: Likewise.  amoralej is looking into it.20:40
amoralejdmsimard, it seems there is some problem with registry.r.o20:40
pradkcool20:40
apevecnot cool :)20:41
dmsimardamoralej: picking up kids, I'll look in 1020:41
amoralejok20:41
apevecamoralej, bnemec when did it start?20:41
amoraleji think it's storage issue20:43
*** jtomasek has joined #rdo20:43
amoraleji mean diskusage20:43
amoralej'FailedScheduling' 0/1 nodes are available: 1 NodeUnderDiskPressure.20:44
amoralejdmsimard, ^20:44
*** atoth has quit IRC20:48
amoralejwe have 32GB of logs20:48
amoralejin /var/log20:48
bnemecapevec: I noticed it maybe 15 or 20 minutes ago.20:48
*** jackNemrod has quit IRC20:48
apevecamoralej, hmm, no sensu alerts in #rdo-dev that I can see for registry.rdo ...20:48
amoralejyeah, i've realized also20:49
amoraleji think that's the problem20:49
amoralejhttps://kubernetes.io/docs/tasks/administer-cluster/out-of-resource/#hard-eviction-thresholds20:49
amoralejk8s has some eviction conditions20:49
amoraleji'm deleting old logs20:50
apevecack20:50
apevec32GB is lots of logs, is it debug enabled?20:50
amoralejtoomanyquestions... :)20:51
apevecnm, just ignore :)20:51
amoraleji'm also compressing some archived messages files20:51
*** Jeffrey4l has quit IRC20:52
amoralejapevec, definetively there are no alerts in uchiwa20:54
amoraleji think the issue started a couple of hours ago or so20:55
*** dprince has quit IRC20:55
amoralejservice is restored20:56
amoralejapevec, dmsimard, bnemec ^20:56
dmsimardamoralej: there is an alert in sensu20:57
amoralejlet me look again...20:57
dmsimardbut it's silenced because of a privilege escalation issue20:57
dmsimardtechnical debt20:57
amoralejbut i think it's a different issue20:57
dmsimardCheckDisk WARNING: /var/lib/origin/openshift.local.volumes/pods/8b789f3a-f648-11e7-91a9-fa163e7f8b33/volumes/kubernetes.io~secret/service-catalog-apiserver-token-2rmhx Unable to read., /var/lib/origin/openshift.local.volumes/pods/8b789f3a-f648-11e7-91a9-fa163e7f8b33/volumes/kubernetes.io~secret/apiserver-ssl Unable to read20:57
amoralejthe problem that happened was root filesystem usage20:57
dmsimardit's check disk20:58
dmsimardcheck disk checks the available space20:58
dmsimardthe other technical debt is that we store a persistent journal and we don't limit the growth of it20:58
dmsimardthe default is like.. 8GB and openshift logs like crazy20:58
amoralejdmsimard, but that alerted just appeared now when starting the services again20:59
amoralejwhen service was down20:59
amoralejit wasn't there before, i think20:59
dmsimardit was20:59
dmsimardthe service is set to be silenced until reocvery20:59
dmsimardif it's not ringing right now (since there is a privilege escalation issue) it's because it never recovered20:59
dmsimardoh actually it did start ringing20:59
dmsimardso likely because the volumes were unmounted and there was no disk space issue ?21:00
amoralejin fact I'd say all those /var/lib/origin/... were not mounted b efore21:00
amoralejexactly21:00
amoralejdmsimard, what i've done is just to remove old messages files21:00
amoralejand gzip the previous one21:00
amoralejthat was it21:00
dmsimardyeah, but look21:01
dmsimard# du -sh journal/21:01
dmsimard8.1Gjournal/21:01
*** toure is now known as toure|gone21:01
dmsimardmessages is intense, yes, but journal also21:01
amoralejand with that i recovered ~21GB21:01
dmsimardI'll apply a temporary bandaid -- journalctl --vacuum-size=500M in the crontab21:01
amoralejyes, but it was faster to remove messages that to prune journal, at least that's what i thought :)21:01
dmsimardideally we need to set a max size to the journal growth21:01
amoralejwe could also limit the usage of messages with logrotate iirc21:02
amoralejand openshift is super verbose21:02
amoraleji'm not sure if there is any kind of debug enabled21:02
amoralejapevec asked before21:02
dmsimardopenshift itself isn't that bad21:02
dmsimardit's docker-registry that's bad21:03
*** Jeffrey4l has joined #rdo21:03
amoralejok21:03
amoralejdmsimard, i need to leave now21:03
*** eharney has quit IRC21:03
dmsimardthe docker-registry pod has a debug loglevel21:03
dmsimardI've tried to make it not debug before but did not suceed21:03
amoralejok21:05
*** amoralej is now known as amoralej|off21:06
rdogerritJon Schlueter created openstack/networking-bgpvpn-distgit rpm-master: adding BR version guard on bagpipe  https://review.rdoproject.org/r/1128621:07
*** dustins has quit IRC21:10
*** dustins has joined #rdo21:18
*** rhallisey has quit IRC21:22
*** pradk has quit IRC21:28
rdogerritMerged rdo-infra/rdo-container-registry master: Configure the projects  https://review.rdoproject.org/r/1084221:34
rdogerritAlan Pevec proposed openstack/networking-bgpvpn-distgit rpm-master: adding BR version guard on bagpipe  https://review.rdoproject.org/r/1128621:35
*** trown is now known as trown|outtypewww21:38
*** apevec has quit IRC21:40
*** pcaruana has joined #rdo21:42
*** jmlowe has quit IRC21:42
*** jayg is now known as jayg|g0n321:42
*** pcaruana has quit IRC21:43
dhellmannjschlueter : would you mind starting a mailing list thread on openstack-dev about the ceilometerclient question? I saw your comment on the governance change, but I'm not sure if anyone else involved is going to (lots of people disable gerrit email notification)21:44
jschlueterdhellmann: ack ... is it a reasonable concern?21:44
jschlueteror am I barking at missing paperwork/busywork that happens all the time?21:45
dhellmannjschlueter : maybe? the most likely course of action is to encourage the remaining consumers to drop it21:45
dhellmannI mean, we have lots of dependencies we should clean up, but this one in particular we should have dealt with21:45
dhellmannit's possible there are reasons heat and those other consumers want to keep supporting it (for legacy clouds?)21:46
rdogerritGonĂ©ri Le Bouder proposed rdo-infra/rdo-container-registry master: run_tests: add some functional tests  https://review.rdoproject.org/r/1102321:46
*** dr_gogeta86 has quit IRC21:47
*** amuller has quit IRC21:50
jschlueterdhellmann: but from what I can see there wasn't discussion of who was still consuming ceilometerclient currently in the Queens cycle and no pressure at the point of retirement to prune usage of it as much as possible21:51
jschlueterI'll open the retire thread with a question21:51
*** jtomasek has quit IRC21:51
*** threestrands_ has joined #rdo21:52
*** threestrands_ has quit IRC21:53
*** threestrands_ has joined #rdo21:53
*** threestrands has quit IRC21:54
*** dustins has quit IRC21:54
jschlueterdhellmann: is there any good way to check where python-ceilometerclient is still in the requirements.txt for openstack projects?22:01
jschlueterI have located 4 examples but wondering if there is a better way to do the check22:01
*** masber has joined #rdo22:02
jschlueterhttp://codesearch.openstack.org/?q=python-ceilometerclient&i=nope&files=requirements.txt22:06
jschlueterfound it22:06
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: magnum: http://trunk.rdoproject.org/centos7-master/report.html22:09
jschlueterdhellmann: responded to "[openstack-dev] [ceilometer] Retiring ceilometerclient" email thread22:10
dhellmannjschlueter : thanks22:11
jschlueterdhellmann: I'm tracking what I find in https://bugzilla.redhat.com/show_bug.cgi?id=153320622:11
openstackbugzilla.redhat.com bug 1533206 in gnocchi "Rename openstack-gnocchi* packages to gnocchi-*" [High,Post] - Assigned to pkilambi22:11
*** rcernin has joined #rdo22:11
jschlueteras a way to let bugzilla help track some of the patches in flight and what we identify where22:11
jschlueterI hope my wording comes across clear enough22:12
jschlueterit's a downstream pain point for packagers22:12
jschlueterbecause once a project is retired you want to ideally stop having to package it or use it in new packages as much as possible22:12
dhellmannyeah, I suspect this just fell through the cracks and the other teams didn't notice the deprecation22:14
dhellmannI think the ceilometer API itself is deprecated, so that's why they deprecated the client22:14
jschlueterdhellmann: sorry wrong bz link https://bugzilla.redhat.com/show_bug.cgi?id=151822222:14
openstackbugzilla.redhat.com bug 1518222 in distribution "[OSP13] Remove ceilometerclient from OSP" [Medium,New] - Assigned to pkilambi22:14
dhellmannah, that one does make more sense :-)22:15
jschlueterdhellmann: yea... but on proposing to retire a project a bit of political capital should be spent on identifying stakeholders who are still referencing it and encouraging them to move off if possible ... LP/patches ...22:16
dhellmannI agree22:16
jschlueternot sure what right governance process is appropiate but well within normal to ask the person propsing the retirement to look at things before approving retirement of a project22:16
jschlueterwell I'm at the end of my day ...22:17
*** nbarcet has quit IRC22:20
*** Son_Goku has joined #rdo22:22
rdogerritDavid Moreau Simard created rdo-infra/rdo-container-registry master: Add missing cacerts for DCI registry  https://review.rdoproject.org/r/1128722:24
-openstackstatus- NOTICE: The zuul system is being restarted to apply security updates and will be offline for several minutes. It will be restarted and changes re-equeued; changes approved during the downtime will need to be rechecked or re-approved.22:24
*** nijaba has joined #rdo22:25
dmsimardFYI registry.distributed-ci.io is now hosted by registry.rdoproject.org (under it's own DNS)22:26
*** jmlowe has joined #rdo22:28
*** jkilpatr has quit IRC22:32
*** Goneri has quit IRC22:34
*** ddmitriev has quit IRC22:36
*** ddmitriev has joined #rdo22:36
*** kgiusti has left #rdo22:37
*** pradk has joined #rdo22:39
*** threestrands_ has quit IRC22:41
*** bfournie has quit IRC22:44
*** bfournie has joined #rdo22:45
*** bfournie has quit IRC22:49
*** choirboy has quit IRC22:50
*** jmlowe has quit IRC22:52
*** morazi has quit IRC22:55
*** threestrands has joined #rdo22:55
*** threestrands has quit IRC22:55
*** threestrands has joined #rdo22:55
*** shep_ has joined #rdo22:56
*** shep__ has joined #rdo22:59
*** racedo has joined #rdo22:59
*** almondjoy has quit IRC23:01
*** shep_ has quit IRC23:02
*** jmelvin has quit IRC23:04
*** atoth has joined #rdo23:08
*** threestrands has quit IRC23:11
*** jmlowe has joined #rdo23:12
*** tosky has quit IRC23:13
*** racedo has quit IRC23:14
*** threestrands has joined #rdo23:20
*** numans has quit IRC23:21
*** numans has joined #rdo23:24
*** social has quit IRC23:36
*** rlandy is now known as rlandy|bbl23:37
*** KarlchenK has joined #rdo23:37
*** wolverineav has quit IRC23:37
*** jmlowe has quit IRC23:44
*** bfournie has joined #rdo23:46
*** jmlowe has joined #rdo23:46
*** pchavva has quit IRC23:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!