Wednesday, 2015-01-14

openstackgerritOpenStack Proposal Bot proposed openstack/designate: Updated from global requirements  https://review.openstack.org/14702500:02
*** chlong has joined #openstack-dns00:05
*** rmoe_ has joined #openstack-dns00:05
*** tryggvil has quit IRC00:07
*** rediskin has joined #openstack-dns00:09
*** pk has quit IRC00:09
*** rmoe has quit IRC00:09
*** redixin has quit IRC00:09
*** tryggvil has joined #openstack-dns00:10
*** pk has joined #openstack-dns00:13
*** simonmcc has joined #openstack-dns00:20
*** vinod1 has joined #openstack-dns00:23
*** vinod1 has quit IRC00:24
*** tryggvil has quit IRC00:34
*** serverascode has joined #openstack-dns00:36
*** tryggvil has joined #openstack-dns00:38
openstackgerritKiall Mac Innes proposed openstack/designate: Update README.md doc build instructions  https://review.openstack.org/14703700:42
*** tryggvil has quit IRC00:55
*** rmoe_ has quit IRC00:57
*** tryggvil has joined #openstack-dns00:57
*** tryggvil has quit IRC00:59
*** Stanley00 has joined #openstack-dns01:01
*** rmoe has joined #openstack-dns01:12
*** shakamunyi has quit IRC01:13
*** stanzgy has joined #openstack-dns01:18
*** nkinder has joined #openstack-dns01:22
*** penick has joined #openstack-dns01:32
*** penick has quit IRC01:51
*** richm has quit IRC02:07
*** mwagner_lap has quit IRC02:29
*** mwagner_lap has joined #openstack-dns02:41
*** shakamunyi has joined #openstack-dns02:41
*** shakamunyi has quit IRC02:47
*** puck has quit IRC02:48
*** harmw has quit IRC02:48
*** shakamunyi has joined #openstack-dns02:48
*** harmw has joined #openstack-dns02:50
*** jmcbride has joined #openstack-dns02:50
openstackgerritstanzgy proposed openstack/designate: Fix powerdns db table records missing column disabled  https://review.openstack.org/14639102:51
*** puck has joined #openstack-dns02:54
*** shakamunyi has quit IRC03:05
*** Stanley|00 has joined #openstack-dns03:16
*** Stanley00 has quit IRC03:20
*** jmcbride has quit IRC03:40
*** harmw has quit IRC03:43
*** simonmcc has quit IRC03:46
*** simonmcc has joined #openstack-dns03:48
*** harmw has joined #openstack-dns03:56
*** Stanley|00 is now known as Stanley0004:02
*** rjrjr_ has quit IRC04:14
openstackgerritstanzgy proposed openstack/designate: Fix powerdns db table records missing column disabled  https://review.openstack.org/14639104:26
*** harmw has quit IRC04:36
*** harmw has joined #openstack-dns04:36
*** hichtakk has quit IRC04:38
*** hichtakk has joined #openstack-dns04:39
*** hichtakk has quit IRC04:39
*** hichtakk has joined #openstack-dns04:39
*** hichtakk has quit IRC04:40
*** hichtakk has joined #openstack-dns04:41
*** hichtakk has quit IRC04:41
*** GonZo2K has quit IRC04:41
*** hichtakk has joined #openstack-dns04:42
*** hichtakk has quit IRC04:42
*** hichtakk has joined #openstack-dns04:42
*** hichtakk has quit IRC04:42
*** hichtakk has joined #openstack-dns04:43
*** zigo has quit IRC05:20
*** zigo has joined #openstack-dns05:21
*** hichtakk has quit IRC05:23
*** hichtakk has joined #openstack-dns05:23
*** hichtakk has quit IRC05:23
*** hichtakk has joined #openstack-dns05:24
*** hichtakk has quit IRC05:24
*** hichtakk_ has joined #openstack-dns05:25
*** hichtak__ has joined #openstack-dns05:26
*** hichtakk_ has quit IRC05:26
*** hichtak__ has quit IRC05:41
openstackgerritOpenStack Proposal Bot proposed openstack/designate: Imported Translations from Transifex  https://review.openstack.org/14707106:09
*** harmw has quit IRC06:22
*** harmw has joined #openstack-dns06:22
ekarlso-Kiall: u up ?06:43
*** serverascode has quit IRC07:12
*** serverascode has joined #openstack-dns07:15
*** nihilifer has joined #openstack-dns07:35
*** chlong has quit IRC07:47
*** hichtakk has joined #openstack-dns08:25
*** hichtakk has quit IRC08:25
*** nkinder has quit IRC08:25
*** nkinder has joined #openstack-dns08:37
*** serverascode has quit IRC09:09
*** jordanP has joined #openstack-dns09:10
*** tryggvil has joined #openstack-dns09:10
*** serverascode has joined #openstack-dns09:12
*** tryggvil has quit IRC09:17
*** Stanley00 has quit IRC10:05
*** eandersson has joined #openstack-dns10:14
openstackgerritEndre Karlson proposed openstack/designate: Support secondary zones  https://review.openstack.org/13368210:16
eanderssonKiall: Did you ever figure out why DBLock wasn't enough for the DB issue?10:45
*** stanzgy has quit IRC10:53
*** untriaged-bot has joined #openstack-dns11:02
untriaged-botUntriaged bugs so far:11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/128944411:02
uvirtbotLaunchpad bug 1289444 in designate "Designate with postgres backend is having issues" [Medium,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/140962911:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/140982411:02
uvirtbotLaunchpad bug 1409629 in designate "powerdns database records table missing 'disabled' column" [Undecided,In progress]11:02
uvirtbotLaunchpad bug 1409824 in designate "The API does not return a status field for recordsets" [Undecided,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/140820211:02
uvirtbotLaunchpad bug 1408202 in designate "Statuses in Pool Manager Cache Are Persistent" [Low,New]11:02
*** untriaged-bot has quit IRC11:02
*** jmcbride has joined #openstack-dns11:09
*** jmcbride has quit IRC11:47
*** mwagner_lap has quit IRC12:00
*** chlong has joined #openstack-dns12:06
*** tryggvil has joined #openstack-dns12:28
*** ryanpetrello has joined #openstack-dns12:53
*** EricGonczer_ has joined #openstack-dns12:55
*** boris-42 has joined #openstack-dns12:56
*** chlong has quit IRC13:02
*** EricGonc_ has joined #openstack-dns13:04
*** EricGonczer_ has quit IRC13:07
*** EricGonc_ has quit IRC13:31
*** mwagner_lap has joined #openstack-dns13:33
*** vinod1 has joined #openstack-dns14:14
*** nkinder has quit IRC14:20
*** richm has joined #openstack-dns14:34
*** jmcbride has joined #openstack-dns14:35
*** jmcbride has quit IRC14:38
*** jmcbride has joined #openstack-dns14:39
*** EricGonczer_ has joined #openstack-dns14:54
*** eandersson has quit IRC14:56
*** eandersson has joined #openstack-dns14:56
*** jmcbride has quit IRC15:01
*** jmcbride has joined #openstack-dns15:02
*** nkinder has joined #openstack-dns15:10
*** jmcbride has quit IRC15:31
*** nihilifer has quit IRC15:36
*** paul_glass has joined #openstack-dns15:37
*** csoukup has joined #openstack-dns15:37
*** richm has quit IRC15:38
*** vinod1 has quit IRC15:40
*** richm has joined #openstack-dns15:40
*** vinod1 has joined #openstack-dns15:41
*** jmcbride has joined #openstack-dns15:51
*** jmcbride has quit IRC15:52
*** jmcbride has joined #openstack-dns15:53
*** ryanpetrello_ has joined #openstack-dns16:04
*** ryanpetrello has quit IRC16:08
*** ryanpetrello_ is now known as ryanpetrello16:08
*** uvirtbot has quit IRC16:25
*** vinod1 has quit IRC16:30
*** timsim has joined #openstack-dns16:33
openstackgerritRon Rickard proposed openstack/designate: Ensure Pool Manager Works for Multiple Backend Servers  https://review.openstack.org/14624616:43
openstackgerritRon Rickard proposed openstack/designate: WIP Add Unit Tests for Pool Manager  https://review.openstack.org/14724116:43
*** rjrjr_ has joined #openstack-dns16:47
timsimIRC meet?17:00
KiallYep17:00
*** untriaged-bot has joined #openstack-dns17:02
untriaged-botUntriaged bugs so far:17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/128944417:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/140962917:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/140982417:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/140820217:02
*** untriaged-bot has quit IRC17:02
*** vinod1 has joined #openstack-dns17:04
*** penick has joined #openstack-dns17:05
*** vinod1 has quit IRC17:05
*** vinod1 has joined #openstack-dns17:07
*** tryggvil has quit IRC17:08
*** tryggvil has joined #openstack-dns17:10
openstackgerritGraham Hayes proposed openstack/designate: Moved to oslo_db namespace  https://review.openstack.org/14725117:11
*** jmcbride has quit IRC17:14
*** rmoe has quit IRC17:17
*** jmcbride has joined #openstack-dns17:36
*** rmoe has joined #openstack-dns17:37
*** jmcbride1 has joined #openstack-dns17:39
*** jmcbride has quit IRC17:41
rjrjr_vinod1: are you on?17:44
*** rmoe has quit IRC17:44
*** rmoe has joined #openstack-dns17:45
*** jordanP has quit IRC17:48
*** jmcbride1 has quit IRC17:48
*** jmcbride has joined #openstack-dns17:48
vinod1hi rjrjr_17:56
*** kbyrne has quit IRC17:56
Kiallhttps://review.openstack.org/#/c/147012/ and https://review.openstack.org/#/c/147251/ are two trivial reviews for oslo.* -> oslo_* switchover's.. vinod1 / betsy culd you through a quick eye over them before they go out of date? :)17:58
betsykiall: sure17:59
vinod1kiall - i had question for https://review.openstack.org/#/c/147012/17:59
vinod1Should requirements.txt be updated too?17:59
*** penick has quit IRC17:59
KiallThat was already updated a while back, currently, both oslo.* and oslo_* will work for all the oslo packages18:00
vinod1the requirements.txt currently has oslo.middleware - so is that fine?18:00
KiallYep - pypi package is still called that18:01
vinod1ok18:01
*** penick has joined #openstack-dns18:03
KiallI'm 99% sure the oslo pypi packages will always be called that, but the code under oslo_*18:03
Kiallrenaming the pypi package has much more fallout than renaming the code inside and leaving a backwards compat shim under oslo.* ;)18:04
vinod1Okay both the changes are approved - one by Betsy and another by me18:05
betsyOr in one case, by both of us. :D18:06
*** chlong has joined #openstack-dns18:10
Kiall;)18:11
rjrjr_vinod1: sorry, was working on fixes for your comments.  what do you mean by the first comment here:18:12
rjrjr_https://review.openstack.org/#/c/146246/1/designate/pool_manager/service.py18:12
rjrjr_in the code (remember, this code relies on a persistent status) the update_status serial reflects the serial number of the domain from the server.18:14
vinod1i was thinking of the case when we create a domain - the domain is still pending and and now some changes occur18:14
openstackgerritMerged openstack/designate: Switch to oslo_middleware namespace  https://review.openstack.org/14701218:15
rjrjr_domain is pending to be created?18:15
vinod1but yesterday evening i was looking some more at the code - and i don't think it matters18:15
rjrjr_if that is the case, no update_status will exist.18:15
vinod1so you can ignore the comment18:15
rjrjr_okay.18:15
rjrjr_you'll be happy to know i unraveled some of the methods calling methods.18:16
vinod1what are you referring to?18:16
rjrjr_let me post the new code up in paste.  just a sec.18:16
vinod1ok - will wait for it18:16
rjrjr_http://paste.openstack.org/show/157996/18:17
rjrjr_you had a comment last week about too many nested methods.  for this particular code, i unraveled that so there are not multiple for-loops, one try-except, etc.18:18
rjrjr_anyway, the code is in a state where it will be easy for me to remove the statuses from the cache.  will work on that right after i get the unit tests done.18:19
openstackgerritKiall Mac Innes proposed openstack/designate: Update Vagrantfile with new Ubuntu box  https://review.openstack.org/14726618:22
vinod1rjrjr_: I see that you uploaded patchset 2 for https://review.openstack.org/#/c/146246/2. But I do not see any difference between that and patchset 118:23
Kiallvinod1: it likely auto-rebased over master18:24
Kiall(I tend to `git review -R` to avoid that, and only rebase when I suspect a merge conflict is likely..)18:24
*** tryggvil has quit IRC18:25
Kiallvinod1: one way to notice that BTW is - Your -1 on PS1 "stuck" around for PS2 :)18:27
*** tryggvil has joined #openstack-dns18:30
*** tryggvil has quit IRC18:31
openstackgerritMerged openstack/designate: Fix powerdns db table records missing column disabled  https://review.openstack.org/14639118:31
rjrjr_vinod1: what kiall said. :)18:34
*** mwagner_lap has quit IRC18:35
openstackgerritMerged openstack/designate: Imported Translations from Transifex  https://review.openstack.org/14707118:38
openstackgerritKiall Mac Innes proposed openstack/designate: Add .coveragerc configuration file  https://review.openstack.org/14727018:47
KiallWould be good to get ^ merged before tomorrow, filters some unwanted stuff from the coverage reports18:47
*** penick has quit IRC18:49
timsimApparently the deadline for Vancouver summit talk submissions is Feb 9. I guess we should talk about that at some point.18:49
vinod1what does the ignore-errors do - what errors is that ignoring?18:49
*** penick has joined #openstack-dns18:50
*** penick_ has joined #openstack-dns18:52
Kiallvinod1: I'm honestly not 100% sure! I robbed nova's config file ;)18:52
KiallFYI - I've also submitted a change to the CI system to run a coverage report as part of the initial check pipeline...18:52
vinod1is that to openstack-infra?18:53
KiallYep - https://review.openstack.org/#/c/147272/18:53
*** penick has quit IRC18:55
*** penick_ is now known as penick18:55
KiallCoverage report: 64% after the config file addition.. 59% before.. Slightly better ;)18:56
vinod1so the post section had coverage before?18:58
vinod1kiall do you know how much time the coverage adds to the check pipeline?19:01
KiallIt shouldn't add any time, it will run in parallel to the other longer running jobs like devstack-pdns/bind and rally19:01
KiallOn occasion, when the CI system is backed up, it could in theory make us wait a little while to get another slave to run on.. But usually the contention is for the devstack slaves rather than bare slaves this + unit tests run on ..19:02
*** penick has quit IRC19:04
*** penick has joined #openstack-dns19:06
openstackgerritKiall Mac Innes proposed openstack/designate: Remove dead SQLAlchemy code  https://review.openstack.org/14727519:06
openstackgerritKiall Mac Innes proposed openstack/designate: Remove dead SQLAlchemy code  https://review.openstack.org/14727519:19
openstackgerritKiall Mac Innes proposed openstack/designate: Remove dead designate.wsgi  https://review.openstack.org/14727819:22
*** jmcbride has quit IRC19:24
*** penick has quit IRC19:27
*** jmcbride has joined #openstack-dns19:36
*** nkinder has quit IRC19:38
*** GonZo2000 has joined #openstack-dns19:46
openstackgerritRon Rickard proposed openstack/designate: Ensure Pool Manager Works for Multiple Backend Servers  https://review.openstack.org/14624619:46
openstackgerritRon Rickard proposed openstack/designate: WIP Add Unit Tests for Pool Manager  https://review.openstack.org/14724119:49
*** mwagner_lap has joined #openstack-dns19:56
*** paul_glass has quit IRC20:03
*** jmcbride has quit IRC20:04
*** jmcbride has joined #openstack-dns20:14
openstackgerritMerged openstack/designate: Moved to oslo_db namespace  https://review.openstack.org/14725120:20
*** jmcbride has quit IRC20:33
*** jmcbride has joined #openstack-dns20:37
*** paul_glass has joined #openstack-dns20:57
timsimrjrjr_: around?20:58
*** paul_glass has quit IRC21:02
rjrjr_i'm here tim.21:09
rjrjr_timsim: i'm here.21:09
timsimHave you given much thought to that 'second' periodic sync job? I think the current one was going to be changed to just reading from the PM cache, and then there was going to be another one that was going to sync *everything*21:10
*** paul_glass has joined #openstack-dns21:10
rjrjr_we have 2 periodic syncs right now.  one that "fixes" things and another that runs a periodic sync.  when i remove the cache entries, that second one will be the sync *everything* one.21:11
rjrjr_periodic_recovery and periodic_sync.21:11
rjrjr_i understand it doesn't exactly do that now.21:11
rjrjr_i have a good idea on how to make all this happen.  i wanted to get the unit tests done and work on that next.  tell vinod to quit -1'ing my stuff and things will go faster. :)21:13
timsimI have no control over vinod1 ;) he's a man on a mission.21:13
rjrjr_vinod's fine.  i'm just kidding about that.  he is very good at finding issues.21:13
*** nkinder has joined #openstack-dns21:14
timsimFor the periodic sync (*everything*) is the plan to basically NOTIFY every zone?21:14
rjrjr_every server for every domain that has the domain created, yes.21:15
rjrjr_no point in notifying servers that do not have the domain created.21:15
timsimRight.21:15
rjrjr_right now, it relies on the cache for which servers to notify.  once the cache is cleaned out on successful updates, that won't be the case.21:16
timsimDoes it make more sense to take the changes for a specified configurable time. Say (24 hours to 1 hour ago, or the beginning of time and now) and send SOA queries for those zones to make sure that they've been done, and if not, do the needful thing?21:17
timsimBecause sometimes you'll have things that won't respond to a notify, that need to be created/deleted, etc.21:17
rjrjr_if the domain is in the process of being deleted on a server, we can ignore those updates too.  i don't think the upstream prevents that though, but it should.21:19
rjrjr_for example, i submit a request to delete a domain, but one server fails and the domain is pending delete.  we still allow updates to that domain (that is code outside pool manager though.)21:20
rjrjr_here is my thought, there are going to be a few situations like this.  let me document them and we can talk about those cases next week.21:20
rjrjr_i'm sure you and vinod can come up with others too.21:21
rjrjr_but, by friday, i want the cache to be a true cache, so we can work from that point.21:21
timsimSure. I've just been thinking, and disucssing with some folks, and I think that sync process can be really valuable, and I want to make sure we think hard on it.21:21
rjrjr_i'm not keen on having sync remove domains from unmanaged servers though. :)21:22
timsimDefinitely not ones that Designate has never managed.21:22
rjrjr_i know i heard that last week.  remember, we went with unmanaged for our default.  that means the server is not managed by pool manager, meaning the admin set up the server and we shouldn't be touching existing domains on those servers.21:23
rjrjr_when we talk about managed servers (so far these are just concepts and not reality in the code) then i can see the pool manager completely controlling the domains on the server.21:23
*** jmcbride has quit IRC21:24
rjrjr_i digress.21:24
timsimThis process should still be able to be used with a "unmanaged" server though.21:25
rjrjr_then i want a flag that will determine how those cases are handled.21:25
rjrjr_we can talk about this next week though.  peripheral to where i want to be by friday.21:26
timsimIt'll definitely have to be thought out well. But if done right, that process has huge potential from our point of view. We can't have it deleting things Designate doesn't/hasn't managed either.21:26
timsimYeah, for sure.21:26
rjrjr_okay, let me finish the unit tests today, get vinod to +1 everything, and i'll have code to cleanup the cache by friday.21:27
rjrjr_the biggest tests I have not run are when we have multiple pool manager instances.  as far as multiple backend instances, i feel we have a good grasp on that right now and it works.21:28
rjrjr_i hope that will be addressed tomorrow with our sprint.21:29
timsimSounds like something to be functionally tested, rather than with a unit test.21:29
rjrjr_exactly.21:30
rjrjr_unit tests *will* cover multiple backends though.  i'm making sure of that.21:30
openstackgerritMerged openstack/designate: Add .coveragerc configuration file  https://review.openstack.org/14727021:31
rjrjr_i'm not sure if we have tests for multiple instance of any of our components though.21:32
rjrjr_2 centrals, 2 mdns, 2 api, 2 sink, etc.21:32
rjrjr_maybe we do and i just haven't stumbled across that code yet.21:32
*** jmcbride has joined #openstack-dns21:42
*** jmcbride has quit IRC21:44
*** jmcbride has joined #openstack-dns21:44
*** jmcbride has quit IRC21:45
*** chlong has quit IRC21:47
*** jmcbride has joined #openstack-dns21:49
Kiallgrr @ merge conflicts -_-21:50
openstackgerritKiall Mac Innes proposed openstack/designate: Remove dead SQLAlchemy code  https://review.openstack.org/14727521:51
openstackgerritKiall Mac Innes proposed openstack/designate: Remove dead designate.wsgi  https://review.openstack.org/14727821:51
Kiallvinod1 / betsy - when you get a chance, can you re-review this one? https://review.openstack.org/#/c/147275/ merge failed and needed a rebase -_-22:33
vinod1kiall - got a chance - rereviewed :-)22:37
KiallExcellent :) Thanks..22:37
KiallEyeballing the coverage reports identified some obvious dead code - may as well remove it before we go write tests for it ;)22:38
*** paul_glass1 has joined #openstack-dns22:38
*** jmcbride has quit IRC22:39
*** paul_glass has quit IRC22:40
vinod1ah - so now all the dead code changes - make sense22:41
KiallYea, Just identifying areas - seeing code with 0% makes me think it's A) totally untested, and B) totally unsed ;)22:43
openstackgerritMerged openstack/designate: Update Vagrantfile with new Ubuntu box  https://review.openstack.org/14726622:44
Kialle.g. lots of dead methods in here: http://logs.openstack.org/75/147275/2/check/designate-coverage/59b584d/cover/designate_rpc.html22:44
*** csoukup has quit IRC22:47
*** ryanpetrello has quit IRC23:02
*** EricGonczer_ has quit IRC23:02
*** ryanpetrello has joined #openstack-dns23:03
*** timsim has quit IRC23:05
openstackgerritKiall Mac Innes proposed openstack/designate: Moved to oslo_utils namespace  https://review.openstack.org/14733123:26
*** rjrjr_ has quit IRC23:29
*** paul_glass1 has quit IRC23:32
openstackgerritMerged openstack/designate: Remove dead SQLAlchemy code  https://review.openstack.org/14727523:38
openstackgerritMerged openstack/designate: Remove dead designate.wsgi  https://review.openstack.org/14727823:39
*** csoukup has joined #openstack-dns23:46
*** ryanpetrello has quit IRC23:46
*** vinod1 has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!