Thursday, 2015-07-09

*** richm has quit IRC00:34
*** dtx00ff has quit IRC00:36
*** lpmulligan has joined #openstack-dns00:47
*** dguerri` is now known as dguerri01:29
*** CTWill has joined #openstack-dns01:29
CTWillHas anyone had experience installing designate on a control node?01:30
*** lpmulligan has quit IRC01:35
*** stanzgy has joined #openstack-dns01:35
*** bitblt has quit IRC01:45
*** cing has joined #openstack-dns02:14
*** cing has quit IRC02:14
*** cing has joined #openstack-dns02:14
*** dguerri is now known as dguerri`02:17
*** CTWill has quit IRC02:21
*** dguerri` is now known as dguerri02:22
*** dguerri is now known as dguerri`02:25
*** dguerri` is now known as dguerri02:30
*** dguerri is now known as dguerri`02:34
*** rbrooker has quit IRC02:56
*** jmcbride has quit IRC03:14
*** rudrajit has joined #openstack-dns03:20
*** crc32 has joined #openstack-dns03:21
*** rudrajit_ has quit IRC03:23
*** pksingh has joined #openstack-dns04:29
pksinghekarlso : hi there?04:29
*** rudrajit has quit IRC04:40
openstackgerritsonu proposed openstack/designate: Fix for ttl values  https://review.openstack.org/19904605:20
*** rudrajit has joined #openstack-dns05:27
*** rudrajit has quit IRC05:35
*** rudrajit has joined #openstack-dns05:35
*** rudrajit has quit IRC05:37
*** rudrajit has joined #openstack-dns05:37
*** fawadkhaliq has joined #openstack-dns05:45
*** ig0r_ has joined #openstack-dns05:52
*** ig0r__ has quit IRC05:55
openstackgerritOpenStack Proposal Bot proposed openstack/designate: Imported Translations from Transifex  https://review.openstack.org/19989406:13
*** crc32 has quit IRC06:23
openstackgerritPradeep Kumar Singh proposed openstack/designate: Handle unhandled exception in dnsutils.py for py3  https://review.openstack.org/19893506:31
*** dguerri` is now known as dguerri06:40
*** dguerri is now known as dguerri`06:46
*** rudrajit has quit IRC06:53
*** nihilifer has joined #openstack-dns06:58
*** hetii has joined #openstack-dns07:02
hetiiHello :)07:03
pksinghhetii, Hi :)07:04
ekarlsomorning :P08:03
pksinghgood morning!!08:06
federico3hi08:20
*** l6unchpad has joined #openstack-dns08:40
openstackgerritEndre Karlson proposed openstack/designate: Increase coverage of RRset tests  https://review.openstack.org/18454508:56
*** l6unchpad has quit IRC09:01
*** nihilifer has quit IRC09:13
*** jordanP has joined #openstack-dns09:16
*** l6unchpad has joined #openstack-dns09:17
*** rudrajit has joined #openstack-dns09:20
*** fawadkhaliq has quit IRC09:22
hetiione question: between juno and kilo version of designate was a big jump09:24
*** rudrajit has quit IRC09:24
hetiibut now I wonder about one aspect, designate is mostly a just a event consumer and can works standalone09:24
hetiiso why not to use kilo version of designate with juno infrastructure ?09:25
*** pksingh has quit IRC09:25
hetiiwhat in such configuration will not works ?09:25
*** nihilifer has joined #openstack-dns09:55
hetiiKiall: hi, are you here?09:55
hetiiI have a question about: self.storage.update_record, why its used in _delete_record_in_storage instead just record = self.storage.delete_record(context, record_id)09:56
hetii?09:56
hetiiby some reason my records are not deleted :/09:56
hetiieven here in line 1561 we have it https://github.com/openstack/designate/blob/master/designate/central/service.py09:58
hetiiis it a bug or decition what to do is made there by setting record.action flag ?09:58
*** stanzgy has quit IRC10:10
Kiallhetii: heya10:18
*** km has quit IRC10:19
*** km has joined #openstack-dns10:20
Kiallhetii: because, inside _update_record_in_storage we do 2 different DB updates, so they need to be wrapped inside a transaction together. If we make the transaction cover the entire update_record method, then that concurrency issue you're hitting in Juno comes back!10:20
KiallL1495 of the master branch designate/central/service.py will trigger it.. and a similar call to the backend class in Juno would do it too10:21
hetiiwell in my case I don`t have a pool_manager_api10:22
*** fawadkhaliq has joined #openstack-dns10:22
*** fawadkhaliq has quit IRC10:23
*** fawadkhaliq has joined #openstack-dns10:23
hetiiand there in _delete_record_in_storage() we have  self.storage.update_record() not self.update_record()10:25
hetiialso I check this update code and don`t see where/how it can delete a row in db10:29
Kiallhetii: right, in Juno - there's self.backend.update_record(), which will tigger it10:31
KiallLot's of the "deletes" will actually do a SQL UPDATE setting the deleted and deleted_at columns10:32
hetiiKiall: but I don`t talk about self.backend.update() callback, this part works for me, so when I delete a record its erased from my backend plugin. The point is that this record still exist in local designate database10:34
hetiiso its a self.storage* issue10:34
KiallYes, it will still exist - but with the deleted flag set, so shouldn't show up in the API after that10:34
KiallPeriodiically, those should be cleared out..10:35
hetiihmm \10:35
KiallOh10:35
Kiallactually10:35
Kiallthat's domains10:35
Kiallnot records/recordsets10:35
hetiiwell... in my case they are in db and when create a second record than got exception that already exist10:36
hetiialso in juno record object have no "action" atribbute10:36
KiallYea, action is a new thing introduced with pool manager in Kilo10:36
hetiiso suppose all logic that thouch this attribute is also not implemented10:36
KiallYes, that's part of Kilo changes to make things async - though pool manager10:37
hetiiok but still why I see those record in juno if you say that they should not be visible10:38
hetiibtw also wonder whats the purpose of keeping data in db that are no longer needed10:38
KiallI confident that bug doesn't exist in stock juno! deleting records is something we test :) Could the backport have missed a call? let me check that pastebin.. or have you updated furthur?10:38
hetiithis is my current file of service.py: http://demo.ovh.eu/download/20341324cf25243dabe0b9b39fe3d072/service.py10:40
hetiiand lockutils that are not exist in juno: http://demo.ovh.eu/download/f20b4d7c100d75d5e25786fb69a0d6d4/lockutils.py10:41
Kialllol ..        LOG.debug("WTF ??????") <-- I usually use more swear words10:44
Kiall;)10:44
KiallSo - When you call delete_recordset, surely that's exploding as your doing the action/status field stuff (which can be just removed  in Juno)10:45
Kiallsame in delete_record_from_storage10:45
hetiiye, but suppose they are ingonerd anyway ?10:46
KiallNope, that should cause issues10:47
KiallTry these two: http://paste.openstack.org/show/358258/10:47
Kiall(should - it might not I guess!)10:47
hetiisure, if I use record = self.storage.delete_record(context, record.id) instead update then it work10:50
hetiibut I thought it was to use update10:50
hetiiso you say that I need to rid from it all record.status/record.action/record.serial  ?10:51
KiallIn the delete? Nope, that's not the right way (I was mistaken a few mins ago)10:51
KiallYes - status and action don't exist or do anything in Juno, serial in that particular case, was related to more Kilo changes so was also not needed10:52
*** eandersson has joined #openstack-dns10:56
hetiiok so I read all  code that was related to record.status/record.action/record.serial but keep in _delete_record_in_storage call to  self.storage.update_record()10:57
hetiibut still my records are not deleted10:57
hetiiand are visible in CLI10:58
hetiiwhen put record = self.storage.delete_record(context, record.id) instead update then looks fine10:58
hetiibut you say its not a proper way10:58
openstackgerritEndre Karlson proposed openstack/designate: Verify DNS changes when updating RRSet  https://review.openstack.org/18671711:02
KiallIn Kilo, we don't delete the records at that point - we do it elsewhere. In juno, we have to do a delete there rather than an update11:06
*** fawadkhaliq has quit IRC11:06
hetiiahh then ok, need to change it to delete then :)11:06
hetiiok other point that you might to help, any idea if kilo designate will works with juno ?11:07
*** fawadkhaliq has joined #openstack-dns11:08
KiallYes, Kilo (or even master) Designate should work fine with Juno OpenStack11:08
hetiihuh. ok the whats the point to do this backporting ?:")11:09
hetii:)11:09
KiallBecause people want Juno with their Juno clouds!11:10
hetiiwhat you mean by that  ?11:11
KiallPeople running Juno are often more comfortable running Juno for everything - it's valid to do that!11:11
hetiiI guess its better to use latest components if he are able to works fine with old release:)11:11
hetiiyep, I see :)11:12
*** pksingh has joined #openstack-dns11:14
pksinghHi Kiall ,11:15
Kiallpksingh: heya11:15
pksinghalmost all UTS are running with py3 except two files,11:15
pksinghi am getting some problem can you please help me out11:16
KiallCool! Sure.. What's still broke?11:16
pksinghhttp://paste.openstack.org/show/357826/11:16
pksinghpaste.openstack.org/show/35804911:16
KiallInteresting - Looking at the NSD tests, I spot two issues offhand - neither I think is your issue though.11:18
Kiall"class NSD4ServerStub:" <-- old style object, needs to change to..11:18
Kiallclass NSD4ServerStub(object):11:19
Kialland the stub is listening on a fixed port number, so concurrency within those tests would cause issues11:19
pksinghOK11:19
pksinghso this is the only fix that is required?11:20
KiallI'm not sure, the first of those two *might* be it..11:20
pksinghok i willl test with this11:20
KiallThe second definatly isn't what you're seeing.. But is an issue, we can fix it later outside of py3 fixes11:20
openstackgerritMerged openstack/designate: Enable filter on blacklists & tlds  https://review.openstack.org/19926311:20
openstackgerritMerged openstack/designate: Imported Translations from Transifex  https://review.openstack.org/19989411:21
openstackgerritMerged openstack/designate: Fix for ttl values  https://review.openstack.org/19904611:21
openstackgerritMerged openstack/designate: Functional tests for Blacklists  https://review.openstack.org/18406811:21
Kiall"exception ssl.SSLWantReadError11:21
KiallA subclass of SSLError raised by a non-blocking SSL socket when trying to read or write data, but more data needs to be received on the underlying TCP transport before the request can be fulfilled."11:21
KiallThat's a new exception in py3.3 - I wonder if the code is doing something odd11:22
pksinghok11:23
KiallAnother possibility.. 1 sec while I write it up11:24
Kiallin the NSD4ServerStub class, try swapping the handle method for this:11:27
Kiall.. cmon paste.openstack.org -_-11:27
Kiallhttp://paste.openstack.org/show/358269/11:27
pksinghOk i will test and let you know the results11:30
Kiallpksingh: and, re the second pastebin.. Can we turn logging back on? it might tell us the issue11:30
pksinghi investigate request.body is byte type in python3.411:31
pksinghhttps://github.com/openstack/designate/blob/master/designate/api/v2/controllers/zones/tasks/imports.py#L7311:31
pksinghi tried to decode that into utf-8 but that does not helped11:31
*** l6unchpad has quit IRC11:35
KiallHumm - I'm not sure.. I would have expected that to be correct.11:35
KiallChances are, the real error is being masked11:35
Kiallhere https://github.com/openstack/designate/blob/master/designate/central/service.py#L251911:35
Kiallcan we add a LOG.exception('An unknown exception was raised during zone import')11:35
Kiallit should log the stacktrace, assuming that's where the issue is11:36
KiallOh - we also do..11:36
Kiallrequest_body = str(request_body)11:36
KiallThat'll explode in py3, right?11:36
*** ducttape_ has joined #openstack-dns11:37
KiallYep - That might just be it11:37
Kiall>>> foo = 'a'.encode('utf-8')11:37
Kiall>>> foo11:37
Kiallb'a'11:37
Kiall>>> str(foo)11:37
Kiall"b'a'"11:37
pksinghif i dont decode in imports.py then the content of body is changed in central/service.py, its some list instead of some text11:38
*** cing has quit IRC11:39
KiallI'm not sure I follow :)11:40
KiallI believe you're right to do the utf8 change in api/v2/tasks/import.py11:40
KiallBut - I think https://github.com/openstack/designate/blob/master/designate/central/service.py#L2491 is then breaking it11:40
Kiall(I *think* - I barely ever use py3 ;))11:40
pksinghyes after that i am getting something like 'byte type no method read' from dnspython311:41
pksingh*'bytes  type has no method read'11:41
KiallHumm - I wonder what dnspy3 is expecting as input then..11:41
openstackgerritMerged openstack/designate: Increase coverage of RRset tests  https://review.openstack.org/18454511:41
openstackgerritMerged openstack/designate: Resolve one py3 compatibility issue  https://review.openstack.org/19935911:41
pksinghi will look into these issues in coming days, by the way when can we enable py34 gates11:42
Kiall:)11:42
pksinghotherwise we have to repeat  the changes in future, what do you think11:43
KiallAbsolutly, once we pass a py34 gate, we'll turn it on11:44
pksinghok11:44
pksingh:)11:44
pksinghand old subunit parser error which we discussed disappeared at my end when i set DESIGNATE_SQL_DEBUG to false11:46
pksinghi dont know what is the relation11:46
KiallCool, I've been meaning to fixup that var for a while but kept forgettting :)11:46
KiallAnd - the relation is odd.. Not sure why, but it's still an issue somewhere!11:47
pksinghbtw what is the purpose of this env variable11:47
*** ducttape_ has quit IRC11:51
Kiallpksingh: to hide to excessive SQL logging :)11:54
*** fawadkhaliq has quit IRC12:22
*** ducttape_ has joined #openstack-dns12:31
*** ducttape_ has quit IRC12:32
*** ducttape_ has joined #openstack-dns12:33
*** kei_yama has quit IRC12:33
*** l6unchpad has joined #openstack-dns12:35
*** cing has joined #openstack-dns12:36
Kialltimsim: found the issue with leader election etc you noticed..12:36
KiallFundamental flaw buried in here ;)12:36
*** ducttape_ has quit IRC12:37
*** l6unchpad has quit IRC12:41
*** fawadkhaliq has joined #openstack-dns12:45
*** pserebryakov has joined #openstack-dns12:48
Kialltimsim: also - workers = 2 in PM logs a trace when you Ctrl+C :/13:00
*** fawadkhaliq has quit IRC13:01
*** pksingh has quit IRC13:02
*** l6unchpad has joined #openstack-dns13:07
*** rbrooker has joined #openstack-dns13:13
*** ducttape_ has joined #openstack-dns13:16
*** ducttape_ has quit IRC13:22
openstackgerritKiall Mac Innes proposed openstack/designate: Default to memcache for PM cache  https://review.openstack.org/20007113:23
*** richm has joined #openstack-dns13:23
openstackgerritKiall Mac Innes proposed openstack/designate: Implement support for LeaderElections  https://review.openstack.org/19470513:24
openstackgerritKiall Mac Innes proposed openstack/designate: Ensure only one pool-manager performs periodic tasks  https://review.openstack.org/19462613:24
openstackgerritKiall Mac Innes proposed openstack/designate: Standup coordination during start  https://review.openstack.org/20007213:24
*** km has quit IRC13:24
Kialltimsim: should fix the issue13:29
KiallStill eyeballing the workers=2 Ctrl+C stacktrace13:29
*** hetii has quit IRC13:35
*** johnbelamaric has joined #openstack-dns13:44
*** ducttape_ has joined #openstack-dns13:51
*** rbrooker has quit IRC13:51
*** pserebryakov has quit IRC14:00
*** pglass has joined #openstack-dns14:05
KiallIgnore these please ;)14:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20009814:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20009914:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010014:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010114:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010214:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010314:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010414:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010514:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010614:08
openstackgerritKiall Mac Innes proposed openstack/designate: Designate - Gate Canary  https://review.openstack.org/20010714:08
*** jmcbride has joined #openstack-dns14:09
*** jhova has joined #openstack-dns14:09
openstackgerritMimi Lee proposed openstack/designate: Add support for Host header in REST queries  https://review.openstack.org/19974414:09
*** l6unchpad has quit IRC14:16
*** cing has quit IRC14:19
*** lpmulligan has joined #openstack-dns14:36
*** nihilifer has quit IRC14:39
*** l6unchpad has joined #openstack-dns14:51
*** mlavalle has joined #openstack-dns14:56
*** jmcbride has quit IRC15:01
*** jmcbride has joined #openstack-dns15:02
*** csoukup has joined #openstack-dns15:02
timsimIt does fix the issue Kiall :)15:08
openstackgerritEndre Karlson proposed openstack/designate: Verify DNS changes when updating RRSet  https://review.openstack.org/18671715:16
*** jmcbride has quit IRC15:17
*** jmcbride has joined #openstack-dns15:17
Kialltimsim: excellent :)15:22
Kialland 3 of 10 of my canary reviews failed -_- All 3 on powerdns gate15:23
timsim:/15:24
timsimAre you still looking into the stack trace when you C-c or do you want to merge these?15:25
*** ducttape_ has quit IRC15:27
timsimOh maybe the sample config should change zookeeper->kazoo?15:29
Kiallgrr ekarlso! ;)15:30
KiallYea, I'll drop a patch for that now15:30
*** ducttape_ has joined #openstack-dns15:30
openstackgerritKiall Mac Innes proposed openstack/designate: Correct sample coord URL  https://review.openstack.org/20014915:31
Kialltimsim / mugsie: ^15:31
*** nihilifer has joined #openstack-dns15:34
*** nihilifer has quit IRC15:34
*** cing has joined #openstack-dns15:46
*** ducttape_ has joined #openstack-dns15:51
openstackgerritMerged openstack/designate: Standup coordination during start  https://review.openstack.org/20007215:59
*** l6unchpad has quit IRC16:00
*** jschwarz has joined #openstack-dns16:00
*** l6unchpad has joined #openstack-dns16:02
openstackgerritMerged openstack/designate: Implement support for LeaderElections  https://review.openstack.org/19470516:02
*** bitblt has joined #openstack-dns16:03
*** fawadkhaliq has joined #openstack-dns16:11
*** boris-42 has quit IRC16:22
openstackgerritMerged openstack/designate: Correct sample coord URL  https://review.openstack.org/20014916:36
*** rudrajit has joined #openstack-dns16:37
*** rudrajit has quit IRC16:37
*** rudrajit has joined #openstack-dns16:37
*** l6unchpad has quit IRC16:39
*** bitblt has quit IRC16:45
*** rudrajit has quit IRC16:53
*** jordanP has quit IRC16:55
*** cing has quit IRC17:02
*** busterswt has joined #openstack-dns17:02
openstackgerritMerged openstack/designate: Ensure only one pool-manager performs periodic tasks  https://review.openstack.org/19462617:07
*** CTWill has joined #openstack-dns17:07
*** rbrooker has joined #openstack-dns17:11
ekarlsoKiall: :D17:11
*** boris-42 has joined #openstack-dns17:20
*** rudrajit has joined #openstack-dns17:21
*** jschwarz has quit IRC17:27
*** naggappan has joined #openstack-dns17:43
*** rudrajit_ has joined #openstack-dns17:59
*** jmcbride has quit IRC17:59
*** jmcbride has joined #openstack-dns18:01
*** rudrajit has quit IRC18:02
*** rbrooker has quit IRC18:34
*** jmcbride has quit IRC18:39
*** CTWill has quit IRC18:40
openstackgerritEric Peterson proposed openstack/designate-dashboard: Record creation / update screen simplification  https://review.openstack.org/19371018:54
*** ducttape_ has quit IRC18:57
*** ducttape_ has joined #openstack-dns18:58
*** jmcbride has joined #openstack-dns18:59
*** jmcbride has quit IRC19:03
*** jmcbride has joined #openstack-dns19:05
*** jmcbride has quit IRC19:05
*** jmcbride has joined #openstack-dns19:06
*** naggappan has quit IRC19:11
*** rbrooker has joined #openstack-dns19:19
openstackgerritMerged openstack/designate: Test - add nicer formating to flake8 output  https://review.openstack.org/19020019:23
*** lpmulligan has quit IRC19:24
Kialllol - why did I only just now notice the commit title on ^? mugsie -_-19:30
timsimhahaha me too19:31
mugsieyurp19:33
mugsieah well19:33
mugsiereview better next time ;)19:34
Kiallnew default review for mugsie's code: -219:34
timsimagreed.19:35
*** rudrajit has joined #openstack-dns19:40
*** rudrajit_ has quit IRC19:43
openstackgerritKiall Mac Innes proposed openstack/designate: Add __pycache__ to ST2 Ignore  https://review.openstack.org/20022919:47
openstackgerritKiall Mac Innes proposed openstack/designate: Refactor mDNS packet finalization  https://review.openstack.org/20023019:47
*** mlavalle has quit IRC19:47
Kialltimsim / mugsie: those ^ please.. Building another important fix on top ;)19:48
* timsim checks for "Test19:49
timsim in the commit msg19:49
*** crc32 has joined #openstack-dns19:55
*** rudrajit_ has joined #openstack-dns20:00
*** rudrajit has quit IRC20:04
*** ducttape_ has quit IRC20:05
*** jmcbride has quit IRC20:05
*** ducttape_ has joined #openstack-dns20:06
*** jmcbride has joined #openstack-dns20:07
*** ducttape_ has quit IRC20:08
*** ducttape_ has joined #openstack-dns20:08
*** mlavalle has joined #openstack-dns20:17
*** CTWill has joined #openstack-dns20:40
*** bustersw_ has joined #openstack-dns20:47
*** rudrajit has joined #openstack-dns20:48
*** bustersw_ has quit IRC20:48
*** rudrajit_ has quit IRC20:51
*** busterswt has quit IRC20:52
*** jmcbride has quit IRC21:03
*** jmcbride has joined #openstack-dns21:07
*** rudrajit_ has joined #openstack-dns21:07
*** rudrajit has quit IRC21:10
*** rudrajit_ has quit IRC21:30
*** rudrajit has joined #openstack-dns21:37
*** CTWill has quit IRC21:40
*** rudrajit has quit IRC21:41
*** rudrajit has joined #openstack-dns21:42
*** johnbelamaric has quit IRC21:43
*** rudrajit has quit IRC21:47
*** rudrajit has joined #openstack-dns21:47
*** jmcbride has quit IRC21:53
*** pglass has quit IRC22:10
*** mlavalle has quit IRC22:11
*** csoukup has quit IRC22:36
*** fawadkhaliq has quit IRC22:43
*** ducttape_ has quit IRC22:59
*** km has joined #openstack-dns23:00
*** rudrajit has quit IRC23:10
*** kei_yama has joined #openstack-dns23:21
*** rudrajit has joined #openstack-dns23:21
*** pksingh has joined #openstack-dns23:25
*** pksingh has quit IRC23:29
*** dtx00ff has joined #openstack-dns23:31
*** openstack has joined #openstack-dns23:40
*** ChanServ sets mode: +v openstack23:40
*** dtx00ff has quit IRC23:45
*** pksingh has joined #openstack-dns23:46
*** chlong has quit IRC23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!