Tuesday, 2015-07-07

*** chlong has quit IRC00:08
*** johnbelamaric has joined #openstack-dns00:18
*** cing has joined #openstack-dns00:21
*** ducttape_ has joined #openstack-dns00:31
*** ducttape_ has quit IRC00:40
*** stanzgy has joined #openstack-dns00:44
*** fawadkhaliq has joined #openstack-dns00:53
*** cing has quit IRC00:54
*** pksingh has joined #openstack-dns00:54
*** fawadkhaliq has quit IRC00:56
*** johnbelamaric has quit IRC01:00
*** ducttape_ has joined #openstack-dns01:14
*** cing has joined #openstack-dns01:28
*** chlong has joined #openstack-dns01:30
*** ducttape_ has quit IRC01:32
openstackgerritPradeep Kumar Singh proposed openstack/designate: Handle unhandled exception in dnsutils.py for py3  https://review.openstack.org/19893501:47
*** jmcbride has joined #openstack-dns01:59
*** richm has quit IRC02:33
*** rudrajit has joined #openstack-dns04:30
*** nihilifer has joined #openstack-dns04:59
*** Trozz_ is now known as Trozz05:50
TrozzMorning everyone05:51
*** ig0r_ has joined #openstack-dns05:52
*** ig0r__ has quit IRC05:55
pksinghTrozz, Good morning!06:09
Trozzhow's your day so far pksingh06:14
pksinghTrozz, good  and yours?06:15
TrozzGood so far06:15
pksingh:)06:16
*** gcmacmalloc has joined #openstack-dns06:17
*** hetii has joined #openstack-dns06:42
*** stanzgy has quit IRC07:05
*** stanzgy has joined #openstack-dns07:07
openstackgerritsonu proposed openstack/python-designateclient: Fix for ttl values  https://review.openstack.org/19859807:09
*** jordanP has joined #openstack-dns07:41
*** rudrajit_ has joined #openstack-dns07:55
*** rudrajit has quit IRC07:58
*** l6unchpad has joined #openstack-dns08:06
*** ToMiles has quit IRC08:10
*** chlong has quit IRC08:13
*** rudrajit_ has quit IRC08:21
*** pksingh has quit IRC08:35
*** pksingh has joined #openstack-dns08:36
*** l6unchpad has quit IRC09:11
*** kei_yama has quit IRC09:17
*** km has quit IRC09:17
*** km has joined #openstack-dns09:17
*** kei_yama has joined #openstack-dns09:18
*** boris-42 has quit IRC09:22
*** l6unchpad has joined #openstack-dns09:29
*** katterstrophe has joined #openstack-dns09:42
*** pksingh has quit IRC09:48
*** pksingh has joined #openstack-dns10:01
hetii2015-07-07 12:03:05.037 21615 TRACE oslo.messaging.notify.dispatcher RemoteError: Remote error: OperationalError (OperationalError) database is locked u'INSERT INTO recordsets10:04
*** pksingh has quit IRC10:09
*** l6unchpad has quit IRC10:11
*** l6unchpad has joined #openstack-dns10:22
*** stanzgy has quit IRC10:51
openstackgerritsonu proposed openstack/designate: Fix for ttl values  https://review.openstack.org/19904610:56
openstackgerritMerged openstack/designate: Ensure test_find_zone_imports waits for all imports  https://review.openstack.org/19796810:59
*** l6unchpad has quit IRC11:18
*** km has quit IRC11:29
*** cing has quit IRC11:33
*** l6unchpad has joined #openstack-dns11:35
*** kei_yama has quit IRC11:37
*** l6unchpad has quit IRC11:40
*** l6unchpad has joined #openstack-dns11:41
*** jmcbride has joined #openstack-dns11:59
*** jmcbride has quit IRC12:00
*** jmcbride has joined #openstack-dns12:01
hetiiKiall: are you here ?12:02
openstackgerritFederico Ceratto proposed openstack/python-designateclient: Check for required CLI options  https://review.openstack.org/19906712:03
Kiallhetii: yes (kinda)12:03
KiallWhats up?12:03
hetiiIn the code (for juno) dist-packages/designate/storage/impl_sqlalchemy/__init__.py I see around line 186 that you raise exception in case when len(results) != 112:05
*** gcmacmalloc has quit IRC12:05
hetiiand I sometimes get form this query empty [] when try build 10 instances one by one in loop12:05
*** chlong has joined #openstack-dns12:06
hetiido you have idea why after a few instance is created this query return empty list ?12:06
hetiimaybe was reported some bug in past about it ?12:06
Kialllet me check what that code looked like in juno12:10
KiallNo, I can't think of why that would return 0 results where 1 is expected? Are you seeing a specifc error etc?12:12
hetiiKiall:  ok I found one misconfiguration cause i switch between db backend engine and for my testing domain I have two db (one sqlite, second mysql) and they have different IDs but designate-sink have a static config about domain id12:14
KiallThat would certainly explain getting zero results back :)12:15
hetiiyes :)12:15
hetiibut have also other issue12:15
hetii2015-07-07 14:15:41.698 31031 TRACE oslo.messaging.notify.dispatcher   File "/usr/local/lib/python2.7/dist-packages/designate/storage/impl_sqlalchemy/__init__.py", line 155, in _create12:16
hetii2015-07-07 14:15:41.698 31031 TRACE oslo.messaging.notify.dispatcher DuplicateRecord12:16
KiallSounds like two identical records are being created, which isn't valid?12:16
hetiiyep, I try to clear all reacords and have a clear state of all comopnents12:19
hetiiand then will create new 10 instances to see if will be fine12:19
hetiiif not then will need to think what can I do with that12:19
hetiiAlso I get when delete it by cli | Message | Managed records may not be deleted |12:22
hetiiok start testing again ;)12:23
*** l6unchpad has quit IRC12:25
hetiiok I create 10 instances have them in designate db and in my remote backend also. Now will try delete it and check if they gone from all components12:28
Kiall:)12:29
hetiiIs it possible that designate will in case of failure, or any descynchronization will ask all compute nodes for their instances12:29
hetiiis there any failover protection in such case of desynchronization?12:30
openstackgerritMerged openstack/designate: Add v1 API deprecation warnings  https://review.openstack.org/19806612:31
hetii "OperationalError: (OperationalError) (1205, 'Lock wait timeout exceeded; try restarting transaction') 'UPDATE domains SET updated_at=%s, serial=%s WHERE domains.id = %s AND domains.deleted = %s' (datetime.datetime(2015, 7, 7, 12, 30, 31, 416077), 1436272231, '65a9bf5705eb445b9862ae98ea05912:33
openstackgerritMerged openstack/designate: Fix broken UTs in test_mdns.test_handler  https://review.openstack.org/19828812:33
hetiiyep and now when I delete all my 10 instances some records are left untouched  :/12:33
hetiifrom 10 only 4 was deleted12:34
*** l6unchpad has joined #openstack-dns12:39
*** dguerri` is now known as dguerri12:39
openstackgerritMerged openstack/designate: Add support for BETWEEN and add tests  https://review.openstack.org/19719312:39
Kiallhetii: Ah, Juno - there's an issue in there that's fixed in kilo+ around lock contention12:42
hetii-07-07 14:41:19.498 3774 TRACE oslo.messaging.notify.dispatcher RemoteError: Remote error: OperationalError (OperationalError) (1205, 'Lock wait timeout exceeded; try restarting transaction')12:42
hetiihuh12:42
hetiireally ? where I can find it?12:43
hetiiis it possible to apply this patch to juno ?12:43
KiallYep, sounds familar. We don't have a fix in Juno, the change was pretty big and it wasn't backported. There was a workaround, trying to remember it tho!12:43
Kiallre "Managed records may not be deleted" - we added the ability to do that in Kilo too BTW12:43
hetiiYep I know about that but in my company they still force to use juno :/12:44
hetiiand I cannot change that fact12:44
hetiiso probably will need to apply this workaround for juno also12:48
*** johnbelamaric has joined #openstack-dns12:49
KiallFrom memory, the workaround for Juno sink was to to update the handler to use a lock, preventing things from happening concurrently - but I'm totally blanking on the specifics -_-12:52
Kiallor - we could backport the proper fix, just nobody has had the time yet12:52
hetiisure, just let know where I could find this fix13:00
hetiiand will try to do it13:00
KiallLet me dig it out..13:00
hetiithx :)13:01
KiallThe fix was introduced as part of https://github.com/openstack/designate/commit/4e75f5b54c149bfd1aeea139bd8108c3031d049c - which has LOTS more in it than the changes that happened to solve the concurrency issues. The concurrency issues were solved purely by the changes in designate/central/service.py - several of the methods, eg create_domain, create_record, update_record etc were split into two parts each. e.g. "update_record" and "13:05
Kiall_update_record_in_storage" - Just the storage related stuff endend up in the new/second method, and, that's the method that got wrapped in the transaction, reudcing the scope of the transaction to a MUCH smaller block of code13:05
*** jmcbride has quit IRC13:06
hetiihmm13:07
hetiiok need to have a while to check code13:07
KiallYep - the commit itself is HUGE - the relavant bits of the change are arctually quite small..13:08
*** cing has joined #openstack-dns13:16
hetiiKiall: ok thanku you very much, tommorow will try to go depper into this code :)13:21
*** johnbelamaric has quit IRC13:22
Kiallhetii: Yea, I'll try find some time towards the end of the week for the fix too, if you don't get to it first.. A few people have hit it :(13:22
*** nihilifer has quit IRC13:23
*** csoukup has joined #openstack-dns13:26
openstackgerritMerged openstack/designate: Fix broken UTs in test_coordination for py34  https://review.openstack.org/19822013:27
openstackgerritMerged openstack/designate: Updated from global requirements  https://review.openstack.org/19809013:28
openstackgerritMerged openstack/designate: Fix broken UTs for python3  https://review.openstack.org/19859713:28
hetiiKiall: in my case I really need it so in this or other way I will need it at the end :>13:29
hetiibut we will see :>13:29
*** hetii has quit IRC13:31
*** boris-42 has joined #openstack-dns13:33
*** csoukup has quit IRC13:36
*** richm has joined #openstack-dns13:38
*** csoukup has joined #openstack-dns13:38
openstackgerritMerged openstack/python-designateclient: Log error message from EndpointNotFound exceptions  https://review.openstack.org/19874713:41
openstackgerritMerged openstack/python-designateclient: Fix for ttl values  https://review.openstack.org/19859813:47
*** jmcbride has joined #openstack-dns13:50
*** cing has quit IRC14:00
*** pglass has joined #openstack-dns14:08
*** robert4man has joined #openstack-dns14:19
openstackgerritKiall Mac Innes proposed openstack/designate: Add tasks and periodic emits  https://review.openstack.org/19719414:20
*** chlong has quit IRC14:25
*** ducttape_ has joined #openstack-dns14:27
*** jmcbride has quit IRC14:38
*** jmcbride has joined #openstack-dns14:39
*** vinod1 has joined #openstack-dns14:41
*** ducttape_ has quit IRC14:53
openstackgerritMerged openstack/designate: Designate Dashboard now has it's own repo  https://review.openstack.org/19328714:53
openstackgerritMerged openstack/designate: Enable designate-zone-manager in DSVM gates  https://review.openstack.org/19696714:54
*** bradjones|away is now known as bradjones14:56
openstackgerritMerged openstack/designate: Use released versions of tempest-lib  https://review.openstack.org/19755014:57
openstackgerritFederico Ceratto proposed openstack/python-designateclient: Implement socket timeout in v1  https://review.openstack.org/19801515:13
KiallMerge happy day today it seems ;)15:18
*** mlavalle has joined #openstack-dns15:18
timsimpew pew15:19
*** bauruine has quit IRC15:21
Kialltimsim: lol ;)15:22
*** bauruine has joined #openstack-dns15:32
openstackgerritMerged openstack/designate: Add tasks and periodic emits  https://review.openstack.org/19719415:48
openstackgerritMerged openstack/designate: Ensure validations account for trailing newlines  https://review.openstack.org/19837815:49
*** katterstrophe has quit IRC16:11
*** l6unchpad has quit IRC16:12
*** fawadkhaliq has joined #openstack-dns16:15
openstackgerritMimi Lee proposed openstack/designate: Error message for database config  https://review.openstack.org/19886116:27
*** rudrajit has joined #openstack-dns16:27
openstackgerritMimi Lee proposed openstack/designate: Error message for database config  https://review.openstack.org/19886116:29
*** rudrajit has quit IRC16:35
*** jordanP has quit IRC16:38
*** CTWill has quit IRC16:39
Kialltimsim: Mimi Lee on your DNS team? (notcied @rackspace.com in the commit author)16:43
timsimYep, she's our intern!16:43
timsimShe should be in here... mimi16:43
mugsienope...16:44
Kiallnope, no mimi in the room ;)16:44
mugsiejezz timsim16:44
timsimBad intern16:44
mugsiebad mentor?16:44
timsimshut it16:44
mugsie(please tell me you are her mentor)16:44
mugsie:D16:44
timsimWe're all her mentor16:44
Kialltimsim's finally getting his own back ;)16:44
*** jmcbride has quit IRC17:02
*** pglass has quit IRC17:02
*** jschwarz has joined #openstack-dns17:02
*** ducttape_ has joined #openstack-dns17:04
*** pglass has joined #openstack-dns17:06
*** jmcbride has joined #openstack-dns17:08
*** rudrajit has joined #openstack-dns17:09
*** jmcbride1 has joined #openstack-dns17:12
*** jmcbride has quit IRC17:13
*** vinod1 has quit IRC17:15
*** johnbelamaric has joined #openstack-dns17:27
*** jschwarz has quit IRC17:28
*** pglass has quit IRC17:29
*** jmcbride1 has quit IRC17:29
*** ducttape_ has quit IRC17:29
*** vinod1 has joined #openstack-dns17:47
*** dguerri is now known as dguerri`17:47
*** ducttape_ has joined #openstack-dns17:53
*** rudrajit_ has joined #openstack-dns18:01
*** pglass has joined #openstack-dns18:03
*** rudrajit has quit IRC18:04
*** robert4man has quit IRC18:05
*** mlavalle has quit IRC18:12
*** mlavalle has joined #openstack-dns18:12
*** vinod1 has quit IRC18:14
*** l6unchpad has joined #openstack-dns18:51
*** l6unchpa_ has joined #openstack-dns19:11
*** l6unchpad has quit IRC19:14
*** mimi has joined #openstack-dns19:22
*** rudrajit has joined #openstack-dns19:24
*** rudrajit_ has quit IRC19:28
*** l6unchpa_ has quit IRC19:43
*** chlong has joined #openstack-dns20:06
*** fawadkhaliq has quit IRC20:15
*** penick has joined #openstack-dns20:22
*** ducttape_ has quit IRC20:30
openstackgerritMimi Lee proposed openstack/designate: Enable filter on blacklists & tlds  https://review.openstack.org/19926320:45
openstackgerritMimi Lee proposed openstack/designate: Enable filter on blacklists & tlds  https://review.openstack.org/19926320:47
*** jmcbride has joined #openstack-dns20:49
*** jmcbride has quit IRC20:50
*** ducttape_ has joined #openstack-dns20:51
*** jmcbride has joined #openstack-dns21:10
openstackgerritEric Peterson proposed openstack/designate-dashboard: Record creation / update screen simplification  https://review.openstack.org/19371021:46
openstackgerritEric Peterson proposed openstack/designate-dashboard: Improving record create update buttons  https://review.openstack.org/19883221:52
*** ducttape_ has quit IRC21:58
*** mimi has quit IRC21:58
*** mlavalle has quit IRC22:08
*** pglass has quit IRC22:10
openstackgerritMerged openstack/designate-dashboard: Adding record-editor fip dropdown  https://review.openstack.org/19331822:17
*** fawadkhaliq has joined #openstack-dns22:22
*** csoukup has quit IRC22:40
*** johnbelamaric has quit IRC22:46
*** chlong has quit IRC22:46
*** jmcbride has quit IRC22:49
*** jmcbride has joined #openstack-dns22:58
*** fawadkhaliq has quit IRC23:02
*** km has joined #openstack-dns23:02
*** kei_yama has joined #openstack-dns23:22
*** rudrajit has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!