Wednesday, 2015-03-25

*** pk has joined #openstack-dns00:05
*** pk__ has joined #openstack-dns00:07
*** pk has quit IRC00:07
*** sn6i23a has quit IRC00:08
*** rmoe has quit IRC00:09
*** penick has quit IRC00:25
*** rmoe has joined #openstack-dns00:28
*** penick has joined #openstack-dns00:29
*** MentalRay_ has quit IRC00:31
*** pk__ has quit IRC00:31
*** penick has quit IRC00:34
*** Phibs has joined #openstack-dns00:52
PhibsCan anyone share with me the .SQL needed to modify the default powerDNS schema (as of current) to work with designate?00:52
Phibsalso, are there any plans to shift to using the new powerDNS httpAPI (JSON) vs direct database access?00:52
*** johnbelamaric has quit IRC00:53
Phibsmore importantly is anyone alive :)00:58
*** pk has joined #openstack-dns01:04
*** stanzgy has joined #openstack-dns01:39
*** km has joined #openstack-dns01:52
*** pk has quit IRC01:52
*** MentalRay has joined #openstack-dns01:57
*** penick has joined #openstack-dns02:34
*** richm has quit IRC02:38
*** pk has joined #openstack-dns02:59
*** pk has quit IRC03:03
*** pk has joined #openstack-dns03:04
*** fouxm_ has joined #openstack-dns03:27
*** fouxm has quit IRC03:28
*** pk has quit IRC03:35
*** mikehn has quit IRC03:38
*** mikehn has joined #openstack-dns03:38
*** km_ has joined #openstack-dns04:03
*** km has quit IRC04:04
*** pk has joined #openstack-dns04:05
*** km has joined #openstack-dns04:30
*** km_ has quit IRC04:32
*** andrewbogott_afk is now known as andrewbogott04:36
*** andrewbogott is now known as andrewbogott_afk04:39
*** MentalRay has quit IRC04:41
*** MentalRay has joined #openstack-dns04:43
*** pk has quit IRC05:09
*** penick has quit IRC05:47
*** pk has joined #openstack-dns06:13
*** pk has quit IRC06:17
Phibsanyone alive ?06:27
*** MentalRay has quit IRC06:27
Phibshttp://docs.openstack.org/developer/designate/getting-started.html06:36
Phibsdoesn't even work :(06:36
Phibspython deps barf06:36
stanzgyPhibs: hi phibs, what's the error message?06:51
Phibswell i've gotten further now with latest pip06:51
Phibsbut now I have06:52
Phibshttps://www.bsd-unix.net/seitz/screenshots/2015-03-25_0252.png06:52
Phibs(I really only want to be able to upgrade my new powerdns installed schema to support designate)06:52
Phibsso if there is an easier way I'm all for it06:52
Phibspbr (0.9.0)06:53
stanzgywhat the code branch you are using?06:54
Phibsjuno stable06:54
stanzgyMaybe you can try the latest master branch if you just wanna a try06:55
Phibssure06:56
Phibsthis one gets to06:58
Phibsdistutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('traceback2')06:58
Phibsheh06:59
stanzgyoh, let me have a check07:00
Phibsgetting a lot of missing stuff but pip install by hand works07:01
Phibsk finished that time ;007:02
stanzgyIt works good in my environment, maybe you get some thing wrong with your pip/virtualenv07:04
Phibshmmm07:05
Phibsthis still fails: python setup.py develop07:05
PhibsERROR:root:Error parsing07:05
Phibshmm07:06
stanzgydo you run 'pip install -r test-requirements.txt -r requirements.txt' successfully?07:06
Phibsyea07:06
Phibsok07:08
Phibsits working now ;)07:08
Phibsmaaaany python deps ;007:08
stanzgy:D07:10
Phibswill it update an existing schema for me and not change what's there ?07:13
Phibsb/c I used what is here: https://doc.powerdns.com/md/authoritative/backend-generic-mypgsql/07:13
stanzgyIf you use designate-manage command to manage your db schema before, there will be a migrate_version table in your pdns db and it should update your exsiting to latest.07:16
Phibshmm07:17
Phibsdo you know if openstack plans on supporting the powerdns http API vs direct database ?07:17
stanzgydesignate-manage decides which scripts to run according to your current db  migration version.07:18
stanzgydirect database07:18
Phibsright, so if it was never run before, but I've created the powerdns schema already...07:18
PhibsWould be nice if designate used https://doc.powerdns.com/md/httpapi/api_spec/07:19
stanzgyAFAIK there is no plan to support pdns http api07:20
Phibsthis is bad then :)07:20
PhibsI wonder if my company can write something07:20
Phibswhat is your relation to the designate project?07:21
stanzgyyou can write a wishlist or a blueprint and the community will discuss about it07:21
Phibsnod07:22
Phibsthanks for your help07:22
stanzgyI'm a openstack developer and  new to designate too :)07:22
Phibshehe07:23
PhibsI will see what we can do, I think using an API is much better07:23
Phibsesp since that allows you to use any powerdns backend, and designate does not know :)07:23
Phibsthanks again, tis late here :)07:24
stanzgyyou are welcome07:24
*** chlong has quit IRC07:52
*** jordanP has joined #openstack-dns07:59
*** pk has joined #openstack-dns08:01
*** pk has quit IRC08:05
ekarlsoheya guys08:19
ekarlsoPhibs: what's uå ?08:21
*** MentalRay has joined #openstack-dns08:26
*** km has quit IRC08:45
*** MentalRay has quit IRC08:47
*** pk has joined #openstack-dns09:50
*** pk has quit IRC09:54
openstackgerritCyril Roelandt proposed openstack/python-designateclient: Enable Python 3  https://review.openstack.org/16755210:42
*** stanzgy has quit IRC10:54
*** untriaged-bot has joined #openstack-dns11:02
untriaged-botUntriaged bugs so far:11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143418911:02
openstackLaunchpad bug 1434189 in Designate "Delete zone process can be interrupted" [Undecided,In progress] - Assigned to Tim Simmons (tim-simmons-t)11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143284211:02
openstackLaunchpad bug 1432842 in Designate "Property setters dont work." [Undecided,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143285011:02
openstackLaunchpad bug 1432850 in Designate "Add periodic refresh task" [High,New] - Assigned to Endre Karlson (endre-karlson)11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/142566811:02
openstackLaunchpad bug 1425668 in Designate "Poor error message when using same database for designate and the pool manager cache" [Undecided,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143283911:02
openstackLaunchpad bug 1432839 in Designate "Calling find_domain in any v1 operation is sub-optimal" [Medium,New] - Assigned to Endre Karlson (endre-karlson)11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143622411:02
openstackLaunchpad bug 1436224 in Designate "Kilo beta 3 unit test errors in Debian: AttributeError: 'ValidationError' object has no attribute 'relative_path'" [Undecided,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143621011:02
openstackLaunchpad bug 1436210 in Designate "Multiple serial update notifications are not buffered " [Undecided,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143364511:02
openstackLaunchpad bug 1433645 in Designate "Floating IP Reverse DNS API does not respect async operations" [Undecided,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143097611:02
openstackLaunchpad bug 1430976 in Designate "Pool Manager creates/deletes can go into an infinite loop" [Undecided,Fix committed] - Assigned to Tim Simmons (tim-simmons-t)11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143626111:02
openstackLaunchpad bug 1436261 in Designate "Requires jsonschema >= 2.4.0 (not 2.2.0)" [Undecided,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143558311:02
openstackLaunchpad bug 1435583 in Designate "designatedashboard packaging is not very simple" [Undecided,In progress] - Assigned to Eric Peterson (ericpeterson-l)11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/142511711:02
openstackLaunchpad bug 1425117 in Designate "Designate does not work with postgres" [High,New]11:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143556811:02
openstackLaunchpad bug 1435568 in Designate "pep8 gate taking longer than 30 mins on occasion" [Undecided,New]11:02
*** untriaged-bot has quit IRC11:02
*** MentalRay has joined #openstack-dns11:11
*** MentalRay has quit IRC11:12
*** pk__ has joined #openstack-dns11:39
openstackgerritEndre Karlson proposed openstack/designate: Fix handling of wildcards in api / storage  https://review.openstack.org/16680611:39
*** pk__ has quit IRC11:43
*** chlong has joined #openstack-dns11:51
openstackgerritGraham Hayes proposed openstack/designate: Remove usage of relative_path in ValidationError Objects  https://review.openstack.org/16757011:55
*** openstackgerrit has quit IRC12:06
*** openstackgerrit has joined #openstack-dns12:06
*** ChanServ sets mode: +v openstackgerrit12:06
*** richm has joined #openstack-dns12:10
openstackgerritKiall Mac Innes proposed openstack/designate: Support mDNS response over 65k  https://review.openstack.org/16726812:10
*** richm has quit IRC12:11
*** richm has joined #openstack-dns12:11
*** jmcbride has joined #openstack-dns12:56
openstackgerritKiall Mac Innes proposed openstack/designate: Unwind mDNS XFRMixin from NotifyEndpoint and Handler  https://review.openstack.org/16662712:59
openstackgerritEndre Karlson proposed openstack/designate: Allow for duplicate domains in different pools  https://review.openstack.org/16758213:00
*** jbratton has quit IRC13:10
*** johnbelamaric has joined #openstack-dns13:19
openstackgerritEndre Karlson proposed openstack/designate: Allow for duplicate domains in different pools  https://review.openstack.org/16758213:22
*** pk__ has joined #openstack-dns13:28
*** andrewbogott_afk is now known as andrewbogott13:30
*** pk__ has quit IRC13:32
*** openstackgerrit has quit IRC13:36
*** openstackgerrit has joined #openstack-dns13:36
*** ChanServ sets mode: +v openstackgerrit13:36
openstackgerritGraham Hayes proposed openstack/designate: Add API_v2 Adapter Objects  https://review.openstack.org/16432713:53
openstackgerritGraham Hayes proposed openstack/designate: Replace API_v2 views with Adapters  https://review.openstack.org/16698313:53
openstackgerritGraham Hayes proposed openstack/designate: Add Decorator to log RPCAPI Calls  https://review.openstack.org/16735213:53
openstackgerritGraham Hayes proposed openstack/designate: WIP: Logging Cleanup  https://review.openstack.org/16735313:53
openstackgerritGraham Hayes proposed openstack/designate: Add __str__() methods to DesignateObjects  https://review.openstack.org/14221813:53
openstackgerritGraham Hayes proposed openstack/designate: Add Enhanced Logging to APIs  https://review.openstack.org/16735113:53
*** mugsie has quit IRC14:00
*** mugsie has joined #openstack-dns14:00
*** paul_glass has joined #openstack-dns14:03
*** jmcbride has quit IRC14:03
*** uschreiber_ has joined #openstack-dns14:08
openstackgerritGraham Hayes proposed openstack/designate: Add Schema to RRData Objects  https://review.openstack.org/16760014:11
openstackgerritGraham Hayes proposed openstack/designate: Remove usage of relative_path in ValidationError Objects  https://review.openstack.org/16757014:15
*** mugsie has quit IRC14:23
*** mugsie has joined #openstack-dns14:24
*** ericpeterson has joined #openstack-dns14:28
*** jschwarz has joined #openstack-dns14:40
*** pk__ has joined #openstack-dns14:43
*** mugsie has quit IRC14:44
*** pk__ has quit IRC14:48
Kialltimsim: about?14:48
*** mugsie has joined #openstack-dns14:48
timsimYep14:48
KiallSo - Agents, targets vs nameservers, was that the only issue you had with pool manager for that?14:49
Kiall(I'm just cleaning up the review for that now..)14:49
*** MentalRay has joined #openstack-dns14:50
timsimYep, the only issue was that I needed to be able to Notify/Create/Delete one place, and poll another.14:50
timsimKiall: Quick question on https://review.openstack.org/#/c/167268/3/designate/dnsutils.py: Is def _xl_to_wire supposed to be embedded in _call_?14:51
Kialllol.. no14:52
Kiallserves me right for not building a 66k response to test -_-14:52
timsimYeah I can't make it work :/14:52
timsimEventually you get this error: http://paste.openstack.org/show/196603/14:53
goncalo[A414:53
timsimBut that was like 7 minutes after the initial request.14:53
timsimThe zone does have 40k records, but still.14:53
*** mugsie has quit IRC14:54
*** mugsie has joined #openstack-dns14:54
Kialltimsim: ah, unindent a level and give it a go?14:55
Kialltimsim: yea, endre filed a bug for that yesterday.. Buried a few layers down, we're doing a billion SQL queries for an AXFR14:57
timsimI should probably delete some of these records...still chugging14:59
KiallYea.. We're literally doing worst possible case data lookup from the DB .. Suffied to say that needs fixing before rc1 ;)15:01
timsimAh, I see it. Is ekarlso working on that?15:02
KiallNo, he just spotted it during some stress testing yesterday15:02
timsimAlright, I can probably take it.15:02
KiallFor mDNS (where the issue hits realy hard) - We really just need to implement a new storage method that does a targeted join cross rrsets and rr's, returning the raw rows rather than objects (it's read only - we've no need to go build up the obj's for mDNS) and have mDNS use that..15:03
Kiallthe other cases went unnoticed because we do page at a time ..15:04
timsimKiall: New error http://paste.openstack.org/show/196606/15:04
*** jmcbride has joined #openstack-dns15:04
KiallGrr, I was worried about that :(15:05
*** openstackgerrit has quit IRC15:08
*** openstackgerrit has joined #openstack-dns15:09
*** ChanServ sets mode: +v openstackgerrit15:09
*** uschreiber_ has quit IRC15:09
Kialltimsim: can you post a SQL dump of that by any chance?15:16
timsimSure, give me a sec15:16
Kiall(looking at the way to fix it, but hard to tell)15:16
timsimhttps://gist.github.com/TimSimmons/e308f470e7b0a2439153#file-log-sql15:20
timsimKiall: ^15:20
Kialltimsim: can you give this a quick go? http://paste.openstack.org/show/Q7UTgZ2qOnyDZw6OCf36/15:23
Kialltotally untested - brb - coffee calling15:23
timsimSure15:23
*** jmcbride has quit IRC15:25
timsimKiall: In "f.read(655....)" what is f?15:28
timsimL331 in the paste15:28
*** johnbelamaric has quit IRC15:31
*** johnbelamaric has joined #openstack-dns15:31
Kiallwhoops was meant to be response15:33
timsimThat's what i figured. It's working now15:33
timsimWell15:33
timsimMiniDNS is chugging away on 40k recors15:33
KiallIt's still slow as hell, but does the AXFR succeed?15:33
timsimDon't know yet15:33
timsimWell then again, I'm not sure I will know, since the dig timed out15:34
timsimI guess I'll see if there aren't errors in the miniDNS log...15:34
timsimI should really delete some of these records.15:34
KiallBefore you do - I meant a SQL dump if possible, rather than the sql logs ;)15:35
Kiall(only if it's dummy / test data ofc..)15:35
timsimOh yeah, sure.15:36
timsimKiall: http://964700e4a3d9dbf5b5ba-7a27b8c5d9fcdc26d383a194ab4f0ebe.r14.cf2.rackcdn.com/bigrecordemp.sql15:39
timsimMost of the records are in an error state.15:39
KiallI'd imagine so :)15:39
ekarlsofound a fix for the select issue ?15:40
Kialldid you say you'd look at the 75 quadrillion (give or take a query or two) AXFR issue BTW? If not, I'll ask endre to look into it tomorrow.. He's gone for the day ;)15:41
Kialllol - and there he is.15:41
timsimI can do it, sure.15:42
ekarlsoKiall: ... popping in before heading out again :|15:43
timsimKiall: I don't think I've done the diff right. Where does the call to xl_wire go? http://paste.openstack.org/show/196646/? I15:44
*** pk__ has joined #openstack-dns15:44
*** richm has quit IRC15:44
openstackgerritEndre Karlson proposed openstack/designate: Allow for duplicate domains in different pools  https://review.openstack.org/16758215:45
*** richm has joined #openstack-dns15:46
*** richm has left #openstack-dns15:47
*** richm has joined #openstack-dns15:48
*** pk__ has quit IRC15:49
Kialltimsim: heh, that would be because I did my diff based on a tree without the xl patch  .. http://paste.openstack.org/show/196649/15:50
Kiall(again, untested, my stack is setup with a different patchset for testing ;))15:50
timsimAlright, trying again.15:52
KiallAlso - I'm assuming you've told dig to use a stupidly large timeout?15:52
Kiall+time=9999999 or something ;)15:52
*** rmoe has quit IRC15:54
timsimOh yeah I was totally doing that ;)15:55
mugsie:)15:56
*** jschwarz has quit IRC15:58
mugsietimsim: https://review.openstack.org/#/c/166983/ / https://review.openstack.org/#/c/164327/ need reviews pretty soon - they are important for the v2 API stuffs :)15:58
timsimYep, on my list for today. vinod is out :/ otherwise I'm sure he would.15:58
mugsiecool :)15:59
timsimKiall: O.o http://paste.openstack.org/show/196655/16:00
timsimThat was way faster though.16:01
Kiallfaster? really?16:01
timsimYeah for some reason that took ~2 minutes intead of six or seven16:01
timsimGranted this is a fairly small vm on my my machine.16:02
KiallAh, well, with a LARGE zone I suppose building the string versus a filehandle-like object would account for some perf difference.. But that seems a tad much.16:02
*** richm has quit IRC16:03
timsimMaybe it abandoned ship when things went wrong, which only about 10% of the zone.16:03
KiallAnyway - Issue at hand. I mentioned to graham earlier we're doing silly things building a dns.message.Message instance as the response, only to iterate everything AGAIN and build a dns.renderer.Renderer16:03
*** richm has joined #openstack-dns16:04
timsimYeah that makes sense. Any idea why it build a bad packet? Looks like it did after the 65535 limit16:04
timsims/build/built16:04
KiallYep - dns compression is per packet, I expected we'd see it..16:05
KiallI think we need to do 2 things.. 1) Get a patch in that get's us up to 65k, and probably adds the cStringIO stuff since it made such a difference.. 2) rework how we render to-wire so we can control it better16:08
*** jschwarz has joined #openstack-dns16:08
openstackgerritGraham Hayes proposed openstack/designate: Add _to_string() methods on RRData Objects.  https://review.openstack.org/16767216:11
KiallAnnoyingly, no option to disable the compression16:11
*** rmoe has joined #openstack-dns16:11
timsimThat's unfortunate16:12
KiallOhh.. Looking again.. I'm not so sure.16:12
KiallI just noticed L38 - ;; WARNING: ID mismatch: expected ID 51399, got 116:12
KiallI don't suppose you have this zone, or a similarity large one, loaded into a BIND server? a pcap of the AXFR would be interesting16:13
timsimThe version of that zone I have on the bind9 server is ;; XFR size: 3145 records (messages 2, bytes 65065)16:15
timsim+16:15
timsimI could look for a larger zone on one of our other nameservers, if you'd like?16:19
Kiallbytes 65065 - so under the limit yet split into 2 messages.. Can you fire up wireshark or similar to grab a pcap? My memory of the protcol is clearly wrong given it ain't working, a pcap showing the right thing to do should make it easier...16:19
KiallScratch that, found it.. Yea, we have some re-work to do. https://tools.ietf.org/html/draft-andrews-dns-more-0116:21
*** chlong has quit IRC16:22
KiallHumm - Reading, that doesn't look like what I remember ..16:22
openstackgerritKiall Mac Innes proposed openstack/designate: WIP: Implement Pool Targets  https://review.openstack.org/16767816:27
*** MentalRay has quit IRC16:28
timsimKiall: I don't really know what I'm doing, but here's what I hope is a pcap of the dig: http://964700e4a3d9dbf5b5ba-7a27b8c5d9fcdc26d383a194ab4f0ebe.r14.cf2.rackcdn.com/capture.pcap16:28
openstackgerritKiall Mac Innes proposed openstack/designate: WIP: Implement Pool Targets  https://review.openstack.org/16767816:28
Kialltimsim: I don't see any DNS traffic in there, lots of SSH though ;)16:31
*** jordanP has quit IRC16:31
*** jordanP has joined #openstack-dns16:31
*** pk__ has joined #openstack-dns16:32
*** jschwarz has quit IRC16:32
*** chlong has joined #openstack-dns16:33
timsimKiall: how about this one: http://964700e4a3d9dbf5b5ba-7a27b8c5d9fcdc26d383a194ab4f0ebe.r14.cf2.rackcdn.com/capture2.pcap16:34
*** pk__ has quit IRC16:36
*** chlong has quit IRC16:39
Kialltimsim: looks more like it :)16:42
timsimFirst time I've done that :P Thanks google16:43
timsimbbiab lunch :)16:46
Kialllol - spotted this ;)16:52
Kiall        # TODO(vinod) check if we dnspython has an upper limit on the number16:52
Kiall        # of rrsets.16:52
Kiall        response.answer = r_rrsets16:52
Kialleither way, I can see from the pcap the patch is doing it wrong ;)16:53
* timsim forgot about the irc meet :P lunch will wait16:54
Kiall:D16:56
*** andrewbogott is now known as andrewbogott_afk16:58
*** untriaged-bot has joined #openstack-dns17:02
untriaged-botUntriaged bugs so far:17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143284217:02
openstackLaunchpad bug 1432842 in Designate "Property setters dont work." [Undecided,New]17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143285017:02
openstackLaunchpad bug 1432850 in Designate "Add periodic refresh task" [High,New] - Assigned to Endre Karlson (endre-karlson)17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143283917:02
openstackLaunchpad bug 1432839 in Designate "Calling find_domain in any v1 operation is sub-optimal" [Medium,New] - Assigned to Endre Karlson (endre-karlson)17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143364517:02
openstackLaunchpad bug 1433645 in Designate "Floating IP Reverse DNS API does not respect async operations" [Undecided,New]17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143558317:02
openstackLaunchpad bug 1435583 in Designate "designatedashboard packaging is not very simple" [Undecided,In progress] - Assigned to Eric Peterson (ericpeterson-l)17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/142511717:02
openstackLaunchpad bug 1425117 in Designate "Designate does not work with postgres" [High,New]17:02
untriaged-bothttps://bugs.launchpad.net/designate/+bug/143556817:02
openstackLaunchpad bug 1435568 in Designate "pep8 gate taking longer than 30 mins on occasion" [Undecided,New]17:02
*** untriaged-bot has quit IRC17:02
*** jmcbride has joined #openstack-dns17:06
*** andrewbogott_afk is now known as andrewbogott17:08
openstackgerritGraham Hayes proposed openstack/designate: Add Decorator to log RPCAPI Calls  https://review.openstack.org/16735217:10
openstackgerritGraham Hayes proposed openstack/designate: WIP: Logging Cleanup  https://review.openstack.org/16735317:10
openstackgerritGraham Hayes proposed openstack/designate: Add __str__() methods to DesignateObjects  https://review.openstack.org/14221817:10
openstackgerritGraham Hayes proposed openstack/designate: Add Enhanced Logging to APIs  https://review.openstack.org/16735117:10
*** andrewbogott is now known as andrewbogott_afk17:11
*** andrewbogott_afk is now known as andrewbogott17:14
*** jmcbride has quit IRC17:18
*** jmcbride has joined #openstack-dns17:18
openstackgerritGraham Hayes proposed openstack/designate: Add _to_string() methods on RRData Objects  https://review.openstack.org/16767217:25
*** fouxm_ is now known as fouxm17:44
*** jordanP has quit IRC17:48
*** ericpeterson has quit IRC17:54
*** ericpeterson has joined #openstack-dns17:58
*** crc32 has joined #openstack-dns18:03
*** rmoe has quit IRC18:04
*** kfox1111 has joined #openstack-dns18:06
kfox1111ah. there we go.18:06
kfox1111trying out designate. havent put a service record for it in keystone yet. shouldn't need to for testing. tried setting both OS_DNS_ENDPOINT=http://localhost:9001 or --os-endpoint http://localhost:9001 but the client still is insisting on contacting keystone to find the endpoint.18:07
kfox1111is this a known bug?18:07
mugsiekfox1111: yes18:11
mugsielet me dig it out18:11
mugsiehttps://bugs.launchpad.net/python-designateclient/+bug/141556018:12
openstackLaunchpad bug 1415560 in python-designateclient "python-designateclient does not work against an non Keystoned designate" [High,Triaged] - Assigned to Graham Hayes (grahamhayes)18:12
kfox1111sure enough.18:13
kfox1111odd.18:15
*** johnbelamaric has quit IRC18:15
mugsiei think it was introduced as part of ks sessions18:15
mugsieits on my list to look at, but a bit down it atm18:16
kfox1111yeah digging through it now. not obvious why its having a problem.18:16
kfox1111ok. really not obvious. Guess I'll have to just add a dummy record for now.18:19
*** johnbelamaric has joined #openstack-dns18:19
andrewbogottDo post-icehouse versions of sink support inserting multiple dns entries for a given host?18:20
kfox1111So, the server pool support seems to be manually seting up pools and then telling designate about them, rather then having designate launch vm's for the user, correct?18:22
*** pk__ has joined #openstack-dns18:26
*** ericpeterson has quit IRC18:29
*** johnbelamaric has quit IRC18:29
*** ericpete_ has joined #openstack-dns18:29
mugsiekfox1111: yup18:31
kfox1111ok. can a user setup a pool, or is it only admins at this point?18:32
mugsieonly admins right now18:32
kfox1111IE, a user wants to setup a private dns server in their tenant and manage it with designate.18:32
kfox1111ok.18:32
mugsieit is based on policy - but currently the info for the pool is loaded from config files on disk18:33
kfox1111hmm. ok.18:33
mugsieso, when that moves to the DB, you could add a role that is allowed create pools18:33
mugsieand it should work18:33
kfox1111ah.18:33
kfox1111so maybe L time frame for that?18:33
mugsieyeah18:33
kfox1111k.18:34
kfox1111I'm just glad it supports it in any form. :)18:34
kfox1111manual's ok so long as there is a path forward. :)18:34
ekarlsoheya kfox1111, mind you that I ask what co you're with ?18:35
kfox1111Pacific Northwest National Lab.18:35
kfox1111http://www.pnl.gov/18:36
kfox1111hmm.. a lot of stuff in the v2 api. is it going to be considered stable for kilo? does the cli support it yet? horizon?18:36
ekarlsokfox1111: there's a "alpha" branch up on gerrit for v2 using openstack cli18:37
kfox1111ah. cool. thanks. :)18:38
kfox1111I can just curl it too, but would rather save some typing if I can help it. ;)18:38
*** pk__ has quit IRC18:39
kfox1111ok. so a server is a dns server. the list of servers is the servers in the pool that will store the domains?18:39
openstackgerritEndre Karlson proposed openstack/designate: Allow for duplicate domains in different pools  https://review.openstack.org/16758218:40
timsimkfox1111: Yep18:40
kfox1111ok. I think I'm getting it.18:41
ekarlsokfox1111: https://review.openstack.org/133675 bindings for v2 https://review.openstack.org/133676 cli18:41
openstackgerritEndre Karlson proposed openstack/designate: Add code to allow triggering of AXFR from API  https://review.openstack.org/16533118:42
kfox1111so, whats the difference between server-list and domain-server-list?18:44
kfox1111oh.... so all the server's in a pool might not be serving a domain, and thats what domain-server-list tells you?18:47
kfox1111if so, that makes sense.18:47
timsimIt's a bit outdated, but domain-server-list would essentially get the NS records of the zone for you. So that would tell you which DNS servers are serving for you. All of the servers in a pool in which the domain resides will be serving the zone.18:50
kfox1111oh. I think I get it. you would use that if, as a user, you needed to register the name servers with a dns registrar, and you'd use that to find out what they were?18:52
*** johnbelamaric has joined #openstack-dns18:52
*** ericpete_ has quit IRC18:52
timsimYep. That's correct.18:53
kfox1111cool.18:53
kfox1111can you blacklist domains too, or just zones?18:55
mugsiekfox1111: blacklists are a regex18:57
mugsieso if you can match it, it will be blocked :)18:57
mugsiealso, in designate zone==domain (i know it is VERY annoying)18:57
openstackgerritEndre Karlson proposed openstack/designate: Add code to allow triggering of AXFR from API  https://review.openstack.org/16533119:00
kfox1111so what does the v2 zone api do?19:04
mugsieits the new name for domain19:04
mugsieif it is in v1 its a domain, in v2 its a zone19:05
kfox1111ah. ok.19:05
kfox1111is there a flag to invert the blacklist making it a white list?19:06
mugsieafaik - no19:06
kfox1111say, I wanted to allow only *.cloud.pnnl.gov subdomains?19:06
mugsieoh19:06
mugsiethat can be done19:06
mugsieor...19:06
mugsielet me take a look quickly19:06
mugsiei *think* you could do it with the tld api19:07
kfox1111ah.19:07
mugsieif there is no tld's created we allow all19:08
mugsieif there is tlds, we limit domains to that19:08
timsimhah.19:08
mugsieso, creating a tld of cloud.pnnl.gov. might work19:08
kfox1111ah. so you do a tld of 'cloud.pnnl.gov'19:08
timsimThat's pretty cool.19:08
kfox1111yeah.19:08
kfox1111nice.19:08
mugsieI would say - test it :)19:08
mugsiei running on my gut here ;)19:08
kfox1111sure. :)19:09
mugsielet me know if it works19:09
mugsie:)19:09
kfox1111"The domain/zone name must not be present as a Tld entry in the database. e.g. If there is a Tld entry co.uk in the database, then a domain/zone with the name co.uk. cannot be created."19:09
mugsieyes19:11
kfox1111ok. so, out of the box, is it easy to configure designate to give every tenant its own subdomain, or is that a lot of work?19:11
mugsiewe generally allow each tenant to create their own19:11
kfox1111how would they hook it up to the providers space without getting an admin to do that? or is that the manual part?19:12
mugsiebut, it could be done relitily easily with a script19:12
mugsieour back ends create the zone on the DNS servers automatically19:12
*** pk__ has joined #openstack-dns19:13
kfox1111maybe I just modify our "create project" scripts to create the domain for the user, and add the subdomain to the cloud.pnnl.gov domain.19:13
mugsieyou could point the NS Records for cloud.pnnl.gov to the designate server, and then avoid the last step19:14
kfox1111With that arangement, can I use designate to manage cloud.pnnl.gov when it has subdomains that designate is also managing?19:14
kfox1111ok. yeah. I think that should work.19:14
*** ericpeterson has joined #openstack-dns19:14
mugsiethat does present a problem - (the sub domain)19:14
*** ericpeterson has quit IRC19:15
mugsiewe do generally block users from creating sub domains of other peoples tenants19:15
*** ericpeterson has joined #openstack-dns19:15
mugsies/tenants/zones19:15
kfox1111oh...19:15
kfox1111can an admin do it?19:15
mugsiebut. There is a transfer of ownership, or admins can do it as well19:15
kfox1111then they can manage the entries in their own subdomain?19:16
mugsieyes19:16
kfox1111well, the "tld" domain, cloud.pnnl.gov would be alwasy owned by the admin project, and the <tenantX>.cloud.pnnl.gov by the tenant.19:16
mugsieyes, that should work19:16
kfox1111that would be ok if admin was the one creating the tenantX domain?19:17
kfox1111ok. cool.19:17
kfox1111man. I have a million questions today. :)19:17
mugsieyup - or the policy.jsonm file was changed to allow it19:17
kfox1111what about about dnssec. any support yet?19:17
mugsienot yet19:17
kfox1111I know next to nothing about it, but know pnnl.gov is using it.19:17
kfox1111ok.19:18
kfox1111one more crazy one... can you have one zone managed by multiple projects at a first come first served record level?19:19
kfox1111 /tmp sticky bit like. :)19:19
*** johnbelamaric has quit IRC19:20
mugsiekfox1111: no. that has been talked about, but no-one is sure how to do record level ACLs19:20
kfox1111yeah. I could see it being messy. figured It wouldn't hurt to ask.19:21
mugsiewe are planning to allow multiple project manage one zone, but it would be a free for all for each project (they could delete each others records)19:21
mugsienever hurts to ask :)19:21
mugsieyou are not the first either19:21
kfox1111subdomains are my preference anyway, but it seems our organization struggles with ssl certs/wild card certs. so subdomains have that one drawback. :/19:21
mugsieyeah, when I did some IT work in 3rd level education, get one of those was nearly impossible19:22
kfox1111I think the relatively simple, put a project on each record on a shared zone. only that project can delete/update it.19:22
kfox1111fairly simple, but should be rather sane semantics?19:23
kfox1111so, assume record level project owner was accepted as the way to do it, how hard do you think it would be to implement?19:24
mugsieyeah, but the increase in policy checks etc would have a detrimental effect on performance19:24
kfox1111(Trying to decide if it would be harder to setup a CA with all the automation, or adding support to Designate :)19:24
mugsieto implement - not too hard. to implement so it scales - a bit tricky19:24
kfox1111yeah. You'd have to have a state flag saying if it was a shared domain or not. If not, skip the extra checks.19:25
*** andrewbogott is now known as andrewbogott_afk19:25
kfox1111on the other hand...19:25
kfox1111its probably something you don't want normal users to be able to do, set the +t bit. so maybe the admin just puts the list of allowed sticky's in the config file, then its always in memory.19:26
mugsiebut if someone did a zonefile import to that domain - pain ensues ;)19:27
kfox1111would be disallowed if it was sticky?19:27
kfox1111export too for that matter.19:27
kfox1111yeah. a few gotcha's in it... but doesn't seem too bad.19:28
kfox1111still sounding like less pain then dealing with the ssl certs. :/19:28
mugsie:)19:29
*** pk__ has quit IRC19:29
kfox1111The irony is, it took us like 3 weeks to buy a cert to secure one of our machines recently. and had to go through three levels of management approval to do so. :/19:30
kfox1111I really don't get it sometimes...19:30
kfox1111ok. I might propose a spec for that later.19:30
kfox1111I'll ask my manager.19:31
mugsiecool. we use the -spec process that most of the projects use19:31
openstackgerritGraham Hayes proposed openstack/designate: Add Decorator to log RPCAPI Calls  https://review.openstack.org/16735219:31
openstackgerritGraham Hayes proposed openstack/designate: WIP: Logging Cleanup  https://review.openstack.org/16735319:31
openstackgerritGraham Hayes proposed openstack/designate: Add __str__() methods to DesignateObjects  https://review.openstack.org/14221819:31
openstackgerritGraham Hayes proposed openstack/designate: Add Enhanced Logging to APIs  https://review.openstack.org/16735119:31
kfox1111ok. I've done a couple of those now.19:31
kfox1111you going to the summit?19:32
mugsiehopefully19:32
mugsieseen as I am presenting19:32
mugsieyou?19:32
kfox1111hehe. yeah.19:32
kfox1111will probably see you there then. :)19:32
mugsieits a long trip for us out, so got to get managers on board :)19:32
kfox1111where are you located?19:33
mugsieireland19:33
kfox1111I'm in Washington state, so its a pretty short trip for me.19:33
kfox1111ah. cool. :)19:33
mugsieah, yeah it would be19:33
timsimAll of this stuff always seems to be on the west coast, we should do something on the east coast for you guys :P19:33
mugsietimsim: its ok, I like seattle :)19:34
Kialltimsim: ... Or in EU ;)19:34
mugsieand, atalanta and paris were closer19:34
timsimKiall: Nah. 'Mericuh ;)19:34
mugsiebut midcycle in EU next time? ;)19:34
timsimI think it's our turn :P19:34
Kiallmugsie: ++ ;)19:34
kfox1111:)19:34
mugsiealthough it would be a shame to have the Liberty midcycle not in the US :)19:35
kfox1111reverse_name?19:36
kfox1111in the database?19:36
kfox1111that for an optomization?19:36
mugsiemakes seraching by domain name much faster19:36
Kiallkfox1111: Yep, it is19:36
timsimYep19:36
kfox1111oh. yeah....19:37
kfox1111do you ever want to search forward then?19:37
mugsiesometimes. but the most searches are done the other way19:37
kfox1111if not, you could drop the forward version and save a bit per row.19:37
mugsiei think timsim wrote it to be smart like that19:38
mugsieKiall: didnt want that ;)19:38
timsimYeah I think it searches the reverse name when beneficial, and the vice-versa.19:38
mugsiehe was giving out about admins trying to read the DB19:38
mugsiehe gets it wrong now and again :P19:39
Kialldropping the name column in favor of only the reverse name column ain't happening ;) I don't do backwards reading! Tis hard enough reading forwards ;)19:39
timsimhahaha19:39
* mugsie does ack that kiall barely does reading19:39
kfox1111select reverse(reverse_name) from domains? :)19:41
*** mikeit has joined #openstack-dns19:42
mugsieoh, this arguement has been had.... repeatedly19:42
mugsie:D19:42
Kiallcan you imaging being in the middle of an incident, say partial DB corruption, you're panicing. Every second counts. 0 rows matched. Fek. double check the spelling, 0 rows matched. "Oh sh** - we've lost data".. 4 minutes later, AHHH YES, the name is in reverse! that's it!19:42
* kfox1111 is amused by the double negative19:42
mugsieKiall: should have better backups19:42
mugsie:D19:42
kfox1111no worries. I'll stop armchair quarterbacking. :)19:42
mugsieits OK i do it all the time19:43
mugsieits loads of fun19:43
kfox1111yeah, but its harder to trip over it when its called reversed_name, and not name.19:43
kfox1111select * from domains where name='foo.bar'; 'colum name not found'19:43
kfox1111oh, yeah... reversed_name... :)19:44
*** MentalRay has joined #openstack-dns19:44
kfox1111now calling it name when its reversed, that would be ugly. :/19:44
mugsietbh, its not a huge amount of data, and its not indexed (or it shouldnt be) - so its fine to denormalise it that way19:44
kfox1111hmm... yeah.19:44
* Kiall takes a screenshot19:45
mugsiei said it was fine, not good ;P19:45
* mugsie is being mis-represented19:45
* kfox1111 chuckles19:46
mugsieask timsim what midcycles / summit design sessions are like ;)19:46
timsimThese two bickering like an old married couple, it's amazing :)19:50
*** johnbelamaric has joined #openstack-dns20:00
*** johnbelamaric has quit IRC20:00
*** johnbelamaric has joined #openstack-dns20:00
openstackgerritGraham Hayes proposed openstack/designate: Add __str__() methods to DesignateObjects  https://review.openstack.org/14221820:04
openstackgerritGraham Hayes proposed openstack/designate: Add Schema to RRData Objects  https://review.openstack.org/16760020:04
openstackgerritGraham Hayes proposed openstack/designate: Add _to_string() methods on RRData Objects  https://review.openstack.org/16767220:11
openstackgerritGraham Hayes proposed openstack/designate: Add Decorator to log RPCAPI Calls  https://review.openstack.org/16735220:12
openstackgerritGraham Hayes proposed openstack/designate: WIP: Logging Cleanup  https://review.openstack.org/16735320:12
openstackgerritGraham Hayes proposed openstack/designate: Add __str__() methods to DesignateObjects  https://review.openstack.org/14221820:12
openstackgerritGraham Hayes proposed openstack/designate: Add Enhanced Logging to APIs  https://review.openstack.org/16735120:12
mugsieoh rebases20:14
mugsiesome idiot decided to get patches rebased into the wronjg chain20:15
* mugsie whispers "it might have been me"20:15
*** jmcbride1 has joined #openstack-dns20:17
*** jmcbride has quit IRC20:18
*** pk__ has joined #openstack-dns20:23
*** pk__ has quit IRC20:28
*** jmcbride has joined #openstack-dns20:33
*** pk__ has joined #openstack-dns20:40
*** pk__ has quit IRC20:44
openstackgerritMerged openstack/designate: improving designatedashboard packaging  https://review.openstack.org/16702420:49
*** pk__ has joined #openstack-dns20:50
*** pk__ has quit IRC20:51
*** jmcbride has quit IRC20:52
*** jmcbride has joined #openstack-dns21:00
*** MentalRay has quit IRC21:00
*** jmcbride has quit IRC21:07
*** MentalRay has joined #openstack-dns21:11
*** pk__ has joined #openstack-dns21:26
kfox1111heh. sweet. I was just looking into how to do designate dashboard. :)21:30
*** richm has quit IRC21:31
kfox1111know if trunk will work with a juno dashboard or does it need javascript bits only in kilo?21:31
mugsiekfox1111: eh...21:32
mugsienot sure21:32
mugsiethis is a code dump from an internal dashboard21:32
mugsie(the one used by HP Cloud)21:33
mugsieso, maybe?21:33
mugsieits pretty basic21:33
kfox1111k. might just try it then. thanks. :)21:35
*** penick has joined #openstack-dns21:36
*** pk__ has quit IRC21:41
openstackgerritTim Simmons proposed openstack/designate: WIP: Reduce the # of SQL queries during AXFRs  https://review.openstack.org/16780921:42
*** mikeit has quit IRC21:43
*** johnbelamaric has quit IRC21:44
Kialltimsim: that was quick :) Did it work out any better in your large AXFR?21:44
timsimGot to put it on top of your patch to see.21:45
Kialle.g. fail after 30 sec rather than 2 min? Since the 65k limit is still around;)21:45
timsimIt's pretty gross code, but I wanted to see if it resembled what you had in mind21:45
KiallIt looks like the general idea all right :)21:46
kfox1111is there a way to have designate manage reverse lookups on ip's too?21:46
kfox1111I have one cloud that may benifit from designate, but their services are grid services, and those tend to be very very sensitive when it comes to reverse lookups. :/21:47
kfox1111if forward and reverse don't match up and ssl and everything, it bombs. :/21:48
mugsiekfox1111: yup21:48
mugsiethere is an extention that enables it21:49
mugsieone sec21:49
kfox1111awesome. thanks. :)21:49
KiallSo, you can certainly manually line things up between the forward / reverse zones - and if your auto creating with sink, you can (it's pluggable) have it manage forward/reverse together..21:49
kfox1111nice. :)21:49
mugsiethis is on neutron floating ips?21:50
kfox1111yeah.21:50
mugsiehttp://docs.openstack.org/developer/designate/integrations.html21:51
ericpetersonyou guys are going to want to punch me from this change:  https://review.openstack.org/#/c/167024/    I forget to add the empty file  designatedashboard/enabled/__init__.py21:51
mugsieit would be 2 calls though21:51
* ericpeterson swallows his pride21:51
mugsieericpeterson: nice :)21:51
mugsiepush up a fix, and we should get it through :)21:52
Kiallericpeterson: lol.. fire another review up and we can +A right away since theres enough core online ;)21:52
ericpetersonthanks / sorry.   I usually have a slightly higher level of incompetence than this21:52
KiallNo worries ;)21:52
openstackgerritEric Peterson proposed openstack/designate: forgot missing __init__.py file  https://review.openstack.org/16781221:54
timsimKiall: It did something...different? http://paste.openstack.org/show/196750/21:55
KiallWait, so, 4 sec before the explosion?21:55
KiallBOO YA.21:55
timsimIt went way farther too21:55
KiallThat's what we wanted :)21:55
kfox1111cool. thanks. :)21:55
timsimI think earlier it stopped at like 3k21:55
timsimI thought it would blow up at the same place.21:56
KiallOdd - It looks like the order is sorted here, while from memory it wasn't sorted21:56
KiallWhich in theory means better compression and more records in the 65k?21:57
* timsim scrolls back21:57
Kiall(at least with RRSets named like yours)21:57
KiallActually.. Not sorted.. Ignore me21:57
KiallEither way - real 0m4.092s .. That's better than the 7-8 mins from earlier today :)21:58
timsimYeah definitely21:58
timsimHere it is21:58
timsimhttp://paste.openstack.org/show/196655/21:58
timsimDifferent error21:58
KiallYea, we're "randomly" cutting the response in 2 - a different sort of any kind would mean things line up different21:59
*** penick has quit IRC21:59
Kiallthey both start with the same ;; WARNING: ID mismatch: expected ID 42417, got 1285121:59
timsimOk, it's doing about the same amount of records though. ~3k21:59
timsimJust ordered a bit different21:59
timsimWell 4 seconds is a lot better than 7 minutes :P22:00
*** pk__ has joined #openstack-dns22:00
Kiallericpeterson: +A'd22:01
Kialltimsim: so, just doubling checking my reading of _prep_rrsets22:02
KiallIn the records come out out of order from the DB, it explodes right?22:03
KiallRRSET1 Record122:03
KiallRRSET1 Record222:03
KiallRRSET2 Record122:03
KiallRRSET1 Record322:03
*** penick has joined #openstack-dns22:03
Kiallthe 4th row in that will create a duplicated RRSet?22:03
timsimYes it would22:04
timsimI should be ordering by recordset id22:04
KiallYea, I think that makes sense22:04
ericpetersonthanks Kiall22:05
*** andrewbogott_afk is now known as andrewbogott22:07
kfox1111wow... the cli doesn't work with the endpoint workaround thing broke the cloud. :/22:07
kfox1111keystone endpoint-create --region Pilot --service-id e7f8c7213e4144f9b0e38334ed3aeb52 --publicurl http://127.0.0.1:9001 --adminurl http://127.0.0.1:9001 --internalurl http://127.0.0.1:900122:07
kfox1111then horizon won't let users login.22:07
kfox1111keystone endpoint-delete de4a10efd6e94df28f7d1df6b566a5c422:08
kfox1111and horizon lets users in again. :/22:08
timsimmugsie: I promise I'll review those changes first thing tomorrow morning.22:08
kfox1111is there any designate related code in juno's dashboard to begin with?22:10
*** crc32 has quit IRC22:11
openstackgerritTim Simmons proposed openstack/designate: WIP: Reduce the # of SQL queries during AXFRs  https://review.openstack.org/16780922:11
ericpetersonkfox1111 - are you asking "does horizon have native support for designate?"22:13
*** pk__ has quit IRC22:14
Kialltimsim: 1 tiny comment on that BTW ;)22:14
kfox1111no, I'm grasping for straws at why a stock juno dashboard seems to break when I put that endpoint into keystone. :/22:14
kfox1111no plugins loaded.22:15
ericpetersonI have an idea....22:15
*** andrewbogott is now known as andrewbogott_afk22:16
timsimKiall: Good call. I didn't think about names at all. _prep_rrsets isn't my favorite thing either. I was also wondering if find_recordsets_axfr needs to be private, that seems to be the pattern for those.22:16
ericpetersonhorizon's session store keeps your session info in a cookie, that is limited to 4k.   if your catalog gets too big, the session information is halfway saved.... and bad things happen22:16
kfox1111ah.22:17
ericpetersonkfox1111 - you can switch horizon to use memcached for it's session store, as a test to my theory22:17
kfox1111k.22:17
ericpeterson(assuming memcached is installed on your horizon node - most likely is)22:17
kfox1111its not, but should be easy enough to do.22:17
ericpetersonhttps://docs.djangoproject.com/en/1.7/ref/settings/#std:setting-SESSION_ENGINE   - set it to cache22:19
ericpetersonin real / production setups, I'd take the questions into horizon room, also recommend db session backend22:19
kfox1111this is in the local config: CACHES={'BACKEND': 'django.core.cache.backends.memcached.MemcachedCache', LOCATION': '127.0.0.1:11211'}22:20
kfox1111where do I set the django options?22:20
ericpetersonhttps://github.com/openstack/horizon/blob/master/openstack_dashboard/settings.py#L177 kfox111122:21
kfox1111so, I set that to django.contrib.sessions.backends.cache then.22:22
ericpetersonkfox1111 - let's take further questions into openstack-horizon room if you like22:22
*** pk__ has joined #openstack-dns22:22
kfox1111ok. thanks for the help.22:22
ericpetersonnp :D22:22
Kialltimsim: re private, no - I don't think so.. it's akin to find_recordsets(), which happens to use some private stuff22:23
kfox1111ok. that seemed to do the trick. thanks. :)22:24
KiallI also wonder if it's find_recordsets_raw?22:24
Kiall(matching up with the _select_raw kinda-ish)22:24
*** pk__ has quit IRC22:24
*** pk has joined #openstack-dns22:24
*** pk has quit IRC22:33
*** paul_glass has quit IRC22:35
mugsietimsim: yeah, whatever :P22:40
kfox1111hmm.... so I assume the designate horizon dashboard depends on the python client?22:40
mugsiei am looking at you code now - might have a few other speedups to try :D22:40
mugsiekfox1111: yes22:40
kfox1111hmm... ok. this will get interesting... :)22:40
ekarlsomugsie: what speedups ?22:41
mugsiekfox1111: rm -rf / && go live in the cascades ;)22:41
mugsieekarlso: for the patch he just put up22:41
mugsiekfox1111: i have been tempted many times with that horizon plugin22:42
ekarlsomugsie: btw, i hope you have your alcohol budget set for when you come over :P22:42
mugsiethough, i will say tripleO was worse22:42
mugsieekarlso: yeah - 022:43
kfox1111is it painful to setup?22:43
ekarlsomugsie: :o22:43
mugsiei can;t afford to drink in Norway ;)22:43
openstackgerritMerged openstack/designate: forgot missing __init__.py file  https://review.openstack.org/16781222:43
ekarlsomugsie: there is "happy" hour though I think some days in the neighbour city22:43
kfox1111I've got a vm with rdo juno dashboard in it. just going to try installing it and see what springs come out. :)22:43
mugsiekfox1111: not really... I just had never done a horizon plugin before, and kept twisting mydself into knots22:43
kfox1111ah.22:43
ekarlsolike 15 mins away :P22:43
mugsieam I right in saying stravagner is an oil town?22:44
*** jmcbride has joined #openstack-dns22:44
mugsieso, what - 15e a pint? :P22:44
*** jmcbride has quit IRC22:46
ekarlsomugsie: more like 6-7 I think22:46
mugsieoh. I can live with that22:46
ekarlso:P22:46
mugsiewhen are we going again?22:46
mugsiesoon, isnt it?22:46
*** jmcbride has joined #openstack-dns22:46
ekarlsomugsie: :P april22:47
kfox1111hmm... so the docs that talk about updating settings to enable the dashboard don't seem to be refering to /etc/openstack-dashboard/local_settings...22:49
*** MentalRay has quit IRC22:50
ericpetersonkfox1111 - correct, all though I think it is possible to make changes there too22:51
kfox1111parse errors if I do it there.22:51
kfox1111/usr/share/openstack-dashboard/openstack_dashboard/settings.py?22:51
ericpetersonyes, there should be an existing line which you can change.   Are you working with the changes that just merged?22:52
ericpetersonI can speak to those, at least22:52
kfox1111arg. no module named pbr.version. :/22:53
kfox1111yup. just git pulled right before trying.22:53
ericpetersonhttps://github.com/openstack/designate/blob/master/contrib/designate-dashboard/README.rst   has the changes I made22:54
kfox1111yeah. thats what I'm following. it would be good to put in that its /usr/share/openstack-dashboard/openstack_dashboard/settings.py, not /etc/openstack-dashboard/local_settings like all the other settings go.22:55
kfox1111also it still doesn't seem to work because of the pbr thing.22:55
kfox1111not sure why, but I think redhat disables that stuff in the rpm's.22:55
ericpetersonI'm not sure where the pbr thing is comming from, that is surprising me22:56
ericpetersonI know pbr, but surprised that is occuring22:56
kfox1111hmm... maybe I missed the requirements install step. let me retry that.22:57
kfox1111yeah. that installed pbr.22:57
kfox1111hmm... ImportError: Could not import settings 'openstack_dashboard.settings' (Is it on sys.path? Is there an import error in the settings file?): No module named enabled22:58
ericpetersonyou can also run horizon in more of a developer mode too, which sometimes help with this.   it uses a venv to isolate add/removing/upgrading python libs22:58
kfox1111ok, thats cause there isn't an enabled anywhere in the code...22:59
ericpetersonmy change, where I forget the init.py file.... did you grab that too?22:59
* ericpeterson is ashamed of that change / ommission22:59
kfox1111not sure. can you point me at it again?23:00
ericpetersonhttps://review.openstack.org/#/c/167812/23:00
ericpetersonyou can also just touch that file, wherever the designatedashboard was installed too23:01
kfox1111so, enabled is an empty module?23:01
*** pk has joined #openstack-dns23:01
*** pk has quit IRC23:01
ericpetersonno, there are other files, but I forgot to include the init.py file - which makes python loader barf23:02
*** penick has quit IRC23:02
ericpetersonimport designatedashboard.enabled    ->   this assumes there will be an __init__.py file in that folder, for the import to succeed23:02
ericpetersonand I am stupid, and had that file in my sandbox during the first commit / forgot that file23:03
kfox1111Ah, there we go.23:03
ericpetersondoes it work?23:03
kfox1111a dashboard! :)23:03
kfox1111testing...23:04
* ericpeterson has a small moment of pride23:04
*** penick has joined #openstack-dns23:04
kfox1111awesome. :)23:04
ericpetersonsorry about this mixup kfox1111, I think you might have pulled from git at a window of time where stuff was messed up23:05
kfox1111with those couple of tweaks it slid right into rdo juno's dashboard. :)23:05
kfox1111no, its all cool. better to smooth it all out now, then after release. :)23:05
kfox1111very very cool. thanks for the help. :)23:06
ericpetersonsure, no prob.   We are working on designate deployment right now, I expect some more changes / bug fixes as we find issues.  :D23:06
kfox1111you hooked up with the RDO folks? it would be awesome to be able to just yum install this stuff. :)23:07
ekarlsoericpeterson: what version you deploying ?23:07
ericpetersonmost of our services are j-2 I think.   I am in charge of horizon, and I ship it from master  ;)23:08
ekarlsoah ok23:08
ericpetersonbut I'll dig into the service stuff too, as needed / etc23:08
kfox1111would be very nice to get it to the point where a stock openstack dashboard will detect if designate's there and load it up on demand.23:10
kfox1111man. this is awesome. :)23:10
*** chlong has joined #openstack-dns23:10
kfox1111now I just gota talk with the dns folks here and get a subdomain pointing at designate managed servers.23:11
mugsiewell, it kind of does that now23:11
ericpetersonkfox1111 - I agree, but there is contention between the horizon team owning tons of code, and understanding it all.23:11
kfox1111awesome job all. :)23:11
mugsieericpeterson: with the new "big tent" stuff - whats happening with horizon?23:11
ericpetersongood question  ;)23:12
mugsie(are you doing a neutron and moving everything to out of tree, or taking all and sundry? )23:12
mugsieah23:12
kfox1111yeah. they should be able to manage some code in their stuff though that says, if 'dns' in servicecatalog: import designatemodule, enableit()23:12
mugsiethere is the if in service catalog, enable_it()23:12
mugsieso if you remove the service entry it *should* dissappear23:12
kfox1111ah.23:13
mugsieits just the installing it bit thats not done (for us - as we are out of tree)23:13
ericpetersonthe problem is horizon developers / cores don't have deep service domain logic.   so if you want to add / change new designate horizon code - is the horizon team the best folks to review that?23:13
mugsieI would love to move it in tree though23:13
kfox1111yeah.23:14
mugsieericpeterson: oh, I understand that entirely23:14
mugsiebut there has to be a better way than what we are doing now :(23:14
mugsieit puts people off stright away23:15
ericpetersonthat might be an ok model, but there would be like 80 horizon core devs, and some of them shouldn't be able to approve certain parts of code.   like a horizon-designate core should not +2 code from the swift-horizon feature set23:15
ericpetersonthere certainly should be a better way, agreed23:15
mugsiei am thinking it may be a topic for vancouver23:16
mugsiein the cross project sessions23:16
ericpetersonI attend most of the horizon stuff, will be in vancouver23:16
mugsiecool, so will I (hopefully)23:16
ericpetersonalso, familiar with most of the horizon cores23:16
ericpeterson(I am not a core - I am a operator who codes)23:17
mugsiethats even better :) - you see the impact of theoretical decissions we make :)23:17
ericpetersonsometimes it's best not to see some changes coming  ;)23:18
mugsieyeah. I know exactly what is in store for us when we upgrade our designate service next23:18
mugsieit gives me the shivers23:18
kfox1111feature request... while its perfectly understandable to specify the name like 'bar.kfox-test.cloud.pnnl.gov.', its kind of not obvious to non dns experts and very verbose. It would be nice if it supported entry of a name with no dots, and it fills out the rest.23:22
ekarlsokfox1111: soo, v2 client that does..23:22
kfox1111oh cool. :)23:22
ekarlsoif your name doesn't contain a ending "." or so when creating a record23:22
kfox1111one step ahead of me. :)23:22
ekarlsoit will fetch the domain first before doing post to records23:23
ekarlsobased on the domain id you give23:23
kfox1111cool.23:23
kfox1111so when the dashboard switches over to v2, then it will get that for free.23:23
ekarlso:p23:23
ekarlsokfox1111: whatever decade that happens :D23:24
mugsiewe need to fix the client not to require the ids as well :/23:24
mugsieit is a PITA most of the time23:24
ekarlsomugsie: ... uh that's a fun one with pools and all...23:24
mugsieekarlso: sounds like a problem for whoever is doing the v2 client :D23:25
ekarlsoor hmm23:25
kfox1111I think once you get this stuff into rdo, there will be enough of us users kicking the tires, that one or two  will come along to help polish up some of the rough edges.23:25
ekarlsoshouldn't be too hard23:25
ekarlso*will get to it tmrw*23:25
mugsiekfox1111: yeah23:25
kfox1111if its not me... ;)23:25
ekarlsomugsie: why isn't your changes in yet for the api ? :(23:25
*** andrewbogott_afk is now known as andrewbogott23:25
mugsieneed to find people in RH to take it into RDO23:25
kfox1111depends on just how much of our users ask. :)23:25
mugsieekarlso: waiting on a +A23:26
mugsieit is a massive amount of code23:26
kfox1111so, with all the big tent stuff going on, how is the incubation stuff working?23:35
kfox1111is designate still incubated or what?23:36
mugsiekfox1111: incubation no longer exists from what I can tell23:36
kfox1111hmm... yeah. http://git.openstack.org/cgit/openstack/governance/tree/reference/projects.yaml no longer references incubation at all.23:37
*** chlong has quit IRC23:37
kfox1111which kind of sucks. it was usefull to some extent to tell what was mature and what wasnt. :/23:37
*** chlong has joined #openstack-dns23:37
kfox1111hmm.. though the file has tags now...23:38
kfox1111so I'm not sure how thats really any different. what does it take for designate to get the 'integrated-release' tag?23:39
mugsiekfox1111: no one else is getting that tag23:44
kfox1111hmm.... ok.23:44
mugsieit is in place for Kilo, then it is just a historic thing23:44
mugsieto be replaced with tags to be defined23:44
mugsie(is my understanding)23:44
kfox1111ah. "we'll replace something thats kind of working, with nothing for now and maybe implement something later" cute.23:45
mugsieI am open to being corrected by anyone who has a better unstanding23:45
mugsieyeh23:45
mugsiemy read is the didnt want to make the hard calls, and just delegated the responsiblities23:45
mugsiethe TC*23:46
mugsiewelcoming everyone is great23:46
mugsiebut things like who is in horizon, devstack, etc wasnt worked out23:46
mugsiethis is where people start shouting that I am wrong usually :D23:48
* mugsie </end_rant>23:48
kfox1111yeah. I think the zaqar thing broke them. :/23:49
ericpetersonthe horizon thing is historical.  if it was re-done today..... every project would be a horizon plugin / addon23:49
kfox1111they were doing pretty well until then.23:49
ericpetersonhave any of you tried to keep rabbit running to support openstack?   the idea that openstack has a great messaging system is a little concerning23:50
kfox1111I guess part of it is the swift vs radosgw thing too. its kind of a hard one to call too. we're using rados gw in all of our clouds now.23:51
mugsieericpeterson: yeah, we run a rabbit cluster for our designate install23:51
kfox1111havent had a problem with rabbit yet.23:51
mugsiewe have had network partition issues before, but mostly its OK23:51
mugsiewe had an older version a while back that was awfull23:52
kfox1111yeah, havent ran a rabbit cluster yet. if you dig into their comments about how it works, it scares the crap out of me.23:52
ericpetersonwe constantly have rabbit problems, especially with the ha setup and making sure everyone stays connected correctly23:52
kfox1111"you should run a fast backend network with them close together so you don't run into issues".23:52
kfox1111aka, the code's racy/buggy, and we don't care (tm)23:52
mugsiethey assume the network never partitions23:53
kfox1111yeah. and thats a really bad assumption.23:53
mugsiewe have had situations where we had to nuke a whole node just to get it to rejoin23:53
ericpetersonI think the best advice at operators meetup was - run rabbit on single node, and don't try to make it resillent23:53
kfox1111in our experience, often the networks one of the first things to go. :/23:53
mugsieas someone who runs on cloud, on neutron - yes, x1000 yes23:54
ericpetersonyep kfox111123:54
*** ericpeterson has quit IRC23:55
mugsieright, home time23:55
mugsielater o/23:55
kfox1111later. thanks again for all the help.23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!