| *** eankutse has joined #openstack-dns | 00:06 | |
| *** RaginBajin has quit IRC | 00:08 | |
| *** RaginBajin has joined #openstack-dns | 00:09 | |
| *** eankutse has quit IRC | 00:11 | |
| *** RaginBajin has quit IRC | 00:13 | |
| *** RaginBajin has joined #openstack-dns | 00:18 | |
| *** matsuhashi has joined #openstack-dns | 00:26 | |
| *** matsuhashi has quit IRC | 00:33 | |
| *** matsuhashi has joined #openstack-dns | 00:34 | |
| openstackgerrit | Kiall Mac Innes proposed a change to stackforge/python-designateclient: Support Keystone V3 authentication https://review.openstack.org/95615 | 00:46 |
|---|---|---|
| *** sbfox has quit IRC | 01:12 | |
| *** matsuhashi has quit IRC | 01:33 | |
| *** matsuhashi has joined #openstack-dns | 01:34 | |
| *** nosnos has joined #openstack-dns | 01:44 | |
| openstackgerrit | Tim Freund proposed a change to stackforge/designate: Create missing domains during Bind9Backend start https://review.openstack.org/95325 | 01:47 |
| *** RaginBajin has quit IRC | 02:00 | |
| *** RaginBajin has joined #openstack-dns | 02:00 | |
| *** RaginBajin has quit IRC | 02:05 | |
| *** aboutGod has joined #openstack-dns | 02:22 | |
| *** aboutGod has left #openstack-dns | 02:27 | |
| *** RaginBajin has joined #openstack-dns | 03:01 | |
| *** cwright has joined #openstack-dns | 03:01 | |
| *** cwright has left #openstack-dns | 03:01 | |
| *** RaginBajin has quit IRC | 03:05 | |
| *** nosnos has quit IRC | 03:25 | |
| *** RaginBajin has joined #openstack-dns | 03:31 | |
| *** RaginBajin has quit IRC | 03:36 | |
| *** RaginBajin has joined #openstack-dns | 04:32 | |
| *** RaginBajin has quit IRC | 04:37 | |
| *** manoj has joined #openstack-dns | 04:38 | |
| manoj | hi all | 04:38 |
| manoj | Is designate ready for production ? | 04:38 |
| *** nosnos has joined #openstack-dns | 04:46 | |
| manoj | hi all, how to use the designate for production environment, is anyone using it now? | 05:05 |
| *** manoj has quit IRC | 05:11 | |
| *** RaginBajin has joined #openstack-dns | 05:33 | |
| *** RaginBajin has quit IRC | 05:38 | |
| *** sbfox has joined #openstack-dns | 05:46 | |
| *** RaginBajin has joined #openstack-dns | 06:34 | |
| *** RaginBajin has quit IRC | 06:38 | |
| *** RaginBajin has joined #openstack-dns | 07:34 | |
| *** RaginBaj_ has joined #openstack-dns | 07:36 | |
| *** RaginBajin has quit IRC | 07:39 | |
| *** RaginBaj_ has quit IRC | 07:41 | |
| *** sbfox has quit IRC | 08:20 | |
| *** RaginBajin has joined #openstack-dns | 08:37 | |
| *** RaginBajin has quit IRC | 08:41 | |
| *** nosnos has quit IRC | 08:48 | |
| *** nosnos has joined #openstack-dns | 08:48 | |
| *** nosnos has quit IRC | 08:53 | |
| *** nosnos has joined #openstack-dns | 09:35 | |
| *** RaginBajin has joined #openstack-dns | 09:38 | |
| *** RaginBajin has quit IRC | 09:42 | |
| *** matsuhashi has quit IRC | 09:58 | |
| *** matsuhashi has joined #openstack-dns | 10:00 | |
| *** matsuhashi has quit IRC | 10:07 | |
| *** nosnos has quit IRC | 10:07 | |
| *** matsuhashi has joined #openstack-dns | 10:07 | |
| *** matsuhashi has quit IRC | 10:12 | |
| *** RaginBajin has joined #openstack-dns | 10:38 | |
| *** RaginBajin has quit IRC | 10:43 | |
| *** RaginBajin has joined #openstack-dns | 11:28 | |
| *** eankutse has joined #openstack-dns | 11:39 | |
| *** RaginBaj_ has joined #openstack-dns | 11:39 | |
| *** RaginBaj_ has quit IRC | 11:44 | |
| *** mwagner_lap has quit IRC | 12:08 | |
| *** RaginBaj_ has joined #openstack-dns | 12:40 | |
| *** RaginBaj_ has quit IRC | 12:44 | |
| *** rmoe has joined #openstack-dns | 12:48 | |
| *** eankutse has quit IRC | 13:06 | |
| *** eankutse has joined #openstack-dns | 13:06 | |
| *** eankutse has quit IRC | 13:13 | |
| *** eankutse has joined #openstack-dns | 13:14 | |
| *** ericvw has joined #openstack-dns | 13:19 | |
| *** betsy has joined #openstack-dns | 13:22 | |
| *** sballe_ has joined #openstack-dns | 13:37 | |
| *** sballe has quit IRC | 13:39 | |
| *** RaginBaj_ has joined #openstack-dns | 13:41 | |
| *** sballe_ has quit IRC | 13:42 | |
| *** RaginBaj_ has quit IRC | 13:46 | |
| *** liyuezho has joined #openstack-dns | 13:48 | |
| *** liyuezho has quit IRC | 13:48 | |
| *** sballe has joined #openstack-dns | 13:54 | |
| *** nkinder has joined #openstack-dns | 13:56 | |
| *** sbfox has joined #openstack-dns | 13:57 | |
| *** msisk has joined #openstack-dns | 13:58 | |
| *** sballe has quit IRC | 13:59 | |
| timfreund | Hi betsy, thanks for pointing out Kiall's in-line comment. I didn't realize the "(1 comment)" text in the main review page was pointing me toward the annotated diff. | 14:11 |
| *** jaycaz has joined #openstack-dns | 14:11 | |
| betsy | timfreund: No problem. Sometimes those comments are confusing. | 14:11 |
| Kiall_ | timfreund: yea, Gerrit's UI takes some getting used to :P | 14:14 |
| *** Kiall_ is now known as Kiall | 14:14 | |
| Kiall | timfreund: also, if we can make it a warning level log | 14:15 |
| Kiall | LOG.warn("Domain %s (%s) missing from backend, recreating", domain['name'], domain['id']) or something :) | 14:15 |
| timfreund | It does take some getting used to, but I like it so far. Puts our ancient installation of Review Board at the office to shame. | 14:16 |
| timfreund | I'll get the log message/level updated and resubmitted. Thanks! | 14:17 |
| Kiall | betsy: BTW - Did you say you were working on merging the RecordSet and Record resources in v2 at the summit? If not, I'll tackle that over the next few days | 14:18 |
| betsy | kiall: are you talking about the database work or the api work? | 14:19 |
| Kiall | api side | 14:19 |
| betsy | I was planning on doing it, but then thought maybe to do the db work first | 14:20 |
| betsy | What do you think? | 14:20 |
| Kiall | Ok - Cool, I think they can both happen at the same time.. Assuming you're talking about the split of records into many different tables per record-type? | 14:20 |
| betsy | Yes, but also the RecordSets table, too. See https://blueprints.launchpad.net/designate/+spec/recordsets-records-tables-redesign | 14:21 |
| Kiall | Yes, that's the one I'm thinking of :) | 14:23 |
| betsy | Does that design look okay? I’d like to get that bp approved today, if possible | 14:24 |
| Kiall | Let me re-read :) | 14:24 |
| betsy | thx | 14:24 |
| Kiall | (This is one of those areas where Postgres kicks MySQL's ass .. Table inheritance would make this MUCH cleaner!) | 14:25 |
| Kiall | http://www.postgresql.org/docs/8.1/static/ddl-inherit.html | 14:25 |
| betsy | kiall: yeah. that would be nicer. Does sqlalchemy support that, tho? | 14:28 |
| Kiall | Probably not ;) | 14:28 |
| betsy | too bad | 14:29 |
| Kiall | So, I'm wondering if it's worth doing the RecordSet's table split? the contents of that table are unlikely to change often, and we get some advantages from it - mainly being able to lookup a RRSet without knowing it's type in advance. | 14:31 |
| *** sballe_ has joined #openstack-dns | 14:31 | |
| Kiall | We also have to figure out how to ensure that no CNAME/DNAME recordset lives alongside any other recorset, which feels like it will be easier to achieve on a single table. | 14:33 |
| Kiall | For me - The biggest win we'll get from moving away from a single records table to table per type is the removal of that "data" column, that column is likely have the biggest penalty on DB performance we have. | 14:36 |
| Kiall | Unrelated comment, for the per-record type tables, I think it would make sense to have their column naming map to the Objects/RFCs closer.. E.g. for MX you have: record, priority vs the RFC/objects having preference, exchange | 14:39 |
| betsy | Well, the purpose of splitting the RecordSet is because if you have one giant one for all record types, it’s going to get huge, at least for us. | 14:41 |
| *** RaginBaj_ has joined #openstack-dns | 14:42 | |
| Kiall | Yep - It'll be huge for everyone eventually ;) But, That's usually OK, even at stupidly large numbers, so long as the cols are kept to a minimum number of very unlikely to change columns | 14:44 |
| Kiall | (I haven't tested any of this, BTW, I know you have so I could easily be wrong here :)) | 14:45 |
| *** sballe_ has quit IRC | 14:45 | |
| betsy | You could still get all the recordsets for a particular domain without knowing the types by doing a search across all the tables by domain id | 14:45 |
| *** RaginBaj_ has quit IRC | 14:46 | |
| *** sbfox has quit IRC | 14:46 | |
| Kiall | My gut tells me that's going to be more expensive than a single, optimized, table? (which today's RecordSet's table is not) | 14:46 |
| Kiall | But.. Again, I've not tested! | 14:47 |
| betsy | I talked to some of our db guys. That’s actually the way we do it currently in production (split tables by type), so they said it was a proven technology. They also said one large table is not that bad, as long as it doesn’t contain much data (i.e. few columns with small data in each one), but the RRSets table will have lots of columns. If it gets too large, it could force the sharding of the table, which would be a hassle. | 14:49 |
| Kiall | MySQL has been known to scale to multiple hundred millions of rows in a well designed+tightly constrained table.. I'm just concerned we're trading one problem for another by splitting that table | 14:50 |
| betsy | It’ll be indexed on the domain_id, so should be fast. But I’m not a db expert either | 14:51 |
| Kiall | Maybe we should start with the records table split, and do some testing of at what point our current RRSet tables "breaks"? Or - have you already got some numbers for that? | 14:53 |
| *** vinod1 has joined #openstack-dns | 15:01 | |
| *** vinod1 has quit IRC | 15:01 | |
| betsy | It’s been a while since I talked to some of our DBAs. Let me ask them again what they think. If I remember right, it was not how many rows the table had, but how large it was in terms of data size. | 15:02 |
| *** nkinder has quit IRC | 15:04 | |
| Kiall | Yep - I'd like to see some numbers on both our current RRSet table, and a split out version .. I'm just concerned splitting that will cause us headaches that might not be necessary.. | 15:06 |
| betsy | Okay. Do you want to get those numbers from your current production? | 15:07 |
| betsy | Maybe we can talk about it at the IRC tomorrow | 15:07 |
| Kiall | Anyway .. The Records table split is 100% needed, it gives obvious value and no obvious issues :) The RecordSets table split seems a little harder to justify to me | 15:07 |
| betsy | Maybe I should start with the api redesign while we discuss the db end | 15:08 |
| Kiall | I'd be interested to see what happens when you take your current #'s, a decent spec MySQL server, and JMeter at it | 15:08 |
| Kiall | point JMeter at it* | 15:08 |
| betsy | Our tables are already split | 15:08 |
| Kiall | Yea, I mean compared with our current RRSet table :) | 15:09 |
| betsy | Hard to compare the two, but we can both gather numbers | 15:09 |
| betsy | I’ll try and get some numbers on how long a join takes with the tables split | 15:09 |
| Kiall | Yea.. I guess I'm just wondering if 15-20 queries (there are lots of record types), or a 15 way join, or 1 large table is the most performant | 15:10 |
| Kiall | (e.g. when listing the RRSets in a zone, a fairly common API operation, and something mDNS will do a good bit) | 15:12 |
| betsy | Yeah, that’s a very common api call | 15:16 |
| betsy | kiall: to go back to your original question - I’ll start on the Recordset/Record api changes now and we can both gather data on the table split and discuss next week at IRC meeting. Does that work? | 15:17 |
| Kiall | Yes.. Sounds good :) | 15:17 |
| Kiall | (I assume by next week, you don't mean the meet tomorrow? :)) | 15:17 |
| betsy | Yes. NOT tomorrow. :) | 15:18 |
| Kiall | Perfect :) | 15:18 |
| *** jorgem has joined #openstack-dns | 15:20 | |
| *** nkinder has joined #openstack-dns | 15:20 | |
| *** vinod1 has joined #openstack-dns | 15:20 | |
| *** vinod1 has quit IRC | 15:29 | |
| *** vinod1 has joined #openstack-dns | 15:31 | |
| *** msisk_ has joined #openstack-dns | 15:31 | |
| *** jmcbride has joined #openstack-dns | 15:31 | |
| *** eankutse has quit IRC | 15:32 | |
| *** eankutse has joined #openstack-dns | 15:32 | |
| *** msisk has quit IRC | 15:33 | |
| *** rmoe has quit IRC | 15:37 | |
| *** RaginBaj_ has joined #openstack-dns | 15:42 | |
| *** RaginBaj_ has quit IRC | 15:47 | |
| *** vinod1 has quit IRC | 15:50 | |
| *** vinod1 has joined #openstack-dns | 15:50 | |
| *** shakamunyi has joined #openstack-dns | 15:56 | |
| *** nkinder has quit IRC | 15:57 | |
| *** rmoe has joined #openstack-dns | 15:57 | |
| *** vinod2 has joined #openstack-dns | 15:58 | |
| *** vinod1 has quit IRC | 15:58 | |
| *** vinod2 has quit IRC | 15:59 | |
| *** vinod1 has joined #openstack-dns | 15:59 | |
| *** sbfox has joined #openstack-dns | 16:00 | |
| *** nkinder has joined #openstack-dns | 16:14 | |
| *** rossk has joined #openstack-dns | 16:29 | |
| *** sbfox has quit IRC | 16:30 | |
| *** sbfox has joined #openstack-dns | 16:33 | |
| *** mwagner_lap has joined #openstack-dns | 16:35 | |
| *** RaginBaj_ has joined #openstack-dns | 16:43 | |
| *** eankutse has quit IRC | 16:43 | |
| *** RaginBaj_ has quit IRC | 16:47 | |
| *** jaycaz has quit IRC | 16:52 | |
| *** vinod2 has joined #openstack-dns | 16:55 | |
| *** vinod1 has quit IRC | 16:56 | |
| *** jmcbride has quit IRC | 17:05 | |
| *** jmcbride has joined #openstack-dns | 17:05 | |
| *** msisk_ has quit IRC | 17:07 | |
| *** jmcbride has quit IRC | 17:10 | |
| *** msisk has joined #openstack-dns | 17:10 | |
| *** jmcbride has joined #openstack-dns | 17:10 | |
| *** msisk has quit IRC | 17:15 | |
| *** jmcbride has quit IRC | 17:15 | |
| *** msisk has joined #openstack-dns | 17:15 | |
| *** jmcbride has joined #openstack-dns | 17:17 | |
| *** sbfox has quit IRC | 17:18 | |
| *** msisk_ has joined #openstack-dns | 17:19 | |
| *** jmcbride has quit IRC | 17:20 | |
| *** jmcbride has joined #openstack-dns | 17:20 | |
| *** msisk has quit IRC | 17:23 | |
| *** sbfox has joined #openstack-dns | 17:24 | |
| *** nkinder has quit IRC | 17:24 | |
| *** jmcbride has quit IRC | 17:32 | |
| *** jmcbride has joined #openstack-dns | 17:40 | |
| *** nkinder has joined #openstack-dns | 17:41 | |
| *** jaycaz has joined #openstack-dns | 17:41 | |
| *** RaginBaj_ has joined #openstack-dns | 17:44 | |
| *** jaycaz has joined #openstack-dns | 17:45 | |
| *** sbfox has quit IRC | 17:46 | |
| *** vinod2 has quit IRC | 17:47 | |
| *** RaginBaj_ has quit IRC | 17:48 | |
| *** vinod1 has joined #openstack-dns | 17:51 | |
| *** eankutse has joined #openstack-dns | 18:05 | |
| *** eankutse has quit IRC | 18:05 | |
| *** eankutse has joined #openstack-dns | 18:05 | |
| *** jmcbride has quit IRC | 18:10 | |
| *** vinod1 has quit IRC | 18:18 | |
| *** sbfox has joined #openstack-dns | 18:22 | |
| *** sbfox1 has joined #openstack-dns | 18:25 | |
| *** jmcbride has joined #openstack-dns | 18:28 | |
| *** sbfox has quit IRC | 18:29 | |
| *** RaginBaj_ has joined #openstack-dns | 18:45 | |
| *** RaginBaj_ has quit IRC | 18:49 | |
| *** msisk_ has quit IRC | 19:18 | |
| *** RaginBaj_ has joined #openstack-dns | 19:45 | |
| *** RaginBaj_ has quit IRC | 19:49 | |
| *** msisk has joined #openstack-dns | 19:54 | |
| *** msisk has quit IRC | 19:55 | |
| *** msisk has joined #openstack-dns | 19:55 | |
| *** sbfox1 has quit IRC | 19:59 | |
| *** vinod1 has joined #openstack-dns | 20:00 | |
| *** jmcbride has quit IRC | 20:01 | |
| *** jmcbride has joined #openstack-dns | 20:02 | |
| *** jaycaz has quit IRC | 20:05 | |
| *** sbfox has joined #openstack-dns | 20:07 | |
| *** jmcbride has quit IRC | 20:12 | |
| *** jmcbride has joined #openstack-dns | 20:15 | |
| *** jorgem has quit IRC | 20:45 | |
| *** RaginBaj_ has joined #openstack-dns | 20:46 | |
| *** RaginBaj_ has quit IRC | 20:51 | |
| *** vinod1 has quit IRC | 21:11 | |
| *** jmcbride has quit IRC | 21:15 | |
| -openstackstatus- NOTICE: Zuul is offline due to an operational issue; ETA 2200 UTC. | 21:32 | |
| *** ChanServ changes topic to "Zuul is offline due to an operational issue; ETA 2200 UTC." | 21:32 | |
| *** RaginBaj_ has joined #openstack-dns | 21:47 | |
| *** RaginBaj_ has quit IRC | 21:51 | |
| *** mwagner_lap has quit IRC | 21:52 | |
| *** shakamunyi has quit IRC | 22:03 | |
| *** ChanServ changes topic to "Openstack DNS / Designate - Weekly meet on Wednesdays @ 1700 UTC https://launchpad.net/designate - https://github.com/stackforge/designate - https://designate.readthedocs.org/ - This room is logged (http://eavesdrop.openstack.org/irclogs/)" | 22:09 | |
| -openstackstatus- NOTICE: Zuul is started and processing changes that were in the queue when it was stopped. Changes uploaded or approved since then will need to be re-approved or rechecked. | 22:09 | |
| *** shakamunyi has joined #openstack-dns | 22:10 | |
| *** msisk has quit IRC | 22:33 | |
| *** RaginBaj_ has joined #openstack-dns | 22:47 | |
| *** RaginBa__ has joined #openstack-dns | 22:50 | |
| *** RaginBaj_ has quit IRC | 22:50 | |
| *** nkinder has quit IRC | 22:58 | |
| *** nkinder has joined #openstack-dns | 23:00 | |
| *** RaginBa__ has quit IRC | 23:08 | |
| *** mwagner_lap has joined #openstack-dns | 23:08 | |
| *** RaginBaj_ has joined #openstack-dns | 23:08 | |
| *** RaginBaj_ has quit IRC | 23:13 | |
| *** RaginBaj_ has joined #openstack-dns | 23:24 | |
| *** nkinder has quit IRC | 23:28 | |
| *** RaginBaj_ has quit IRC | 23:36 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!