intergalactic data speak_highload++_20131028

65
Intergalactic Dataspeak Highload++ 2013/10/28 Copyright© 2013 David Fetter [email protected] All rights reserved.

Upload: david-fetter

Post on 22-Apr-2015

470 views

Category:

Technology


0 download

DESCRIPTION

Slides from my Highload++ 2013 talk. Join the fun!

TRANSCRIPT

Page 1: Intergalactic data speak_highload++_20131028

Intergalactic Dataspeak

Highload++ 2013/10/28Copyright© 2013David Fetter [email protected] rights reserved.

Page 2: Intergalactic data speak_highload++_20131028

SQL Everywhere!

Page 3: Intergalactic data speak_highload++_20131028
Page 4: Intergalactic data speak_highload++_20131028
Page 5: Intergalactic data speak_highload++_20131028

Virtual Table Interface

Page 6: Intergalactic data speak_highload++_20131028

Virtual Index Interface

Page 7: Intergalactic data speak_highload++_20131028

SQL/MED

Page 8: Intergalactic data speak_highload++_20131028

<DIGRESSION>

Page 9: Intergalactic data speak_highload++_20131028

EXTENSIONS!

Page 10: Intergalactic data speak_highload++_20131028

</DIGRESSION>

Page 11: Intergalactic data speak_highload++_20131028

<PAST>

Page 12: Intergalactic data speak_highload++_20131028

SQL/MED in PostgreSQL

contrib/dblink

Page 13: Intergalactic data speak_highload++_20131028

SQL/MED in PostgreSQL

DBI-Link

Page 14: Intergalactic data speak_highload++_20131028

Time Passes...

Page 15: Intergalactic data speak_highload++_20131028

PostgreSQL 8.4

Page 16: Intergalactic data speak_highload++_20131028

Infrastructure Only

Page 17: Intergalactic data speak_highload++_20131028

PostgreSQL 9.0

Page 18: Intergalactic data speak_highload++_20131028

More Infrastructure

Page 19: Intergalactic data speak_highload++_20131028

PostgreSQL 9.2

Page 20: Intergalactic data speak_highload++_20131028

ReadsANALYZE

Page 21: Intergalactic data speak_highload++_20131028

</PAST>

Page 22: Intergalactic data speak_highload++_20131028

<PRESENT>

Page 23: Intergalactic data speak_highload++_20131028

A Disqus Hour

•50 GB raw log data

•30 GB event data

•100 million embed loads

•...last week.

Page 24: Intergalactic data speak_highload++_20131028

PostgreSQL 9.3

Page 25: Intergalactic data speak_highload++_20131028

WRITES!

Page 26: Intergalactic data speak_highload++_20131028

Wrappers. Lots of Wrappers.

Page 27: Intergalactic data speak_highload++_20131028

<SQL>

Page 28: Intergalactic data speak_highload++_20131028

Oracle

Page 29: Intergalactic data speak_highload++_20131028

MySQL

Page 30: Intergalactic data speak_highload++_20131028

ODBC

Page 31: Intergalactic data speak_highload++_20131028

</SQL>

Page 32: Intergalactic data speak_highload++_20131028

<NoSQL>

Page 33: Intergalactic data speak_highload++_20131028

CouchDB

Page 34: Intergalactic data speak_highload++_20131028

Redis

Page 35: Intergalactic data speak_highload++_20131028

</NoSQL>

Page 36: Intergalactic data speak_highload++_20131028

<File>

Page 37: Intergalactic data speak_highload++_20131028

file

Page 38: Intergalactic data speak_highload++_20131028

file_text_array

Page 39: Intergalactic data speak_highload++_20131028

</File>

Page 40: Intergalactic data speak_highload++_20131028

<Creativity>

Page 41: Intergalactic data speak_highload++_20131028

Twitter

Page 42: Intergalactic data speak_highload++_20131028

LDAP

Page 43: Intergalactic data speak_highload++_20131028

S3

Page 44: Intergalactic data speak_highload++_20131028

</Creativity

>

Page 45: Intergalactic data speak_highload++_20131028

More!

Page 48: Intergalactic data speak_highload++_20131028

<New_Commands>

Page 49: Intergalactic data speak_highload++_20131028

{CREATE | ALTER | DROP}

FOREIGN DATA WRAPPER

Page 50: Intergalactic data speak_highload++_20131028

{CREATE | ALTER | DROP}SERVER

Page 51: Intergalactic data speak_highload++_20131028

{CREATE | ALTER | DROP}

USER MAPPING

Page 52: Intergalactic data speak_highload++_20131028

</New_Commands>

Page 53: Intergalactic data speak_highload++_20131028

<INTROSPECTION>

Page 54: Intergalactic data speak_highload++_20131028

Remote Partitioning

• Expose information_schema.columns.

• Create view over them.• Create foreign table generator.

Page 55: Intergalactic data speak_highload++_20131028

</INTROSPECTION>

Page 56: Intergalactic data speak_highload++_20131028

</PRESENT>

Page 57: Intergalactic data speak_highload++_20131028

<FUTURE>

Page 58: Intergalactic data speak_highload++_20131028

<INTROSPECTION>

Page 60: Intergalactic data speak_highload++_20131028

More and better.

Page 61: Intergalactic data speak_highload++_20131028

</INTROSPECTION>

Page 62: Intergalactic data speak_highload++_20131028

Full SQL/MED Compliance

Page 63: Intergalactic data speak_highload++_20131028

The ever-interesting: Stuff I Never Thought Of

Page 64: Intergalactic data speak_highload++_20131028

</FUTURE>

Page 65: Intergalactic data speak_highload++_20131028

Большое спасибо!

Highload++ 2013/10/28Copyright© 2013David Fetter [email protected] rights reserved.