AWS for the SQL Server Pro

@LynnLangit

Oct 2013

Data Expertise / Lynn Langit

Practicing Architect• Cloud Deployments (Azure, AWS, Google)

Technical author / trainer• Google Cloud Developer Series• SQL Server 2012 Developer Series • Cloudera Certified Developer• 2 books on SQL Server BI

Industry awards• Microsoft – MVP for SQL Server • Google – GDE for Cloud Platform• 10Gen – Master for MongoDB

Former MSFT FTE• 4 years

What and Why AWS?

AWS = Amazon’s cloud

Set of services• Compute• Data• More

Market leader• In market

longest• Usually

cheapest • Most often used

in production

Amazon Web Services

EC 2 for training, testing and production

6 April 2013

Demo - EC2Virtual Machines

S3 and Glacierfor archival storage

About EC2 storage

EBS optional

Can store AMIs (persistent)

Can ‘stop’ EC2 instances and

‘re-start’ – saves $$$

Costs more Can expand One copy only (faster)

S3 by default10 GB max 3 copies

S3 – bucket properties

10 April 2013

Demo – S3 Archival Storage

11 April 2013

Demo – GlacierArchival Storage

RDSfor full SQL Server and more…

13 April 2013

Demo – RDSSQL Server as a service

RDS vs. EC2 for SQL Server

• Provisioned IO – performance guarantees

• Scheduled backups • Point in time restores• Scheduled maintenance

windows• Full use of all SQL tools,

SSMS, Profiler, DTA, etc…

• Supports Availability Groups (requires 2012 Enterprise)

Why RDS costs more

Redshift – Warehouse as a Service

16 April 2013

Demo – RedshiftData Warehousing as a Service

DynamoDBfor fast NoSQL with SSDs

18 April 2013

Demo – DynamoDB

NoSQL on SSD

Elastic MapReducefor easy Hadoop

20 April 2013

Demo – MapReduceHadoop on AWS

Data Pipelines – automated data transfer

22 April 2013

Demo – Data Pipeline

Build data flows on AWS

Elastic Beanstalkfor application scalability

24 April 2013

Demo – BeanstalkPaaS on AWS

25 April 2013

Demo – AWS SDKAdd-in for Visual Studio and .NET

Cloud Database Services by Vendor

AWS Google MicrosoftVirtual Machines EC2 w/SQL Server GCE – Linux only Azure VM – W/SQL

Server

Cloud RDBMS RDS - SQL ServerRedshift -Postgres

mySQLMariaDB

SQL Azure

NoSQL bucketsKey-Value stores

S3, EBS, Glacier, DynamoDB

Cloud Storage HR Datastore on GAE

Azure Blobs Azure Tables

Pipelines Data Pipelines Via APIs only SSIS (on-premises)

Streaming Machine Learning

Custom EC2 Prospective Search &Prediction API

StreamInsight

Document MongoDB on EC2 None MongoDB on Windows Azure

Hadoop MapReduce or Dremel

MapReduce on EC2 using S3

Big Query HDInsight (HDFS) on Azure

Data sets & other Karmasphere FreebaseTranslation APIFull-text search

Azure Marketplace

Costs - Free Tier – EC2

Costs - Free Tier SQL and Dynamo

How much does it cost?

Creative Financing

• Use what you need and no more, i.e. instance size, storage size…

• Watch for price drops – RDS price decrease this week

Regular Pricing

• Pause EC2 instances to reduce compute charges• Delete EC2 instances to reduce storage charges

Smart EC2 Instance Usage

• Set pricing alerts• Use spot pricing• Re-selling compute / storage

Vanity Pricing

Conclusions

EC2 for testing, training and production (IaaS)

S3 for archiving R/W

Glacier for archiving W fast & cheap, R slow & expensive

RDS for HA SQL Server

Redshift for Data Warehousing on demand

DynamoDB for fast NoSQL – on SSDs

Elastic Map Reduce for easy Hadoop MapReduce

www.TeachingKidsProgramming.org• Free Courseware • Do a Recipe Teach a Kid (Ages 10 ++)• Java or Microsoft SmallBasic• C# on Pluralsight

• recipes)

VOTECONFIRMSHARE

Keep Learning

Twitter: @LynnLangitYouTube:http://www.youtube.com/user/SoCalDevGal

Hire me• To help build your BI/Big Data

solution• To teach your team next gen BI• To learn more about using NoSQL

solutions