introduction 2 to aws and storage options

Introduction to AWSStorage Options

Szilveszter Molnar@moszinet

Development vs Operations

Recap

Recap• Infrastructure as a Service -

IAAS

• No reason to do it by yourself

• Elastic Computing

• Regions an Availability Zones

• Elastic Compute Cloud - EC2

AWS Services Overview

Compute• EC2 (On-Demand, Reserved, Spot)

• Autoscaling

• ELB

• AWS Lambda

• Container Service

• VM Import/Export

Storage & Content Delivery• Amazon S3

• Glacier

• Elastic Block Store - EBS

• Elastic File System

• CloudFront

• Import/Export Snowball

Storage & Content Delivery• Amazon S3

• Glacier

• Elastic Block Store - EBS

• Elastic File System

• CloudFront

• Import/Export Snowball

Database• Relational Database Service - RDS

• MySQL, MS SQL, Oracle, Postgres, etc ...

• Aurora

• AWS Database Migration Service

• DynamoDB

• Redshift

• ElastiCache

Networking• Amazon VPC

• AWS Direct Connect

• Amazon Route53

Developer Tools• AWS CodeCommit

• AWS CodeDeploy

• AWS CodePipeline

...• Management Tools

• Security & Identity

• Analytics

• Internet of Things

• Mobile Services

• Application Services

• Enterprise Applications

Storage Options

Storage Options• EBS

• Instance Store Volumes

• S3

• Glacier

EBS

Elastic Block Storage• Block level storage

• Use with EC2 instances

• Types

• Standard - ~100 IOPS, "best effort"

• Provisioned - max 2000 IOPS / volume

• stripe volumes for more (RAID 0)

Elastic Block Storage• Highly available and reliable

• Replicated across multiple servers in an AZ

• Snapshots

• Incremental

• Stored in S3

• Annual Durability w/ less then 20 GB modified data 99.5%-99.9%

Elastic Block Storage• Ideal Usage Patterns

• relatively frequent data changes

• databases with consistent read & writes

• raw block-level storage

Elastic Block Storage• Anti-Patterns

• Temporary storage (use local instance volumes, SQS or ElastiCache)

• Highly-durable storage (use S3, Glacier)

• Static data (use S3)

Instance Store Volumes• Temporary

• SSD

• up to 120,000 IOPS

• attached to the physical server

• NOT Durable: lost if the instance is stopped/fails

S3

Simple Storage Service• Simple key-value storage

• 1 Byte - 5 TB object size

• Buckets

• Highly scalable, reliable and low-latency

• Durability: 99.999999999 %

• Availability: 99.99 %

Simple Storage Service• Versioning

• Lifetime control

• Multi-Factor Auth Delete

• Reduced Redundancy - 99.99% durability

• 400x more durable than 1 typical HDD

Simple Storage Service• Ideal Usage Patterns

• Static web content and media

• Static website hosting

• Archival of critical data

Simple Storage Service• Anti-Patterns

• File System

• Structured data with query

• Rapidly changing data

• Backup and archival storage

Glacier

Glacier• 0.01$ / GB

• Store "archives"

• Retrieve archives by initiating a retrieval job

• Archives organised in vaults

• Durability 99.999999999 %

• Retrieve jobs complete in 3-5 hours

Glacier• Ideal Usage Patterns

• Offsite archival

• Magnetic tape replacement

• Anti-patterns

• Rapidly changing data

• Real time access

Recap

Recap• EBS

• "Hard disk"

• S3

• Buckets, highly durable 11 9's, fast access

• Glacier

• Archives, highly durable 11 9's, slow access

• AWS Overview White Paper

• AWS Storage Options Whitepaper

• qwiklab.com (free until end of March)

Thank you!@moszinet