moving to the cloud as easy as 1 2 4 - heanet into the cloud... · amazon simple workflow amazon...

46
Moving to the Cloud As easy as 1 2 …4 Kevin Dermody Project Manager - Multimedia Services - HEAnet 1 10/11/2016 [email protected]

Upload: lamtuong

Post on 11-Jun-2018

220 views

Category:

Documents


0 download

TRANSCRIPT

Moving to the CloudAs easy as 1 2 …4

Kevin Dermody

Project Manager - Multimedia Services - HEAnet

110/11/2016 [email protected]

What do clients want?

Cloud Competency!

2

What is Cloud Competency?

¯\_(ツ)_/¯3

Architecting on AWS

3 day course in HEAnet Office

Majority of technical staff participated

Covered significant amount of core AWS

Mixture of theory and hands-on practical

4

AWS Services

Database

Amazon DynamoDB

Amazon ElastiCache

Amazon Relational Database Service

Amazon Redshift

Amazon SimpleDB

AWS Data Pipeline

Amazon Kinesis

Amazon Aurora

Deployment

AWS CloudFormation

AWS Elastic Beanstalk

AWS OpsWorks provides

AWS CodeDeploy

Miscellaneous

Amazon Fulfillment Web Service

Amazon Historical Pricing

Amazon Mechanical Turk

Amazon Product Advertising API

Amazon Gift Code On Demand

AWS Partner Network

Amazon Lumberyard

Application services

Amazon API Gateway

Amazon CloudSearch

Amazon DevPay

Amazon Elastic Transcoder

Amazon Simple Email Service

Amazon Simple Queue Service

Amazon Simple Notification Service

Amazon Simple Workflow

Amazon Cognito

Amazon AppStream

Compute

Amazon Elastic Compute Cloud

Amazon Elastic MapReduce

Amazon Lambda

Networking

Amazon Route 53

Amazon Virtual Private Cloud

AWS Direct Connect

Amazon Elastic Load Balancing

Storage and content delivery

Amazon Simple Storage Service

Amazon Glacier

AWS Storage Gateway

Amazon Elastic Block Store

AWS Import/Export

Amazon Elastic File System

Content delivery

Amazon CloudFront

Analytics

Amazon Machine Learning

Amazon Kinesis

Management

Amazon Identity and Access

AWS Directory Service

Amazon CloudWatch

AWS Management Console

CloudFront

Amazon CloudHSM

AWS Key Management Service

Amazon EC2 Container Service

5

Familiar set of services

Compute

EmailDatabase

Storage

6

What is FileSender

FileSender is a way to share large files withanyone. It works through your web browser tosend a file to any email address.

FileSender can send files up to 500 GB. Thisconsiderable sending power allows users totransfer large files with ease.

7

What does FileSender Look Like?

8

CloudSender - Free-Tier AWS

Compute

EmailDatabase

Storage✓ ✓

✓ ✓CloudSender9

Forming the Cloud

Region

Availability Zone

CloudSenderclient

Virtual Private Cloud

Security Group

Internet gateway

10

AWS Services

VPC

EC2

EBS

Success!

11

That’s no cloud!

12

CloudSender Status

Compute

EmailDatabase

Storage✓

CloudSender13

CloudSender - Resilient

Availability Zone

Internet gateway

clientRDSCloudSender

14

AWS Services

VPC

EC2

EBS

RDS

CloudSender Status

Compute

EmailDatabase

Storage✓

✓ CloudSender15

CloudSender - Scalable

Elastic Load Balancing

clientRDS

Auto Scaling Group

Availability Zone

CloudSender N

CloudSender N+1

16

AWS Services

VPC

EC2

EBS

RDS

ELB

17

CloudSender – Scalable (broken)

Elastic Load Balancing

clientRDS

Auto Scaling Group

Availability Zone

CloudSender N

CloudSender N+1

18

AWS Services

VPC

EC2

EBS

RDS

ELB

CloudSender - Scalable (fixed!)

Elastic Load Balancing

clientRDS

Auto Scaling Group

Availability Zone

CloudSender N

CloudSender N+1

Sticky!

19

AWS Services

VPC

EC2

EBS

RDS

ELB

CloudSender Status

Compute

EmailDatabase

Storage✓

✓✓

✓✓✓

CloudSender20

CloudSender - Scalable (broken again!)

Elastic Load Balancing

clientRDS

Auto Scaling Group

Availability Zone

CloudSender N

CloudSender N+1

21

AWS Services

VPC

EC2

EBS

RDS

ELB

Storage Options

S3 Simple Storage Service - Web / REST / SDK

EBS Elastic Block Store - iSCSI

DIY Do It Yourself?

22

CloudSender - My Head Begins to Hurt

CloudSender NElastic Load Balancing

client

RDS

Auto Scaling Group

Auto Scaling Group

Elastic Load Balancing

NFS

NFS

Availability Zone23

AWS Services

VPC

EC2

EBS

RDS

ELB

24

Storage Options - A New Hope

S3 Simple Storage Service - Web / REST / SDK

EBS Elastic Block Store - iSCSI

EFS Elastic File System - NFSv4

25

EFS Preview

26

It’s not what you know, it’s who you know!

27

Virtual Road Trip

28

29

You wake up in a dark room

# Run cron: [daily]

02 0 * * * curl --silent "http://filesender...daily" > /dev/null 2>&1

@reboot curl --silent "http://filesender...daily" > /dev/null 2>&1

# Run cron: [hourly]

01 * * * * curl --silent "http://filesender...hourly" > /dev/null 2>&1

@reboot curl --silent "http://filesender...hourly" > /dev/null 2>&1

# Run cron: [frequent]

*/5 * * * * curl --silent "http://filesender...frequent" > /dev/null 2>&1

@reboot curl --silent "http://filesender...frequent" > /dev/null 2>&1

30

CloudSender - Back from the dead

CloudSender N

Elastic Load Balancing

client

RDS

CloudSender N+1

Auto Scaling GroupEFS

Availability Zone31

AWS Services

VPC

EC2

EBS

RDS

ELB

EFS

CloudSender Status

Compute

EmailDatabase

Storage✓ ✓

✓ CloudSender32

CloudSender - Almost there

CloudSender N

Elastic Load Balancing

client

RDS

CloudSender N+1

Auto Scaling GroupEFS

SES

AWS Services

VPC

EC2

EBS

RDS

ELB

EFS

SES

Availability Zone33

CloudSender - Fully functional PoC

CloudSender N

Elastic Load Balancing

client

RDS

CloudSender N+1

Auto Scaling GroupEFS

Mail Server

Availability Zone34

AWS Services

VPC

EC2

EBS

RDS

ELB

EFS

CloudSender Status

Compute

EmailDatabase

Storage✓ ✓

✓ ✓CloudSender35

Success! (no really!)

36

Benefits

37

Expansion

38

Scale Up/Down

39

Things to consider

40

Not all things are equal

41

People & Knowledge

42

SysAdmin Architect Developer Cloud-Expert

Things fail, in new and unexpected ways!

43

Turn off the lights when you leave!

44

Mine’s a pint!

45

Thank [email protected]

46