chinanetcoud - cloud architecture - qcon oct 2014
DESCRIPTION
ChinaNetCloud presentation about Cloud Architecture, on what developers should think about when building cloud-based Internet apps, games, and more. Video of Steve giving the presentation is on Youtube at: https://www.youtube.com/watch?v=nsUy3B40JB4&feature=youtu.be Given at Qcon's Developer Conference in Shanghai, China in October, 2014 by Steve Mushero.TRANSCRIPT
OaaS – Operations as a Service www.ChinaNetCloud.comCopyright © 2014 ChinaNetCloudBuild & Manage Servers Optimize & Manage Servers Managed Cloud Servers
Running the World’s Internet Servers
Cloud SystemsArchitecture & Issues
By Steve MusheroOctober, 2014
International Software
Development ConferenceShanghai 2014
OaaS – Operations as a Service www.ChinaNetCloud.com
Hi – I’m Steve
OaaS – Operations as a Service www.ChinaNetCloud.com
Welcome to the cloud !
OaaS – Operations as a Service www.ChinaNetCloud.com
This is great, I think
OaaS – Operations as a Service www.ChinaNetCloud.com
This is great, I think
OaaS – Operations as a Service www.ChinaNetCloud.com
My goal is to tell you what I think
OaaS – Operations as a Service www.ChinaNetCloud.com
Clouds are great
OaaS – Operations as a Service www.ChinaNetCloud.com
Clouds are great – but can get you in trouble
OaaS – Operations as a Service www.ChinaNetCloud.com
Clouds are actually more difficult/complex than you think
OaaS – Operations as a Service www.ChinaNetCloud.com
So let’s get started talking about clouds
OaaS – Operations as a Service www.ChinaNetCloud.com
What is the cloud ?
OaaS – Operations as a Service www.ChinaNetCloud.com
We are talking about IaaS / Infrastructure
OaaS – Operations as a Service www.ChinaNetCloud.com
This is about how you Design, Build & Deploy on IaaS
OaaS – Operations as a Service www.ChinaNetCloud.com
Why the cloud ?
OaaS – Operations as a Service www.ChinaNetCloud.com
Cheap !
OaaS – Operations as a Service www.ChinaNetCloud.com
No up-front capital – Pay as you go
OaaS – Operations as a Service www.ChinaNetCloud.com
Easy to start – Click and compute !
OaaS – Operations as a Service www.ChinaNetCloud.com
All true, but . . .
OaaS – Operations as a Service www.ChinaNetCloud.com
Not that important
OaaS – Operations as a Service www.ChinaNetCloud.com
It’s important to accountants – that’s not us
OaaS – Operations as a Service www.ChinaNetCloud.com
So what is important – to US ?
OaaS – Operations as a Service www.ChinaNetCloud.com
#1 – Flexibility – Do what we want, when we want, how we want
OaaS – Operations as a Service www.ChinaNetCloud.com
#2 - Dynamic – Handle changing needs over time
OaaS – Operations as a Service www.ChinaNetCloud.com
#3 - Service-Oriented Thinking
OaaS – Operations as a Service www.ChinaNetCloud.com
#4 - That Scales – Small, big, bigger, huge . . .
OaaS – Operations as a Service www.ChinaNetCloud.com
Scales, but not in the way you think
OaaS – Operations as a Service www.ChinaNetCloud.com
Sometimes each service is the same
OaaS – Operations as a Service www.ChinaNetCloud.com
Sometimes they are not the same
OaaS – Operations as a Service www.ChinaNetCloud.com
Cloud Design – Think Layers
OaaS – Operations as a Service www.ChinaNetCloud.com
A key opportunity is Service Architectures – Separate functions
OaaS – Operations as a Service www.ChinaNetCloud.com
But don’t separate too much – No tiny VMs per function
OaaS – Operations as a Service www.ChinaNetCloud.com
Cloud Design – Think Services
OaaS – Operations as a Service www.ChinaNetCloud.com
Cloud Design – Think Scale – HORIZONTAL
OaaS – Operations as a Service www.ChinaNetCloud.com
Cloud Design – Think Scale – Many Small vs. Few Big
OaaS – Operations as a Service www.ChinaNetCloud.com
Clouds have limits, too
OaaS – Operations as a Service www.ChinaNetCloud.com
Common Cloud Layers
OaaS – Operations as a Service www.ChinaNetCloud.com
Load Balancer
OaaS – Operations as a Service www.ChinaNetCloud.com
Load Balancer
OaaS – Operations as a Service www.ChinaNetCloud.com
Load Balancer
OaaS – Operations as a Service www.ChinaNetCloud.com
Load Balancers
AWS ELB
OaaS – Operations as a Service www.ChinaNetCloud.com
Load Balancers – SSL, TCP, Monitoring, Features
OaaS – Operations as a Service www.ChinaNetCloud.com
Web Layer
OaaS – Operations as a Service www.ChinaNetCloud.com
Web – Statics & Proxy for App
OaaS – Operations as a Service www.ChinaNetCloud.com
Web – Statics & Sharing or S3 ?
OR
OaaS – Operations as a Service www.ChinaNetCloud.com
Application / Code Layer
OaaS – Operations as a Service www.ChinaNetCloud.com
Application / Code Layer – Memory vs. CPU
OaaS – Operations as a Service www.ChinaNetCloud.com
Application / Code Layer – Memory vs. CPU
Out of RAM - Swap
Out of CPU- Thrash
OaaS – Operations as a Service www.ChinaNetCloud.com
Database Layer
OaaS – Operations as a Service www.ChinaNetCloud.com
Database Layer – Never enough I/O – RAM is helpful
OaaS – Operations as a Service www.ChinaNetCloud.com
Database Layer – PIOPS & SSD help
OaaS – Operations as a Service www.ChinaNetCloud.com
Database Layer – PIOPS & SSD – More IOPS !
OaaS – Operations as a Service www.ChinaNetCloud.com
Database Layer – RDS (Relational DB Service)
OaaS – Operations as a Service www.ChinaNetCloud.com
Database Layer – RDS – Limitations
OaaS – Operations as a Service www.ChinaNetCloud.com
More cloud layers – Cache
OaaS – Operations as a Service www.ChinaNetCloud.com
More cloud layers – Search
OaaS – Operations as a Service www.ChinaNetCloud.com
More cloud layers – Search – I/O Again (& RAM)
OaaS – Operations as a Service www.ChinaNetCloud.com
Unusual Cloud Layers - Queue
OaaS – Operations as a Service www.ChinaNetCloud.com
Unusual Cloud Layers - Unusual
OaaS – Operations as a Service www.ChinaNetCloud.com
Special Clouds Issues/Worries
OaaS – Operations as a Service www.ChinaNetCloud.com
Dependencies
OaaS – Operations as a Service www.ChinaNetCloud.com
Everything runs at speed of slowest service
OaaS – Operations as a Service www.ChinaNetCloud.com
Where are the dependencies ?
OaaS – Operations as a Service www.ChinaNetCloud.com
Big fragile machine
OaaS – Operations as a Service www.ChinaNetCloud.com
Resource Limits – Hitting the wall
OaaS – Operations as a Service www.ChinaNetCloud.com
Dynamic Cost – More than you think . . .
OaaS – Operations as a Service www.ChinaNetCloud.com
Deploying on the Cloud – Often & Easily
OaaS – Operations as a Service www.ChinaNetCloud.com
Deploying on the Cloud – DevOps & Push Systems are your friend
OaaS – Operations as a Service www.ChinaNetCloud.com
Mix of Deployment Levels
OS & Config
Services & Config
Code & Config
OaaS – Operations as a Service www.ChinaNetCloud.com
Deploying on the Cloud – Think Clones
OaaS – Operations as a Service www.ChinaNetCloud.com
But careful of Cloud interaction & orchestration
OaaS – Operations as a Service www.ChinaNetCloud.com
Things don’t always go well – Coordinate & Signal
OaaS – Operations as a Service www.ChinaNetCloud.com
OaaS – Operations as a Service www.ChinaNetCloud.com
Change / improve quickly
OaaS – Operations as a Service www.ChinaNetCloud.com
And be flexible
OaaS – Operations as a Service www.ChinaNetCloud.com
That’s the Cloud – Good Luck !
OaaS – Operations as a Service www.ChinaNetCloud.com 76
Pioneers in OaaS – Operations as a Service
Thanks from ChinaNetCloud
OaaS – Operations as a Service www.ChinaNetCloud.com
ChinaNetCloud
www.ChinaNetCloud.com
Beijing Office:
Lee World Business Building #305
57 Happiness Village Road, Chaoyang District
Beijing, 100027 China
Silicon Valley Office:
California Avenue
Palo Alto, 94123 USA
Shanghai Headquarters:
X2 Space 1-601, 1238 Xietu Lu
Shanghai, 200032 China
T: +86-21-6422-1946 F: +86-21-6422-4911