nov 8 2012: cloud expo sf "elastic cloud infrastructure: why the enterprise wants it"
DESCRIPTION
A talk detailing how and why elastic cloud infrastructure emerged in the marketplace. NOTE: For current Cloudscaling messaging and presentations, please refer to http://www.slideshare.net/randybias and www.cloudscaling.comTRANSCRIPT
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Why Enterprises Need Two (or more) Cloudspresented toCloud Expo, San FranciscoNovember 8, 2012
Troy AngrignonVP, BD & [email protected]@troyangrignon
1
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Market DriversTwo Cloud Theory
EIC Design principlesReal-world scenarios
2
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Market Drivers
3
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
2B+ people online but...
4http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
2B+ people online but...
5http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
2B+ people online but...
6http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
App usage is swamping web usage
7http://www.businessinsider.com/state-of-internet-slides-2012-10?op=1
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Macro Market Trends
8
The application portfolio is expanding.
Mobile matters.
Application teams are embracing the agility benefits of public cloud.
Time to market pressures are accelerating.
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Applications are changing. And so are the approaches we use to create them
9
Applications Development Approaches
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
The way we build code is changing...fast
10
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
App Developers are Flocking to AWS
11
• Tremendous growth for market leader• 1 trillion objects in S3
• ~$1.5B business run rate for Amazon
• ~ 450,000 servers in seven data center hubs around the globe
• 100s of servers per admin ratio
• 20 price reductions in 5 years
• Fast scale and prominent companies running production workloads on AWS
• Zynga, Pinterest and Dropbox are a few
• AWS allow app developers to self serve and assume control • DevOps centric
• Auto-scaling
• Manage data replication
• Ensure server & data redundancy
• Geo-distribution
IT infrastructure teams are under increasing pressure to compete with highly elastic, on-demand, self-service public cloud offerings.
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
A wave of new apps requiring new infra
12
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Two Clouds
13
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
This has led to a bifurcation in infra & apps
14
Enterprise Virtualization Cloud
Elastic Infrastructure Clouds
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
These are entirely different classes of apps
15
Loca
tion
of c
ompl
exity
Infra
App
Up OutPrimary scaling dimension
Cloud Apps
Existing Apps
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
These apps require different architectures
16
Loca
tion
of c
ompl
exity
Infra
App
Up OutPrimary scaling dimension
Elastic Infrastructure
Cloud
“Enterprise” Cloud
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Two Clouds for Two Needs
17
Uptime in InfrastructureData mgmt in Infra
InfraOps centricIT Ticket Requests
Default to H/W redundancyCustom H/W Arch
Scale Up
Elastic Infrastructure
Cloud
EnterpriseVirtualization
Cloud
Uptime in AppsData mgmt in Apps
DevOps centricApp Developer Self ServeMinimal H/W redundancy
Template H/W ArchScale Out
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
The network design is different
18
Cloud
Enterprise
Enterprise Virtualization Cloud
Elastic Infrastructure Cloud
EC2
VPC
Cloud Apps
Traditional Apps
VLAN
netw
orki
ng m
odel
cloud type
FLAT
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
And so we end up with this:
19
Traditional apps Cloud Apps
APPS
INFRA
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Elastic Infrastructure Cloud Design Principles
20
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
EICs have Open APIs and protocols
21
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
EICs use commodity / ODM hardware
22
ODMs operate their businesses on 3-10%
margins.
AMZN, GOOG, and Facebook buy direct
without a middleman.
Only a few enterprise vendors are pivoting to
compete.
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
EICs use open source software
23
Open Cloud System 2.0
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
EICs force software to be responsible for uptime, not the hardware
24
Hardware fails.Software fails.
People fail.
Only software can measure itself &
respond to failure in near real-time.
Applications designed for 99.999% uptime can run anywhere
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
EICs are inherently scale-out in nature
25
A B
A B
A B C D N
Scale-up - Make boxes bigger (usually an HA pair)
Scale-out - Make more boxes
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
EICs help you stop hugging servers and start shooting them instead
26attrib: Bill Baker, Distinguished Engineer, Microsoft* added by yours truly ...
VMs are your pets
You name them and when they get
sick, you nurse them back to
health
garfield.company.com
Servers are cattle
You number them and when they get
sick, you shoot them
web001.company.com*thanks to Bill Baker, Distinguished Engineer, Microsoft for this
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
EICs use open networking approaches, and are moving to commodity networking eqpt
27
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Summary of EVC vs. EIC
28
Enterprise Virtualization Cloud Elastic Infrastructure Cloud
Applications Traditional & Legacy Dynamic
Scaling Architecture Up Out
Technology Stack Heavy & Proprietary Distributed & Open
Price/Performance 4x-8x 1x
Failure Domains Large Small
Provisioning Slower & Manual Faster & 100% API
Best For: Server consolidation and lower datacenter mgmt costs
On-demand, scale-out infrastructure for new apps
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Real-world scenarios
29
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Your app portfolio is spreading out...
30
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Building a public or private EIC
31
OpenCloud
System2.0
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Building a hybrid Elastic Infra Cloud?
32
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
App Architecture: Split-tier
33
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaSWeb-Tier
DB Tier
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Hybrid app portfolio (Gaming-model)
34
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaSUNKnown
Known
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Building new legacy-style apps?
35
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Building new dynamic cloud apps?
36
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Full dev/test/production lifecycle in the cloud
37
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Develop out, production in
38
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaSDevelopment
Production
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Or the reverse.
39
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Development
Production
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Traditional “large data” + “big data”
40
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
LargeStructured
Data;
Data Warehouse;
BI
BIG Data
Unstructured
Hadoop
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Hybrid Big Data (in/out)?
41
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaSPublic
Big Data
Private Big Data
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Private or Public PaaS
42
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Hybrid PaaS
43
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Traditional Systems Mgmt: Tivoli, etc.
44
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Application Mgmt: Cloudscaling OCS
45
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Application Mgmt: RightScale
46
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Application Mgmt: enStratus
47
Bare Metal Infrastructure
Virtualized Infrastructure
Private Enterprise
Virtualization Cloud
Hosted Bare Metal
Hosted Virtualized
Infrastructure
Public Enterprise
Virtualization Cloud
Public
Private
Public Elastic Infrastructure
Cloud
Private Elastic
Infrastructure Cloud
Traditional inelastic client/server type applications
Dynamic applications
PaaS SaaS
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Homework
48
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
Your Homework
49
•Share this more defined worldview / language to your team•Look at your business and where you create value•Analyze your upcoming app dev and existing apps•Clearly bucket them into EVC / EIC candidates•Build out your EVC and EIC•Create and deploy the apps•Accrue the business value
Why Most Organizations Will Need Two CloudsCloud Expo, November 8, 2012, San Francisco
THANK YOU
50
Troy AngrignonVP, BD & [email protected]@troyangrignon