rightscale user conference / fall / 2010 - morning sessions
TRANSCRIPT
2
RightScale Community Programs
• User Conferences
• Online Forums
• Community Publishing
• Local User Groups
• RightScale Ambassadors
4
RightScale User Groups
• Network and share best practices
with other RightScale Users
• Local Meetings
• Support from RightScale
• First User Groups
• Tokyo, Japan
• Northern CA
• Southern CA
• To find out more or
start your own:
www. rightscale.com/usergroups
5
RightScale Ambassador Program
Empower RightScale and cloud
enthusiasts to share with their
communities
• Pre-release Webinars
• RightScale and Industry Information
• Access to Executives and
Subject Matter Experts
• Speaking Opportunities
• SWAG!!
For more info or to apply to go:
www.RightScale.com/ambassador
7
―With RightScale, we can launch collaborations globally in
the same day we discuss them. It‘s not a multi-month
process.‖ — Academic Research Institute
―RightScale reduced our time to market by three months.‖—Digital Distribution Network
"Once we chose RightScale, it took us only four months from
development to launch of our new service. — Independent Software Vendor
8
―We expanded into an entirely new line of business that
required massive grid capacity for a limited time. Without
RightScale, we would never have considered it.‖ — Major Insurance Company
―By automating our cloud computing deployments with
RightScale, we increased the time we devote to
translational science projects.‖ — Medical Research Institute
―We‘ve implemented a self-service approach to
infrastructure.‖ — Major Pharmaceutical Company
14
2009 – First User Meetup
“In an industry melting down under the weight of vendor
hype, RightScale Inc. let its customers do the talking on the benefits
and challenges of cloud computing at a user group meeting this
week.”
Jo Maitland, Executive Editor, SearchCloudComputing.com
15
• James J. Ahn – American Girl, a division of Mattel, Inc.
• Seth Gerson – AltEgo
• David Lowe – Electronic Arts Interactive (EAi)
• Todd Martin – The Associated Press
• Dave Tucker – WebFilings
Sponsors
2010
17
2010 – Staff of 120
• 10 states, 6 countries, 14 languages
• Locations in US west & east coast, UK, Singapore
20
2009 – Server Types
Small
Large
X-Large
Medium
X-Large
2X-4X Large
• March 2009 – average cost $0.174/hr.
22
2010 – Server Types
• June 2010 – average cost $0.474/hr. (+272%)
Small
Large
X-Large
Medium
X-Large
2X-4X Large
26
Continuing Usage Growth
O-09 N-09 D-09 J-10 F-10 M-10 A-10 M-10 J-10 J-10 A-10 S-10 O-10
• Launching more & bigger servers
• Running them longer
27
Crossing the Chasm
Early Adopters
• Buying a change agent
• Get a jump on competition
• Patient with glitches
Early Majority
• Driven by practicality
• Productivity improvements
• Won‟t tolerate bugs
31
Cloud Computing Survey
15%
14%
9%
10%
13%
8%
5%
7%
16%
CEO / COO
CTO / CIO
VP
Director
Manager
System Administrator
Consultant / Systems Integrator
Developer / QA
Architect / Strategist
32
Initial Driver for Cloud
30%
32%
19%
12%
8%
CEO / COO
CIO / Sr IT Executives
Development Team
IT Operations Team
Line of Business Team
33
5%
16%
20%
15%
33%
56%
3%
5%
9%
29%
44%
80%
No plans
Research cloud computing
Implement a proof of concept
Launch a production application
Continue to run one or more production apps
Have budget for cloud computing
Cloud Computing Adoption
34
85%
82%
82%
69%
69%
56%
45%
41%
82%
62%
65%
64%
57%
58%
44%
43%
40%
68%
51%
Improve IT agility
Reduce infrastructure cost
Improve business agility
Automate IT infrastructure
Improve DR and BC
Reduce staff cost
Implement IT self-service for line of business users
Gain visibility into resource use and costs for chargeback
Improve scalability with on demand IT resources
Improve infrastructure utilization
Improve computing resource security
Rise of the Hybrid Cloud
35
85%
82%
82%
69%
69%
56%
45%
41%
82%
62%
65%
64%
57%
58%
44%
43%
40%
68%
51%
Improve IT agility
Reduce infrastructure cost
Improve business agility
Automate IT infrastructure
Improve DR and BC
Reduce staff cost
Implement IT self-service for line of business users
Gain visibility into resource use and costs for chargeback
Improve scalability with on demand IT resources
Improve infrastructure utilization
Improve computing resource security
Rise of the Hybrid Cloud
36
85%
82%
82%
69%
69%
56%
45%
41%
82%
62%
65%
64%
57%
58%
44%
43%
40%
68%
51%
Improve IT agility
Reduce infrastructure cost
Improve business agility
Automate IT infrastructure
Improve DR and BC
Reduce staff cost
Implement IT self-service for line of business users
Gain visibility into resource use and costs for chargeback
Improve scalability with on demand IT resources
Improve infrastructure utilization
Improve computing resource security
Rise of the Hybrid Cloud
37
85%
82%
82%
69%
69%
56%
45%
41%
82%
62%
65%
64%
57%
58%
44%
43%
40%
68%
51%
Improve IT agility
Reduce infrastructure cost
Improve business agility
Automate IT infrastructure
Improve DR and BC
Reduce staff cost
Implement IT self-service for line of business users
Gain visibility into resource use and costs for chargeback
Improve scalability with on demand IT resources
Improve infrastructure utilization
Improve computing resource security
Rise of the Hybrid Cloud
42
Together with customers & partners
We are building a platform that:
Manages new on-demand infrastructures
43
Together with customers & partners
We are building a platform that:
Manages new on-demand infrastructures
In both publicly hosted and internal datacenters
44
Together with customers & partners
We are building a platform that:
Manages new on-demand infrastructures
In both publicly hosted and internal datacenters
Drives new levels of automation and portability
45
Together with customers & partners
We are building a platform that:
Manages new on-demand infrastructures
In both publicly hosted and internal datacenters
Drives new levels of automation and portability
Enables complete control & authoring freedom
46
Together with customers & partners
We are building a platform that:
Manages new on-demand infrastructures
In both publicly hosted and internal datacenters
Drives new levels of automation and portability
Enables complete control & authoring freedom
Supports 95% of operating systems and 95% of server-side
programming environments
47
Together with customers & partners
We are building a platform that:
Manages new on-demand infrastructures
In both publicly hosted and internal datacenters
Drives new levels of automation and portability
Enables complete control & authoring freedom
Supports 95% of operating systems and 95% of server-side
programming environments
Offers a community library of cloud-ready solutions
48
Together with customers & partners
We are building a platform that:
Manages new on-demand infrastructures
In both publicly hosted and internal datacenters
Drives new levels of automation and portability
Enables complete control & authoring freedom
Supports 95% of operating systems and 95% of server-side
programming environments
Offers a community library of cloud-ready solutions
All from a single pane of glass
49
Features to Support
Agile Development and
OperationsRafael Saavedra, VP Engineering
Darryl Eaton, Dir Product
Josep Blanquer, Sr Architect
50
Managing servers at scale
• New Cluster Monitoring
• New Bulk UI operations
• API usage
• New Overview Widgets
52
Coming soon: stacked graphs
• Each color band shows contribution of one server
• Servers are stacked on top of one another
53
Coming soon: heat maps
• Each horizontal strip shows one server
• The color shows how “hot” the server is running
56
Cluster monitoring
• Individual graphs
• Good for a dozen servers
• Displays all standard graphs with full detail
• Stacked graphs
• Displays the contribution of many servers to a total
• Great to see the sum and variability of activity in a cluster
• Difficult to make out individual servers
• Examples: requests/sec, cpu busy cycles, I/O bytes/sec
• Heat maps
• Displays a bar for each server
• Great to see uneven distribution across servers
• Great to quickly spot performance problems across many servers
• Difficult to read absolute values or see the total cluster activity
57
Cluster monitoring architecture
• Architecture
• Monitoring front-end servers
pull data from storage servers
• Up to 100 servers on one graph
(to be increased)
• Current status:
• Individual graphs available today
• Stacked graphs & heat maps in private beta
EC2 us-east, rackspace, private clouds only
your servers
monitoring
storage
servers
monitoring
front-end
servers
58
Bulk UI operations
• Operating on many objects in a web UI is difficult
• New bulk selection available on a number of pages
• Applies action to a few objects immediately, rest is async
• Use tags to mark collections of servers and operate on them!
59
RightScale API status
Goals: 1. One API to manage resources across multiple clouds
2. Extend the RightScale platform through custom scripts or apps
API 1.0 Status
API requests/sec UI requests/sec
Typical uses: backups, run RightScripts, retrieve state/config, …
60
Towards API 1.5 / 2.0
• API 1.0 limitations
• Designed when only EC2 existed, difficult to extend to multiple clouds
• Data model no longer matches the platform internals
• Code suffers from many backwards-compatibility patches
• API 1.5
• Supports RackSpace, and Cloud.com or Eucalyptus private clouds• Does NOT support EC2
• Improved design, incl. self-discovery of resources
• Beta release real soon
• API 2.0
• Expect largely the same API structure as 1.5
• Inclusion of EC2
62
Custom widget example• Widgets use the „Liquid‟ templating language
• Data is drawn from a variety of pre-defined data collections:
•Servers, instances, volumes, snapshots, …
• Private alpha
soon…
63
Roadmap
• More tools to manage collections of
servers (and other resources) coming
• Increased use of tags to
group, identify, operate on collections of
resources
• Increase sysadmin efficiency
65
Why share or publish ServerTemplates?
Organizations ISV Partners Community Developers
• Share encapsulated best
practices
• Standardize internal
developer environments
• Maintain flexibility
Share to internal accounts
to distribute common
components within your
organization.
• Cloud-enable your
software product
• Gain valuable usage data
• Maintain portability
• Increase exposure
Publish community editions
to everyone, share full
editions to contracted
customers.
• Drive awareness
• Develop for many
clouds at once
• Incorporate best
practices from others
Contribute common
templates and
components to everyone.
66
Where do ServerTemplates go?
• The RightScale Library holds
published
ServerTemplates, RightScripts,
MultiCloud Images, and Macros
• Publishing – free sharing for the
community / for-pay access-
controlled sharing for ISVs
• Sharing – multiple groups within
organization, with partners, etc.
• Metering – allows publisher to
receive usage info that can be used
for billing (instance hours, total
instances, custom metrics, etc.)
67
• Global architecture
• Will enable local RightScale clusters
in various global regions
• Any account in any region can publish
to all accounts in all regions
• Access control
• Sophisticated access control
Not just “open source publishing”
• Tracks permissions through sub-components
e.g. publishing a ServerTemplate includes
RightScripts, cookbooks, attachments, etc.
• Mediates access to external resources
for example servers downloading attachments or cookbooks
Library - Behind the scenes
Library
RightScale
Shard 1
EC2-US-EAST
RightScale
Shard 2
EC2-US-WEST
EC2-AP-SoutEast
RightScale
Shard 3
68
Library - Tracking usage
• Aggregating usage stats across all users
• For free ServerTemplates publisher sees anonymous aggregate usage
• For pay ServerTemplates publisher can track exact customer usage for
billing purposes
• Tracking usage of clones
• Users can clone imported ServerTemplates to modify them• Important to allow customization, mixing private best practices with public best practices
• Tracking extends across such clones when shared internally• This is not a DRM system, relies on traditional legal contracts
69
Coming Soon: Your Imports & Updates
• See all the updates available for your library components
• Review the affected Servers and Server Arrays
• Diff your revision with the new one from the library
• Try doing that with a virtual machine image!
71
Most Popular: nginx+Apache
• Most Imported
Submission (even
though for paid
only)
• Gain notoriety by
showing your
expertise
• Build a consulting
business off
shared best
practices
Winner for Most Popular!
72
More Winners!
Winner for most Useful! Winner for Most Innovative!
Set up a standalone OpenLDAP
server or a Provider-Consumer
pair… with backups!
“Create your own CDN” by
deploying these globally with
load balancing.
74
Multi-cloud today
• Multiple clouds for different purposes
• Redundancy and disaster recovery
• Geo-location
• Different stages, from dev to production
• Different application characteristics
• Support varying levels of security concerns
• Different cost structures and existing investments
• Varying levels of multi-cloud deployments
• Crawl, walk then run.
• Cloud portability (current focus)
• Buiding blocks model. Reuse assets, simplify management…
• Scaling and distributing across clouds (near future)
• Most complex and technically challenging form of using multiple clouds
• Requires significant custom work
Public cloud A
Public cloud B
Private cloud
75
Multi-cloud pains: each cloud is different
• Other clouds are differentiating from AWS
• APIs differ, sometimes significantly
• Different resources, formats, versions
• Abstractions differ
• Network architectures differ: VLANs, security groups, NAT, ACLs, …
• Storage architectures differ: local/attachable disks, backup, snapshots, …
• Hypervisors and machine images differ
• Supported features differ
• Spot pricing, RDS, Attachable IPs or disks, etc..
• Not just by cloud type, but by cloud instantiation or version
• And more…cost models, billing, reporting…etc
• Significant barriers to integrating a new cloud
76
RightScale multi-cloud approach
• Cross-cloud abstractions, unified view
• Unified UI and API for automation
• Servers/Arrays: runtime
• Same look and feel regardless of cloud
• ServerTemplates: configuration
• Server configurations that work across OS‟s and clouds
• Convert base images to fully configured servers
• RightImages / Multi-cloud images: starting point
• Define and map compatible base OS installs across clouds
• Ever growing library of RightScript / Chef cookbook
• Design using abstractions, deploy using cloud specifics
• Expose and support the capabilities of each cloud and NOT a lowest
common denominator approach