it camp 2015 how to scale above clouds limits, radu vunvulea
TRANSCRIPT
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
How to scale above clouds limits
Radu Vunvulea
Technical Lead, iQuest Group
@RaduVunvulea
vunvulearadu.blogspot.com
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
WHY SCALING IS IMPORTANT
8000m – Cirrus
6000m – Cumulonimbus
4000m – Altostratus
2000m - Nimbostratus
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Understand that scaling and failover
is not only cloud provider’s responsibilities,
is also our yours
Goal
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
RADU VUNVULEA MCTS MCP BANK HOME AUTOMATION
MVP IoT
AUTOMOTIVE PHARMA
LEAN AND AGILE E-COMMERCE
WEB&SPA iQuest
AZURE JAVASCRIPT VUNVULEARADU.BLOGSPOT.COM
MOBILE DOTNET @RaduVunvulea
WCF WPF ENTHUSIASTIC
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Many thanks to our sponsors & partners!
GOLD
SILVER
PARTNERS
PLATINUM
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• Identify limitations
• Investigate different problems
• Overview on different solutions
Agenda
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Hardware
Capabilities
Functionality
App Design
Types of limitations
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Hardware
Capabilities
Functionality
App Design
Types of limitations
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Hardware
Capabilities
Functionality
App Design
Types of limitations
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Hardware
Capabilities
Functionality
App Design
Types of limitations
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Hardware
Capabilities
Functionality
App Design
Types of limitations
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage bandwidth
Target throughput for single blob
• 60MB/s
• 500 requests/s
Per storage account
• 30Gb/s
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage bandwidth
Target throughput for single blob
• 60MB/s
Can we still have 10MB/s for
each client?
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage bandwidth
Target throughput for single blob
• 60MB/s
Can we still have 10MB/s for
each client? NO
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage bandwidth
Solutions
• CDNs
• Content replication
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage bandwidth
Solutions
• CDNs
• Content replication
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage capacity
Storage account capacity
• 500TB
Storage accounts
• 100 per subscription
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage capacity
Storage account capacity
• 500TB
What happens in 1 year if we produce
2TB of data per day?
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage capacity
Storage account capacity
• 500TB
What happens in 1 year if we produce
2TB of data per day? Out of space
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Storage capacity
Solution:
• Work with multiple storage
accounts
To be able to do this our application
needs to be able to store a list of
storage accounts, not only one
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• CSDEF
• SQL Database
• Azure Table
• Azure Storage
Configuration
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• CSDEF
• SQL Database
• Azure Table
• Azure Storage
–Blobs
–XML Format
Configuration
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
HOW LONG WE CAN SCALE?
Adding more and more instances and resources is a good solution.
Can we quarantee the quality of our service when we are adding more and more
resources?
How much we can stretch in this way?
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Adding more instances
• Soon this will break, why?
–The quality of service will not remain the same by adding
more and more resources
–Managing a large infrastructure will
be a nightmare
–Our confidence will be lower and
lower
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Adding more instances
• Soon this will break, why?
–The quality of service will not remain the same by adding
more and more resources
–Managing a large infrastructure will
be a nightmare
–Our confidence will be lower and
lower
• In the end the system will BREAK
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Scaling Unit
• Grouping resources together and defining the
quality attributes of that scaling unit
• When the limits are hit
another scaling unit is
added, without adding
more resources to the
current one(s)
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
FAILOVER MECHANISM
What should we do when we need better SLA?
Or a failover mechanism…
… to be able to be up and running even during and after a major disaster…
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• One or more services from
current region are going
down
• What should we do?
Failover mechanism
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• Adding resources in another region
Failover mechanism
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• Adding resources in another region
–Before
–During
–After
a disaster
Failover mechanism
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• Adding resources in another region
–Before, is great. But with extra costs
–During, we can lose a part of data
–After, is to late. We are not the only one in this situation
a disaster
Failover mechanism
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Active - Passive
• Active is upOnly storage is allocated
on the passive
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Active - Active
• Active is up75% of computation power is
allocated on passive
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Active-Active
• Minimum downtime
• Resource reservation
• You pay for resources that you don’t use
• Data sync can be a nightmare
Active-Passive
• A few seconds (minutes) downtime
• No resources reservation
• No extra costs (except storage)
• Data sync can be a nightmare
Active – Active & Active - Passive
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
WHAT ABOUT COMMUNICATION
It is not enough to have a failover mechanism for storage and computing
If there is no communication channel between the components then by they are used…
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
Communication Channel
• Active-Active
• Active-Passive
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
• We should scale our system in different ways, not
only by adding more instances
• Scaling Unit is a good way for scaling
• Active-Active can be useful but is expensive and can
be a nightmare
Conclusion
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
THANK YOU
@Radu Vunvulea
www.vunvulearadu.blogspot.com
@ITCAMPRO #ITCAMP15Community Conference for IT Professionals
TAKE A LOOK ON SCALING UNIT CONCEPT
Next steps