managing storage - trends, challenges, options in 2013 - 2014

1 © Copyright 2013 EMC Corporation. All rights reserved.

MANAGING INFORMATION STORAGE–TRENDS,CHALLENGES, AND OPTIONS 2013-2014 Includes Impact of Virtualization and Cloud

Industry Study Based on a Survey of 1,000+ IT Managers and Storage Professionals Across 800+ Organizations

Alok Shrivastava Senior Director, EMC Education Services


Agenda • Introduction • Storage Infrastructure Highlights • Impact of Virtualization and Cloud Technologies • Managing Storage Challenges • Considerations for a Storage Management Organization • EMC Response and Initiatives


Introduction: 2013-14 Study

• Comprehensive Study – Global Trends in Storage Infrastructure and Technology Segments, Including

Virtualization and Cloud – Challenges Faced by IT and Storage Managers – Practices Being Used in Building and Developing Storage/IT Groups/Teams

• Value for IT and Storage Managers – Compare, Correlate, and Refine Plans – Overall Industry Trends and Practices

• Study Coverage – IT Managers (25%) and Storage Professionals (75%) From Over 800+

Organizations – Americas, EMEA, and Asia-Pacific – EMC Customers and Customers of Other Storage Vendors – Data Centers of Large Enterprises and Small & Medium Enterprises

• Study Period, January - February 2013

Annual Revenue Distribution

Geographic Distribution

Americas 45%

Europe Middle East Africa

35%

Asia Pacific 20%

Up to $100M 30%

$100M - $500M 17% $500M

- $1B 8%

Over $1B 17%

Not Known 28%


Storage Infrastructure – Increasing Capacities

Distribution of storage capacity across companies

Up to 99TB 48%

100 - 499TB 21%

500 - 999TB 10%

1PB - 10PB 15%

11PB-25PB 3%

Over 25PB 4%

• 7% of Data Centers Have More Than 10 Petabytes (PB) of Usable Storage Capacity to Manage

• 22% of the Data Centers Have over 1 PB of Usable Capacity (Up 10% Y/Y)

• Nearly 52% of the Companies Have 100 TB or More Usable Storage to Manage (Up 8% Y/Y)

• Average Usable Capacity Across the Participating Companies is 2.18 PB (Up 12.8% Y/Y)


2.1% 5.9%

7.4% 9.0% 9.6% 9.7% 9.9%

13.6% 17.9%

19.4% 23.2% 24.4%

31.4% 48.2%

58.4% 66.4%

0% 10% 20% 30% 40% 50% 60% 70%

Object-based Storage* Scale-out NAS

Local Replication Converged Infrastructure*

Flash Drives* Data Mobility*

Storage Technology for Cloud Environment Big Data (infrastructure and/or analytics)*

Remote Replication Network Attached Storage (NAS)

Cloud Computing Storage Virtualization

Automated Storage Tiering* Server Virtualization

Storage Area Networks (SAN) Backup, Recovery, & Archive

Respondents/Organizations * New in 2013-14

Technology Segments - Importance


14.1% 16.8%

19.4% 20.1%

23.3% 25.1%

39.3% 46.2%

48.2% 56.5%

74.9% 78.6%

87.7% 88.3%

100.0%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Object Based Storage Scale Out NAS Data Mobility

Big Data (Infrastructure and/or Analytics) Converged Infrastructure

Storage Technology for Cloud Environment Cloud Computing

Storage Virtualization Automated Storage Tiering

Flash Drives Network Attached Storage (NAS)

Server Virtualization Backup, Recovery & Archive

Storage Area Network (SAN) Local/Remote Replication

Respondents/Organizations

Technologies Segments Deployed


Challenges Faced by IT and Storage Managers Managing Growth and the IT Transformation Rank Challenge Identified by IT/Storage Managers and Professionals

1 Managing Storage Growth

2 Designing, Deploying & Managing Backup, Recovery, & Archive Solutions

3 Making Informed Strategic /Big-picture Decisions

4 Designing, Deploying & Managing Disaster Recovery Solutions

5 Designing, Deploying & Managing Storage in a Virtualized Server Environment

6 Lack of Skilled Storage Professionals

7 Designing, Deploying & Managing Storage in a Cloud Computing Environment

8 Lack of Skilled Cloud Technology Professionals

9 Convincing Higher Management to Adopt Cloud

10 Infrastructure Setup for Big Data Analytics


Year-over-year Comparison

Challenges Faced by IT and Storage Managers

2013-14 2012-13 IT/Storage Managers and Professionals 79% 77% Managing Storage Growth 43% 45% Designing, Deploying and Managing Backup, Recovery, and Archive Solutions 39% 36% Making Informed Strategic/Big-picture Decisions (+8%) 38% 39% Designing, Deploying and Managing Disaster Recovery Solutions 37% 31% Designing, Deploying and Managing Storage in a Virtualized Server Environment (+19%) 29% 27% Lack of Skilled Storage Professionals (+7%) 18% 16% Designing, Deploying and Managing Storage in Cloud Computing Environments (+13%) 15% 15% Lack of skilled Cloud Technology Professionals 11% 10% Convincing Higher Management to Adopt Cloud (+10%) 10% 7% Infrastructure for Big Data Analytics (+43%) 8% 4% Managing External Cloud Service Providers (+100%)


Impact of Virtualization and Cloud


Data/Storage Movement to Virtualized and Cloud Environments

Virtualized Server 43%

Internal Private Cloud 11%

External Cloud 3%

Traditional/Classic 42% 2013

Virtualized Server 49%

Internal Private Cloud 16%

External Cloud 6%

Traditional/Classic 28% 2015

+13.3%

+56.3% +100%

-31.3%


IT Megatrend: The Rate of IT Transformation Data/Storage Migration to Virtualized and Cloud Environments

70%

60%

50%

40%

30%

20%

10%

0%

Per

cen

tag

e of

Sto

rag

e D

eplo

yed

2011 2012 2013 2014 2015 2016 2017 Virtualized Server Environment

External Cloud Environment

Expon. (Virtualized Server Environment)

Expon. (External Cloud Environment)

Internal Private Cloud Environment

Traditional / Classic Environment

Expon. (Internal Private Cloud Environment)

Expon. (Traditional / Classic Cloud Environment)


0

10

20

30

40

50

60

Traditional/ Classic

Virtualized Internal Private Cloud

External Cloud

Less than $100M $100-500M

$500M-$1B More than $1B

0

10

20

30

40

50

60

Traditional/ Classic

Virtualized Internal Private Cloud

External Cloud

Less than $100M $100-500M

$500M-$1B More than $1B

2013 2015

Percent of Storage Deployed by Environment

Data Movement by Size of the Company

% %


5.7%

10.3%

27.0%

16.1%

40.8%

3%

2%

14%

12%

68%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Do not know

In-house skills not ciritical

Will be critical in 12-24 months

In-house skills critical but will use vendors

Critical to have in-house skills

Virtualization Cloud

In-house Architecting and Designing Skills


Managing Storage in Virtualized and Cloud Environments Managers’ View on Current Skills of Storage Professionals

23%

16%

26%

18% 17%

55%

18% 13%

7% 7% 0%

10%

20%

30%

40%

50%

60%

Less than 10% 11% - 25% 26% - 50% 51-75% 76-100%

Man

ager

s/O

rgan

izat

ions

% of Professionals on the Team

--------------------- Weak---------------------------------- ----- Moderate ------ ------ Strong ------

Virtualization

Cloud


Managing Storage in Virtualized and Cloud Environments Managers’ View on Current Skills of Storage Professionals

Strong+ Moderate

35% Weak 65%

Virtualization Skills Strong+ Moderate

14%

Weak 86%

Cloud Skills

No Change Y/Y Up 2% Y/Y


Cross-domain Skills for Cloud Infrastructure Self Representation of Storage Professionals on Their Cross-domain Skills

37% of Individuals Possess Skills in OS+Storage+Networking

50%

37%

30%

25%

17%

0% 10% 20% 30% 40% 50% 60%

OS+Storage

OS+Storage+Networking

OS+Storage+Networking+Virtualization

OS+Storage+Networking+Virtualization+B/R

OS+Storage+Networking+Virtualization+B/R+Security


Cloud and ITaaS Transformation – Management Skills


Data Science and Big Data Analytics-Management Skills


Building an Effective Storage Management Organization


Storage Group - Tasks & Responsibilities Storage Group - Tasks & Responsibilities % Time Spent*

Design and/or Participate in Design of Storage Infrastructure 14.0%

Integration of the Storage Infrastructure, Databases and Applications 13.6%

Storage Provisioning 10.8%

Backup, Recovery and Archiving of Information/Data 10.6%

Managing the Implementation of Storage Infrastructure 10.0%

Trouble- shooting 7.8%

Monitoring of Storage Infrastructure 7.4%**

Evaluating Storage Technologies From Different Vendors 6.8%

Storage Capacity Planning 6.4%**

Storage-related Reporting and Analysis 4.6%

Design, Discussion and Planning of Storage in Cloud Environments 4.3%

Other Storage-related Activities 3.7% * %Time Spent in Last 12 Months on Specific Activities ** Significant Increase in Time Allocation in Last Year


Storage Groups and Technology Segments

1.1% 2.0% 2.0% 2.5% 2.6%

3.3% 3.4% 3.8%

4.5% 7.2% 7.7%

9.5% 19.6%

30.8%

0% 5% 10% 15% 20% 25% 30% 35%

Object based storage Big Data Infrastructure

Data Mobility Converged Infrastructure

Scale out NAS Cloud Computing

Other Storage Technology for Cloud Environment

Local Replication Remote Replication

Storage Virtualization Network Attached Storage (NAS)

Backup, Recovery & Archive Storage Area Networks (SAN)

% of Time Invested in last 12 Months


Skills Mapping by Tasks/Responsibilities Managers’ View on Their Team’s Skills and Capabilities

55% 50% 49% 49%

45% 45%

42% 42%

40% 34%

26% 25%

18% 16%

4%

37% 45%

42% 45%

47% 48%

48% 53%

54% 55%

48% 60%

42% 44%

37%

8% 5%

8% 6% 7% 7%

10% 5% 6%

11% 26%

14% 40% 40%

59%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Server Virtualization Storage Provisioning

Design &/or participate in design of storage infrastructure Manage implementation of storage infrastructure

Troubleshooting Backup, recovery, & archiving of information/data

Evaluate storage technologies from different vendors Integration of the storage infrastructure, databases, & …

Monitoring of storage infrastructure Storage capacity planning

Storage Virtualization Storage related reporting & analysis

Cloud Computing Design storage infrastructure for Cloud environment

Big Data Analytics

Strong Moderate Weak


Skills Mapping by Technologies Managers’ View on Their Team’s Skills and Capabilities

65% 62%

56% 50%

44% 39% 39%

29% 23%

21% 15%

13% 13% 12% 10%

5%

32% 34%

40% 41%

48% 47%

42% 42%

50% 41%

37% 38%

44% 50%

46% 35%

3% 5% 4%

10% 9%

14% 19%

29% 27%

38% 48% 49%

44% 38%

44% 61%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Server Virtualization Storage Area Networks (SAN) Backup, Recovery, & Archive

Network-Attached Storage (NAS) Local Replication

Storage Platforms/ subsystems Remote Replication

Automated Storage Tiering Storage Virtualization

Scale out NAS Object based storage

Data Mobility Storage Technology for Cloud Environment

Converged Infrastructure Cloud Computing

Big Data

Strong Moderate Weak


Building Storage Groups: Finding Storage Expertise

33.8%

34.1%

52.4%

63.1%

81.1%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

Hire Fresh College Graduates

Engage Consultants

Internal Appointment

Hire Certified

Hire Experienced

Preferred Hiring Sources


Challenges Identified by IT/Storage Managers

• Managing Storage Growth • Storage Consolidation • Designing, Deploying, and Managing Backup, Recovery, and Archive • Designing, Deploying, and Managing Disaster Recovery Solutions • Making Informed Strategic/Big-picture Decisions • Designing, Deploying, and Managing Storage in Virtualized Environments • Lack of Skilled Storage Professionals • Designing, Deploying, and Managing Storage in Cloud Environments • Lack of Skilled Cloud Technology Professionals • Convincing Higher Management to Adopt Cloud • Infrastructure for Big Data Analytics • Managing External Cloud Service Providers

And . . . Rapid Shift from Classic to Virtualized and Cloud Environment

• Widening Knowledge Gap Due to Virtualization and Cloud • Plans to hire additional 36.4% storage professionals • Shortage of Storage/Cloud-educated Workforce in the Industry


Education Solutions EMC Education Services


Education Solutions EMC Proven Professional Learning Framework and Certification

– Quality Assurance, Formal Validation and Recognition – ‘Open’ curriculum and certifications – EMC Products and Technology Specific Curriculum and Certifications

EMC Technology-specific Learning Paths – Leverage Extensive Capabilities of EMC Technology and Solutions – Comprehensive Coverage for All Segments of EMC Technology

EMC Academic Alliance – 1,100+ Universities Across 60+ Countries;175,000+ Students Educated – Storage Technology, Cloud Infrastructure, and Data Science Curriculum

‘Open’ – Unique Approach Focused on Technology Concepts, Principles, and Case Studies That Can be Applicable to Any IT Environment


Lead Your Transformation With Education!

Business Transformation for Leaders and Managers – Cloud and IT as a Service | Data Science and Big Data Analytics

Information Storage and Management – Develop Knowledge and Skills Across All Storage Technology Segments in Classic, Virtualized,

and Cloud Environments

Cloud Infrastructure and Services – For All IT Professionals to Develop Knowledge and Skills on Virtualized Data Center and Cloud

to Become Part of Their Organization’s Cloud Transformation

Cloud Architect – Develop Cross-domain Architect and Design Expertise for Highly Virtualized Cloud/ITaaS Environments

Data Center Architect – Develop Storage Domain Architect and Design Expertise for Highly Virtualized Data Centers

Data Science and Big Data Analytics – For All Professionals Who Want to Learn Advanced Analytics, Techniques, and Tools and Develop

Data Science Skills

‘Open’ – Unique Approach Focused on Technology Concepts, Principles, and Case Studies That Can Be Applicable to Any IT Environment


‘Open’ Courses for Any Vendor Environment in Any Industry Cloud and ITaaS Education for the Entire Organization

Audiences Course Offerings

All IT Professionals

Business Leaders

Business Leaders and Managers

Cloud and IT-as-a-Service for Business Transformation 1 day

IT-as-a-Service Planning and Design 5 days

Cloud Infrastructure and Services 5 days

Introducing Cloud and IT-as-a-Service for Business Transformation 90 minute Module

Virtualized Data Center and Cloud Infrastructure Planning and Design 5 days

Architects and

Designers

New

New


EMC Proven Professional Learning and Certification Framework


Download the Whitepaper Now!

Managing Information Storage: Trends, Challenges, and Options 2013-2014 Visit http://education.EMC.com/ManagingStorage

http://education.emc.com/ManagingStorage

managing storage - trends, challenges, options in 2013 - 2014

Technology

storage vendorsup

storage growth43

cloud copyright

storage managersglobal

emc corporation

nas objectbased storage

cloud technologies

cloud practices