restoring data storage predictability · restoring data storage predictability thoughts and...
TRANSCRIPT
![Page 1: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/1.jpg)
1
Restoring Data Storage Predictability
Thoughts and Approaches on Managing Storage Performance and Capacity in 2017
Brent Phillips – Managing Director, Americas Brett Allison – Director of Technical Services
![Page 2: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/2.jpg)
2
Agenda
• The Predictability Challenge
• Storage Background
• Storage Capacity Management
• Storage Performance Management
![Page 3: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/3.jpg)
3
The Predictability Challenge
• What risky conditions exist right now across our entire environment? (rated metrics & exception charts for space, performance, configuration issues)
• Where do go next to see root causes? (intelligent drill downs)
• What related metrics are relevant to the context of this issue? (side-by-side mini-charts of related metrics that are clickable)
• What help is there to create a solutions? (built-in recommendations)
![Page 4: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/4.jpg)
4
Predictability Requires Better Analytics • Lots of disparate data from:
‒ Hosts ‒ SAN Switches ‒ Storage Arrays
• Need to automatically: ‒ Normalize the data ‒ Enrich, additional calculations ‒ Correlate, interrelate ‒ Evaluate, good or bad? ‒ Easily navigate through it
IT Operations Analytics (ITOA)
"The use of mathematical algorithms and other innovations to extract
meaningful information from the sea of raw data collected
by management and monitoring technologies.”
Forrestor Research
![Page 5: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/5.jpg)
5
Predictability Requires Better Analytics
• “..and other innovations…” ‒ Most useful ITOA innovation for storage is applying a
storage-specific type of artificial intelligence (AI).
• “Artificial intelligence is the science of making machines do things that would require intelligence if done by men” - Marvin Minsky 1968
• What could be done that there is no time to do?
• This is an example of why Applied AI is the #1 strategic technology trend according to Gartner
![Page 6: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/6.jpg)
6
• Spend time on proactive storage management ‒ Not reactive fire fighting ‒ Not on maintaining the analytics infrastructure
• Allows for quick, easy Proof of Concept (POC)
Predictability through ITOA as a Service
© IntelliMagic 2016
![Page 7: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/7.jpg)
7
Storage Background
![Page 8: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/8.jpg)
8
What is Data Storage?
This Photo by Unknown Author is licensed under CC BY-SA This Photo by Unknown Author is licensed under CC BY-NC
Primary Storage Remote Storage
![Page 9: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/9.jpg)
9
Data Center Storage Architectures and Industry Adoption
![Page 10: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/10.jpg)
10
![Page 11: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/11.jpg)
11
State of Industry
State of Technology
![Page 12: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/12.jpg)
12
State of Industry
State of Technology
![Page 13: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/13.jpg)
13
Performance Management Characteristics Tier Purpose Performance External
Dependencies * I/O Profile Ideal
Capacity Growth
Availability
0 Flash Extremely Fast Any IOPS intensive Average High (if in enterprise storage array)
1 Enterprise Hybrid
Fast Any IOPS intensive Average High
2 Mid-range Spinning
Good Any IOPS average/Throughput
Average High
3 Nearline/NAS Medium to slow, but predicable response times
Any IOPS low intensity Medium growth
High
4 Tape/VTS Archive
Not latency sensitive, think batch/archive
Any IOPS low intensity/Occasional high throughput
High growth
Moderate
5 Cloud Slow and unpredictable
None High throughput is okay
High growth
Moderate
![Page 14: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/14.jpg)
14
Storage Capacity Management
![Page 15: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/15.jpg)
15
Storage Capacity Management Methodology
Collect
Report
Calculate Growth
Forecast Requirements
Make Recommendations
Identify Important Metrics
![Page 16: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/16.jpg)
16
Technology Enhanced Storage Capacity Management Methodology
Collect
Report
Calculate Growth
Forecast Requirements
Make Recommendations
Identify Important Metrics
Automated Analysis
![Page 17: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/17.jpg)
17
Storage Capacity Measurement (Local)
![Page 18: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/18.jpg)
18
Storage Capacity Measurement (NAS)
![Page 19: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/19.jpg)
19
Storage Capacity Measurement (SAN)
![Page 20: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/20.jpg)
20
Storage Capacity Measurement (Hyper-converged)
![Page 21: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/21.jpg)
21
Storage Capacity Measurement (Public Cloud)
![Page 22: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/22.jpg)
22
Common Storage Capacity Forecasting Techniques
• HisS: Historical Swag or Order about the same as last year
• LRA: Linear Regression Analysis: Apply linear regression analysis to your usable capacity trend from the previous year(s). Continue growth line for some time in future.
• ABRBO: Burn rate/Burn out: Calculate average burn rate per day/month/etc. Divide capacity left by burn rate to calculate days until burn out.
• WARP: Wait and Reach out to vendor in Panic
![Page 23: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/23.jpg)
23
Example of Burnout
![Page 24: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/24.jpg)
24
Burn out Tabular View for Multiple Systems
![Page 25: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/25.jpg)
25
Track Capacity By Application
![Page 26: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/26.jpg)
26
Storage Performance Management
![Page 27: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/27.jpg)
27
Storage Performance Management Methodology
Load
Report
Assess
Correlate
Make Recommendations
Collect
![Page 28: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/28.jpg)
28
Technology Enhanced Storage Performance Management Methodology
Prepare
Enrich
Assess
Rate
Visualize
Correlate
Recommend
Collect
Automated Analysis
![Page 29: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/29.jpg)
29
Storage Performance Measurements: Collect
![Page 30: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/30.jpg)
30
Prepare: Validate, Normalize and Categorize
1. Validate 2. Normalize: EMC vs HDS
3. Categorize
![Page 31: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/31.jpg)
31
Enrich: Add Meaning
![Page 32: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/32.jpg)
32
Enrich: Add Meaning
![Page 33: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/33.jpg)
33
Enrich: Add Meaning
![Page 34: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/34.jpg)
34
Assess: Define the Criteria
1. Hardware Specific Storage System Throughput
2. Workload Dependent Storage System Response Time
![Page 35: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/35.jpg)
35
Assess: Define the Criteria
![Page 36: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/36.jpg)
36
Rate: Apply The Assessment Criteria
• (∑ 𝑟𝑟𝑖𝑖𝑛𝑛𝑖𝑖=1 )/n
‒ Where • r = rating at interval i • n = number of intervals
‒ Rating is always either • 0 = Value is less than warning • 1 = Value is greater than or equal to warning or less than
performance exception • 3 = Value is greater than or equal to performance exception
![Page 37: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/37.jpg)
37
Visualize: Visualize the Rating
• How does color relate to the rating displayed? ‒ 0-.1 is Green ‒ >.1-.3 is Yellow ‒ >.3-3.0 is Red
• So out of 96 intervals: ‒ we need no more than 3 red or 9 yellow intervals to rate
green. ‒ Less than 28 yellow or 9 red intervals make the chart rated
yellow. ‒ Otherwise, the chart is rated red.
![Page 38: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/38.jpg)
38
Correlate Configuration
![Page 39: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/39.jpg)
39
Apply Rating to Correlation?
Port Issues
![Page 40: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/40.jpg)
40
Application Views
![Page 41: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/41.jpg)
41
Automated Analysis
Automatic Correlation
Application Performance
Capacity Forecasting
How Can You Restore Data Storage Predictability?
Accurately and Quickly Identify Risks
Highlight potential affected paths
Understand health of applications
Plan for demand
Challenges Benefits
![Page 42: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/42.jpg)
42
IntelliMagic Vision Architecture
![Page 43: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/43.jpg)
43
IntelliMagic Vision for SAN Logical Architecture
![Page 44: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/44.jpg)
44
IntelliMagic Vision as a Service Architecture
![Page 45: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/45.jpg)
45
Thank you
For more information, please visit
www.intellimagic.com
Contact us with any questions or feedback:
Email: [email protected]
![Page 46: Restoring Data Storage Predictability · Restoring Data Storage Predictability Thoughts and Approaches on Managing Storage Performance and Capacity in 2017 Brent Phillips – Managing](https://reader030.vdocument.in/reader030/viewer/2022040915/5e8e24503d38f42d095e3a0e/html5/thumbnails/46.jpg)
Save the Date!