aws re:invent 2016: deep dive on amazon elastic block store (stg301)
TRANSCRIPT
![Page 1: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/1.jpg)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rob Alexander, AWS Principal Solutions Architect
November 30, 2016
Deep Dive on Amazon
Elastic Block Store
STG301
![Page 2: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/2.jpg)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Who: Lead Software Development Engineers, Architects, and Technical PMs
Where: Storage Booth Walk-up Bar
When: Exhibit hours (Tues 5-7pm, Wed & Thurs 10:30a-6:00p)
What: Architecture best practices, code reviews, feature requests
Storage “Office Hours”Meet the People who Build AWS Storage
![Page 3: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/3.jpg)
Storage service options
Amazon
Elastic Block Store
Amazon
Elastic File SystemAmazon S3
Block File Object
![Page 4: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/4.jpg)
AWS
block storage
offerings
EC2
instance
store
![Page 5: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/5.jpg)
What is Amazon EC2 instance store?
EC2 instances • Local to instance
• Non-persistent data store
• Data not replicated (by default)
• No snapshot support
• SSD or HDD
Physical Host
Instance Store
or
![Page 6: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/6.jpg)
AWS
block storage
offerings
EC2
instance
store
sc1st1
io1gp2
EBS
SSD-backed
volumes
EBS
HDD-backed
volumes
![Page 7: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/7.jpg)
What is EBS?
EBS
volume
EC2
instance
• Block storage as a service
• Create, attach volumes through an API
• Service accessed over the network
![Page 8: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/8.jpg)
What is EBS?
EBS
volume
EC2
instance
!=
![Page 9: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/9.jpg)
What is EBS?
EBS
volume
EC2
instance
![Page 10: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/10.jpg)
What is EBS?
EBS
volume
Availability Zone
AWS Region
EC2
instance
![Page 11: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/11.jpg)
What is EBS?
EBS
volume
EC2
instance
EC2
instance
• Volumes persist
independent of EC2
• Detach and attach between
instances
• Volume and instance must
be in the same AZ
Availability Zone
AWS Region
![Page 12: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/12.jpg)
What is EBS?
EBS
boot
volume
Availability Zone
AWS Region
EC2
instance
EBS
data
volume
EBS
data
volume
• Volumes attach to one
instance at a time
• Many volumes can attach
to an instance
• Separate boot volume from
data volumes
![Page 13: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/13.jpg)
What is EBS?
EBS
volume
Availability Zone Availability Zone
AWS Region
Replica
![Page 14: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/14.jpg)
EBS is designed for:
What is EBS?
99.999% service availability
0.1% to 0.2% annual failure rate (AFR)
![Page 15: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/15.jpg)
What is an EBS snapshot?
EBS
volume
Availability Zone
AWS Region
Amazon
S3EBS snapshot
Availability Zone
Replica
![Page 16: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/16.jpg)
How does an EBS snapshot work?
EBS
volume
• Point-in-time backup of modified volume blocks
• Stored in S3, accessed via EBS APIs
• Subsequent snapshots are incremental
• Deleting snapshot will only remove data
exclusive to that snapshot
EBS
snapshot
![Page 17: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/17.jpg)
What can you do with a snapshot?
EBS
volume
Availability Zone
AWS Region
EC2 instance
EBS snapshot
AMI
![Page 18: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/18.jpg)
What can you do with a snapshot?
EBS
volume
Availability Zone
AWS Region
Amazon
S3EBS snapshot
Availability Zone
EBS
volume
Replica Replica
![Page 19: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/19.jpg)
What can you do with a snapshot?
EBS
volume
Availability Zone
AWS Region
Amazon
S3EBS snapshot
EBS
volume
Availability Zone
AWS Region
EBS snapshot
Replica Replica
![Page 20: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/20.jpg)
What can you do with a snapshot?
AWS Region
Public datasets on
AWS available as
EBS snapshots:
Availability Zone
EBS
volume
https://aws.amazon.com/public-data-sets/
• Genomic
• Census
• Global weather
• Transportation
Replica
![Page 21: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/21.jpg)
What is an EBS-optimized instance?
EBS
volume
Availability Zone
AWS Region
EBS-optimized
EC2 instance
![Page 22: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/22.jpg)
What is an EBS-optimized instance?
EBS
EC2
instances
Internet
Databases
~ 125 MB/s
S3
Shared
c3.2xlarge
![Page 23: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/23.jpg)
What is an EBS-optimized instance?
EBS
EC2
instances InternetDatabasesc3.2xlarge
S3
~ 125 MB/s
Shared
![Page 24: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/24.jpg)
What is an EBS-optimized instance?
More details:
http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSOptimized.html
• Dedicated network bandwidth for EBS I/O
• Enabled by default on c4, d2, m4, p2, and x1 instances
• Can be enabled at instance launch or on a running instance
• Not an option on some 10 Gbps instance types
(c3.8xlarge, r3.8xlarge, i2.8xlarge)
![Page 25: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/25.jpg)
What is EBS encryption?
Encryption
• Attach both encrypted and unencrypted
• No volume performance impact
• Any current generation instance
• Supported by all EBS volume types
• Snapshots also encrypted
• No extra cost
• Boot and data volumes can be encrypted
![Page 26: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/26.jpg)
EBS volume types
![Page 27: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/27.jpg)
EBS volume types
Hard disk driveSolid state drive
![Page 28: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/28.jpg)
EBS volume types
General Purpose
SSD
gp2
Provisioned IOPS
SSD
io1
Throughput Optimized
HDD
st1
Cold
HDD
sc1
SSD HDD
![Page 29: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/29.jpg)
Throughput?
orIOPS
Choosing an EBS volume type
What is more important to your workload:
![Page 30: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/30.jpg)
Don’t know
Choosing an EBS volume
your workload
yet?
![Page 31: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/31.jpg)
EBS volume types: I/O Provisioned
General Purpose SSD
gp2
Throughput: 160 MB/s
Latency: Single-digit ms
Capacity: 1 GB to 16 TB
Baseline: 3 IOPS per GB up to 10,000
Burst: 3,000 IOPS (for volumes up to 1 TB)
Great for boot volumes, low-latency applications, and bursty databases
![Page 32: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/32.jpg)
Burst & baseline: General Purpose SSD (gp2)IO
PS
0 1 16
1,000
2,000
3,000
8,000
10,000
BASELINE IOPS(Baseline of 3 IOPS/GB)
Burstable to
3,000 IOPS
3 90.5
Volume size (TB)
~ 3334 GB
100 IOPS
Minimum
300 GB volume
![Page 33: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/33.jpg)
Burst bucket: General Purpose SSD (gp2)
Max I/O credit per bucket is 5.4M
You can spend up to
3000 IOPS per second
Baseline performance = 3 IOPS per GiB or 100 IOPS
Always accumulating
3 IOPS per GiB per second
gp2
![Page 34: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/34.jpg)
How long can I burst on gp2?
0
100
200
300
400
500
600
700
1 8 30 100 150 200 250 300 350 400 450 500 550 600 650 700 750 800 850 900 950
Min
ute
s o
f B
urs
t
Volume size in GB
43 min 1 hour
10 hours
![Page 35: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/35.jpg)
How do I monitor gp2 burst balance?
VolumeWriteOpsBurstBalance500 GB gp2 volume
900,000
write IOs
over 5 min =
3000 IOPS
450,000
write IOs
over 5 min =
1500 IOPS
![Page 36: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/36.jpg)
Throughput?
orIOPS
Choosing an EBS volume type
What is more important to your workload:
![Page 37: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/37.jpg)
i2
gp2 io1
Choosing an EBS volume type
Latency ?
< 1 ms Single-digit ms
Which is more important ?
Cost Performance
IOPS
≤ 65,000> 65,000
is more important
![Page 38: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/38.jpg)
EBS volume types: I/O Provisioned
Provisioned IOPS SSD
io1
Baseline: 100 to 20,000 IOPS
Throughput: 320 MB/s
Latency: Single-digit ms
Capacity: 4 GB to 16 TB
Ideal for critical applications and databases with sustained IOPS
![Page 39: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/39.jpg)
Scaling Provisioned IOPS SSD (io1)IO
PS
0 2 16
1,000
5,000
10,000
15,000
20,000
6 90.4
MAX PROVISIONED IOPS(Maximum IOPS:GB ratio of 50:1)
Available Provisioned IOPS
Volume Size (TB)
~ 400 GB
![Page 40: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/40.jpg)
i2
gp2 io1
Choosing an EBS volume type
Latency ?
< 1 ms Single-digit ms
Which is more important ?
Cost Performance
IOPS
≤ 65,000> 65,000
is more important
Throughput?
![Page 41: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/41.jpg)
Throughputis more important
Small, random I/O Large, sequential I/O
i2
gp2 io1 st1
d2
Choosing an EBS volume type
Latency ?
< 1 ms Single-digit ms ≤ 1,250 MB/s
Aggregate throughput?
> 1,250 MB/s
Which is more important ?
Cost Performance
IOPS
≤ 65,000> 65,000
is more important
Which is more important ?
Cost Performance
![Page 42: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/42.jpg)
EBS volume types: Throughput Provisioned
Throughput
Optimized HDD
st1
Baseline: 40 MB/s per TB up to 500 MB/s
Capacity: 500 GB to 16 TB
Burst: 250 MB/s per TB up to 500 MB/s
Ideal for large-block, high-throughput sequential workloads
![Page 43: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/43.jpg)
Throughput Optimized HDD – burst and base
0
100
200
300
400
500
600
0.5 1 2 4 6 8 10 12 14 16
Thro
ug
hput in
MB
/s
Volume Size in TB
Burst Base
320
ST1
![Page 44: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/44.jpg)
Burst bucket: Throughput Optimized HDD (st1)
Max I/O bucket credit is 1 TB of
credit per TB in volume
You can spend up to
250 MB/s per TB
Baseline performance = 40 MB/s per TB
Always accumulating 40 MB/s per TB
st1
![Page 45: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/45.jpg)
Up to 8 TB in I/O credit
Always accumulating 320 MB/s
You can spend up
to 500 MB/s
Burst bucket: example 8 TB st1 volume
Baseline performance = 320 MB/s
st1
![Page 46: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/46.jpg)
Throughputis more important
Small, random I//O Large, sequential I/O
Which is more important?
Latency?
i2
gp2 io1 sc1 st1
d2
Choosing an EBS volume type
IOPS
≤ 65,000> 65,000
< 1 ms Single-digit ms ≤ 1,250 MB/s
Aggregate throughput?
> 1,250 MB/s
is more important
Cost Performance
Which is more important?
Cost Performance
![Page 47: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/47.jpg)
Cold HDD
sc1
EBS volume types: Throughput Provisioned
Baseline: 12 MB/s per TB up to 192 MB/s
Capacity: 500 GB to 16 TB
Burst: 80 MB/s per TB up to 250 MB/s
Ideal for sequential throughput workloads, such as logging and backup
![Page 48: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/48.jpg)
Cold HDD – burst and base
0
50
100
150
200
250
300
0.5 1 2 4 6 8 10 12 14 16
Thro
ug
hput in
MB
/s
Volume size in TB
Burst Base
192
SC1
![Page 49: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/49.jpg)
Burst bucket: Cold HDD (sc1)
Max I/O bucket credit is 1 TB of
credit per TB in volume
You can spend up to 80
MB/s per TB
Baseline performance = 12 MB/s per TB
Always accumulating 12 MB/s per TB
sc1
![Page 50: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/50.jpg)
Throughputis more important
Small, random I/O Large, sequential I/O
Which is more important?
Latency?
i2
gp2 io1 sc1 st1
d2
Choosing an EBS volume type
IOPS
≤ 65,000> 65,000
< 1 ms Single-digit ms ≤ 1,250 MB/s
Aggregate throughput?
> 1,250 MB/s
is more important
Cost Performance
Which is more important?
Cost Performance
![Page 51: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/51.jpg)
I/O Provisioned Volumes Throughput Provisioned Volumes
sc1st1io1gp2
$0.10 per GB $0.125 per GB
$0.065 per PIOPS
* All prices are per month, and from the us-west-2 Region as of April 2016
$0.045 per GB $0.025 per GB
Snapshot storage for all volume types is $0.05 per GB per month
![Page 52: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/52.jpg)
Hybrid volume use cases
c4
gp2
st1
STG205Case Study:
Librato’s Experience Running
Cassandra Using Amazon EBS
Data files
Commit log
i2
![Page 53: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/53.jpg)
Hybrid volume use cases
gp2 st1
STG311Case Study:
How Videology and Zendesk
Modernized Their Big Data Platforms on
Amazon EBS
Hot data
0–7 DaysWarm data
8–30 days
sc1
Cold data
31–60 days
Tiered Elasticsearch data:
![Page 54: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/54.jpg)
Hybrid volume use cases
st1
Case Study:
Info: https://aws.amazon.com/solutions/case-
studies/infor-ebs/
Transaction logs
“We’ve seen much stronger performance for our database
backup workloads with the Amazon EBS ST1 volumes, and
we’re also saving 75 percent on our monthly backup costs.”
Randy Young, Director of Cloud Operations, Infor
i2st1
Full backups
st1
Partial backups
SQL Server
Database
EBS
snapshots
![Page 55: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/55.jpg)
Hybrid volume use cases
gp2
st1
Amazon EMR Apache Hadoop
Example
Frameworks on YARN
HDFS
sc1
EMR cluster
instance
• Random, small I/O
• Shuffle, spill, and temp operations
• Large, sequential I/O
• Multiple volumes for more parallelism
or
![Page 56: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/56.jpg)
Hadoop with multiple EBS volume types
[{
"classification":"yarn-site","properties":{
"yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage":"99.9","yarn.nodemanager.local-dirs":"/mnt/yarn,/mnt1/yarn"
}},{
"classification":"core-site","properties":{
"fs.s3.buffer.dir":"/mnt/s3,/mnt1/s3"}
},{
"classification":"hdfs-site","properties":{
"dfs.namenode.name.dir":"file:///mnt2/namenode,file:///mnt3/namenode,file:///mnt4/namenode","dfs.name.dir":"/mnt2/namenode,/mnt3/namenode,/mnt4/namenode","dfs.data.dir":"/mnt2/hdfs,/mnt3/hdfs,/mnt4/hdfs","dfs.datanode.data.dir":"file:///mnt2/hdfs,file:///mnt3/hdfs,file:///mnt4/hdfs"
}},{
"classification":"mapred-site","properties":{
"mapred.local.dir":"/mnt/mapred,/mnt1/mapred","mapreduce.cluster.local.dir":"/mnt/mapred,/mnt1/mapred"
}}
]
GP2 = mnt, mnt1 ST1 / SC1 = mnt2, mnt3, mnt4
![Page 57: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/57.jpg)
EBS deep dive
![Page 58: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/58.jpg)
EBS deep dive
Performance
![Page 59: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/59.jpg)
How do we count I/Os for GP2 and IO1?
When possible, we merge sequential I/Os (up to 256 KB in
size)
...To minimize I/O charges on IO1
and maximize burst on GP2
![Page 60: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/60.jpg)
How do we count I/Os for GP2 and IO1?
Example 1: Random I/Os
• 4 random I/Os (i.e., non sequential I/Os)
• Each I/O 64 KB
Up to 256 KBEC2
instanceEBS
Counted as 4 I/Os
![Page 61: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/61.jpg)
How do we count I/Os for GP2 and IO1?
Example 2: Sequential I/O
• 4 sequential I/Os
• Each I/O 64 KB
Up to 256 KBEC2
instanceEBS
Counted as 1 I/O
![Page 62: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/62.jpg)
How do we count I/Os for GP2 and IO1?
Example 3: Large I/O
• 1 I/O
• 1024 KB
Up to 256 KBEC2
instanceEBS
Counted as 4 I/Os
![Page 63: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/63.jpg)
How do we count I/Os for ST1 and SC1?
• When possible, we merge sequential I/Os (up to 1 MB in size)
• Workloads with primarily large, sequential I/Os perform best on
ST1 and SC1
• Ex: Big Data/EMR, Hadoop, Kafka, Log Processing, Data
Warehouses
![Page 64: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/64.jpg)
How do we count I/Os for ST1 and SC1?
Example 1: Random I/Os
• 4 random I/Os
• Each I/O 64 KB
Up to 1024 KBEC2
instanceEBS
Counted as 4 I/Os or 4 MB/s of burst
![Page 65: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/65.jpg)
How do we count I/Os for ST1 and SC1?
Example 2: Sequential I/O
• 4 sequential I/Os
• Each I/O 1024 KB
Up to 1024 KBEC2
instanceEBS
Counted as 4 I/Os or 4 MB/s of burst
![Page 66: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/66.jpg)
How do we count I/Os for ST1 and SC1?
Example 3: Mixed I/O
• 2 * 512 KB sequential I/Os
• 2 * 64 KB random I/Os
• 2 * 128 KB sequential I/Os
Up to 1024 KBEC2
instanceEBS
Counted as 4 I/Os or 4 MB/s of burst (but only ~ 1.4 MB of data transferred)
![Page 67: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/67.jpg)
Burst balance for ST1 and SC1
0
20
40
60
80
100
120
0 1 2 3 4 5 6 7 8 9 10
Burs
t B
ala
nce %
Time in Hours
1 MB Sequential 16 KB Random
4 TB ST1 volume
1 MB Sequential:
500 MB/s for 3 hours
16 KB Random:
8 MB/s for 3 hours
![Page 68: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/68.jpg)
Burst balance for ST1 and SC1
4 TB ST1 Volume
0
1000
2000
3000
4000
5000
6000
Data Transferred in GB
1 MB Sequential 16 KB Random
1 MB Sequential:
5.4 TB transferred
16 KB Random:
87 GB transferred
![Page 69: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/69.jpg)
2046 sectors x 512 bytes/sector = ~1024 KiB
$ iostat –xm
Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
xvdf 0.00 0.20 0.00 523.40 0.00 523.00 2046.44 3.99 7.62 1.61 100.00
Verify workload I/O patterns
iostat for Linux
perfmon for Windows
![Page 70: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/70.jpg)
128 KiB
Verify ST1 & SC1 workloads
Amazon
CloudWatch
Console
![Page 71: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/71.jpg)
Under
64 KiB?
Verify ST1 & SC1 workloads
Small or
random IOPS
likely
CloudWatch
Console
![Page 72: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/72.jpg)
Stuck
around
44 KiB?
Verify ST1 & SC1 workloads
CloudWatch
Console
Upgrade your Linux
kernel to at least 3.8
![Page 73: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/73.jpg)
Responses
RequestsInstance
Ring queue
userspace process
kernel
request
queuenoop
deadline
cfq
scheduler
I/O requests in a Linux virtual world
I/O Driver Domain
Hypervisor
![Page 74: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/74.jpg)
I/O requests in a Linux virtual world: 3.8+ kernel
Instance
EBS
userspace process
kernel
request
queue
scheduler
noop
deadline
cfq
pre 3.8:
44 KB
post 3.8:
128 KB to
1024 KB
I/O Driver Domain
Hypervisor
Up to 32 requests in queue
![Page 75: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/75.jpg)
I/O requests in a Linux virtual world: 4.2+ kernel
Instance
EBS
userspace process
kernel
request
queue
per core
blk-mq
pre 3.8:
44 KB
post 3.8:
128 KB to
1024 KB
I/O Driver Domain
Hypervisor
Up to 32 requests in queue
![Page 76: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/76.jpg)
ST1 & SC1: Linux performance tuning
Increase maximum request size:
• Recommended for ST1, SC1 on a 4.2+ Linux kernel
• Memory allocated per device
• Default is 32, max for EC2 is 256
For example with GRUB’s /boot/grub/menu.lst configuration:
kernel /boot/vmlinuz-4.4.5-15.26.amzn1.x86_64 root=LABEL=/ console=ttyS0 xen_blkfront.max=256
Verify setting:
/sys/module/xen_blkfront/parameters/max
• OS boot command line configuration
![Page 77: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/77.jpg)
ST1 & SC1: Linux performance tuning
Increase read-ahead buffer:
• Recommended for high-throughput read workloads
• Per device configuration
• Default is 128 KiB (256 sectors) for Amazon Linux
• Smaller or random I/O will degrade performance
For example:
$ sudo blockdev –setra 2048 /dev/xvdf
http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EBSPerformance.html
![Page 78: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/78.jpg)
IOPS vs. throughput
20,000 IOPS
16 KB
320 MB/s
10,000 IOPS
64 KB
640 MB/s
10,000 IOPS
32 KB
320 MB/s
I/O request size
1,250 IOPS
256 KB
320 MB/s
Example:
io1 volume
20,000 PIOPS
![Page 79: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/79.jpg)
Performance: EBS-optimized
c4.large
Dedicated to EBS
500 Mbps ~ 62.5 MB/s
2 TB GP2 volume:6,000 IOPS
160 MB/s max throughput4,000 16K IOPS
c4.2xlarge
Dedicated to EBS
1 Gbps ~ 125 MB/s
8,000 16K IOPS
2 TB GP2 volume:6,000 IOPS
160 MB/s max throughput
![Page 80: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/80.jpg)
Performance: throughput workload
EC2
instances InternetDatabases
m4.16xlarge
S3
10 Gbps ~ 1250 MB/s
EBS-optimized
10 Gbps
~1,250 MB/s
65,000 16K IOPS
8 TB ST1 volume:320 MB/s base
500 MB/s burst
Shared
![Page 81: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/81.jpg)
Performance: throughput workload
EC2
instances InternetDatabases
m4.16xlarge
S3
3 * 8 TB ST1 volume:960 MB/s base
1,250 MB/s burstRAID0
10 Gbps ~ 1250 MB/s
Shared
EBS-optimized
10 Gbps
~1,250 MB/s
65,000 16K IOPS
![Page 82: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/82.jpg)
Best practice: RAID
When to RAID?
• Storage requirement > 16 TB
• Throughput requirement > 500 MB/s
• IOPS requirement > 20,000 @ 16K
![Page 83: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/83.jpg)
Best practice: RAID
EBS
volume
Availability Zone
AWS Region
EC2
instance
EBS
volume
RAID0RAID10
Replica Replica
![Page 84: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/84.jpg)
Best practice: RAID
Avoid RAID for redundancy
• EBS data is already replicated
• RAID5/6 loses 20 – 30% of usable I/O to parity
• RAID1 halves available EBS bandwidth
![Page 85: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/85.jpg)
EBS deep dive
Performance
Reliability
![Page 86: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/86.jpg)
What about EC2 instance failure?
Availability Zone
AWS Region
EBS
volume
EC2
instance
Replica
![Page 87: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/87.jpg)
What about EC2 instance failure?
Availability Zone
AWS Region
EBS
volume
New
EC2
instance
Replica
![Page 88: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/88.jpg)
EBS enables EC2 auto recovery
RECOVER Instance
Instance ID
Instance metadata
Private IP addresses
Elastic IP addresses
EBS volume attachments
Instance retains:
* Supported on C3, C4, M3, M4, P2, R3, T2, and X1 instance types with EBS-only storage
StatusCheckFailed_System
Amazon CloudWatch
per-instance metric alarm:
When alarm triggers?
![Page 89: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/89.jpg)
What about EC2 instance termination?
Availability Zone
EBS
volume
EC2
instance
DeleteOnTermination = True
DeleteOnTermination = False
AWS Region
Replica
![Page 90: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/90.jpg)
Best practice: taking snapshots from Linux
Quiesce I/O
1. Database: FLUSH and LOCK tables
2. Filesystem: sync and fsfreeze
3. EBS: snapshot all volumes
4. When CreateSnapshot API returns
success, it is safe to resume
![Page 91: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/91.jpg)
Best practice: taking snapshots from Windows
1. sync equivalent available
2. Use Volume Shadow Copy Service-
(VSS) aware utilities for backups
3. EBS: backups on dedicated volume
for snapshots
![Page 92: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/92.jpg)
Best practice: taking EBS snapshots from Windows
EBS
boot
volume
Windows
EC2
instance
EBS
data
volume
EBS
backup
volume
Windows Server Backup
EBS snapshot
![Page 93: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/93.jpg)
EBS volume initialization
New EBS volume? New EBS volume from snapshot?
• Attach and it’s ready to go • Initialize for best performance
• Random read across volume
![Page 94: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/94.jpg)
Best practice: EBS volume initialization
$ sudo yum install –y fio
$ sudo fio --filename=/dev/xvdf --rw=randread --bs=128k --iodepth=32
--ioengine=libaio --direct=1 --name=volume-initialize
Fio-based example:
![Page 95: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/95.jpg)
Best practice: automate snapshots
Key ingredients:
AWS Lambda Amazon EC2
Run commandTagging
https://aws.amazon.com/ec2/run-command/
![Page 96: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/96.jpg)
Best practice: automate snapshots
Lambda
scheduled event:
daily snapshots
EC2
instances
Backup
Retention30 days
Search for instances
tagged “Backup”
EC2 Run commands to
quiesce file systemSnapshot attached
volumes
Tag snapshots with
expire date
1. 2. 3. 4.
![Page 97: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/97.jpg)
Best practice: automate snapshot expiration
Lambda
scheduled event:
daily expire
Search for snapshots
tagged to “Expire On”
today
Delete expired
snapshots
1. 2.
EBS
snapshots
BackupExpireOn
Date
![Page 98: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/98.jpg)
https://github.com/dR0ski/lambda-ebs-snapshot-custodian
Prototype for EBS Snapshot Custodian:
![Page 99: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/99.jpg)
EBS best practices
Performance
Reliability
Security
![Page 100: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/100.jpg)
Best practice: encryption
EBS encryption:
data volumes
![Page 101: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/101.jpg)
Best practice: encryption
Create a new AWS KMS master key for EBS
• Define key rotation policy
• Enable AWS CloudTrail auditing
• Control who can use key
• Control who can administer key
![Page 102: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/102.jpg)
Best practice: encryption
EBS encryption:
data volumes
![Page 103: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/103.jpg)
How does EBS encryption work?
EBS volume 1
EBS
master
key
KMS
Data key 1
Data key 2
Data key 3Envelope encryption
EBS volume 2
EBS volume 3
![Page 104: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/104.jpg)
How does EBS encryption work?
EBS volume 1
EBS
master
key
AWS KMS
Envelope encryption
EBS volume 2
EBS volume 3
![Page 105: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/105.jpg)
How does EBS encryption work?
EBS volume 1
EBS
master
key
KMS
Envelope encryption
• Limits exposure risk
• Performance
• Simplifies key management
EBS volume 2
EBS volume 3
![Page 106: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/106.jpg)
Summary
Use encryption if
you need it
Take snapshots,
tag snapshotsSelect the right
instance for your
workload
Select the right
volume for your
workload
![Page 107: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/107.jpg)
Thank you!
![Page 108: AWS re:Invent 2016: Deep Dive on Amazon Elastic Block Store (STG301)](https://reader033.vdocument.in/reader033/viewer/2022042707/586f90cc1a28ab54768b7a41/html5/thumbnails/108.jpg)
Remember to complete
your evaluations!