preston design backupsd 03
TRANSCRIPT
-
8/2/2019 Preston Design BackupSD 03
1/29
Hosted by
Designing a
Backup ArchitectureThat Actually Works
W. Curtis PrestonPresident/CEOThe Storage Group
-
8/2/2019 Preston Design BackupSD 03
2/29
-
8/2/2019 Preston Design BackupSD 03
3/29
Hosted by
What are the design
options?
-
8/2/2019 Preston Design BackupSD 03
4/29
Hosted by
SAN: LAN-free, Client-free, and Server-freebackup
NAS: NDMP filer to self, filer to filer, filer to server, &server to filer
Ethernet
DataGeneral
BackupServer
IBM
Backup Client
IBM
Backup Client
FC
FC
Router
Library
SCSISCSI
Disk Array
NAS Server
FCFC
FC Switchor Hub
FC
NAS Server
NAS Server
LibraryFC Switch
or Hub
FC
SCSI
Library
FC
NASSAN SAN
Virtual tape
-
8/2/2019 Preston Design BackupSD 03
5/29
Hosted by
LAN-based backups
Standard method
Central backup server
with network clients
backing up across the
LAN
Simplest, least
expensive design
la
ti
g
i
d
HEWLETTPACKARD
Data General
Backup
Server
TapeLibrary
Disk Disk Disk
-
8/2/2019 Preston Design BackupSD 03
6/29
Hosted by
LAN-free backups How does this work?
SCSI Reserve/Release
Third-party queuingsystem
Levels of drive sharing
Restores
IBM
IBM
Disk
Disk
IBM
Disk
TapeLibrary
SCSI/FC
Router
SCSI
SCSI
SCSI
SCSI
FC
FC Switch
FC
FC
FC
-
8/2/2019 Preston Design BackupSD 03
7/29
Hosted by
Client-free backups
Transaction Logs
TapeLibrary
DataSrvr
BackUpSrvrB
primarydisk set
backupmirror
1
3
2a
TapeLibrary
BackUpSrvrA
2c
2b
LAN
TapeLibrary
DataSrvr
BackUpSrvr
primarydisk set
backupmirror
Transaction Logs
2
1
TapeLibrary
BackUpSrvr
A
LAN
Backup transaction logs to disk
Establish backup mirrorTape
LibraryDataSrvr
BackUpSrvr
primary
disk set
backup
mirror
4a 4b
Transaction Logs
1
2
3Tape
Library
Back
UpSrvrA
LAN
Split backup mirror and back it up
-
8/2/2019 Preston Design BackupSD 03
8/29
-
8/2/2019 Preston Design BackupSD 03
9/29
Hosted by
Server-free backups
Server directsclient to take acopy-on-writesnapshot
Client and server
record block andfile associations
Server sendsXCOPY requestto SAN
TapeLibrary
DataSrvr
SAN
w/xcopysupport
primarydisk set
backupmirror
orsnapshot
3
Transaction Logs
1
2
TapeLibrary
BackUpSrvr
A
LAN
Virtual Disk
Provided by
Disk Array
Block D
Block E
Block F
FileB
Block A
Block B
Block C
FileA
-
8/2/2019 Preston Design BackupSD 03
10/29
Hosted by
Server-less Restores
Changing
block
locations
Image level
restores
File level
restores
Virtual DiskProvided byDisk Array
Block D
Block EBlock F
FileB
Block A
Block B
Block C
FileA
Tape
Snapshotor
Mirror
Block D
Block EBlock F
Block A
Block B
Block C
Virtual DiskProvided byDisk Array
Block D
Block E Block F
FileB (deleted)
Block A
Block B
Block C
FileA
Snapshotor
Mirror
Block A
Block B
Block C
Block D
Block EBlock F
Tape
Backup Restore
-
8/2/2019 Preston Design BackupSD 03
11/29
Hosted by
Backing up a filer: NDMP Filer to self
Filer to filer
Filer to
server
Server to
filer
Similar to
server-free
backups
LAN
Filer Filer Filer
BackupServer
Tape library Tape libraryTape library
OtherServer
Server to Filer
Filer
toSelf
Filer to Filer
NDMP tapelibrary
Filerto
libraryFiler toServer
-
8/2/2019 Preston Design BackupSD 03
12/29
Hosted by
Using NDMP Level of functionality depends on the DMA
and filer vendors
Robotic Support Filer to Library Support
Filer to Server Support
Direct access restore support
Image level backup
-
8/2/2019 Preston Design BackupSD 03
13/29
Hosted by
Using diskATA-based storage arrays as low as $5/GB
(disk only, needs filesystem)
Special function arrays Quantum DX-30 looks and behaves like a Quantum P1000.
Can be used as target for tape-based backups
(3 usable TB, $55K list, or $18/GB)
NetApp R100 looks like other NetApp filer. Target for
SnapVault and disk-based backups, source for SnapMirror
(9+ usable TB, $175K list, or $18/GB)
-
8/2/2019 Preston Design BackupSD 03
14/29
Hosted by
First Step: Backup to disk Use as a target for all
incremental backups.
(Full, too, if you can afford
it)
For off-site storage,
duplicate all disk-based
backups to tape.
Leave disk-based backups
on disk.
-
8/2/2019 Preston Design BackupSD 03
15/29
Hosted by
Second Step: Mirror to disk Use dumb arrays and
smart volume managers
and replication software.
Use smart arrays withreplication built into them.
Most valuable methods
have built in point-in-time
snapshots.
Mirror to disk, then backup
to tape, or mirror to
another disk!
-
8/2/2019 Preston Design BackupSD 03
16/29
-
8/2/2019 Preston Design BackupSD 03
17/29
Hosted by
Give it enough powerNot enough tape drives
Tape drives that arent
fast enough
Not enough slots in the
tape library
Not enough bandwidth
to the server
-
8/2/2019 Preston Design BackupSD 03
18/29
Hosted by
Dont give it too much power
Streaming tape drives must be
streamed
If you dont, you will wear out
your tape drives and decrease
aggregate performance
Must match the speed of the pipe
to the speed of the tape
You can actually increase your
throughput by using fewer tape
drives
-
8/2/2019 Preston Design BackupSD 03
19/29
Hosted by
Server Size/Power
I/O performance more important than
CPU power
CPU, memory, I/O expandability
paramount
Avoid overbuying by testingprospective server under load
-
8/2/2019 Preston Design BackupSD 03
20/29
Hosted by
Catalog/database Size Determine number of files (n)
Determine number of days in cycle (d)
(A cycle is a full backup and its associated
incremental backups)
Determine daily incremental size (i = n * .02)
Determine number of cycles on-line (c)
150-250 bytesper file, per backup
Use a 1.5 multiplier for growth and error
Index Size = (n + (i*d)) * c * 250 * 1.5
-
8/2/2019 Preston Design BackupSD 03
21/29
-
8/2/2019 Preston Design BackupSD 03
22/29
Hosted by
Number of Drives Disk/Tape Combo
LAN-based Backup
Buydisk system large enough to satisfy entire
on-site retention period without deletion. Buyenough tape drives to duplicate each nights
backups. Duplicate each nights backups to tape,
then take them out and send them offsite.
Library should be large enough to hold three tofour days of backups. (Only needs to hold
duplicated tapes until theyre sent off-site.)
-
8/2/2019 Preston Design BackupSD 03
23/29
-
8/2/2019 Preston Design BackupSD 03
24/29
Hosted by
Library Size - slots (all tape environment) Should hold allonsite tapes
On-site tapes automatically expire and get
reused
Only offsite tapes require phys. mgmt.
Should monitor library via a script to ensure
that each pool has enough free tapes before
you go home
Watch for those downed drive messages
-
8/2/2019 Preston Design BackupSD 03
25/29
Hosted by
Library Size - slots (disk/tape environment)
Do all backups to disk wherever possible.
Library only needs to hold the latest set of
copies (three or four days worth).
Disk-based backups automatically expire and
space gets reused.
Only off-site tapes require phys. mgmt.
Should monitor library and diskvia a script toensure that each pool has enough free space
before you go home
Watch for those downed drive messages
-
8/2/2019 Preston Design BackupSD 03
26/29
Hosted by
Configuring your server
Backup all drives.
Make sure you are streaming your drives.
Create an automated monitoring system.
Establish standards wherever possible,and use them!
-
8/2/2019 Preston Design BackupSD 03
27/29
Hosted by
Resources
-
8/2/2019 Preston Design BackupSD 03
28/29
Hosted by
Resources
Directories of products to help you
build a better backup system
http://www.storagemountain.com
Send questions to:
http://www.storagemountain.com/http://www.storagemountain.com/ -
8/2/2019 Preston Design BackupSD 03
29/29
Hosted by
Thank you!
W. Curtis PrestonPresident/CEO
The Storage Group