preston design backupsd 03

Upload: markobu

Post on 05-Apr-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/2/2019 Preston Design BackupSD 03

    1/29

    Hosted by

    Designing a

    Backup ArchitectureThat Actually Works

    W. Curtis PrestonPresident/CEOThe Storage Group

  • 8/2/2019 Preston Design BackupSD 03

    2/29

  • 8/2/2019 Preston Design BackupSD 03

    3/29

    Hosted by

    What are the design

    options?

  • 8/2/2019 Preston Design BackupSD 03

    4/29

    Hosted by

    SAN: LAN-free, Client-free, and Server-freebackup

    NAS: NDMP filer to self, filer to filer, filer to server, &server to filer

    Ethernet

    DataGeneral

    BackupServer

    IBM

    Backup Client

    IBM

    Backup Client

    FC

    FC

    Router

    Library

    SCSISCSI

    Disk Array

    NAS Server

    FCFC

    FC Switchor Hub

    FC

    NAS Server

    NAS Server

    LibraryFC Switch

    or Hub

    FC

    SCSI

    Library

    FC

    NASSAN SAN

    Virtual tape

  • 8/2/2019 Preston Design BackupSD 03

    5/29

    Hosted by

    LAN-based backups

    Standard method

    Central backup server

    with network clients

    backing up across the

    LAN

    Simplest, least

    expensive design

    la

    ti

    g

    i

    d

    HEWLETTPACKARD

    Data General

    Backup

    Server

    TapeLibrary

    Disk Disk Disk

  • 8/2/2019 Preston Design BackupSD 03

    6/29

    Hosted by

    LAN-free backups How does this work?

    SCSI Reserve/Release

    Third-party queuingsystem

    Levels of drive sharing

    Restores

    IBM

    IBM

    Disk

    Disk

    IBM

    Disk

    TapeLibrary

    SCSI/FC

    Router

    SCSI

    SCSI

    SCSI

    SCSI

    FC

    FC Switch

    FC

    FC

    FC

  • 8/2/2019 Preston Design BackupSD 03

    7/29

    Hosted by

    Client-free backups

    Transaction Logs

    TapeLibrary

    DataSrvr

    BackUpSrvrB

    primarydisk set

    backupmirror

    1

    3

    2a

    TapeLibrary

    BackUpSrvrA

    2c

    2b

    LAN

    TapeLibrary

    DataSrvr

    BackUpSrvr

    primarydisk set

    backupmirror

    Transaction Logs

    2

    1

    TapeLibrary

    BackUpSrvr

    A

    LAN

    Backup transaction logs to disk

    Establish backup mirrorTape

    LibraryDataSrvr

    BackUpSrvr

    primary

    disk set

    backup

    mirror

    4a 4b

    Transaction Logs

    1

    2

    3Tape

    Library

    Back

    UpSrvrA

    LAN

    Split backup mirror and back it up

  • 8/2/2019 Preston Design BackupSD 03

    8/29

  • 8/2/2019 Preston Design BackupSD 03

    9/29

    Hosted by

    Server-free backups

    Server directsclient to take acopy-on-writesnapshot

    Client and server

    record block andfile associations

    Server sendsXCOPY requestto SAN

    TapeLibrary

    DataSrvr

    SAN

    w/xcopysupport

    primarydisk set

    backupmirror

    orsnapshot

    3

    Transaction Logs

    1

    2

    TapeLibrary

    BackUpSrvr

    A

    LAN

    Virtual Disk

    Provided by

    Disk Array

    Block D

    Block E

    Block F

    FileB

    Block A

    Block B

    Block C

    FileA

  • 8/2/2019 Preston Design BackupSD 03

    10/29

    Hosted by

    Server-less Restores

    Changing

    block

    locations

    Image level

    restores

    File level

    restores

    Virtual DiskProvided byDisk Array

    Block D

    Block EBlock F

    FileB

    Block A

    Block B

    Block C

    FileA

    Tape

    Snapshotor

    Mirror

    Block D

    Block EBlock F

    Block A

    Block B

    Block C

    Virtual DiskProvided byDisk Array

    Block D

    Block E Block F

    FileB (deleted)

    Block A

    Block B

    Block C

    FileA

    Snapshotor

    Mirror

    Block A

    Block B

    Block C

    Block D

    Block EBlock F

    Tape

    Backup Restore

  • 8/2/2019 Preston Design BackupSD 03

    11/29

    Hosted by

    Backing up a filer: NDMP Filer to self

    Filer to filer

    Filer to

    server

    Server to

    filer

    Similar to

    server-free

    backups

    LAN

    Filer Filer Filer

    BackupServer

    Tape library Tape libraryTape library

    OtherServer

    Server to Filer

    Filer

    toSelf

    Filer to Filer

    NDMP tapelibrary

    Filerto

    libraryFiler toServer

  • 8/2/2019 Preston Design BackupSD 03

    12/29

    Hosted by

    Using NDMP Level of functionality depends on the DMA

    and filer vendors

    Robotic Support Filer to Library Support

    Filer to Server Support

    Direct access restore support

    Image level backup

  • 8/2/2019 Preston Design BackupSD 03

    13/29

    Hosted by

    Using diskATA-based storage arrays as low as $5/GB

    (disk only, needs filesystem)

    Special function arrays Quantum DX-30 looks and behaves like a Quantum P1000.

    Can be used as target for tape-based backups

    (3 usable TB, $55K list, or $18/GB)

    NetApp R100 looks like other NetApp filer. Target for

    SnapVault and disk-based backups, source for SnapMirror

    (9+ usable TB, $175K list, or $18/GB)

  • 8/2/2019 Preston Design BackupSD 03

    14/29

    Hosted by

    First Step: Backup to disk Use as a target for all

    incremental backups.

    (Full, too, if you can afford

    it)

    For off-site storage,

    duplicate all disk-based

    backups to tape.

    Leave disk-based backups

    on disk.

  • 8/2/2019 Preston Design BackupSD 03

    15/29

    Hosted by

    Second Step: Mirror to disk Use dumb arrays and

    smart volume managers

    and replication software.

    Use smart arrays withreplication built into them.

    Most valuable methods

    have built in point-in-time

    snapshots.

    Mirror to disk, then backup

    to tape, or mirror to

    another disk!

  • 8/2/2019 Preston Design BackupSD 03

    16/29

  • 8/2/2019 Preston Design BackupSD 03

    17/29

    Hosted by

    Give it enough powerNot enough tape drives

    Tape drives that arent

    fast enough

    Not enough slots in the

    tape library

    Not enough bandwidth

    to the server

  • 8/2/2019 Preston Design BackupSD 03

    18/29

    Hosted by

    Dont give it too much power

    Streaming tape drives must be

    streamed

    If you dont, you will wear out

    your tape drives and decrease

    aggregate performance

    Must match the speed of the pipe

    to the speed of the tape

    You can actually increase your

    throughput by using fewer tape

    drives

  • 8/2/2019 Preston Design BackupSD 03

    19/29

    Hosted by

    Server Size/Power

    I/O performance more important than

    CPU power

    CPU, memory, I/O expandability

    paramount

    Avoid overbuying by testingprospective server under load

  • 8/2/2019 Preston Design BackupSD 03

    20/29

    Hosted by

    Catalog/database Size Determine number of files (n)

    Determine number of days in cycle (d)

    (A cycle is a full backup and its associated

    incremental backups)

    Determine daily incremental size (i = n * .02)

    Determine number of cycles on-line (c)

    150-250 bytesper file, per backup

    Use a 1.5 multiplier for growth and error

    Index Size = (n + (i*d)) * c * 250 * 1.5

  • 8/2/2019 Preston Design BackupSD 03

    21/29

  • 8/2/2019 Preston Design BackupSD 03

    22/29

    Hosted by

    Number of Drives Disk/Tape Combo

    LAN-based Backup

    Buydisk system large enough to satisfy entire

    on-site retention period without deletion. Buyenough tape drives to duplicate each nights

    backups. Duplicate each nights backups to tape,

    then take them out and send them offsite.

    Library should be large enough to hold three tofour days of backups. (Only needs to hold

    duplicated tapes until theyre sent off-site.)

  • 8/2/2019 Preston Design BackupSD 03

    23/29

  • 8/2/2019 Preston Design BackupSD 03

    24/29

    Hosted by

    Library Size - slots (all tape environment) Should hold allonsite tapes

    On-site tapes automatically expire and get

    reused

    Only offsite tapes require phys. mgmt.

    Should monitor library via a script to ensure

    that each pool has enough free tapes before

    you go home

    Watch for those downed drive messages

  • 8/2/2019 Preston Design BackupSD 03

    25/29

    Hosted by

    Library Size - slots (disk/tape environment)

    Do all backups to disk wherever possible.

    Library only needs to hold the latest set of

    copies (three or four days worth).

    Disk-based backups automatically expire and

    space gets reused.

    Only off-site tapes require phys. mgmt.

    Should monitor library and diskvia a script toensure that each pool has enough free space

    before you go home

    Watch for those downed drive messages

  • 8/2/2019 Preston Design BackupSD 03

    26/29

    Hosted by

    Configuring your server

    Backup all drives.

    Make sure you are streaming your drives.

    Create an automated monitoring system.

    Establish standards wherever possible,and use them!

  • 8/2/2019 Preston Design BackupSD 03

    27/29

    Hosted by

    Resources

  • 8/2/2019 Preston Design BackupSD 03

    28/29

    Hosted by

    Resources

    Directories of products to help you

    build a better backup system

    http://www.storagemountain.com

    Send questions to:

    [email protected]

    http://www.storagemountain.com/http://www.storagemountain.com/
  • 8/2/2019 Preston Design BackupSD 03

    29/29

    Hosted by

    Thank you!

    W. Curtis PrestonPresident/CEO

    The Storage Group