active data pools
TRANSCRIPT
-
8/2/2019 Active Data Pools
1/45
2009 IBM Corporation
Using TSM Active Data Pools for On-Site andOff-Site Backup and Restore
Dave Daun
IBM Advanced Technical [email protected]
-
8/2/2019 Active Data Pools
2/45
IBM Advanced Technical Support
2009 IBM Corporation2
Agenda
Overview of Active Data Pools
Defining Active Data Pools
Removing Inactive Files from an Active
Data PoolRestoring from Active Data Pools
Restrictions and Potential Issues
Active Data Pools Offsite Volumes
Implementation Ideas
Demonstration
-
8/2/2019 Active Data Pools
3/45
IBM Advanced Technical Support
2009 IBM Corporation3
Active Data Pools
New feature in TSM 5.4
Long standing requirement from the TSM community
New Storage Pool Type
Only for Backup data
Only for Sequential Access pools
Implementation is similar to Copy Storage Pools Restore will come automatically from the Active Data Pool
Why use Active Data Pools
Faster restore of data
Useful for disaster recovery Minimizes tape mount activity during restore
New function in TSM V6
Offsite functions using Disaster Recovery Manager (DRM)
-
8/2/2019 Active Data Pools
4/45
IBM Advanced Technical Support
2009 IBM Corporation4
TSM Pool Types
Random Disk Sequential Disk
(FILE)
Primary
Copy Pool
ActiveData Pool
Sequential TapeSequential Disk
(FILE)
Sequential Tape Sequential Disk
(FILE)
Sequential Tape
-
8/2/2019 Active Data Pools
5/45
-
8/2/2019 Active Data Pools
6/45
IBM Advanced Technical Support
2009 IBM Corporation6
Removing Inactive Versions from Active Data Pools
Inactive versions in a Active Data Pool are treated as expired files
Version is inactivated when a new backup version is receivedfrom the client
Reclamation removes inactive versions from Active Data Pools
Reclamation must be run regularly
MOVE DATA or MOVE NODEDATA will also remove inactive
versions from an Active Data Pool RECONSTRUCT defaults to YES on MOVE DATA or MOVE
NODEDATA in an Active Data Pool
-
8/2/2019 Active Data Pools
7/45
IBM Advanced Technical Support
2009 IBM Corporation7
Active Data Pools Disk vs. Tape
Benefits of Active Data Pools on sequential disk
Optimized access to active versions for fast restore
Reduced size of disk pool if only active versions are stored
Reduced data movement in preparation for restore of active data
Benefits of Active Data Pools on sequential tape
Reduced storage requirement (onsite or offsite) while protecting dataagainst media failure or disaster
Simplified tape management because of fewer tapes
-
8/2/2019 Active Data Pools
8/45
IBM Advanced Technical Support
2009 IBM Corporation8
Defining an Active Storage Pool
Define the pool DEFINE STGPOOL ACTIVE_POOL POOLTYPE=ACTIVEDATA
Add the active data pool to an existing primary pool definition (optional)
UPDATE STGPOOL PRIM_POOL ACTIVEDATAPOOLS=ACTIVE_POOL
Schedule a command to copy from the primary pool to the active pool
COPY ACTIVEDATA PRIM_POOL ACTIVE_POOL MAXPROC=4
Create a new policy domain to enable active data pools (or update anexisting domain)
DEFINE DOMAIN ACT_DOMAIN
ACTIVEDESTINATION=ACTIVE_POOL
-
8/2/2019 Active Data Pools
9/45
IBM Advanced Technical Support
2009 IBM Corporation9
Controlling Which Nodes Use Active Data Pools
Policy Set
Policy Domain
ACTIVEDESTINATION
Management Class
Copygroup
NODES
Active Pool
Primary Pool
-
8/2/2019 Active Data Pools
10/45
IBM Advanced Technical Support
2009 IBM Corporation10
Controlling Which Nodes Use Active Data Pools
1. Use an existing domain:
Simply use the UPDATE DOMAIN command and specify the list ofactive-data pools in the ACTIVEDESTINATION parameter.
2. Restrict which nodes can write to an active-data pool:
Decide which nodes are critical and should use Active Data Pools
Define a new domain and specify the list of active-data pools in the
ACTIVEDESTINATION parameter.
Update the node definitions to assign the nodes to the new domain
Complete the policy structure (copy it if possible)
-
8/2/2019 Active Data Pools
11/45
IBM Advanced Technical Support
2009 IBM Corporation11
Getting Active Versions Into an Active Data Pool
Using simultaneous copy (not available for LAN-Free)
New parameter on DEFINE and UPDATE STGPOOL commandACTIVEDATAPOOLS
Specifies the names of active-data pools where the server
simultaneously writes data during a client backup operation. The combined total number of storage pools in the COPYSTGPOOLS
and the ACTIVEDATAPOOLS cannot exceed three.
COPY ACTIVEDATA command
Use this command to copy active versions of backup data from aprimary storage pool to an active-data pool.
Similar to BACKUP STGPOOL
Should be used in addition to simultaneous copy
-
8/2/2019 Active Data Pools
12/45
IBM Advanced Technical Support
2009 IBM Corporation12
Removing Inactive Files from an Active Data Pool
When a file is deactivated, the logical occupancy of the volume it isstored on is reduced by the size of the file. This causes reclamation torun sooner for the volume.
Reclamation (with aggregate reconstruction) is used to remove
inactive files from the active data pool. Reconstruction will build the new aggregate by copying just the active
files and not any deleted or inactive files.
The COPY ACTIVEDATA command and MOVE DATA/NODEDATAcommands will reconstruct aggregates as they are copied or moved
within an active-data pool. Do not specify RECONSTRUCT=NO onthe MOVE DATA/NODEDATA commands when dealing with active-data pools.
-
8/2/2019 Active Data Pools
13/45
IBM Advanced Technical Support
2009 IBM Corporation13
Collocation of Active Data An Example
Client
Active data pool
A0 B0 C0 D0
A0 B0 C0 D0
A0 B0 C0 D0
1. Client backs up A0, B0, C0, D0 to primary pool
with simultaneous write to active data pool.
Server
Active/inactiveprimary pool
B1A0 B0 C0 D0 E1
Client Server
B1 E1
B1A0 B0 C0 D0 E1
B1A0 B0 C0 D0 E1
2. Client backs up B1, E1 with simultaneous
write to active data pool. B0 deactivated.
B1A0 B0 C0 D0 E1
Client Server
B1A0 B0 C0 D0 E1
B1A0 C0 D0 E1
3. Reclamation removes inactive B0 fromactive data pool.
B1A0 B0 C0 D0 E1
Client Server
B1A0 B0 C0 D0 E1
B1A0 C0 D0 E1
4. Client restores active files A0, C0, D0, B1,and E1 from active data pool.
A0 C0 D0 B1 E1
Active/inactiveprimary pool
Active/inactiveprimary pool
Active/inactiveprimary pool
Active data pool Active data pool
Active data pool
-
8/2/2019 Active Data Pools
14/45
IBM Advanced Technical Support
2009 IBM Corporation14
Client data restore when using Active Data Pools
When restoring client data, the server will select the activeversion of a file from an Active Data Poll whenappropriate. The restore order has been modified toinclude Active Data Pools:
1. Active Data Pool (FILE)
2. DISK (random)
3. FILE (primary or copypool)
4. Active Data Pool sequential tape onsite.
5. Sequential onsite-volume (primary, copy or Active DataPool), priority considers: mounted(idle) -> automated ->manual
-
8/2/2019 Active Data Pools
15/45
IBM Advanced Technical Support
2009 IBM Corporation15
Restoring Volumes or Storage Pools with Active Data Pools
Two new parameters on the RESTORE STGPOOL andRESTORE VOLUME commands:
ACTIVEDATAONLY
Specifies that active versions of backup files are to be restored
from active-data pools only.
ACTIVEDATAPOOL
Specifies the name of the active data pool from which the activeversions of backup files are to be restored. If this parameter is
not specified, files are restored from any active data pool inwhich active versions of backup files can be located.
Note: Inactive files cannot be restored from active datapool and will be deleted from the primary pool (when thevolume is deleted)
-
8/2/2019 Active Data Pools
16/45
IBM Advanced Technical Support
2009 IBM Corporation16
Active Data Pools - The Q OCC and Q CONTENT commands
Query Occupancy Command:
Number of Files
Reduced when non-aggregated files are deleted duringdeactivation
Reduced by number of logical files only when aggregate is deleted
Physical Size reflects the actual size of the aggregates (as itdoes today)
Logical Space Occupied
Reduced by size of logical file being deleted
Reduced by size of logical file that is removed during reclamation(reconstruction)
Query Content Command:
Will show all logical files in an aggregate regardless if it hasbeen removed
-
8/2/2019 Active Data Pools
17/45
IBM Advanced Technical Support
2009 IBM Corporation17
Active Data Pools Restrictions and Potential Issues
Can only be used for Backup data, not Archive data or HSM data
NDMP Backups do not go to Active Data Pools
A point-in-time restore will not use Active Data Pools
Must plan for time needed to do active data copies Concurrent copies may be slower
COPY ACTIVEDATA may be an additional process
COPY ACTIVEDATA runs somewhat slower than BACKUPSTGPOOL
Difference is due to additional processing needed to verify theactive/inactive state of logical files in aggregates and actaccordingly.
Must check ownership of files and see of Node is authorized to
used Active Data Pools for each file
-
8/2/2019 Active Data Pools
18/45
IBM Advanced Technical Support
2009 IBM Corporation18
Active Data Pools for Off-Site
Active Data Pool volumes will be processed by the PREPAREcommand and by the Query DRMedia and MOVE DRMediacommands
Active Data Pool volumes can have an access mode of OFFSITE
Active Data Pool volumes with an access mode of OFFSITE will usethe off-site reclamation process (data is read from Primary Poolvolumes)
The implementation is nearly identical to Copy Storage Pools
S
-
8/2/2019 Active Data Pools
19/45
IBM Advanced Technical Support
2009 IBM Corporation19
Active Data Pools for Off-Site - Command Changes
SET DRMACTIVEDATASTGPOOL New command
QUERY DRMSTATUS Output now shows Active Pools
UPDATE VOLUME - no change OFFSITE for ADP volumes
MOVE DRMEDIA new parm: ACTIVEDATASTGPOOL=
PREPARE new parm: ACTIVEDATASTGPOOL=
QUERY DRMEDIA new parm: ACTIVEDATASTGPOOL=
IBM Ad d T h i l S
-
8/2/2019 Active Data Pools
20/45
IBM Advanced Technical Support
2009 IBM Corporation20
Active Data Pool Implementation Ideas
Use an Active Data Pool as a substitute for disk onlypool
Reduces the size of the disk requirement
Faster restores from disk (non-point-in-time restores)
BackupsActive
Pool
Primary
Pool
Tape
Copy
Pool
(for offsite)
Migration
IBM Ad d T h i l S t
-
8/2/2019 Active Data Pools
21/45
IBM Advanced Technical Support
2009 IBM Corporation21
Active Data Pool Implementation Ideas
Use an Active Data Pool for on-site media recovery
Reduces the size of the tape requirement
Faster restores from tape (non-point-in-time restores)
BackupsActive
Pool
Primary
Pool
Tape
Copy
Pool
(for offsite)
Migration
IBM Ad d T h i l S t
-
8/2/2019 Active Data Pools
22/45
IBM Advanced Technical Support
2009 IBM Corporation22
Active Data Pool Implementation Ideas
Use an Active Data Pool as a staging area for an
anticipated restore
Reduces the size of the disk staging area
Faster restores when enough time is available to perform thestaging operation
Use a special Policy Domain to enable a single node copy
BackupsActive
Pool
Primary
Pool
Tape
Copy
Pool
(for offsite)
Migration
Copy when needed
IBM Ad d T h i l S t
-
8/2/2019 Active Data Pools
23/45
IBM Advanced Technical Support
2009 IBM Corporation23
Active Data Pool Implementation Ideas
Use an Active Data Pool as a staging area for recurringBackupset generation
Reduces the number of tape mounts needed for Backupsetgeneration
Use Policy Domain to restrict Active Pool to only those nodesthat need Backupsets
Backups
Active
Pool
Primary
Pool
Tape
Copy
Pool
(for offsite)
Migration
Backupsets
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
24/45
IBM Advanced Technical Support
2009 IBM Corporation24
Active Data Pool Implementation Ideas
Use an Active Data Pool for off-site vaulting
Reduces the size of the off-site tape requirement
Faster disaster restores from tape (very few inactivefiles on the disaster tapes)
Use DRM to manage off-site Active Data Pool volumes
Backups
Active
Pool
(for off-site)
Primary
Pool
Migration
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
25/45
IBM Advanced Technical Support
2009 IBM Corporation25
Active Data Pool Implementation Ideas
Use an Active Data Pool as an electronic vaulting target
Reduces the amount of data which must be stored in theremote location
Faster disaster restores
Replaces the Copy Storage Pool
Use DRM to manage the off-site volumes
BackupsActive
Pool
Primary
Pool
Migration
ExtendedSAN
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
26/45
IBM Advanced Technical Support
2009 IBM Corporation26
Active Data Pool Demonstration
Server Layout
DISKPOOL1
Random
Primary Pool
DISKPOOL2
Random
Primary Pool
ACTPOOLSequential
Active Data Pool
POOL101
POOL102
POOL201
STGPOOL VOLUMES
VOL001VOL002
..
VOL014
DEVCLASS
DISK
ACTDEV
NODE
ACTNODE1
(ACTDOM1)
ACTNODE2
(ACTDOM2)
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
27/45
IBM Advanced Technical Support
2009 IBM Corporation27
Active Data Pool Demonstration
Server Scripts
FILEVOLS displays the status, utilization and percent reclaimable ofthe ACTPOOL volumes
RECLAIM runs reclamation on the ACTPOOL with a threshold of 10%
ACTLOG5 displays the last five minutes of Activity Log records
Windows Scripts
Touchfiles updates the last access date of specified number of files
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
28/45
IBM Advanced Technical Support
2009 IBM Corporation28
Active Data Pool Demonstration
Highlights
Backup repeatedly and run reclamation to see theinactive files removed from the active pool
Backup with concurrent copy to the active pool Use the COPY ACTIVEDATA command to populate the
active pool
Restore data from an active data pool
Perform off-site storage pool reclamation
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
29/45
IBM Advanced Technical Support
2009 IBM Corporation29
Active Data Pools Q DOMAIN
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
30/45
IBM Advanced Technical Support
2009 IBM Corporation30
Active Data Pools Q STGPOOL
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
31/45
IBM Advanced Technical Support
2009 IBM Corporation31
Active Data Pools Q STGPOOL
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
32/45
IBM Advanced Technical Support
2009 IBM Corporation32
Active Data Pools COPY ACTIVEDATA
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
33/45
IBM Advanced Technical Support
2009 IBM Corporation33
Active Data Pools The FILEVOLS Script
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
34/45
IBM Advanced Technical Support
2009 IBM Corporation34
Active Data Pools Day 1: First Incremental
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
35/45
pp
2009 IBM Corporation35
Active Data Pools Day 1: First Incremental
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
36/45
pp
2009 IBM Corporation36
Active Data Pools Day 2: Subsequent Incremental
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
37/45
pp
2009 IBM Corporation37
Active Data Pools Day 2: Subsequent Incremental
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
38/45
pp
2009 IBM Corporation38
Active Data Pools Day 2: Reclamation
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
39/45
2009 IBM Corporation39
Active Data Pools Day 2: After Reclamation
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
40/45
2009 IBM Corporation40
Active Data Pools Day 3: After Reclamation
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
41/45
2009 IBM Corporation41
Active Data Pools Client Restore
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
42/45
2009 IBM Corporation42
Active DataPools
Actlog forClient Restore
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
43/45
2009 IBM Corporation43
Active Data Pools Offsite Reclamation
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
44/45
2009 IBM Corporation44
Active Data Pools Offsite Reclamation
IBM Advanced Technical Support
-
8/2/2019 Active Data Pools
45/45
Questions???