it matters data storage 2014. topics current storage infrastructure backup and restore handy...
TRANSCRIPT
![Page 1: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/1.jpg)
IT Matters
Data Storage 2014
![Page 2: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/2.jpg)
University of Adelaide 2
Topics
• Current Storage Infrastructure• Backup and Restore• Handy Information and Techniques• Storage Future
![Page 3: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/3.jpg)
University of Adelaide 3
Current Storage Infrastructure
• Mainly consists of NetApp Storage (www.netapp.com)– FAS 6240’s
• Home/Shared Folders (U:\ and S:\)• Staff Email (Exchange Mailboxes)• TRIM Records Management• MyMedia Streaming Data• Majority Server Storage• Uptime is vital!
– FAS 3250’s• Databases (Peoplesoft/Access Adelaide/MyUni)• Uptime is vital!
– FAS 2240’s• Lower Cost Storage
![Page 4: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/4.jpg)
University of Adelaide 4
Current Storage Infrastructure
• FAS 6240
![Page 5: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/5.jpg)
University of Adelaide 5
Current Storage Infrastructure
• FAS 3250
![Page 6: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/6.jpg)
University of Adelaide 6
Current Storage Infrastructure
• FAS 2240
![Page 7: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/7.jpg)
University of Adelaide 7
Current Storage Infrastructure
• How much data?– Total Capacity: 1000TB+ usable.– Data Transfer Rates: 880MB/s.– Usage Numbers:
• 20TB of Email (Staff) – 128,368,337 emails.• 49TB of Home Folders – 84,763,414 files and folders.• 26TB of Shared – 39,266,782 files and folders.
![Page 8: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/8.jpg)
University of Adelaide 8
Current Storage Infrastructure
• Enterprise Support – 24/7 – Substantial Cost– Proactive Maintenance
• Guaranteed Compatibility– The storage system is guaranteed to integrate
effectively with other components of our IT infrastructure.
![Page 9: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/9.jpg)
University of Adelaide 9
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)– Deduplication
Duplication Enabled
U:\ Drive Storage
![Page 10: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/10.jpg)
University of Adelaide 10
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)– Thin Provisioning
Storage AdminUsers
Wow, so much storage! :D
Only going to buy enoughstorage to store actualdata! This should do:
Saved Data
Money Saved!
Saved Data
CRAP!
![Page 11: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/11.jpg)
University of Adelaide 11
Current Storage Infrastructure
• Data Efficiencies (Cost Benefits!)– Thin Provisioning– Capacity on Demand (COD)
Storage AdminUsers
Wow, so much storage! :D
Only going to buy enoughstorage to store actualdata! This should do:
Saved DataSaved Data
CrisisAverted!
Lets save all the data!
Data increasing.. Stress rising! Better enableCOD.
![Page 12: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/12.jpg)
University of Adelaide 12
Current Storage Infrastructure
• Data Protection– Has a whole topic coming next!
• High Reliability– Hardware Redundancy (two of everything)
• Plus many more..– Performance– Manageability (Provisioning/Monitoring/Reporting)
![Page 13: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/13.jpg)
University of Adelaide 13
Backup and Restore
What is a Backup?
A second copy of data!
Main purpose:Recover data from large scale corruption, equipment failure or disaster scenarios...
![Page 14: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/14.jpg)
University of Adelaide 14
Backup and Restore
Disasters won’t happen to us? Think again!
![Page 15: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/15.jpg)
University of Adelaide 15
Backup and Restore
Any other uses?!
Alternate usage:Recover individual emails or files from particular points of time in the past. Alternate usage, but most common.
![Page 16: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/16.jpg)
University of Adelaide 16
Backup and Restore - Tape
• Backup-To-Tape:– Long term retention.– Slow to restore data.
![Page 17: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/17.jpg)
University of Adelaide 17
Backup and Restore - Tape
• Backup-To-Tape:– Long term retention.– Slow to restore data.
U:\ Drive
S:\ Drive
Email Tape Library
GeographicallyRemote
Data Centre 1 Data Centre 2
Aged 8 weeks
![Page 18: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/18.jpg)
University of Adelaide 18
Backup and Restore – “Local” Disk• Backup-To-Disk:
– Reduced disk cost and smart software making this possible.– Fast to access!– We utilise backup-to-disk in a couple ways, Local and Remote backups.
“Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.
Storage without Snapshots
Time (Days)
1010101 1010101011110
101010111110011
10101001010100100
101010101001010100110011
10101
“Bugger”
![Page 19: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/19.jpg)
University of Adelaide 19
Backup and Restore – “Local” Disk• Backup-To-Disk:
– Reduced disk cost and smart software making this possible.– Fast to access!– We utilise backup-to-disk in a couple ways, Local and Remote backups.
“Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept.
Storage with Snapshots
Time (Days)
1010101 1010101011110
101010111110011
10101001010100100
101010101001010100110011
10101
Snapshot 1 Snapshot 2 Snapshot 3 Snapshot 4 Snapshot 5
Snapshots protect the data!
“Bugger”“Snapshots!”
![Page 20: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/20.jpg)
University of Adelaide 20
Backup and Restore – “Remote” Disk#1 “Remote” Disk Backups: Quick Disaster Recovery!Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre.
U:\ Drive
Primary DataCentre
S:\ Drive
Active Connections
FAS 6240
U:\ Drive
Secondary DataCentre
S:\ Drive
FAS 6240
Changes made toData are copied to
Secondary Data Centre(Twice a day)
Active Connections
Data is a maximum of 24 hours out of date.
![Page 21: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/21.jpg)
University of Adelaide 21
Backup and Restore – “Remote” Disk#2 “Remote” Disk Backups: Making File and Email Restores easy!Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre.
U:\ Drive
Primary DataCentre
Active Connections
FAS 6240
U:\ Drive
Secondary DataCentre
FAS 2240
Changes made to data, copied to Secondary Data Centre (Once a day)
Manual Connections
Efficient Backup Software
Email Admin
![Page 22: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/22.jpg)
University of Adelaide 22
Backup and Restore
• Important:– Missing Data? Call Service Desk as soon as possible.– Never delete required data, assuming it’ll just get restored from
backup.– Local Computer Hard Disc, not backed up!
![Page 23: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/23.jpg)
University of Adelaide 23
Handy Information and Techniques• Secure Data Transfers and Remote File Access
– AARnet CloudStor (https://cloudstor.aarnet.edu.au/sender/)• Secure data transfer to anyone with an email address.
– University Virtual Private Network (https://vpn.adelaide.edu.au/)• Secure data access to R:\, S:\ and U:\ drives for all UofA affiliated users.
![Page 24: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/24.jpg)
University of Adelaide 24
Handy Information and Techniques• Big Datasets
– AARnet CloudStor+ (https://cloudstor.aarnet.edu.au/plus)
– eResearchSA (http://www.ersa.edu.au/data)
• Data Collaboration– AARnet CloudStor+– Shared Data Drive (S:\)– Low Cost Storage (R:\)
• More information on research data management:
http://libguides.adelaide.edu.au/researchdata
![Page 25: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/25.jpg)
University of Adelaide 25
Handy Information and TechniquesWhat about Cloud Storage?
• Would the Cloud provider tell you if they were hacked and your data was stolen?
• Is your data being backed up?
• Is your data being shared with advertising companies?
• What happens if the Cloud provider goes bankrupt or is taken over?
• Are employees of the Cloud provider allowed to view and share your data?
![Page 26: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/26.jpg)
University of Adelaide 26
Handy Information and TechniquesWhat about Cloud Storage?
Some privacy policies:
“When you upload or otherwise submit content to our Services, you give Google (and those we work with) a worldwide license to use, host, store, reproduce, modify, create derivative works … communicate, publish, publicly perform, publicly display and distribute such content.” – Google, April 2014
“In the event of a reorganization, merger, or sale we may transfer any and all personal information we collect to the relevant third party.” – Apple, March 2014
“If we are involved in a reorganization, merger, acquisition or sale of our assets, your information may be transferred as part of that deal. We will notify you (for example, via a message to the email address associated with your account) of any such deal and outline your choices in that event.” – DropBox, March 2014
More information about keeping data secure:http://www.adelaide.edu.au/technology/secureit/data/
![Page 27: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/27.jpg)
University of Adelaide 27
Storage Future
• What’s on the horizon.
– Bigger S:\ drive allocations
– Smarter Archiving
– Cloud Integration for Data Storage• Ability to access your files any device, any time, any way.• Ease of collaboration.
– Research Data Reforms (via eResearch Strategy)• Associate Director Research IT Strategy (David Munro)
– Identify-Classify-Protect! (Data Classification Campaign - Secure IT)
![Page 28: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/28.jpg)
Questions?IT Matters – 2014 Storage
![Page 29: IT Matters Data Storage 2014. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2](https://reader037.vdocument.in/reader037/viewer/2022103015/551a9a75550346761a8b5cb0/html5/thumbnails/29.jpg)
IT Matters
THANKS FOR LISTENING!