- neustrelitzkonferenz-nz.dlr.de/pages/storage2012/present/2. konferenztag/09... · functionality...
TRANSCRIPT
<Insert Picture Here>
<Insert Picture Here>
Evolution und Trends der Storage Technologien
Christian BanduletPrincipal Sales Consultant15/06/12
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3
Oracle’s Complete Storage PortfolioEngineered for Oracle Software
SSD F20 F5100
Tape and Virtual Tape
SL8500SL3000
VSM
SL500
LTOT9840
T10K SL24/48
NAS Storage
Flash Storage
SAN Storage
Axiom 600ZFS StorageAppliances 6000/2500
series
Storage Management: OEM, ASM, DTrace Analytics, CAM, ACSLS, ELSAutomated Tiering: Partitions, SAM QFS, Hybrid Storage Pools, VSMData Reduction: 11g ACO, EHCC, RMAN, ZFSSA Dedup/CompData Protection: Data Guard, RMAN, OSB, ZFSSA Snap/Rep, MaxRepSecurity/Encryption: ASO, Oracle Key Manager, Disk/Tape Encryption
Storage Software
4
EASE
OF
IMPL
EMEN
TATI
ON
Best-of-breed Compute, Storage, Network, Software
Simplicity, Return of Investment
H
IGH
ER
HIGHER
Oracle’s Optimized Solutions(Reference Configurations)
Efficiency: From Best-of-Breed to Engineered Systems... and from Applications to Storage
A typical n x m DC-Architecture requires● n*m Product Skillsets● n*m Management Requirements● n*m Availability and Security Concepts● n*m Product Lifecycles & Service Contracts● mn Solution Stacks
Layer 1
m Products
Layer 2
. . .
Layer n
Integration, Lifecycle Mgmt.
•Are your DC Architecture 'n' & 'm's ● affordable?● sustainable ??● necessary to support your Business ???
Typical Public Cloud Complexity● One Stack
IT Diversity drives Complexity and Cost80% of IT Budget is spent on Maintenance, with Integration being the Lion Share
EASE
OF
IMPL
EMEN
TATI
ON
Best-of-breed Compute, Storage, Network, Software
Simplicity, Return of Investment
H
IGH
ER
HIGHER
Oracle’s Optimized Solutions(Reference Configurations)
Engineered Systems
Efficiency: From Best-of-Breed to Engineered Systems... and from Applications to Storage
SPARC SuperCluster
Engineered Systems – The Family
• Expedited time to value• Easier to manage and upgrade• Lower cost of ownership
ExalyticsExadataDatabaseMachine
ExalogicElastic Cloud
Database Appliance
SPARCSuperCluster
Big Data Appliance
• Reduced change management risk• One-stop support• Extreme performance
Gartner Hype Cycle for Storage Technologies 2011
• Moore’s Law has out-stripped improvements to disk drive technology by two orders of magnitude during the last decade
• Today’s servers are hopelessly unbalanced between the CPUs need for data and the HDDs ability to keep up
HDD vs. CPU Relative Performance Improvement
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
Server and Storage Disconnect
Where to Deploy Flash Storage?
HBA/NIC/HCA/CNA
Fmod
Fmod
Fmod
Fmod
Fmod
Fmod
Fmod
Fmod
Application
OS
Memory
IO
PCIe CTR
L
StorageNetworkStorageNetwork
DR
AMD
RAM
DR
AMD
RAM
DRAM
Fmod
SSDFmod
SSD
Fmod DRAM
Fmod
Fmod
Where to Deploy Flash Storage?
Where to Deploy Flash Storage?www.nvmexpress.org
Application
OS
Memory
IO
HBA/NIC/HCA/CNA
PCIe
FmodFmod
FmodFmod
•Mapping between SCSI and
NVMe specifications
•End-to-end data protection
(compatible with T10 DIF and DIX)
•Support for I/O virtualization
architectures like SR-IOV
Become More Efficient...
Thick Thin Thinner Green Tape Gone
FullProvisioning
ThinProvisioning
ResourceOptimization:Compression
De-DupSingle
InstancingAuto-Tiering
Low rotational HDDs,
Spin DownMAIDFlash
HSM,Archive
Deletion
Resource optimization facilitates: backup to disk with improved restore times, store on Flash, more frequent backups & snapshots, improved RPO/RTO, replication to DR site, reduction of OPEX/CAPEX, longer retention
times on disk, ...
Prosperity Data Shift...
DRAM Flash PerformanceHDD TapeCapacity
HDD
DRAM Flash PerformanceHDD TapeCapacity
HDD
Store Big D
ata forlonger and longer tim
e...
Field Proven Controller Architecture
LoopSwitch
8 7
LoopSwitch
6 5
LoopSwitch
4
LoopSwitch
2 13
LoopSwitch
1 2
LoopSwitch
3 4
LoopSwitch
5
LoopSwitch
7 81
6
Server
Storage
The Vertical Consolidation• Blurring the line between storage and server
Storage
Server
StorageStorage
ServerServer
Storver
Sun ZFSSA Basic Architecture
Solaris/ZFS
iSCSI
TCP/IP
Adapter Driver
SAS ExpanderSAS Expander
SAS HBA SAS HBA
SAS Expander SAS Expander
Solaris/ZFS
SAS HBA SAS HBA
IP
Intelligent Storage Node
Storage Virtualization - PartitioningMake One Box Look Like Hundred Boxes...
Hypervisor
Guest OSData Service
Hardware
CPU Memory NIC HBA
Guest OSData Service ...
The Clustered/Grid Storage (R)evolution
Storage
DAS NAS SAN ClusterGrid
http://en.wikipedia.org/wiki/Swarm_intelligence
Storage Grid ?
Storage Grid & Data AvailabilityData Placement
Storage Node Storage Node Storage Node Storage Node
Storage Node Storage Node Storage Node Storage Node
Storage Node Storage Node Storage Node Storage Node
Storage Node Storage Node Storage Node Storage Node
Object 1
= Data
= Parity
Object 2
Object 3
Storage Grid
Storage Grid & Data AvailabilityReplication
Storage Node Storage Node Storage Node Storage Node
Storage Node Storage Node Storage Node Storage Node
Storage Node Storage Node Storage Node Storage Node
Storage Node Storage Node Storage Node Storage Node
Object 1
Object 2
Object 3
Storage Grid
Resource Lifecycle Management
Storage Grid
Svc1 Svc1 Svc1Svc1 Svc2Svc2 Spare
Storage Grid - expand
Svc1 Svc1 Svc1Svc1
Spare
Storage Grid - repurposed/new services
Svc1 Svc1Svc1
Old
Svc3 SpareNew
Minimal application impactExpand a Storage Grid
Install an elementAuto-discover, bindProvisionRedistribute workload
Decommision elementsDrain dataDe-presentUnbindRetire and de-install
Also applies to replacements/upgrade
New
Host Host Host Host Host Host Host Host
IB FC IP
I/O RoutingI/O Redirection
Single Storage ImageISD ISD
ISDISD
Remote
Global Namespace
Global Namespace ?
NAS Appliancewith NFSv4.1
pNFS extensions
Data
Global Namespace
NAS Appliancewith NFSv4.1
pNFS extensions
Data
NFSv4.1 + pNFS
NFSv4.1
File: NFSv4.1Block: iSCSI, FCP
OSD
one-to-one, stripe, replication, concatenation
MDS
Storage Protocol:SCSI, NFS, OSD
Control Protocol
NFSv4.1 client with pNFS
NFSv4.1 client with pNFS
NFSv4.1 client w/o pNFS
Scalable/Clustered NAS with NFSv4.1 pNFS aka NAS Virtualization
NFS Server NFS Server NFS Server NFS Server
Hybrid Storage Cloud Gateway Appliance
Intelligent Storage Node
HypervisorGuest OS
Data Service
HardwareCPU Memory NIC HBA
Guest OSData Service ...
Hybrid StorageGateway
Appliance
- data can be transparently stored locally or de-staged to the cloud- bridge between on-premises storage systems and a cloud storage Service- public cloud storage providers rely on Internet protocols like REST APIs over HTTP
Cloud ?
NIST Definition of Cloud Computing
Cloud Service Models
Man
aged
by
Prov
ider
Application and Data
Middleware
Database
Operating System
Virtualization
Servers
Storage
Networking
IaaS:- Amazon Elastic Compute Cloud (EC2)- Amazon Simple Storage Service (S3)
- Rackspace- Verizon- AT&T
- GoGrid
Man
aged
by
Prov
ider
Application and Data
Middleware
Database
Operating System
Virtualization
Servers
Storage
Networking
PaaS:- targeted at application
developers- developers control
applications not providers- provides runtime/development
frameworks and tools(authentication, session mgmt,
inter-system integrationtransactional integrity, …)
- deployment of user applications- MS Azure
- Google App Engine- Amazon Elastic Beanstalk
Man
aged
by
Prov
ider
Application and Data
Middleware
Database
Operating System
Virtualization
Servers
Storage
Networking
SaaS:- SAP Business by Design
- Salesforce.com- Application Service Provider (ASPs)
- Email, web conferencing,- productivity suites (e.g. word
processing), collaboration
Oracle Cloud – Unparalleled Depth & Breadth
Oracle
… …
Other Providers
… …
• Comprehensive and integrated set of functional apps supported
• Optimized solutions across the entire IT stack
• SaaS Players: Island solutions with limited ability to support functional expansion (SaaS)
• IaaS/PaaS: Layer solutions without end-to-end optimization
From Compute Centers to Data Centers
Compute
Data Data
Data Data
Data Data
Data Data Data Data
Data
Compute Compute Compute Compute
Compute Compute Compute Compute
Application-Awareness
Server
Application Context
Application
Storage Device
• Application Context:– I/O patterns, data layout, intrusion detection, data
relationships, consumer information, spatial, etc. – e.g. which blocks are stale/empty or belong to a file– e.g. relationships among data, users and applications
Data
Active Storage – Distributed Data ManagementApplication De-compositioning
Storage Device
Application Context
Server
Application Context
Application
• Runs application-specific code– e.g. indexing, search, caching
• Enables adaptive-computing
Application
Data
Ethernet 1, 10 Gbps
IPTCP
iSCSI
InfiniBand
SRP
IPTCPFCIP
FCP*
IPTCPiFCP
FCP*
Fibrechannel
FCP*
1, 2, 4, (8), 10 Gbps 10, 20 Gbps
iSCSI FCoE InfiniBand
iSER
iSCSI
Data Center Ethernet
FCoE
FCP*
SCSI Layer
Operating System / Applications
(1), 10 Gbps
* Includes FC Layer
Encapsulation Technologies
Source: Cisco
InfiniBand Roadmap June'2011http://www.infinibandta.org/content/pages.php?pg=technology_overview
FDR/EDR/HDR/NDR: 64/66 bit encoding; FDR cabling backward compatible with QDR...
“Data is getting BIGGER!!!50%/yr Growth Rate
Source: IDC, White Paper Sponsored by EMC, The Digital Universe Decade - Are You Ready? Doc.# IDC_925, May 2010
*Source: SearchStorage Magazine, July 2011
Fueling the Digital Universe: The Digital Shadow
Source: IDC's Digital Universe Study, sponsored by EMC, June 2011
Y Yotta 10**24 1.000.000.000.000.000.000.000.000 Quadrillion Z Zetta 10**21 1.000.000.000.000.000.000.000 Trilliarde E Exa 10**18 1.000.000.000.000.000.000 TrillionP Peta 10**15 1.000.000.000.000.000 BilliardeT Tera 10**12 1.000.000.000.000 Billion griech. teras, MonsterG Giga 10**9 1.000.000.000 Milliarde griech. gigas, riesigM Mega 10**6 1.000.000 Million griech. mega, großk Kilo 10**3 1.000 Tausend griech. chilioi, tausendh Hekto 10**2 100 Einhundertda Deka 10**1 10 Zehnd Dezi 10**-1 0,1 Zehntel lat. decem, zehnc Zenti 10**-2 0,01 Hundertstel lat. centum, hundertm Milli 10**-3 0,001 Tausenstel lat. mille, tausendμ Mikro 10**-6 0,000.001 Millionsteln Nano 10**-9 0,000.000.001 Milliardstelp Pico 10**-12 0,000.000.000.001 Billionstelf Femto 10**-15 0,000.000.000.000.001 Billiardstela Atto 10**-18 0,000.000.000.000.000.001 Trillionstelz Zepto 10**-21 0,000.000.000.000.000.000.001 Trilliardstel y Yocto 10**-24 0,000.000.000.000.000.000.000.001 Quadrillionstel
e.g. Femtolaser, Femtowaage...
Global Digital Data Growth Growing Leaps and Bounds by 40+% YoY!
Object ID
Data:Structured
Semi-Structured
Unstructured
Metadata owner, permissions, type, last mod. date, ...
Attributes user/application defined
Policies e.g. replication
Methods e.g.encryption
Data For Clouds – File ObjectsA File System Can Handle Any Type Of Data...
Data:Structured
Semi-Structured
Unstructured
Metadata
Traditional Files
FileObjects
Data:Structured
Semi-Structured
Unstructured
Metadata
Attributes
Policies
Methods
ExtendedAttributes
Big Data ?
Accenture Technology Vision 2012
Big Data is a Big Deal
Transactional DataBig Data
Decide
- correlate structuredand unstructured data
- capturing a tweetwith a comment
about your productbecomes more valuable
if you can correlateit with you most valuable
customer...
New Data Source - Predicting
What is my customer going to buy in the future?React in real-time...
What has my customer bought in the past?React in low frequency depending on
data warehouse refresh intervals...
e.g. providing a personalized car insurance plan based on your
unique driving behavior
Big Data Technology Continuum
Oracle Products for Big Data Management
EASE
OF
IMPL
EMEN
TATI
ON
Best-of-breed Compute, Storage, Network, Software
Simplicity, Return of Investment
H
IGH
ER
HIGHER
Oracle’s Optimized Solutions(Reference Configurations)
Engineered Systems
Efficiency: From Best-of-Breed to Engineered Systems... and from Applications to Storage
Oracle’s Complete Storage PortfolioEngineered for Oracle Software
SSD F20 F5100
Tape and Virtual Tape
SL8500SL3000
VSM
SL500
LTOT9840
T10K SL24/48
NAS Storage
Flash Storage
SAN Storage
Axiom 600ZFS StorageAppliances 6000/2500
series
Storage Management: OEM, ASM, DTrace Analytics, CAM, ACSLS, ELSAutomated Tiering: Partitions, SAM QFS, Hybrid Storage Pools, VSMData Reduction: 11g ACO, EHCC, RMAN, ZFSSA Dedup/CompData Protection: Data Guard, RMAN, OSB, ZFSSA Snap/Rep, MaxRepSecurity/Encryption: ASO, Oracle Key Manager, Disk/Tape Encryption
Storage Software
53
<Insert Picture Here>
Evolution und Trends der Storage Technologien
Christian BanduletPrincipal Sales Consultant15/06/12