cisco data center networking … data center networking architecture ... ulrich hamm [email protected]...

1© 2005 Cisco Systems, Inc. All r ights reserved. Cisco PublicBusiness Ready Data CenterArchitecture

CISCO DATA CENTER NETWORKING ARCHITECTURE

A STRATEGIC NETWORKING FOUNDATION FOR THE NEW DATA CENTER

Ulrich Hamm [email protected] Center Team

2© 2005 Cisco Systems, Inc. All r ights reserved.Business Ready Data CenterArchitecture Cisco Public

Agenda

• Data Center Challenges and Trends• Cisco Data Center Networking Architecture• Addressing Key Data Center Challenges• Summary• Cisco on Cisco


Key Data Center Infrastructure Challenges and Trends

Controlling

Costs

Application

Service LevelsBusiness

Responsiveness

Compliance and

ResilienceInformation

Management

Business

Challenges

Current Infrastructure

TCO

RESILIENCE

AGILITY

Inconsistent Security

Inconsistent DR

Isolated Application Silos

Rigid Infrastructure Silos

Under- utilized Resources

Operational Complexity and Inefficiency

NewInfrastructure

TCO

RESILIENCE

AGILITY

Integrated, Multi- layer Security

Tiered Storage and Business Continuance

Service Oriented Architecture and

Infrastructure

Highly- utilized Pooled Resources

Dynamic Provisioning

Standard Operating Environment


Evolution of the Data Center InfrastructurePhased Approach

AUTOMATION

Storage

Network

Compute

Dynamic Provisioning and Information Lifecyle Management (ILM) to

Enable Business Agility

Business PoliciesOn- Demand

Service OrientedVIRTUALIZATION

StorageNetworkCompute

EnterpriseApplications

Management of Resources Independent of Underlying Physical Infrastructure to

Increase Utilization, Efficiency and Flexibility

Data Network

Server Fabric

Network

Centralization and Standardization to

Lower Costs, Improve Efficiency and Uptime

CONSOLIDATION

LANWANMAN

SAN

Storage Network

Intelligent Information

Network

HPCCluster

GRID


Infrastructure Standardization and Consolidation Server- Centric to Service- Centric

Server ProcessingI/ O Storage Applications

Monolithic Proprietary Compute Silos

User Access Network

Service- Centric Model“Pools” of standardized resourcesAssembled On- Demand to create

“Virtual Infrastructure” out of piece- parts

DATA CENTER

NETWORK

User Access Network

Shared Application Services

Pooled Compute

ResourcesPooledStorage

Resources

1. Virtual Machines

2.

3. Compute Networks

4.

3.

1.

2. Storage Networks

4. I/ OConsolidation


PooledStorage

Resources

Consolidated Data CenterBased on an Intelligent Data Center Network Platform

• Integrated data center technologies and services

• One network, many services

• Single point of management

• Resilience with Security and Stateful Redundancy

UserAccess Network

Shared Application

Services

Pooled Compute

Resources

Application Application Optimization Optimization

ServicesServicesSecurity Security ServicesServices

1 and 10 Gigabit Ethernet

Fibre Channel

Infiniband

Roles Based Administration and Provisioning

Compute Compute ServicesServicesStorage Storage

Fabric Fabric ServicesServices

Consolidated Data Center Fabric

Open API’s


Agenda



Server FabricServices

INT

ER

CA

TIV

ESE

RV

ICE

S L

AY

ER Data Center Services

Compute ServicesCompute Services Storage Fabric ServicesStorage Fabric Services

DC SecurityDC SecurityDC L4- 7 SwitchingDC L4- 7 Switching

NE

TW

OR

KE

DIN

FRA

STR

UC

TU

RE

LA

YE

R

Compute NetworkCompute Network Storage NetworkStorage Network

Server FabricServer Fabric SwitchingSwitchingStorage Storage

SwitchingSwitchingOptical Optical

TransportTransport

Application/ Content ServicesApplication/ Content ServicesApplication Velocity SystemApplication Velocity SystemWide- Area File ServicesWide- Area File Services

Application Optimization

Fabric M

anag

er Netw

ork

Man

agem

ent

Fabric M

anag

er Netw

ork

Man

agem

ent

VFram

e Virtu

alization

and

Pro

visio

nin

gV

Frame V

irtualizatio

n an

d P

rov

ision

ing

Executing on the Data Center Network Architecture with Innovation, Partnerships and Acquisitions

MDS Family

Wide Area File Services

Application Velocity Engine

Firewalls, Intrusion Protection, Security

Agents

Virtualization, Replication, Virtual

Fabrics

Server Load Balancing, SSL Offload

Topspin

SFS Family

RDMA, Virtual I/ O, Low Latency Clustering

Catalyst Family ONS Family

Content Services


EMPLOYEE / PARTNER / CUSTOMER ACCESS

NETWORK

InternetMPLS VPNIPSEC/ SSL VPN

Gig E, 10 Gig E

Catalyst 6500

Network Attached Appliances

Storage &Tape Arrays

SONET/ SDHxWDM

Metro EthernetFCIP

FC, FICON, iSCSI, FCIP

MDS 9500

ONS 15000

DATA CENTERINTERCONNECT

NETWORK

NAS Caches

Infiniband

SFS 3000 Enterprise Grids

Virtual Server Clusters

Blade ServersUNIX/ NT Servers

Mainframes

Data Center Network Topology

DDOS Guard

Intrusion Prevention

ServerLoad Balancing

SSL Off- load

INTEGRATED NETWORK SERVICES

ApplicationMessageServices

Firewall Services

SERVER FARM NETWORK

FabricAssistedApplications

Data ReplicationServices

StorageVirtualization

Virtual Fabrics (VSANs)

STORAGE AREA NETWORK

INTEGRATED STORAGE SERVICES

SERVER FABRIC NETWORK

Server Virtualization

Low Latency RDMA Virtual I/ O

Grid/ Utility Computing

INTEGRATED VIRTUALIZATION SERVICES

V


Data Center Networking Lifecycle Services

Prepare

PlanOptimize

Operate Design

Implement

Deploying best practice configurations for easier manageability of networks

Delivering Network Investment Protection to maximize ROI

Planning for Peak Network Performance to protect mission-critical application traffic

Delivering a Technology Vision and Consultancy Services to optimize current resources and plan for future network growth

Designing agile, resilient, scalable, and highly available networks for greater service velocity and minimal impact of outages

Performance Evaluation, Architecture Planning, and Skills Assessments to reduce cost and Complexity

SAN Extensio

n Support

OpticalInfrastructure

RemoteDeployment

Support

DNS DesignKnowledge

Transfer andMentoring

MDS SubjectMatter Expert(SME)

Service

HTTP Performance Analysis

SAN Network

ArchitectureAssessment


Ease Deployment, Reduce Risk, Improve Resilience with Data Center Networking Design Best Practices

www.cisco.com/ go/ datacenter


Cisco Data Center Network Architecture Backed by Key Partners

• Storage consolidation—MDS 9000• Storage virtualization—EMC

Invista• Business continuance—ONS

15000• File server consolidation— WAFS

and Celerra

Reducing Cost and Complexity Through Information Lifecycle Management

Enabling Business Transformation to an On- Demand Operating Environment

• Server consolidation—Infiniband and GE Switch—Blade center

• Storage consolidation— virtualization engine

• End- to- end provisioning—IBM Tivoli provisioning manager

• Server optimization— e- workload manager

• Remote data replication—FCIP• Synchronous data replication DWDM• Server consolidation—GE and

Infiniband Switch for Blade server• Storage consolidation—MDS 9000

Protecting Against Outages with a Disaster Tolerant Framework


Agenda



Addressing Key Data Center ChallengesCost, Resilience and Flexibility

• Storage Consolidation and Virtualization • Proliferation of Server I/ O Connections• File Server Proliferation in Branches• Cost Effective High Performance Computing• Business Continuance and Compliance• Web Application Performance Challenges• Data Center Virtualization


Challenge: Storage and SAN Island Proliferation

Island A

Island B

Island C

• Extra ports ($$) due to dedicated ISLs

• Extra Administrators ($$) to manage extra switches

• Extra time ($$) to expand existing islands

Cost

• Cannot move ports from one island to another

• Extra time to provision new SAN island – complete new infrastructure

Flexibility



FC, FICON, iSCSI, FCIP

MDS

9500


Mainframes

Data Center Network Architecture Solution: Storage Consolidation and Virtualization

• Fully- redundant platform (MDS 9500)

• Non- disruptive software upgrades

• Stateful switchovers• Fault- Isolation with VSANs

Mission- Critical Availability

• Provides standard- based API to 3 rd party virtualization engines

• Enhances performance and transparency by hosting virtualization in the fabric

Virtualization Platform

• Integrated FC, FCIP, FICON, iSCSI

• Common set of features • Unified provisioning and

management

Multi- protocol Connectivity

• 1.44 Tbps switching bandwidth

• 224 FC ports in 14RU (MDS 9509)

• 10G Ready• VSANs and Inter- VSAN

Routing (IVR)

Scalability and Density• Interoperability with legacy

switches• Inter- VSAN Routing (IVR)• Native- mode interop. with

legacy switches

Heterogeneous Fabrics

• Embedded FC Analyzer• FC Ping and FC Traceroute• Remote SPAN (RSPAN)• Hot- spot analysis

Troubleshooting

Virtualization Engine

API


$200

Storage Consolidation - Reduced CostCisco- on- Cisco - Increasing Storage Effectiveness

Co

sts

W/ O MDS 9500Assets

$600

$500

$400

$300

$100

$0

20022002 2003 2004 2005

With MDS 9500Assets

W/ O MDS- 9500Operations

With MDS Operations

Based on 20c/ MB TCO – Gartner


Catalyst 6500

Challenge: Proliferation of Server I/ O Connections

GbE

FC

SAN

Campus/ WAN/ VPN

MDS 9500 Systems

Administrator

LAN

• High TCO of traditional server I/ O model

• Costly NICs & HBAs

Cost

• Server, cable. I/ O changes are complicated

• Not enough I/ O slots to allow use of 1RU servers or blade servers

Flexibility

• Downtime dealing with frequent change

• Cabling bulk interferes with cooling

Resilience

CLUSTER


Catalyst 6500

SFS 3000

Data Center Network Architecture Solution: Consolidation of Server I/ O Connections

GbE

FC

SAN

Campus/ WAN/ VPN

MDS 9500

Consolidated I/ O over IB

Consolidated 5 connections into 1 and 2+ RUs to 1RU

VFrame Provisioning Systems

Administrator

CLUSTER

• Consolidate LAN, SAN and Clustering traffic over a single transport

Lower Cost

• Provision servers and I/ O connectivity on- demand

Increased Flexibility

• Reduced complexity results in higher availability

• Changes no longer require downtime

Improved Resilience


Case Study: Media CompanyImmediate ROI from MFIO

150 ServersStorage Arrays

Ethernet Switches (LAN Connectivity and

Clustering)

Fibre Channel Switches (SAN Connectivity)

Corporate LANs

Cisco 3000 Server Switches

Storage Arrays

150 Servers

Corporate LANs

Cisco 7000 Server Switches

Total Cisco Savings = $329,101 or 48%

150 LAN and SAN Attached Nodes

Before Cisco

With Cisco


Branch Office

Challenge: Distribution of File Servers at Branches

File Storage in the Data Center

WAN/ VPN Network

Local File & Print Server and Backup

File Storage Distributed

Tape Arrays

Files

Storage Arrays

Files

Network Attached Storage Filers

Files

• Cost of maintaining file and print servers at multiple branches

Cost

• Expansion requires system replacement

Flexibility

• Difficulty to implement and maintain consistent, compliant reliable security and back up practices

Resilience

Files

Administrator

Administrator


Branch Office

Data Center Network Architecture Solution: Wide Area File Services

File Storage in the Data Center

WAN/ VPN Network

Local File & Print Server

File Storage Distributed

Core File Engine

Tape Arrays

Files

Storage Arrays

Files

Network Attached Storage Filers

Files

LAN Speeds for Remote Files

• Consolidate files on scalable, centralized NAS• Centralize file administration

Lower Cost

• Dynamic provisioning of additional storage• Universal access to information

Improved Flexibility

• Consistent, compliant security and business continuance best practices

Improved Resilience

Files

Administrator

Administrator


Challenge:Business Continuance and Compliance

ConsolidatedData Center

Remote BranchTelecommuter

WAN/ VPN Network

Server Network

Applications

Storage Network

Data Storage

• Compliance with regulations• Increased business impact of downtime• Lower RPO and RTO needs• Traditional disaster recovery/ backup solutions are insufficient

Requirements

• Traditional business continuance solutions are costly.

• Cost of interconnecting data centers• Cost of scaling solutions to support increases in data and number of systems

Cost


Data Center Network Architecture Solution: Comprehensive Business Continuance Networking

MDS 9500

DWDMNetwork

SONET/ SDH

IP WAN

Metro / Wide Data Center

Interconnect Network

ONS155X

0154x

x

ONS1545

4

7X00



Mainframes

1

3

MDS

9500



Mainframes

Access Access NetworNetwor

kk

• Asynch / Synch Replication, Backup, Point in Time Copy

• Multi- vendor Support: EMC, HP, HDS, IBM, Appliances

• 3 rd Party Appliance Support: SANTap• Network Assisted Serverless Backup

Broad Application Support

• Global Site Selector • VPN – IPSec, SSL, MPLS• Optimized Exit Routing

Continuous Access

• Multi- protocol Transport: FCIP, DWDM, Sonet/ SDH

• Distance / Application Optimization: Write and Tape Acceleration

• Security: FCIP Encryption and FC- SP Auth• WAN Utilization: Compression and Large B2B

Credits• Availability: VSANs and Inter VSAN Routing

Optimized SAN Extension

• Multi- protocol Transport: FCIP, DWDM, Sonet/ SDH

• Distance / Application Optimization: Write and Tape Acceleration

• Security: FCIP Encryption and FC- SP Auth• WAN Utilization: Compression and Large FC Buffers• Availability: VSANs and Inter VSAN Routing

Optimized SAN Extension


LondonLondon

Amsterdam

ParisParis

ONS 15454

SAN 1

SAN 2

SDH RingOC- 48

Cisco 7600

Cisco MDS 9509 w/ IPS

Approx 650km

Approx 1500km

Long Distance Business Continuance

SAN 3

SAN 4

Asynchronous replication through HDS TrueCopy over FCIP


Challenge:Cost Effective High Performance Computing

Research HPCCatalyst 6500

Enterprise HPC

• Universities• Research Labs• Dept of Energy• Dept of Defense• Federal / Intelligence

• Auto Design• Drug Research• Oil Explotation• Aerospace Design• “On- Demand” HPC

• High cost of proprietary supercomputer hardware• Requirement for specialized application development

• Lack of pay as you grow capabilities• Increased low- cost option with higher performance x86 / Linux servers

Cost

Proprietary Supercomputer


Data Center Networking Architecture Solution:Standard- based Server Fabric Switching

Server FabricSwitching

Low- Latency Cluster Interconnect

Catalyst 6500Research HPC

Enterprise HPC

• High performance, low latency, low cost interconnect -

Infiniband• Proven scalability to 4000 nodes• Standard- based • Servers transparently replaced for continuous operation• Prove interoperability with major server vendors

Lower Cost High Performance Computing

• Universities• Research Labs• Dept of Energy• Dept of Defense• Federal / Intelligence

• Auto Design• Drug Research• Oil Explotation• Aerospace Design• “On- Demand” HPCSFS- 7000


Remote Users

Challenge:Consistent Performance of Web Applications

WAN/ VPN Network

APPS ARE TOO SLOW!Remote Branch

Telecommuter

Data Center

• Remote user challenges for HTTP-based Enterprise Applications

• Increased graphic content requires more bandwidth

• Users increasingly mobile = varying access speeds

• Customers often accessing over dial up

Performance


Remote Users

Data Center Networking Architecture Solution: Performance Acceleration with Wide Area Application Services

WAN/ VPN Network

APPS ARE TOO SLOW!Remote

Branch

Telecommuter

Data Center

2x - 5x Faster Application Delivery!

• Dramatically reduces the amount of information sent to the client from the central site.

• Dynamically Caches, Transforms Content, Compresses Content, and Secures the Web With Full- Proxy Functionality.

• Reduces latency and improves responsiveness by handling all redirections

Improved Performance

AVS - 3100


Enabling the Virtualized Data CenterVirtualizing Server, Storage and Network Infrastructure

Virtual Server Clusters

FC, FICON

SERVER FARM NETWORK

INTEGRATED NETWORK SERVICES

Catalyst

Blade, UNIX/ NT Servers,

Mainframes

Storage & Tape Arrays

Pooled Storage Resources

APPLICATION OPTIMIZATION

SERVER FABRIC NETWORK

INTEGRATED VIRTUALIZATION SERVICES SFS 3000SFS 3000

Server Virtualization

Virtual I/ O

V

Clustering

MDS 9500

STORAGE AREA NETWORK

INTEGRATED STORAGE SERVICES

Network Hosted, Assisted, Accelerated Applications

SECURITY SERVICES

• Infiniband Switching• Server I/ O Virtualization• Policy- based Server

Virtualization – VFrame

Compute Virtualization

• SAN Fabric Virtualization – VSAN

• Network- based virtualization – e.g EMC Invista, IBM SVC with MDS Storage Service Module

Storage Virtualization

• Virtual LANs (VLANs)• Virtual Firewalls • Service Chaining and

Virtualization

Virtualized Network Services

• GLB, SSL / IPSec VPN• MPLS

Virtualized User Connectivity

• DWDM, Sonet, • InterVSAN Routing

Virtualized DC Interconnect

VFrameVFrameProvisioningProvisioning


CSM Load Balancer

Servers

VFrame identifies right App / OS Image

From storage

VFrame translates policies to actions

and passes to infrastructure

End- to- end Data Center Provisioning VisionCisco Virtualized Data Center

Catalyst 6500

SAN

Server GRID

SFS 3012

FWSM Firewall

Administrator

MDS 9500

IB

GigE

FC

Campus/ WAN/ VPN

Data Center

Policy

Application: SAP

Performance

Security

Availability

Image

Accounting

Define application services and pass policy to VFrame

VFrame™ VFrame picks server with right criteria to run application and

boots server

VFrame gives new server right VLAN and LUN info so it

can find/ be found by right clients and

storage

VFrame provisions security policies to

FWSM

VFrame provisions CSM to add new server to load balancing poolApplication Service Provisioned!


Agenda



Summary —Cisco Data Center Networking Architecture

Data Center Challenges

• Investment Protection

• Flexible, scalable network

Cisco Data Center Network Architecture Benefits

COMPLIANCECOMPLIANCEAND RESILIENCEAND RESILIENCE

RESPONSIVENESSRESPONSIVENESSTO THE BUSINESSTO THE BUSINESS

INFORMATIOINFORMATION N

MANAGEMENMANAGEMENTT

APPLICATION APPLICATION SERVICES LEVELSSERVICES LEVELS

CONTROLCONTROLCOSTSCOSTS

• End- to- end for simpler operations

• Resource sharing and virtualization

• Architectural approach

• DCN service and support

• Application Optimization

• Enhances business continuance and security

• High availability technologies, designs

• Provides platform for 3 rd party technologies

• Enables Service Oriented Infrastructure (SOI)


Agenda



Cisco’s RZ Umgebung

• 7,000 Server

• 80 Servers per Sysadmin

• Server Umgebung wird weiter wachsen

• Heterogene Umgebung with mit diversen HW Herstellern

• Diverse OS Umgebungen • Cisco IT unterstützt ca. 3 .9

PB storageWachstums- Raten: FY’02= 69%, FY’03= 32%, FY’04= 50%, FY’05= 58%

Solaris 2,526

36%

Windows1,756 25%Linux

2,538 37%

HPUX166 2%

0

500

1000

1500

2000

2500

FY'01 FY'02 FY'03 FY'04 FY'05

DAS

NAS

SAN


Cisco RZ Technologie Roadmap hin zu einem Service Oriented Data Center

• Mixed hosting platforms and OS’s begin move to Linux, Windows

• Multiple infrastructures aligned to BU’s

• Multiple support processes

• Improved storage utilization, management, agility and TCO

• Common, x86 hosting platform

• Storage Virtualization begins

• Common processes

• Improved availability

• Improved utilization, management, agility and TCO

• Server automation begins

20052004 2006 2008

• Consolidated, virtual infrastructure aligned to services

• Intelligent network services

• Policy based server automation

• High availability with low cost components

Service OrientedData Center

Standardisierung VirtualisierungAutomation

LegacyData Center

• Mixed hosting platforms and OS’s

• Infrastructures aligned to BU’s

• Multiple support processes

• Disruptive changes hurt availability

• Poor resource utilization, management, agility and TCO

• Storage Consolidation to SAN islands

20072003Zentralisierung


Ein Beispiel:Benefits durch zentralisiertes RZ Management

Durch das zentrale Managen von verteilten Ressourcen erzielt Cisco signifikante

Einsparungen

$86.8 MGesamte Kumulative Einsparungen

$6.9 MUnity$8.1 MExchange migration$3.8 MDNS/ DHCP

$65.7 MActive directory migration$2.3 MActive directory

management

Jährliche Einsparungen durch zentralisiertes Management

Einsparungsbereiche


Additional Information

http:/ / www.cisco.com/ go/ datacenter

cisco data center networking … data center networking architecture ... ulrich hamm [email protected]...

Documents