cisco and smart grid - lehigh universityingrid/workshop_11/taft.pdf · cisco and smart grid ......

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1

Cisco and Smart Grid

Jeffrey D. Taft, PhDCisco Distinguished Engineer

Chief ArchitectCisco Connected Energy Networks

January 2012


Emerging Trends and Cisco’s Interest in Electric Utilties


Utility Business Model Evolution

Energy Delivery +

Energy Information Management

Energy Delivery


Advanced Grid Management Issues

Reduced rotational inertia; more instabilityDistributed Energy Resources/VERStochastic generation

Grid mostly stabilized by inherent rotational inertia Some assistance via ancillary servicesDispatchable generation


Grid Stabilization in the Future Power Grid

“Fly-by-Wire” Power Grids

“Fly-by-Wire” Air Craft

Need for high performance

Must be agile for combat

Unstable by design

Electronically stabilized

Need to integrate new capabilities

Must be agile for reliability

Unstable by evolution

Electronically stabilized


The Grid As An MO/MC System: New ControlsSome elements may reside outside of the utility

Fast and slow time scales: latency hierarchy

Scalar control modes: D-LMP/transactive/ALM control

Active load interactions with grid control systems can be unstable; volatility of grid with price sensitive loads

Reference:“Volatility of Power Grids Under Real Time Pricing”, www.mit.edu/~mardavij/publications_files/Volatility.pdf

http://www.mit.edu/~mardavij/publications_files/Volatility.pdf


Reference ArchitectureOverview


The Technical Architecture Level of the Solution Pyramid Contains the GridBlocks Architecture

GridBlocks Reference Architecture


Cisco Business ArchitectureFoundation of the Pyramid

Innovation

Customer Value Added

Solutions

Information

Services

MarketEnablement

DER Integration

Local MarketOperations

Core

Operational Excellence

Asset Utilization

Operational Effectiveness

Customer Engagement

Customer Experience

Pricing & Programs


The GridBlocks Reference Architecture

Our entire GridBlocks Reference Architecture consists of five parts, all integrated with Cisco technologies, products and services.

Connected Grid Network ArchitectureLayered Network Services ArchitectureIntegrated Comms/Computing/Storage Framework Data/Applications FrameworkSecurity Interlay

This architecture unifies the Connected Grid with Cisco’s core focus elements:

Switching and routing, security, mobility, video and collaboration, data center and virtualizationIt also provides the model to integrate other Cisco technologies


Relationship to Cisco Designs

GridBlocks Reference Model

Tier Drawings

Tier Specifications

Support Documents

ClientSpecific

Solutions

Ref

eren

ce A

rchi

tect

ure Components

StructureProperties

Design and Implementation

Guides

CiscoValidatedDesigns

Abstractions


Cisco GridBlocksReference Architecture

Forward-looking view of preferred end state for utility communications networks, platforms, and security

Starts with an 11 tier reference model of communications for the whole power delivery chain

Helps define the increasing interaction across tiers

Contains architecture for each tier: components, structure, protocols, properties, and standards

Also contains comprehensive security interlay, integrated comms/computing/storage platforms, and advanced network services

ModularUse across differing industry modelsUtility can define large picture then focus on

specific tiers, segments, or functional groups as appropriate


Examples From The GridBlocks Network Architecture


Primary Substation GridBlock with Ring Network

Substation NetworkStation Bus

Substation NetworkMulti-Service Bus / FAN Aggregation

Station bus behind electronic security perimeter for NERC/CIP compliance

Multi-service Ethernet ring to facilitate various traffic typeswhile keeping logically segregation w/station bus traffic

IEC 61850Station

Bus DFRRTU

Distributed Intelligence

Process Bus toSwitchyard Devices Remote Workforce

ManagementPhysical Security

Secondary

WAN

… IED IED … IEDIED

MPLS PE Router

FAN Aggregation

WiMax

Fiber

To Field Area

Router via WiMaxor Fiber

CE Router

Multiservice Bus

ESP

PrimaryWAN

One of several Primary Substation GridBlocks

Ring station bus

Tree station busMulti-drop

station bus

Multiservice bus for enterprise services supportProcess busSecurity interlayFAN aggregation at the substation via various physical layers280 page Design and Implementation Guide


SCADA

EMS

Security Services

NMS

SIEM

Directory Services

Certificate Authority

Identity Services Engine

Access ControlEng

DBMedia Server

Video Analytics

Data Center, Enterprise

Apps

Management, NOC

RTU Relay PMU

Teleprotection Relay

Protection and Control

ENG/SYS

HMIMulti

Service

Distributed Services Fan Agg

Substation Automation Network

Utility Private WAN(MPLS,SDH/PDH)

Service Provider WAN(MPLS/GPRS/3G/4G)

Control Center

Secure Device Identity via X.509 Certificates

Strong user identities with Role-Based Access Control (RBAC)

Mutual Authentication, Authorization and Accounting for each user and device (centralized and distributed authentication service)

Electronic Security Perimeter

Ethernet switch security

Security GridBlock for Low Latency NetworksAccess Control Data Integrity, Confidentiality, and Privacy Threat Detection and Mitigation Device and Platform Integrity

Access Control is one of four major dimensions of the security interlay for GridBlocks


Field Area Network GridBlockTwo Tier Model with Upper Multi-Service Platform Tier

Cisco 1000 Series Connected Grid

Router

Residential Metering

Grid Sensing

Distribution Automation

EV Charging Infrastructure

C&I Meters Work Force Automation

Distributed Generation

Distribution Protection

and Control Network

DA Network

Gateway

Substation

Customer Portal MDM Load

Control SCADA DMS

CIS/BillingAMI

Head End

EMS OMS

IP Mesh

NMS


WAMS/PMU GridBlockLow latency, complex routing, very wide areaCOTS and Open Standard Protocols throughoutSecure MPLS, IP-multi-cast, GDOI are key to managing complex PMU data flows, minimizing gateways


Variable Energy Resource Communication Integration

Solar Thermal

Farm Control Center

TSO or DNOControl Center WAMS

(PMU Data)

Bulk Energy Storage

Farm Control & Monitoring Networks

Field Network Field Network Field Network Field Network

Inter Control Center WAN

ISO/RTO

Fiber Wireless MeshWireless MeshFiber

Farm Substation

System Control Network

Distribution FAN

DSTATCOM(Stabilization)

Interchange and Balancing NetworksFACTS(Stabilization)

IPPMode

Fiber FiberWireless MeshOther renewable and variable energy resources and storage options

DER Aggregator

IEEE P1547.3Information Exchange

Related:IEC 61400-25-3

IEC 61850-7-2IEC 61850-90-5

Solar ElectricOnshore WindOffshore Wind

OEM Data Center


The GridBlocks Layered Network Services


Embedding Intelligence Into the Grid

The network becomes the connected grid innovation platform

Enable peer-to-peer messaging for any grid applicationGive the grid views of network operations Rely on network for cyber security Rely on network for low level analytics Use network for data collection and aggregationRely on the network for grid state distribution

Collect and aggregate grid data in the networkVirtualize services and legacy devicesFederate/disaggregate controlsSupport distributed intelligenceProvide behavioral security; grid security, not just network securityManage grid devices as well as communication networksImplement core smart grid functions

Make the power grid network-aware

Make the network power grid-aware


GridBlocks Layered Network Services Architecture

We add to the architecture by extending the value of the networks:

extended definition of network services concepttraditional network services at the

bottom; increasingly focused on the domain as we move up the stack

this organizes a wide variety of existing Cisco technologies into a structured approach for use in the Connected Grid domainit also provides the means to identify, develop, and integrate new extended services specifically for the Connected Grid domain


GridBlocks Security Services Interlay DimensionsPervasive Security Throughout the Architecture

Access Control• User and Device Identity• Authentication, Authorization & Accounting

Data Confidentiality and Data Privacy• Network Segmentation• Security Connectivity and Encryption (VPN)

Threat Detection and Mitigation• Security Zones with Firewall• Intrusion Prevention with SCADA signatures

Device and Platform Integrity• Device Hardening• Configuration Assurance


Some CENBUProducts


Cisco Connected Grid Router 2010o Meets IEC 61850-3 and IEEE1613 standardso Integrated security for NERC/CIP compliance o Modular chassis, 4 Slots, rugged moduleso Gigabit fiber and/or copper Ethernet WANo Runs Cisco IOS , 25 years experience

Based on Cisco Market-Leading ISRs, with More Than 8 Million Routers Shipped

Pervasive Security High Availability Resiliency End-to-End Manageability

Intrusion detection and prevention systems

MPLS VPN, Get-VPN, SSL VPN

Zone-based firewalls

Quality of Service

Prioritization of control traffic

SCADA encapsulation

Designed for 15-year service

Hot-standby & WAN failover capabilities

No moving parts

IEC 61850-3, IEEE 1613

Industrial grade components

Dual, redundant hot swap power supplies

Remote diagnostic tools

Configuration & device tools with GUI

Industry standard CLI

Cisco CGR 2010 Connected Grid Router


Cisco Connected Grid Switch 2520o Meets IEC 61850-3 and IEEE1613 standardso 24 10/100BASE-TX, 2 Gigabit ethernet uplinkso 16 Fast Ethernet SFP ports, 8 10/100BASE-TX and

PoE ports, and two GigE uplinkso One hardware and two software images options:

High-end layer 3 (IP) servicesLayer 2 Services

Based on the Cisco Catalyst® 2000 and 3000 Series the Most Successful Switches in the World Today

Pervasive Security High Availability ResiliencyEnd-to-End

Manageability

Hardware-based security for secure, unique identityAdvanced security solution

GOOSE support: QoSFast ring convergenceFlexible VLAN handlingDual, redundant hot swap power supplies

IEC 61850-3, IEEE 1613 cNo moving partsResilient Ethernet Protocol for fast convergenceExtended temperaturerangeDesigned for 15-year service

Smart port templates for ease of configurationRemote diagnostic toolsConfiguration and device management w/GUIIndustry standard CLI

Cisco CGS 2520 Connected Grid Switch


Cisco 1000 Series Connected Grid RoutersField Area Routers and Modules

Ruggedized Modular Platforms Designed to Provide the Foundation for Multi-Service FAN Support

CGR 1240 Outdoor Pole Mount

CGR 1120 Indoor Din-Rail Mount

WAN ConnectivityCGM-3G - 2G/3GModuleCGM-WIMAX -WiMax

NAN ConnectivityCGM-WPAN - RFMesh Module


Connected Grid Network ManagementEnd-to-End Monitoring and ControlThe Connected Grid NMS Solutionprovides grid operators

Scalable, Utility Ops communication managementEnterprise-class visibility for up to 10M endpointsSecure network commissioning, monitoring and life cycle management via well-defined interfacesIntegration with Utility Operations and Enterprise Bus

The Cisco Connected Grid Device Manager provides

Device level network monitoring and troubleshooting