ict informational webcast - fan demo

© 2015 Electric Power Research Institute, Inc. All rights reserved.

Tim Godfrey

August 27, 2015

ICT Informational Webcast

Field Area Network Demo

2© 2015 Electric Power Research Institute, Inc. All rights reserved.

Agenda

The context of the FAN and the FAN Demo

Selected FAN Demo Themes and Member Activity

Future Research on Telecommunications


The FAN in the communications hierarchy

Core

Fiber

Private Field Area Network

Collector

CommercialCellularNetwork

Collector

Sensor

CapBank

LAN

WAN

FAN

Devices

NAN

Microwave

BATTERY

PEV

CapBank

PV


Relationship to Other EPRI Research

Core

Fiber

Private Field Area Network

Collector

CommercialCellular Network

Collector

Sensor

CapBank

LAN

WAN

FAN

Devices

NAN

Microwave

BATTERY

PEV

CapBank

PV

DMDTMD

Smart Distribution

OpenADR

DMS

Energy Efficiency

Renewables

GIS Data

FAN Demo


Field Area Network (FAN) Demonstration Project

Approach:Work with several utilities on the design,

implementation and analysis of FAN pilot projects that utilize a variety of technologies and approaches

Assessment and testing of performance and reliability

Develop Cost Benefit Analysis Framework

Conduct a Vendor Forum series and an Interoperability Plugfest series for standardized FAN technologies

Objective: Address gaps in utility telecommunications. Answer open questions about FAN design,implementation, and operation.


Utility Communications Gaps

New Applications:

Communications requirements exceed network capacity

Legacy Infrastructure:

Separate, isolated networks

Transition to IP Networks

Cybersecurity

Field Area NetworkLack of Interoperability


FAN Demo Research Themes and Member Projects


High Reliability Private Network

Architecture

First FAN Pilot Deployment

SRP Communications FAN Pilot – EPRI PDU Meeting (Sept 2013) 9

•Completed in 2013•WiMAX in 3.65 GHz Band

ABB Test Area Primary

FAN Demo Meeting Update – October 2014 10

SRP Distribution System• Limited line of sight• Density varies• No fiber/copper today• No street light access

11

New Protection, Control & Telecom Building

New WiMAX Base Towers

New WiMAX CPE’s

Factory Built & Commissioned

Intelligence

Added to the Trial

Area

United Illuminating

• Moving forward with deployment of GE Orbit• First Link commissioned in July• Planning small‐scale mesh network trial in downtown Bridgeport to extend communication to four

vaults from a nearby substation using ABB Tropos.

Current Status

13

GRE/CONNEXUS: MODIFIED WIMAX TRIAL

Applicable technology for both substations, DA and fixed wireless AMI backhaul.• Initial testing in 220 MHz band• Reconfigured to 700 MHz band

• Spectrum purchased by Great River Energy

• Full Spectrum equipment

• Two capacitor banks• Cooper CBC‐8000 capacitor controls

SCADA System ArchitectureTraditional & Advanced Overlay

Advanced SCADA FAN:

• Selective Deployment

• WiMAX in 3.65 GHz

• ABB/Tropos Mesh


Securing the FANCyber Security


FAN Penetration Testing

Collaborative with EPRI FAN Demo and Cyber Security

Three FAN Demo member utilities

Findings:– Some vulnerabilities

found in every case


Network Sharing with Public Safety

FirstNet


Utility Spectrum Sharing with Public Safety

Sharing the FirstNet public safety network is one option for a Field Area Network

The sharing public safety spectrum owned by FirstNet is a complex issue– Deployment is likely to be a long term prospect: > 5 yrs– Positive development with Great River Energy trial in Minnesota

One (of many) concerns are the technical parameters for sharing– What does “secondary use” actually mean?– Would a secondary user completely lose access to the network during

a disaster or major public safety event?– Are utilities “secondary”? If so, could that change?


Demonstration and Testing of Sharing

EPRI FAN Demo testing collaboration with FirstNet

To address the unknowns regarding network and spectrum sharing, test and demonstrate a Public Safety / Utility scenario– Utility traffic is secondary to Public Safety traffic, except for minimum

utility bandwidth that is guaranteed no matter what– Utility devices do not have network entry priority, but cannot be

“kicked off” the network by PS users if they are already connected.

Objective: show that the requirements of both PS and Utility users can be met in the sharing scenario

GRE FirstNet Pilot


Distributed Intelligence

Reliability of Public Carrier Networks

Distributed Architecture: Telecom Networking VisionMulti‐Tier Communications Node Architecture

8/27/2015 Duke Energy – Confidential and Proprietary Information -used with permission page 22

HQ: Long term monitoring results

• Cellular:– 9 outages (maintenance internal and external– IREQ link non redundant)– Duration from 1,5 hr to 43 hrs.– Many intermittent outages between 1 to 5 minutes where unexplained

• Weather Effect– WiMAX and Cellular : No significant effect (heavy rain, snow, …)

• During winter: Better RSSI (~2 dB) and performance (↓delay and ↓packet loss)

Groupe − Technologie, Hydro-Québec23

2013

RTT 79 ms 87 ms 1.93 sec 0.7 secDL 9 ms 29 ms nd ndUL 74 ms 58 ms nd nd

0.46% 0.68% 13.96% 0.08%99.83% 99.70% 88.60% 97.57%0.16% 1.61% nd nd99.67% 98.09% 88.60% 97.57%

Availability excluding maintenanceMaintenance (internal and external)Effective Availability

[email protected] GHz

Cell 3G(Rogers)

SatelliteBGAN

SatelliteiDirect

Delay(avg)

Packet Loss (avg)

Hydro One Cellular FAN Test Bed

Raspberry Pi w/environmental sensors

IxChariot client for Linux

Enables: Remote periodic network

performance testing (e.g. latency, jitter, throughput)

Remote network monitoring capabilities testing

WAN Modem

Raspberry Pi

Power Supply

120 VAC

Cellular (HSPA/LTE)

TemperatureHumidity

Ethernet

IxChariotClient


Narrow Channel Standards

and Testing


Standards for 1 MHz spectrum

Issue: A number of utilities (SRP and GRE in the FAN Demo) have purchased 700 MHz Spectrum. – The spectrum consists of 1 channels with a width of 1 MHz– This width is too narrow for standards such as WiMAX and LTE– Currently, only proprietary equipment is available.

Action: Develop a standard for 1 MHz channel width operation– The same techniques could apply to WiMAX and LTE, but the path to

standardization is different – WiMAX is achievable


Standards for 1 MHz width spectrum

Meeting at UTC Telecom in Atlanta (May 2015)

IEEE 802.16 initiating PAR development– Three teleconferences August through October– PAR submission in November

WiMAX Forum will develop WiGRID update in parallel

There are different technical approaches– Need to define cellular frequency re-use mechanism for narrow chan– Different affects on throughput, interference, etc.

EPRI and Idaho National Labs are developing a test plan for narrow-channel WiMAX– Field test different narrow-channel approaches to channelization and

frequency re-use.


Collaboration with WiMAX Forum Smart Energy Working Group

FCC NPRM on 3.65 GHz Band


3.65 GHz FCC Ruling in 2015

3.65 – 3.7 GHz band widely used for utility FANs– SRP, Ameren, SDG&E, GRE

FCC allocated 3.5 – 3.65 GHz to “Citizen's Broadband Radio Service”

FCC FNPRM included existing 3.65 – 3.7 GHz in CBRS – Potential impact on dozens of utilities with deployments– New “Spectrum Access System” for access control

WiMAX Forum activities– Submitted ex-parte filing to FCC opposing inclusion of 3.65 – 3.7 GHz in

CBRS– Joined by Utilities Telecom Council, American Petroleum Institute,

Ameren Corporation, CenterPoint Energy Houston Electric, Exelon Corporation, Iberdrola USA, GE Digital Energy, Siemens Industry Inc., and Telrad Networks

3.7 GHz

3.5 GHz

3.65 GHz


Highlights of FCC Ruling 15-247

PAL will not be issued in upper 3.65 GHz Band. – Only available in lower 100 MHz (3.5 – 3.65 GHz)

Grandfathering: Existing 3650-3700 MHz operators get incumbency status for 5 years or longer

Outcome of ruling is a complex set of details– The situation is not ideal, but could have been worse for utilities– Level of uncertainty is higher than before– The band is still a viable option for utilities


Upcoming Development


Unified Test Plan

Based on test plans provided by membersTwo related objective sets

– Test plans for initial network validation– Test plans for long term network testing and monitoring

Provide options for execution– Level 1: Basic testing, low cost tools, open source software– Level 2: More advanced testing with commercial HW/SW

Testing Scope– WAN and Backhaul– Wireless to field device


Raspberry Pi Test Platform

A simple, low cost platform to implement the test plan

Enables access to data that is not directly reachable through the FAN

Can continue to collect data even during FAN communications outages

Integrated by EPRI, based on contributions from Hydro One and other members


Summary and Key Findings


SRP Duke H-One UI GRE NPPD HQ Ameren SDG&E

1 Securing the FAN (connecting devices to the FAN) 2 High reliability network architecture 3 QoS w/ shared and/or impaired network 4 AMI vs. broadband FAN technologies for DA 5 Reliability of public carrier networks, network entry 6 Long‐term reliability, Netwk Mgmt (monitoring/metrics) 8 Distributed vs. centralized processing 13 Private networks: Requirements and Propagation 16 Integrating applications beyond electric delivery 18 Sharing Networks with Public Safety 19 Operation in the 3.65 GHz band

Research Topic Matrix


Key Findings

No single technology is broadly applicable. A mix of technologies is necessary to meet varying requirements

Private licensed spectrum is the optimal choice for many, but cost and availability result in challenges and compromises

For Canadian utilities, the per-device license cost for using private spectrum makes commercial cellular more economical for the FAN

New opportunities are emerging with commercial cellular– MVNO, PVNO, QoS….


Looking Forward


The Road to Telecom

FAN Demo

High Reliability Field Area Networks

Implementing Private Wireless Networks

Integrating Multiple Applications

Sharing with Public Safety

Reliability of Commercial Cellular

Implementing QoS and Prioritization

Serial to IP, retirement of leased lines and copper

Communications to DER, customer premises

Fiber Optics, MPLS, WAN, Microwave

Telecom Initiative

Spectrum Sharing

Spectrum Assessment


Telecom Initiative Roadmap

2015 2016 2017 2018

Socialize Telecom Initiative with Members

ICT Telecom Initiative

Telecom Project Set

Field Area Network DemoField Area Network Demo

May

Feb


Why a Telecom Initiative?

“Pain points” in the industry reaching the executive level– Retirement of analog and TDM leased line services from carriers– Transition of applications to IP– Rapidly increasing bandwidth and geographic coverage requirements for

intelligent field devices– Obsolescence and/or insecurity of legacy wireless systems– Lack of private spectrum for critical operational links– Increasingly crowded unlicensed spectrum, and resulting impacts on

reliability

Some common themes extend onward from FAN Demo and Spectrum Assessment, but also include a broader scope

We need your input now on the things we should accomplish in the next two years in the area of Telecom


Candidate Research Topics for Initiative

“Serial to IP” transition. – Applying MPLS and IP networks– Retirement of analog and TDM leased lines– Testing and demonstration of wireless replacement technologies

Leveraging Private Spectrum– Standards development, testing, and demonstration in 700 MHz upper A block

(Narrowband WiMAX)– Hybrid licensed / unlicensed operations to increase capacity– Testing, feasibility, and demonstration of shared operation in 406 MHz

Public Network Sharing – Testing and demonstration with utility-focused MVNOs– Development and demonstration of a utility Private VNO (PVNO)– Sharing with Public Safety

Business Case for Telecom Strategic Investment


Survey

What is your Highest priority– “Serial to IP” transition and retirement of copper/TDM circuits. – Leveraging Private Spectrum– Public Network Sharing – Business Case for Telecom Strategic Investment– Other

What is your Second priority– “Serial to IP” transition and retirement of copper/TDM circuits. – Leveraging Private Spectrum– Public Network Sharing – Business Case for Telecom Strategic Investment– Other

Could we schedule a follow up call to discuss further?– Yes– Not Interested


Discussion and Questions


Together…Shaping the Future of Electricity


Backup and Reference


FAN Demo Deliverables (to date) May 2013 Advisors Meeting: Presentations and Minutes (United Illuminating)

– Product ID: 3002002210 286 pages

September 2013 Advisors Meeting - Presentations and Minutes (Hydro One Networks)– Product ID: 3002002211 228 pages

October 2013 Vendor Forum Presentations (Palo Alto)– Product ID: 3002002212 232 pages

March 2014 Advisors Meeting: Presentations and Minutes (Salt River Project)– Product ID: 3002003096 262 pages

Field Area Network Demo: First Year Update– Product ID: 3002003094 178 pages

June 2014 Advisors Meeting: Presentations and Minutes (Great River Energy)– Product ID: 3002004241 736 pages

October 2014 Advisors Meeting: Presentations and Minutes (Duke Energy)– Product ID: 3002004848 199 pages

March 2015 Advisors Meeting: Presentations and Minutes (Salt River Project)– Product ID: 3002005215 308 pages

Field Area Network Demo: Second Year Update– Product ID: 3002005222 1244 pages

June 2015 Advisors Meeting: Presentations and Minutes (Hydro Quebec)– Product ID: 3002005220 242 pages


Vendor Forum HistoryEPRI Field Area Network Demo Vendor Forum History Aug 2015

Vendor Product Category Date EPRI Product IDFiretide Networks Unlicensed Broadband Mesh 5/30/2013 3002002210RuggedCom (Siemens) WiMAX Infrastructure 9/3/2013 3002002211Alcatel Lucent LTE Infrastructure 9/4/2013 3002002211GE WiMAX and other Infrastructure 9/4/2013 3002002211Full Spectrum Infrastructure 10/23/2013 3002002212Ambient Infrastructure 10/23/2013 3002002212Cisco (CGR) Infrastructure 10/23/2013 3002002212ABB Tropos Unlicensed Broadband Mesh 10/23/2013 3002002212SK Telecom GridMaven Network Management 10/23/2013 3002002212Sprint Commercial Wireless Operator 10/23/2013 3002002212OnRamp Wireless Infrastructure 2/12/2014 3002003096Access Spectrum Spectrum 3/6/2014 3002003096IBM Infrastructure 3/6/2014 3002003096Ericsson Infrastructure 3/6/2014 3002003096CellPlan Network Design 6/26/2014 3002004241EDX Wireless Network Design 6/26/2014 3002004241Infovista (Mentum Planet) Network Design 6/26/2014 3002004241Cisco (IOX) Infrastructure 10/9/2014 3002004848Sierra Wireless Commercial Wireless Devices 10/9/2014 3002004848Proximetry Network Management 10/9/2014 3002004848MimoMAX / Tait Radio Infrastructure 3/19/2015 3002005215ABB Tropos Unlicensed Broadband Mesh 3/19/2015 3002005215Trilliant Unlicensed Broadband Mesh 6/18/2015 3002005220CalAmp Commercial Wireless Devices 6/18/2015 3002005220

ict informational webcast - fan demo

Documents