Transportation leadership you can trust.

Operations and ITS Data Tools – Turning Data into InformationTRANSPO

October 2012

Anita Vandervalk, P.E.

Cambridge Systematics, Inc.

2

AgendaWhy is this important?

Which data?

What decisions?

Challenges

Solutions and tools

Future outlook

3

Why is this Important?Performance Management in an era of declining budgets

Information industry - Rapid changes in technology and infrastructure for data sharing» Breadth of technologies for data management and

dissemination continues to increase» Complexity and cost of deploying these tools

continues to fall» Rapid growth in open source software solutions

and low-priced, third-party hosting services

Access to data necessary» Analyzing and evaluating management and

operations strategies» Making the case for greater levels of investment

in operations

4

MAP 21 – Focus on Performance Measurement

National Goal Areas: 1.) Safety; 2.) Infrastructure condition; 3.) Congestion reductions; and 4.) System reliability

ITS is needed to measure and improve safety, congestion, system reliability, and freight movement

Contains strong language supporting Transportation Systems Management and Operations (TSM&O)

Potential for a large ITS planning effort out of RITA/JPO

Section 513 requires a comprehensive plan be developed to assess ITS deployment activities across all modes

Continues funding for the Connected Vehicle Program

Includes research statements on several Ops and ITS areas

5

Transportation Agency ChallengesFaced with» Big Data, lots of (new) data» Technology/Innovation advances» Aging Infrastructure » Outdated IT strategies» Evolving customer expectations» Information Management challenges

Need» INFORMATION – Organized and Fused for

Decision Making» A well designed strategy for data, analytical

tools and information technology to support and institutional new processes around economics, freight, project selection, PMs

6

Data Management Services Framework

DecisionsInformationData

OperationsPlanningFundingProjectsPolicy

Programming

Collection Analysis Integration Visualization

BUSINESS REQUIREMENTS

ToolsForecasting/

Modeling Communication

7

Which Data?Traveler Information Systems» Current traffic conditions (e.g., travel time, speed,

level of congestion)» Traffic incidents, work zone, and/ or lane closures

Traffic Control Systems» Time and location of traffic control actions (e.g.,

ramp metering, traffic signal control, lane control signals, message board content)

Incident and Emergency Management Systems» Location, cause, extent, and time history of

roadway incident/ emergency detection and clearance, incident timeline.

Roadway Infrastructure Data» Roadway characteristics, intersection data, traffic

control data

8

Which Data?Vehicle Probe Data: Recent “real-time” speed and travel time» Historical speed and travel time; data quality

measures – completeness, accuracy, latency; and validation

State/Local Generated Detector Data» Recent “real-time” volume, occupancy, speed,

travel times, vehicle type; and historical volume, occupancy, speed, travel times

State/Local Work Zone » Location, agency, lanes closed, date/ time,

duration

Weather Data» State/ local RWIS data, NWS (or equivalent) data –

date/ time, road ways affected, type, intensity

9

Which Data?Advanced Public Transit Systems» Transit vehicle passenger boardings by time

and location, vehicle trajectories, passenger origins, and destinations

Network Typology» Link capacity, free flow speed, number of

lanes

Origin/Destination Data» Surveys, travel diaries, or direct monitoring

Traffic Monitoring and Detection Systems» Vehicle volume, speed, classification, weight,

turning movements, and position trajectories

10

NEW DATA SOURCES FROM PRIVATE SECTOR

Toll tag readers» Toll tag readers deployed at various points on a

roadway network– Electronic tags, antennas, readers, and a central

computing and communication facility

Bluetooth device matching» Computers, car radios, navigation devices, PDAs,

cell phones, headsets, and other personal devices are Bluetooth enabled

» Unique Median Access Control (MAC) addresses to Bluetooth equipped devices

» Travel time measurement involves identifying and matching the MAC address of Bluetooth-enabled devices carried by motorists as they pass a detector location

11

NEW DATA SOURCES FROM PRIVATE SECTOR

Wireless location technology» Using signaling information from cell phones

(such as cell tower handoffs) to anonymously track wireless devices as they traverse a roadway network

» Major vendors of the technology include Cellint (TrafficSense system), AirSage, and Delcan

Crowd-sourcing» Obtaining real-time traffic congestion information

from drivers’ GPS-enabled mobile phones» Relies on a large number of users and is primarily

to support personal navigation systems and mobile applications

12

NEW DATA SOURCES FROM PRIVATE SECTOR

Private data providers» Combine information from multiple probe

technologies such as cell phones, toll tags, crowd-sourcing, and fleet-based GPS probe vehicles, as well as data from existing fixed-sensor networks such as loop- or radar-based detection

» Data is then fused to provide real-time travel time estimates and incident information

» Private data sources include INRIX, Navteq Traffic, TomTom, Clear Channel’s Total Traffic Network and American Transportation Research Institute (ATRI)

13

Which Programs? (TSM&O) Traveler Information Systems

Active Traffic Management

Traffic Incident Management

Maintenance Activity Planning

Work Zone Management

Event Management

Traffic Control Device Synchronization

Road Weather Information Systems

Regional Traffic Management Centers

14

Which Programs?Freight Management and Commercial Vehicle Operations;

Electronic Toll and Fare Collection

Congestion Management Process

Performance Measures

ITS Strategic Planning

Managed Lanes

15

Which Decisions?

Planning for Operations» Investment » Project priorities» Types of strategies

Real Time Management» Traveler Information» Work Zones» Weather

16

ChallengesTechnical» Development and maintenance of hardware

and software» Specifications for data collection, analysis,

archiving, and reporting.

Institutional » Centralized policy-making, and decentralized

execution of policies» Limited appreciation by decision-makers of

the role of data systems in supporting business operations

» Lack of formal policies and standards

17

Challenges with Data IntegrationData Integration

Data Resolution

Data Quality» Maintaining extensive electronic field equipment

(sensors and communication)

Active Versus Passive Archiving

Rigid Data Format Standards versus Flexible Formats with Metadata

Data Integration (Fusion) Issues» Location Matching» Version Control

18

Transportation Data Formats!TranXML, TMDD, Data.gov, geospatial reference frameworks (e.g., TMC codes), Apache Software Foundation Object-Oriented Data Technology, NTCIP, and TCIP. Others will be included such as the National Information Exchange Model (FHWA Office of Policy is currently examining this model as a possible standard), UN-recommended UN/EDIFACT (which is the only international standard and is predominant outside of North America and as well predominant in life science and pharmaceutical industry), U.S. standard ANSI ASC X12 (X12)(predominant in North America), TRADACOMS standard developed by the ANA (Article Numbering Association) (predominant in the UK retail industry), ODETTE standard used within the European automotive industry, ebXML, used by many Asian community systems, WCO standards, such as WCO data model and ASYCUDA.

SOLUTIONS AND TOOLSTECHNICAL AND INSTITUTIONAL

Data Business PlanningWhat is a Data Business Plan?» A plan for efficient

utilization of people, processes, and technology, to support management of data and information within an organization

» The data business plan framework links business objectives, programs, and processes to data systems, services and products

20

Data Management and GovernanceData Management» Development, execution and oversight of

architectures, policies, practices, and procedures to manage the information life-cycle needs of an enterprise in an effective manner as it pertains to data collection, storage, security, data inventory, analy sis, quality control, reporting, and visualization

Data Governance » Execution and enforcement of authority over the

management of data assets and the performance of data functions. The implementation of data governance includes participants from many areas of the organization

21

22

FHWA Office of Operations – Data Business Plan

GOAL 1. Improve the coordination and communication mechanism across U.S. DOT and FHWA offices involved with roadway travel mobility data to avoid investing resources in the same or similar types of data related programs.

» Objective 1.1. Identify gaps and redundancies in roadway travel mobility data programs.

» Objective 1.2. Devise “rules of engagement” regarding collaboration of the data functions for roadway travel mobility data.

23

FHWA Office of Operations – Data Business Plan

GOAL 2. Improve the coordination of the connected vehicle data capture program with other related data programs within U.S. DOT and FHWA.

» Objective 2.1. Identify how current and planned data from the connected vehicle initiative can support existing data programs.

»  Objective 2.2. Identify how data from other mobility related programs within U.S. DOT and FHWA can support the connected vehicle initiative.

»  Objective 2.3. Identify existing/future data inventory and data structures/ policies/governance practices that could be applicable to the Research Data Exchange.

24

D. Data Products (Raw Data & Reports)Infrastructure (Inventory)

- State Roadway Inventory ProgramsTravel (Speed and Volume)

- Archived Data User Service- Transportation Technology Innovation & Demonstration (TTID)- Urban Congestion Report (UCR) Program- State Traffic Monitoring Stations- Traffic Volume Trend (TVT) Reports

Climate (Weather)- Road Weather Information Systems

Modal- FHWA Freight Performance Measures Initiative

Other Data Products- Integrated Corridor Management (ICM) Program

Real-Time Data Capture and Management Program- TFHRC Data Resources Testbed- DCM Program Test Data Sets- Dynamic Mobility Application Datasets (Future)

C. Core Data Systems & RepositoriesHighway Performance Monitoring System (HPMS)National Speed Data Collection & Reporting Program

(Future)Travel Monitoring and Analysis System (TMAS)Vehicle Travel Information System (VTRIS)ClarusNorth American Transborder FreightCross-Town Improvement Project (C-TIP) (Future)Freight Analysis Framework (FAF)International Freight Data System (IFDS) (Future)Data.govDCM Program Research Data Exchange

Manage & Consume

A. Operations ObjectivesSupport activities to mitigate non-recurring congestion

through aggressive management of temporary disruptions as well as consideration of public safety and security by preparing for emergency response (Transportation Operations)

Promote efficient, seamless, and secure freight flows on the U.S. highway system, intermodal connectors, and across our borders (Freight Management & Operations)

Support activities to improve day-to-day operation of the transportation system and to reduce recurring congestion through the development and implementation of new technologies and procedures (Transportation Management)

Enable

SupportB. Business ObjectivesNational LeadershipProgram DeliverySystem PerformanceCorporate Capacity

Achieve

UseE. Communities of Interest:Mobility Data COI (Internal/External)

Connected Vehicle Data COI (Internal/External)

F. Data ServicesData Acquisition and UpdatingData Quality Data StandardsBusiness Analysis ToolsData Privacy and SecurityData Storage and AccessInternal CoordinationTraceabilityPerformance MeasuresRisk AssessmentValue of Data ProgramsKnowledge Management System

Provide

Mobility Data Business Owners

Implements

Designates

FHWA Enterprise

Data Architect (IT office??)

FHWA Data Custodian (IT

Office)

MobilityData Stewards

Designates

Structures

Administers

Use

GovernanceFramework

Office of Operations Data

Governance Team

G. Other Data Governance InitiativesFHWA Data StandardsFHWA Data Governance Advisory Council Structure

Coordinates with

FHWA Data Governance Board (1 Rep

from OPS)

Participates

Connected Vehicle Data

Business Owners

Connected Vehicle

Data Stewards

Operations Program OfficesFHWA Office of Transportation Management

FHWA Office of Transportation OperationsFHWA Office of Freight Management & Operations

25

State Roadway Inventory Programs

Travel Monitoring & Analysis System

(TMAS)

State Traffic Monitoring Programs

State Database (Future)

State Database (Future)

State Database (Future)

NOTE: Orange symbols represent future data systems/programs. Orange dashed lines represent future connections.

Researchers

Federal, State & Local

Transportation Agencies

Private Data Providers

Public

Vehicle Weight Data

National Park Volume/Asset Data

(Future)

Bicycle/Pedestrian Volume/Asset Data

(Future)

Long Term Pavement

Performance Data (Future)

Roadway/Asset Inventory Data

Traffic Volume Data

Vehicle Classification Data

Vehicle Speed Data (Future)

U.S. Congress

FAST On-Line Dashboard http://bugatti.nvfast.org/PMMS/

27

PeMs

28

RITIS

29

INRIX Analytics Tool

Cloud-based service that combines Traffic Archive with real-time and historical analytics tools

Real-time Dashboard highlighting bottleneck locations, 99status and history

Historical analysis tools to enable configurable graphing, 99plotting, and mapping traffic performance measures

Configurable Massive Data Downloader to extract 99detailed Traffic Archive data by time, road segment, etc.

Options to add agency data (sensors, incidents, work 99zones, etc.) to increase utility of analysis

30

31

The CloudNational Association of State Chief Information Officers (NASCIO) has published an exhaustive set of resources

U.S. government is » mandating agency IT resources migrate to the

cloud (“cloud-first” strategy) » highly concerned with data security» larger in scale than any State or individual State

agency/DOT» an information and policy resource

32

State DOT Cloud use SurveyAll 50 states contacted

16 states responded

Lots of variation of cloud users, agencies considering the cloud, and agencies not using or considering the cloud

Storage and availability of GIS is a very common application for the cloud

SaaS (remote access to an application) is more common than IaaS (remote storage of agency data)

33

Survey Responses

Agency Agency currently Stores data "in the cloud"

Agency plans to Store data "in the cloud"

Neither

Colorado DOT  •  

Hawaii DOT      •Iowa DOT •    

Illinois DOT •    

Missouri DOT    •

Montana DOT •    

Nevada DOT    •

New Hampshire DOT  •  

New York State DOT    •

North Dakota DOT  •  

Ohio DOT •Pennsylvania DOT •Utah DOT •  

WHAT THE FUTURE HOLDS

35

What the future holdsIncreasing public involvement in managing transportation

Evolving role of ITS and Operations

Increasing private sector data sources – Issues» Common definitions for performance measures

(how to calculate from low-level data)» Integration with agency data: volumes, incidents,

work zones, weather, highway location» Distinguish O/D travel times

Technology and Innovation

????

36

FHWA/Saxton Labs Data Sharing Framework/Virtual Data Warehouse - Goals

Bring together many types of transportation data (probe data, traffic counters, incident locations, weather events) to give planners and operators a multi-faceted view of transportation performance overtime and by select locationBased on Concept of Operations, User Needs and Requirements, addressing:» Technical issues - data integration issues» Institutional issues - business rules

Partner agency involvement Software addresses access/feed, connection to applications

Virtual Data Integration

38

Virtual Data Integration

39

Framework Strategic Outcomes Framework is widely adopted by states and regions across the U.S.

Demonstration regarding how data sharing can support modeling, operations and planning

Planners and operations managers have complete and accurate information on the operational performance of the regional transportation system

Planning and investment decisions reflect all available and relevant data

MPOs and State DOTs are better able to meet new performance measurement requirements of MAP-21

“Start using operations data – eliminate barriers”

40

Thanks! (avandervalk@camsys.com)