open data for transportation agencies

Open Data for Transportation Agencies

Embracing Innovation in Information Sharing

Note to copyright owners: all third-party materials contained in this presentation were obtained from publicly available sources. However, they are reproduced here without explicit permission from their owners. Novavia Solutions will gladly remove any such material at the owner’s request.

Founded in 2010 as a management consulting firm that aims to create social value by promoting the use and development of intelligent transportation solutions.

Primary expertise is in the application of information technology to traffic and transit operations, urban mobility, and infrastructure management.

Novavia Solutions works with public agencies, operators, solution providers and start-up entrepreneurs with the overarching objective to instill technological innovation and design thinking into transportation networks and the institutions that steward them.

Our services include information technology consulting, program design and management, systems engineering, organizational development, product development and marketing, and business development into new markets.

About Novavia Solutions

Open Transportation Data - April 2012 2

www.novaviasolutions.com

@NovaviaSols

linkedin/jdmargulici

Email me:

[email protected]

www.slideshare.net/jdmargulici

http://www.novaviasolutions.com/

mailto:[email protected]

http://www.slideshare.net/jdmargulici



What is Open Data?

The Case for Open Transportation Data

Implementation & Challenges

Questions & Answers

3

Open data is the idea that certain data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control. (Wikipedia, April 2012)

Open data is the idea that certain data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control. (Wikipedia, April 2012)

A Definition of Open Data


Open Data: New Term, Old Idea


Open Data: Old Idea, New Tools


Development Hosting Delivery

Application Programming Interface Mashup

Key Concepts: APIs, Mashups


Data

Application Server

Data Consumer

The API is a specification for obtaining data dynamically

Data Data Data

API 1 API 2 API 3

Visualization

Publication

Services

A mashup creates information by fusing multiple data sources

Prime Example: Google Maps


Popular Web APIs and Simple Mashup


Term reportedly coined by Tim O’Reilly, founder of O’Reilly Media:

“…. think of it as the adoption of cloud computing, wikis, crowdsourcing, mobile applications, mashups, developer contests, or all of the other epiphenomena of Web 2.0 as applied to the job of government.”

Open Data in Government: “Government 2.0”


“The rise of Gov 2.0 signals the emergence of IT innovation and the Web as a platform for fostering efficiencies within government and citizen participation.”

“… start thinking about designing programs (APIs) that are enablers”

Notion of “Government as a Platform”

•All public data are made available. Data are electronically stored information or recordings, including but not limited to documents, databases, transcripts, and audio/visual recordings. Public data are data that are not subject to valid privacy, security or privilege limitations, as governed by other statutes.

1. Data Must Be Complete

•Data are published as collected at the source, with the finest possible level of granularity, not in aggregate or modified forms.

2. Data Must Be Primary

•Data are made available as quickly as necessary to preserve the value of the data.

3. Data Must Be Timely

•Data are available to the widest range of users for the widest range of purposes.

4. Data Must Be Accessible

Open Government Data Principles


Tim O'Reilly of O'Reilly Media and Carl Malamud of Public.Resource.Org—with sponsorship from the Sunlight Foundation, Google, and Yahoo—hosted a meeting of 30 people interested in open government in Sebastopol, CA on December 7-8, 2007. https://public.resource.org/open_government_meeting.html

Finally, compliance must be reviewable. A contact person must be designated to respond to people trying to use the data. A

contact person must be designated to respond to complaints about violations of the principles. An administrative or judicial court must have the jurisdiction to review whether the agency has applied these principles appropriately.

•Data are reasonably structured to allow automated processing of it.

5. Data Must Be Machine-processable

•Data are available to anyone, with no requirement of registration.

6. Access Must Be Non-Discriminatory

•Data are available in a format over which no entity has exclusive control.

7. Data Formats Must Be Non-Proprietary

•Data are not subject to any copyright, patent, trademark or trade secret regulation. Reasonable privacy, security and privilege restrictions may be allowed as governed by other statutes.

8. Data Must Be License-free

https://public.resource.org/open_government_meeting.html



Presidency’s opening remarks Three guiding principles

Open Data: Federal Leadership


Transparency

Collaboration Participation

DATA.GOV and Other Initiatives


First U.S. CIO

First U.S. CTO

Diffusion of Open Data Policies & Initiatives


April 2012



What is Open Data?



Questions & Answers

15

Opening Case: Google Transit


2006

2012

Planning your Cross-Country Transit Trip…


GTFS: Third-Party Applications


Agencies Leveraging Third-Party Development


Developers Challenges, Prizes, Hackathons…


More Examples…


Open Transportation Data Sample: Traffic


Road Geometries

ITS Assets

Ramp Meters

Signals & Timing Plans

School Zone Schedules

HOV Lanes & Rules

Roadway Signage

Toll Schedules

Maintenance Schedule

Evacuation Routes

Weather Stations

Sweeping Schedules

Air Quality Rules

Safety Statistics

Park & Ride Lots

Parking Rules & Schedules

Road Closures & Detours

ITS Asset Conditions

Ramp Metering Rates

Signal Timing & Phases

Incidents & Special Events

Dynamic Messages

Traffic Volumes & Speeds

HOT / Cordon Toll Rates

Pavement Conditions

Evacuation Routes

Road Surface Conditions

Sweeping Operations

Air Quality Restrictions

Safety Conditions

Parking Availability

Parking Pricing

Navigation

Traffic Control

Parking & Streets

Roadway Assets &

Conditions

Description Data State / Predictive Data

Open Transportation Data Sample: Modal


Stop Locations

Carsharing Stations

Fares

Taxi Stations

Bike Safety

Reservation Call-in Numbers

Schedules

Typical Wait Times

Ridesharing Pickup Locations

On-time Performance

Rates and Incentives

Bike Sharing

ADA Access

User Ratings

Bike Lanes

Bike Parking

Station Maintenance

Carshare Availability

Special Deals

Taxi Locations

Incidents & Special Events

Fleet Availability

Arrival Times

Wait Times

Ridesharing Supply

Service Alerts

Guaranteed Ride Availability

Bike Availability

Elevator / Escalator Status

Ridesharing Demand

Closures & Detours

Parking Availability

Transit

Taxi

Biking

Rideshare / Carshare

Description Data State / Predictive Data

Beyond Traffic Detectors: Complete Scope


• Participation

• Collaboration

• Transparency

• Participation

• Collaboration

• Transparency

• Participation

Planning System

Description

System State Performance

Measures

Many apps, many platforms, many user experiences

More Channels

Third-party pick up delivery so agencies focus on data curation

Less Front-End Development

50% of the U.S. adult population has a smartphone as of 2012

Less Infrastructure

Direct Benefits of Open Data: More with Less


Transit information on Google Maps is a must. What next?

Public’s Expectations

Open data only gets cheaper than responding to requests

Freedom of Information

Open data as a self-help tool: can you afford to pass on it?

Disaster Backup Plan

Forced Benefits of Open Data: Few Alternatives


Apps and mashups can be used by the agencies themselves

Improved Toolkit

What gets published gets integrated

Interoperability

Data availability and quality become political considerations

Premium on Data

Collateral Benefits of Open Data: Ride the Wave


Both parties use Open Data to demonstrate accountability

Transparency

Open Data gets Gen Y involved with civic engagement

Participation

Open Data stimulates new business creation

Collaboration

Political Benefits of Open Data: Power to the People




What is Open Data?



Questions & Answers

30

It’s not exactly FREE! Misuse & Liability Security

Contractual obligations Open what? Who cares anyway?

Open is Good, But…

Legacy systems

• IT Systems may not have the capabilities to publish machine-readable files

Fees for data

• Open data may run counter to established revenue streams (fees or advertising)

Exclusivity

• Open data means breaking exclusive relationships, either contractual or de facto

Cultural barriers

• Open data is poised to redefine how government relates and operates: that’s pretty scary!

Common Barriers to Open Data


Exogenous Factors Endogenous Factors

Where Will Open Data Create Lasting Value?


Three years later, reportedly ONE application out of several dozens is still running

Illustration credits: Brown Bird Design and FastCompany Ecosystem slowly building for municipal issues reporting with open API

• How to promote universal access and unrestricted use yet…

• Abide by local laws and statuses

• Conserve a sense of control and security

• Preserve valuable commercial interests

Scoping and Licensing

• What technical functionalities and requirements?

• What data formats? Available standards?

Publishing

• How to engage the developer community?

• How to get sustainable results from an open data initiative?

Promoting

Implementing Open Data


Documents & Bulk Data

• Policies & Reports

• Archived Data & Statistics

• Public Notices

Core Dynamic Data

• Description Data

• State Data

Enterprise Data

• Events & Notifications

• Organization Directory

Open Data Scope


Semantic Descriptions Structural Descriptions

Content Quality Descriptions Availability and Service Quality

DATA

METADATA

Licensing Practices


Public Domain

Copyright

Un

iver

sal A

cces

s

Un

rest

rict

ed U

sag

e

Use Reuse Redistribute

Commercial Use

Revocable License

No Warranties

Hold Harmless

Attribution

Share-Alike

Publishing Open Data to make it discoverable


Dat

a F

orm

ats Markup Languages:

XML, JSON, KML

Structured data:

CSV

Unstructured data:

HTML, JPG…

Dat

a E

xch

ang

e

Stateless Server:

REST

Message-Oriented:

SOAP, JMS

Repository:

FTP

Ser

vice

De

scri

pti

on

Semantic:

Resource Description Framework (RDF)

Protocol:

Web Services Description Language (WSDL)

A Note on Data Protocols


Open Leads to Interoperability: Smart Procurement


Closed systems: no communication possible

Open systems, different languages

Translator provides interoperability

Low-hanging fruit: impose web publishing capabilities for every data of every new software system, irrespective of content / format / current need to publish

Open Data Promotion and Resources


Find Developers

How To Resources

Eve

nts

Public Initiatives



What is Open Data?



Questions & Answers

41

open data for transportation agencies

Travel

timely data

data formats

accessible data

available toeveryone

available sources

job of government

tim oreilly of oreilly

public agencies