dealing with the data deluge: effectively using npmrds dr. christopher upchurch wichita area...

33
Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Upload: magnus-moore

Post on 20-Jan-2016

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Dealing with the data deluge: Effectively

using NPMRDSDr. Christopher Upchurch

Wichita Area Metropolitan Planning Organization

Page 2: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

How many of you have heard of

NPMRDS?

Page 3: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

How many have downloaded NPMRDS data and looked at it?

Page 4: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

How many of you have done something with NPMRDS data?

Page 5: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

What is NPMRDS?

NationalPerformanceManagementResearchDataSet

Page 6: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

What is NPMRDS?

• Travel time data for road segments• 5 minute increments

• Covers the National Highway System

Page 7: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

What is NPMRDS?

• Based on vehicle probe data• Gathered from cellphones and in-vehicle navigation

systems

• Goes back to 2011• 2011 and later for freeways• 2013 and later for surface streets

• Data from HERE• Provided to states and MPOs by FHWA

Page 8: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

What is NPMRDS?

• Raw Data• No post processing

• Not provided with any tools

Page 9: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Getting NPMRDS Data

• Email HERE to get an account set up• Must be an elgible agency (state DOT or MPO)

• Log into the HERE portal

Page 10: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Getting NPMRDS Data

Page 11: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Getting NPMRDS Data

Page 12: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Getting NPMRDS Data

Page 13: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Getting NPMRDS Data

Page 14: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Getting NPMRDS Data

Page 15: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Opening NPMRDS

Page 16: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Opening NPMRDS

• Microsoft Access• Database Server• Write your own software

Page 17: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

NPMRDS Data

TMC DATE EPOCHTravel_TIME_ALL_VEHICLES

Travel_TIME_PASSENGER_VEHICLES

Travel_TIME_FREIGHT_TRUCKS

119N04404 8272015 114 50 49 58119N04404 8262015 217 59 59119N04404 8262015 160 50 49 58119N04404 8262015 103 57 55 65119N04404 8262015 46 62 62119N04404 8252015 206 65 65

Page 18: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

NPMRDS Data

TMC DATE EPOCHTravel_TIME_ALL_VEHICLES

Travel_TIME_PASSENGER_VEHICLES

Travel_TIME_FREIGHT_TRUCKS

119N04404 8272015 114 50 49 58119N04404 8262015 217 59 59119N04404 8262015 160 50 49 58119N04404 8262015 103 57 55 65119N04404 8262015 46 62 62119N04404 8252015 206 65 65

Page 19: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

NPMRDS Data

TMC DATE EPOCHTravel_TIME_ALL_VEHICLES

Travel_TIME_PASSENGER_VEHICLES

Travel_TIME_FREIGHT_TRUCKS

119N04404 8272015 114 50 49 58119N04404 8262015 217 59 59119N04404 8262015 160 50 49 58119N04404 8262015 103 57 55 65119N04404 8262015 46 62 62119N04404 8252015 206 65 65

Page 20: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

NPMRDS Data

TMC DATE EPOCHTravel_TIME_ALL_VEHICLES

Travel_TIME_PASSENGER_VEHICLES

Travel_TIME_FREIGHT_TRUCKS

119N04404 8272015 114 50 49 58119N04404 8262015 217 59 59119N04404 8262015 160 50 49 58119N04404 8262015 103 57 55 65119N04404 8262015 46 62 62119N04404 8252015 206 65 65

Page 21: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

NPMRDS Data

TMC DATE EPOCHTravel_TIME_ALL_VEHICLES

Travel_TIME_PASSENGER_VEHICLES

Travel_TIME_FREIGHT_TRUCKS

119N04404 8272015 114 50 49 58119N04404 8262015 217 59 59119N04404 8262015 160 50 49 58119N04404 8262015 103 57 55 65119N04404 8262015 46 62 62119N04404 8252015 206 65 65

Page 22: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

NPMRDS Data

TMC DATE EPOCHTravel_TIME_ALL_VEHICLES

Travel_TIME_PASSENGER_VEHICLES

Travel_TIME_FREIGHT_TRUCKS

119N04404 8272015 114 50 49 58119N04404 8262015 217 59 59119N04404 8262015 160 50 49 58119N04404 8262015 103 57 55 65119N04404 8262015 46 62 62119N04404 8252015 206 65 65

Page 23: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Cutting NPMRDS Data Down to Size• Most of us are not interested in an entire state

Page 24: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Cutting NPMRDS DataDown to Size

Page 25: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Cutting NPMRDS DataDown to Size• Get a list of the TMC codes inside the MPO

boundary• Throw away everything that doesn’t have one of

those TMC codes

Page 26: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Caveats with NPMRDS Data• Has not been post processed• Outliers• Missing data

Page 27: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Caveats with NPMRDS Data• Outliers• Anomolously high or low travel times

• Addressing outliers• Remove or adjust anomalous travel times• Use percentile based metrics

Page 28: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Caveats with NPMRDS Data• Does not have travel times for all epochs• More likely to have times for:• Higher volume roadways• Peak periods

• Measures that require speeds on multiple segments in the same epoch can be problematic

Page 29: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Caveats with NPMRDS Data• Addressing missing data• Fill in data using surrounding values• Ignore missing data• Use system level metrics

Page 30: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Using NPMRDS

• WAMPO's Current Uses• Planning Time Index (PTI) – MTP Performance Measure• Travel Time Index (TTI)• Buffer Time Index

• Future Uses• Bottleneck area studies

Page 31: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Thank You

[email protected]

Page 32: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization

Questions?

[email protected]

Page 33: Dealing with the data deluge: Effectively using NPMRDS Dr. Christopher Upchurch Wichita Area Metropolitan Planning Organization