an overview of the data management challenges faced by a rather large mitigation program, and the...

16
An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another spreadsheet: Project Tracking in cbfish.org Matt Deniston, Sitka Technology Group American Fisheries Society Annual Meeting Seattle, WA, Sept 4-8, 2011

Upload: hamza-corte

Post on 01-Apr-2015

214 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges.

Not another spreadsheet: Project Tracking in cbfish.org

Matt Deniston, Sitka Technology GroupAmerican Fisheries Society Annual Meeting

Seattle, WA, Sept 4-8, 2011

Page 2: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

The Situation: $$$

Annual expenditures have steadily increased from $2.3 million in 1980 to $310 million in 2011. Cumulative to date: over $10.5 billion.

1980

1982

1984

1986

1988

1990

1992

1994

1996

1998

2000

2002

2004

2006

2008

2010

2012

2014

2016

2018

0.0

50.0

100.0

150.0

200.0

250.0

300.0Expenditures 1980-2010, Budget 2011-2018

Expense

mil

lio

ns

Page 3: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

The Situation: Large ScopeOne of the largest environmental mitigation programs in the world

• 260,000 square miles (France)

• 600 active projects,1300+ total projects

• MOAs signed with tribal and state entities

• NOAA and USFWS regulation: Endangered Species Act

Page 4: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

The Situation: Data ChaosTraditional tools of memos, spreadsheets, mini databases no longer worked

ISRP Review 5

FY07 Budgets v.23

Decision History

Draft Jan07 DecisionExpenditures FY05-06

Public Comments ‘07 In Lieu Ratings Jul07

Fish Accord DRAFT budgets

Summary-Budget-Reqs-BOG-Apr08

Budget Change Requests

Capital Ratings Jul07

UPA Projects Mar2005

Page 5: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

RPA 1 – Implementation Plans

RPA 2 – Annual

Progress Reports

RPA …

RPA 73.3 –

Comprehensive

Habitat Tracking System

The Situation: Regulatory Pressures

Biological Opinions have significantly increased demand for reporting and tracking

ColumbiaBasin Fish &

WildlifeProgram

Page 6: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

The Situation: ??? ResultsLack of a sustained rebound in the salmon and steelhead runs makes no one happy…

1980

1981

1982

1983

1984

1985

1986

1987

1988

1989

1990

1991

1992

1993

1994

1995

1996

1997

1998

1999

2000

2001

2002

2003

2004

2005

2006

2007

2008

0

200,000

400,000

600,000

800,000

1,000,000Annual Adult Fish Returns at Bonneville Dam

(1980-2008)

Chinook Coho Sockeye Steelhead

Source: Fish Passage Center, www.fpc.org/adultsalmon/adultqueries/Adult_Annual_Totals_Query_Results.asp

Page 7: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

The Challenge

Obligations• NW Power Act• ESA – BiOps• Fish Accord 10 year

agreements

To design and build a transparent web-based system for managing the program’s obligations, objectives, activities, and accomplishments.

Activities• Budgeting• Portfolio Analysis• Project Reviews

{title}• {text}

Objectives

Accomplishments

Columbia BasinFish & Wildlife

Program

Wildlife

ResidentFish

AnadromousFish

Page 8: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

The Solution: cbfish.org

Page 9: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

Schedule & Key Deliverables

Project Proposals & Change Requests

10/1/2008 9/30/2010

Dashboards& Web Services

Project Records & Budgets

Interactive Maps & Reports

10/1/2009

New System of Record / Process Improvements Improved Info / Analytics

Page 10: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

Approach for design & development of cbfish.org

• Iterative & collaborative

• Requirements evolve with real-world use

• Updates to software every 2 weeks

• Continuous feedback loop

Requirements Deliver

Syst

em C

apab

ility

Tim

e

Design

Analysis

Page 11: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

Extreme Makeover

BEFORE AFTER

6-9 months to enter and upload budget decisions into the old system

1-2 days to enter budget decisions directly into the new system

Emailing dueling budget spreadsheets Viewing and collaborating on budgets online

Qualitative narratives of the program’s accomplishments

Quantitative, interactive summaries of the program’s accomplishments

Working with GIS experts to generate maps Self-service, interactive maps

Bottoms-up budgeting Top-down, objective-driven budgeting

1-2 weeks to respond to an info request A few minutes to respond to an info request

1,000 pg BiOp document (unstructured data) 3 pg BiOp dashboard (structured data)

Page 12: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

Ways to view/manage a project Example project: “Avian Predation on Juvenile Salmonids”

Page 13: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

13

Data visualizations: High Level Indicator charts

Page 14: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

Data visualizations: Accomplishments by ESU

Page 15: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

Benefits of cbfish.org

• Provides transparent public access

• Centralizes info for easy access and sharing

• Tracks progress towards obligations and objectives

• Delivers new insights into accomplishments & areas where more is needed

• Enables program to grow – more restoration, more research and monitoring, etc.

Page 16: An overview of the data management challenges faced by a rather large mitigation program, and the system we created to overcome those challenges. Not another

Thanks for your time!

Matt Deniston, [email protected]

Questions?