performance measures: so why should i care?
DESCRIPTION
PERFORMANCE MEASURES: So WHY should I care?. Remarks by Sherry Sterling Senior Advisor, OPP PREP Course 13 June 2005. Critical Components of Program Success. CLEAR GOALS Public Health & Ecological Protection Outcomes. MEANINGFUL ACCOUNTABILITY Measures & Tracking. GOOD PLANNING - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/1.jpg)
1
PERFORMANCE MEASURES:So WHY should I care?
Remarks by Sherry Sterling
Senior Advisor, OPP
PREP Course
13 June 2005
![Page 2: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/2.jpg)
2
Critical Components of Program Success
CLEAR GOALSPublic Health & Ecological
Protection Outcomes
GOOD PLANNINGStrategic Objectives
EFFECTIVE IMPLEMENTATIONMultiple Levels
ADEQUATE RESOURCESAcquisition & Allocation
MEANINGFULACCOUNTABILITYMeasures & Tracking
![Page 3: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/3.jpg)
3
Accountability Drivers in EPA
Statutes
EPA 5 Year Strategic Plan
3 Year NPM Commitments
Budget Formulation
Annual Work Plan
Performance Standards
Budget Allocation
Audits
Tracking Systems/Reporting
![Page 4: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/4.jpg)
4
Government Performance and Review Act (GPRA)
GPRA is a statute aimed at increasing accountability for all federal agencies by requiring measurement of program results & linking those results to resource allocation.
Provides a statutory framework for strategic planning and reporting that requires federal agencies to:– Establish accountability measures to assess the outcomes of
each program activity, and – Prepare performance plans that establish annual performance
goals.
![Page 5: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/5.jpg)
5
GPRA: Auditing Function
Office of Management & Budget (OMB) assumed the role of
evaluating progress against GPRA, developing the Program
Assessment Rating Tool (PART)
OMB is committed to audit all federally funded programs against
GPRA requirements on a 5 year cycle.
This is the third year. Several Pesticide Programs have been
audited.
![Page 6: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/6.jpg)
6
Principle focus has been on Outcome Measures.
Short turn-around times for agencies to develop their data.
Average scores have been very low; many classified as “Results
Not Demonstrated”.
“Re-PARTing” is the norm.
Results are published each year with the federal budget.
Programs not demonstrating results for successive years are
subject to budget cuts or elimination.
PART: Outcomes
![Page 7: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/7.jpg)
7
How do we measure?OUTPUTS
An activity, effort, or work product related to a goal
May be quantitative or qualitative Must be measurable during the funding
period Examples: number of policies developed,
number of REDs issued
![Page 8: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/8.jpg)
8
How do we measure?OUTCOMES
The result, effect, or consequence that will occur from carrying out a program or activity related to a goal
Must be quantitative May not be achievable during the funding
period Examples: reduced occurrence of disease,
fewer incidents
![Page 9: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/9.jpg)
9
Levels of Outcomes
Short-Term– Most direct and measurable– 1 to 3 years
Intermediate– Less measurable– 4 to 6 years
Long-Term– Difficult to measure impacts– 7 to 10 years
![Page 10: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/10.jpg)
10
How do we measure?EFFICIENCY
Ratio of outputs to cost Cost can be dollars or time Examples: cost per purchase order
transaction, cost per seminar conducted
![Page 11: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/11.jpg)
11
Framework for Action in OPP
Senior Level Steering CommitteeFOCUS: Set Direction; Manage Process; Resolve conflicts/issues
Task GroupsFOCUS: developing outcome and efficiency in specific areas
ESAWater Quality
PESPSAIFood Safety
WorkerSafety
??? ???
Coordinating CommitteeFOCUS: developing outcome and efficiency measures for MISSION AREAS; coordinating work of task groups
![Page 12: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/12.jpg)
12
Process highlights…
Inclusive – HQ, Regions, States, Tribes, Stakeholders
Performance measures will serve as an important management tool
Very tight timeframe
![Page 13: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/13.jpg)
13
Products expected from process…
Protect Human Health
Protect Environment
Other Benefits from Use
Worker Safety Yes Yes
Food/Agg. Exp. Yes Yes Yes
ESA Yes Yes
Water Quality Yes Yes Yes
SAI + PESP Yes Yes Yes
![Page 14: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/14.jpg)
14
What’s a Logic Model?
A systematic and visual way to develop and present the causal links between the:– resources available to operate a program– activities conducted with those resources– products or services produced by the activities– intended changes or results
![Page 15: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/15.jpg)
15
Why the Logic Model?
Simple to understand and use Links budget to goals Helps to identify what to measure Communication tool Endorsed by National Grants Office as a way
to address EPA Order 5700.1 Endorsed by OMB (conference website)
![Page 16: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/16.jpg)
16
Logic Model Template
Resources Activities Outputs Outcomes/Results
What do we need to operate this program well?
What are we doing to achieve our intended results?
How many, how often, over what duration?
So what?
What difference are we making?
![Page 17: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/17.jpg)
17
Criteria for Good Measures
VALUEMeaningful Outcomes BeansUnderstandable
Clear ComplexUseful
Sliced bread File 13
BURDEN# Measures
Few ManyCollecting Difficulty
Simple HardData System Cost
Low HighExpertise required
User-friendly Geeks
![Page 18: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/18.jpg)
18
Performance Measures Quadrant Analysis
Value
Burden
OUTCOMENIRVANA
OUTPUTHELL
Low
High
High Low
![Page 19: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/19.jpg)
19
Example of a good measure….
From OMB’s website Efficiency measure: Percent reduction in
review time for registration of conventional pesticides
![Page 20: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/20.jpg)
20
Why is this a good measure?
Properly assists the program in improving its administrative efficiency
Important to stakeholders Reduction in time, taking into account various
steps in the process, is a valuable method for improving efficiency and potentially cost effectiveness
![Page 21: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/21.jpg)
21
WHY do we care? Because…
As public servants, we must assume responsibility
We are always searching for the highest quality public service at the lowest cost
We want to use whatever information is available to improve programs
Remembering that we are the trustees for the public’s monies
![Page 22: PERFORMANCE MEASURES: So WHY should I care?](https://reader036.vdocument.in/reader036/viewer/2022081603/5681478e550346895db4be33/html5/thumbnails/22.jpg)
22
WHY do we care? Because…
Meaningful Accountability =
Good Management =
Good Government