outcomes based accountability the fiscal policy studies institute websites raguide.org...
TRANSCRIPT
Outcomes BasedAccountability
The Fiscal Policy Studies Institute
Websitesraguide.org
resultsaccountability.com
Book - DVD Ordersamazon.com
resultsleadership.org
TM
"TURNING THE CURVE"
SIMPLE
COMMON SENSE
PLAIN LANGUAGE
MINIMUM PAPER
USEFUL
Outcomes-Based Accountabilityis made up of two parts:
Performance Accountabilityabout the well-being of
CUSTOMER POPULATIONSFor Services – Agencies – and Service Systems
Population Accountabilityabout the well-being of
WHOLE POPULATIONSFor Communities – Cities – Counties – States - Nations
Outcome-Based Accountability
COMMON LANGUAGE
COMMON SENSE
COMMON GROUND
THE LANGUAGE TRAPToo many terms. Too few definitions. Too little discipline
Benchmark
Target
Indicator Goal
Result
Objective
Outcome
Measure
Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic
Lewis Carroll Center for Language DisordersMeasurable urgent systemic indicatorsCore qualitative strategic objectivesYour made up jargon here
DEFINITIONS
Children born healthy, Children ready for school, Safe communities, Clean Environment, Prosperous Economy
Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate
1. How much did we do? 2. How well did we do it? 3. Is anyone better off?
OUTCOME or RESULT
INDICATOR or BENCHMARK
PERFORMANCE MEASURE
A condition of well-being for children, adults, families or communities.
A measure which helps quantify the achievement of an outcome.
A measure of how well a program, agency or service system is working. Three types:
Popu
latio
nPe
rform
ance
Children born healthy
Rate of low-birthweight babies Percent ready at K entry
Children ready for school
crime rate
Safe communities
air quality index
Clean Environment
unemployment rate
Prosperous Economy
INDICATOR
OUTCOME
PERFORMANCE MEASURE
Popu
latio
nPe
rform
ance
= Customer Outcome
1.
2.
3.
From Ends to Means
ENDS
MEANS
From Talk to ActionPo
pula
tion
Perf
orm
ance
OUTCOME
INDICATOR
PERFORMANCEMEASURE
Customer outcome = EndsService delivery = Means
From Talk to Action
POPULATIONACCOUNTABILITY
Fiscal Policy Studies InstituteSanta Fe, New Mexicowww.resultsaccountability.comwww.raguide.org
For Whole Populationsin a Geographic Area
Community Outcomesfor Christchurch, NZ
1. A Safe City
2. A City of Inclusive and Diverse Communities
3. A City of People who Value and Protect the Natural Environment
4. A Well-Governed City
5. A Prosperous City
6. A Healthy City
7. A City for Recreation, Fun and Creativity
8. City of Lifelong Learning
9. An Attractive and Well-Designed City
Every Child Matters – Children Act
Outcomes for Children and Young People
Being Healthy: enjoying good physical and mental health and living a healthy lifestyle.
Staying Safe: being protected from harm and neglect and growing up able to look after themselves.
Enjoying and Achieving: getting the most out of life and developing broad skills for adulthood.
Making a Positive Contribution: to the community and to society and not engaging in anti-social or offending behaviour.
Economic Well-being: overcoming socio-economic disadvantages to achieve their full potential in life.
City of London Ontario, CanadaPriority Results
● A Strong Economy
● A Vibrant Diverse Community
● A Green and Growing City
● A Reliable Infrastructure
● A Safe City
Source: Draft Strategic Plan Sept 2011
New Zealand
Coventry, UKSanta Cruz, CA
Halton Ontario
Leaking Roof(Outcomes thinking in everyday life)
Experience
Measure
Story behind the baseline (causes)
Partners
What Works
Action Plan
Inches of WaterBASELINE
? Fixed
Not OK
Turning the Curve
Action Plan #2
Baseline & Story
Outcomes
Indicators
Rebound
6.00%
8.00%
10.00%
12.00%
14.00%
16.00%
18.00%
20.00%
Ncle 14.5 14.5 16.8 14.5 17 15 11.9 10.6 9.5 9.3
1998 1999 2000 2001 2002 2003 2004 2005 2006 2007
Source: Connexions Tyne and Wear, UK
Newcastle, UK
Revised 9 Nov 2007
Nov 08 – Jan 09
8.5
no. of Tagged Sites visited
02000400060008000
1000012000140001600018000
2001
/02
2002
/03
2003
/04
2004
/05
2005
/06
2006
/07
2007
/08
2008
/09
2009
/10
year
no
. of
site
s
2001/02
2002/03
2003/04
2004/05
2005/06
2006/07
2007/08
2008/09
2009/10
Christchurch, New ZealandNumber of Graffiti Sites
FY 2002 to FY 2010
Hull, UK"Woundings"
Performance Accountability
For Services, Agencies and Service Systems
Fiscal Policy Studies InstituteSanta Fe, New Mexicowww.resultsaccountability.comwww.raguide.org
“All Performance Measures
that have ever existed
for any service
in the history of the universe
involve answering two sets of
interlocking questions.”
HowMuchdid we do?
( # )
HowWell
did we do it?
( % )
Quantity Quality
Service Performance Measures
EffortHow hard did we try?
EffectIs anyone better off?
Service Performance Measures
Effort
Effect
HowMuch
HowWell
Service Performance Measures
How much service did we deliver?
Service Performance Measures
How welldid we
deliver it?
How much change / effect
did we produce?
What quality of change / effect
did we produce?
Quantity Quality
Effe
ct
Effo
rt
O
utpu
t
In
put
How much did we do?
Service Performance Measures
How welldid we do it?
Is anyonebetter off?
Quantity Quality
Effe
ct
Effo
rt
# %
How much did we do?
Education
How well did we do it?
Is anyone better off?
Quantity Quality
Effe
ct
E
ffort Number of
studentsStudent-teacher
ratio
Number of 16 olds with 5 A to C
GCSE’s
Number of fixedterm exclusions
Percent of 16 yr olds with 5 A to C
GCSE’s
Rate of fixedterm exclusions
How much did we do?
Pediatric Practice
How well did we do it?
Is anyone better off?
Number ofpatientstreated
Percent ofpatients treated
in less than1 hour
Quantity Quality
Effe
ct
E
ffort
#children
fullyimmunized
(in the practice)
%children
fullyimmunized
(in the practice)
How much did we do?
Drug/Alcohol Treatment Program
How well did we do it?
Is anyone better off?
Number ofpersonstreated
Percent ofstaff withtraining/
certification
Number of clientsoff of alcohol & drugs - at exit - 12 months after exit
Percent of clientsoff of alcohol & drugs - at exit - 12 months after exit
Quantity Quality
Effe
ct
E
ffort
How much did we do?
Fire Department
How well did we do it?
Is anyone better off?
Number ofresponses
ResponseTime
Quantity Quality
Effe
ct
E
ffort
# of fireskept to
room of origin
% of fireskept to
room of origin
How much did we do?
Not All Performance Measures Are Created Equal
How well did we do it?
Is anyone better off?
LeastImportant
Quantity Quality
Effe
ct
E
ffort
MostImportant
Least
Most
AlsoVery Important
Quality
How much did we do?
The Matter of Control
How well did we do it?
Is anyone better off?
Quantity Quality
Effe
ct
E
ffort
LeastControl
PARTNERSHIPS
MostControl
How much did we do?
Performance AccountabilityTypes of Measures found in each Quadrant
How well did we do it?
Is anyone better off?
# Clients/customers served
# Activities (by type of activity)
% Common measurese.g. client staff ratio, workload ratio, staffturnover rate, staff morale, % staff fully trained, % clients seen in their own language,worker safety, unit cost
% Skills / Knowledge (e.g. parenting skills)
#
% Attitude / Opinion (e.g. toward drugs)
#
% Behavior (e.g.school attendance)
#
% Circumstance (e.g. working, in stable housing)
#
% Activity-specific measures
e.g. % timely, % clients completing activity, % correct and complete, % meeting standard
Point in Timevs.
2 Point Comparison
# %
LR
UR
Primary v. Secondary
Direct v. Indirect
Internal v. External
Baseline & Story
How Population
&Performance Accountability
FIT TOGETHER
Contributionrelationship
Alignmentof measures
Appropriateresponsibility
THE LINKAGE Between POPULATION and PERFORMANCE
POPULATION ACCOUNTABILITY
Healthy Births Rate of low birth-weight babiesStable Families Rate of child abuse and neglect Children Ready for School Percent fully ready per K-entry assessment
CUSTOMERRESULTS
# ofinvestigations
completed
% initiatedwithin 24 hrs
of report
# repeatAbuse/Neglect
% repeatAbuse/Neglect
PERFORMANCE ACCOUNTABILITY
POPULATIONRESULTS
Child Protective Services
3 - kinds of performance measures. How much did we do? How well did we do it? Is anyone better off?
OBA in a Nutshell2 – 3 - 7
2 - kinds of accountability Population accountability Performance accountability
7 - questions from ends to means in less than an hour. Baselines and Turning the Curve
plus language discipline Outcomes & Indicators Performance measures
“If you do what you always did,
you will get what you always got.”
Kenneth W. JenkinsPresident, Yonkers NY NAACP
------Book - DVD Orders------amazon.com
resultsleadership.org
THANK YOU !Websites
raguide.orgresultsaccountability.com