empowerment evaluation with david fetterman
DESCRIPTION
Check out these slides from our webinar with David Fetterman on Empowerment Evaluation.TRANSCRIPT
CROSS CULTURAL
The International: Crew
Australia Canada Ethiopia Finland Mexico Nepal New Zealand South Africa
3The Engine
Definition Theory Concepts Steps
EE?
Use of evaluation concepts, techniques, & findings to foster improvement & self-determination
Expanded definition An evaluation approach that aims to increase the probability of achieving program success by (1) providing program stakeholders with tools for assessing the planning, implementation, & self-evaluation of their program, & (2) mainstreaming evaluation as part of the planning & management of the program/organization.
Empowerment Evaluation
Underlying Theories of Empowerment Evaluation
PROCESS USE: the more that people engage in the act of conducting their own evaluations the more likely it is that they will find the results credible and act on the recommendations
Knowledge Utilization
Theory Number One
Aligning Theories of Action and Use
theory of action theory of use
espoused observed behavior
Theories Number Two and Three
Key Empowerment Evaluation Concepts
Evidence
Critical Friend
Culture of Evidence
Cycles of Reflection & Action
Community of Learners
Reflective Practitioners
Coaching: Critical Friend
Critical Friend - believes in the type of program but still asks the critical questions to ensure an honest but constructive critique and self-assessment (including across grantees)
Critical Friend
1. Mission 2. Taking Stock 3. Planning for the Future
Empowerment Evaluation3 Steps
1. Democratic 2. Transparent 3. Group Values 4. Honor existing mission but go where
the energy is in the room 5. Giving Voice and Making Meaning
Mission
• List activities
• Prioritize (dots)
Taking Stock (Part I)
Activities Prioritization with Dots
Communication
!Product Development
!Fundraising
• Rating 1 (low) – 10 (high)
• Dialogue
Taking Stock (Part II)
Activities DF DE SEC AVG.Communicatio
n3 6 3 4
Teaching 4 5 9 6
Funding 5 2 1 2.67Prod Dev Develop
1 8 4 4.33
Average 3.25 5.25 4.25 4.25
• Goals • Strategies • Evidence
Planning for the Future
Accountability & Outcomes
• Arkansas - Academically Distressed Schools
!
• Hewlett Packard - $15 Million Digital Village
• Stanford School of Medicine - Curriculum
!
• Arkansas - Tobacco Prevention Programs
GainsAltheimer Comparison
August 2002 to January 2003
7.4 7.1 7.2 6.9 6.7 6.1 5.96.7 6.5 6.2
6.9 6.5 5.95.2 5
5.9 5.3 5.9 5.3 4.7
Tea
chin
g
Pla
nn
ing
Cla
ssroom
Man
agem
ent
Coop
eratio
n
Motiv
atio
n
Reso
urces
Com
mu
nica
tion
Assessm
ent
Positiv
e Rela
tion
ship
s
Up
date P
aren
ts
0
2
4
6
8
10
Aug. 2002 Jan. 2003
Aug. 2002 6.9 6.5 5.9 5.2 5 5.9 5.3 5.9 5.3 4.7
Jan. 2003 7.4 7.1 7.2 6.9 6.7 6.1 5.9 6.7 6.5 6.2
Test ScoresElaine School District
59
38.5
0
10
20
30
40
50
60
70
Percent of Students at or below the 25th percentile
Fall 2001 Spring 2003
Tribal Digital Village
Largest Wireless System in the Country
Stanford School of Medicine
p=0.04 Dialogue
STEP 1
PGY-1
Accreditation
Arkansas Tobacco Prevention: ROI
Grantee Evaluation Dashboard
• Goals (where grantee wants to go at the end of 5 years)
• Benchmarks (points along the way each year)
• Actual Performance (where grantee is now - today)
• Baseline (where grantee started)
Tobacco-Free Environment Program
Dashboard - 1 Year
Actual Performance 0 1 3
Benchmarks 1 2 3 4
Goals 4 4 4 4
Baseline 1 1 1 1
Qtr 2Qtr 1 Qtr 3 Qtr 4
1 Year Tobacco-Free Environment
0
1
2
3
4
Baseline Qtr 1 Qtr 2 Qtr 3 Qtr 4
Actual
Benchmark
Goal
4 Quarter -Tobacco-Free Environment: Baseline, Benchmarks, Actual
Performance & GoalActual Performance Benchmarks
5 Year Tobacco-Free Environment
0
5
10
15
20
25
30
Baseline 2010 2011 2012 2013 2014
30
21
18
9
22
30
20
15
10
5
0
Benchmark Number of Tobacco-Free EnvironmentsActual Number of Tobacco-Free Environments
Act
ual
Ben
chm
ark
Goal
Building Evaluation Capacity
Arkansas Evaluation Center
Tech Tools
Technological Tools of the Trade: A Metaphor
Align Tools with the Principles of Empowerment
Evaluation
Online Surveys Digital Photography
Blogs Picture Sharing
Docs & Spreadsheets Collaborative Web Sites
Videoconferencing YouTube
Word Cloud
YouTube
Infographics Data Visualization
Evaluation Capacity Building: Empowerment
2013
Stanford University Press New!
2014
Sage Press
Radio Interviews: New Frontiers
Dr. David Fetterman [email protected]
!(650) 269-5689
Fetterman & Associates
25 Years Experience at
Stanford University
American Evaluation
Association!Past-President