evaluation planning presentation - ydekc · steps to creating an evaluation plan 1. identify...

14
PLANNING FOR EVALUATION Using Your Logic Model as a Blueprint for Improvement

Upload: others

Post on 05-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

PLANNING FOR EVALUATION

Using Your Logic Model as a Blueprint for Improvement

Page 2: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

Agenda

• Evaluation purposes and audiences

• Using your Logic Model to ask evaluation questions

• Prioritizing your evaluation questions

• Data collection considerations

• Using planning tools

Page 3: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

Youth Development Executives of King County

(YDEKC) is a coalition of youth-serving organizations

working to advance the youth development field in

order to improve outcomes for young people.

Representing the executive leadership of King County

based youth serving organizations, YDEKC is uniquely

positioned to advocate for its members with the systems

(school districts, governments, the public) that they intersect

with; to develop field level knowledge about best

practices in youth development; and to build leadership

strength in the non-profit youth serving sector.

Who We Are

Page 4: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

Plan Collect Reflect

Page 5: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

Steps to Creating an Evaluation Plan

1. Identify evaluation purpose(s) and audience(s)

2. Use your logic model to clarify evaluation questions

3. Specify indicators that can help answer evaluation questions

4. Map data collection, analysis, and reporting strategies for indicators

5. Sketch out an evaluation timeline and budget

Involve program stakeholders – including young people – in every part of the process!

Page 6: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

1. Evaluation Purposes and Audiences

Purposes

• Positioning of your

program and its work in

the public consciousness

• Improvement of the

program on an ongoing

basis

• Proof of program impact

Audiences

• External stakeholders

(funders, community

members, partners and

potential partners)

• Internal stakeholders

(staff, parents, young

people)

Page 7: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

2. Logic Model → Evaluation Questions

Page 8: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

Types of Evaluation Questions

• Feedback loops

What do participants value about our program?

• Program process (outputs, activities, participation)

Are we serving the youth we intend to serve?

• Program outcomes (learning, action, conditions)

What percentage of our participants graduate from high school?

• Linking process and outcomes

Do participants who attend our program more frequently do better?

Page 9: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

3. Specifying indicators

Outcome: Improved postsecondary performance

Indicators:

• % enrolling directly in college after high school graduation

• % enrolling in college within 2 years of graduation

• % placing directly into college-level math courses

• % persisting in college

• # college credits earned

• college grade point average (GPA)

• % earning a degree within 6 years

Page 10: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

4. Collecting, Analyzing, Reporting

Indicator design

template from our

Evaluation Planning

worksheet

Page 11: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

5. Creating a Timeline and Budget

• A timeline can help you to:

• Ensure readiness for evaluation activities

• Minimize burden on participants and staff

• A budget is:

• Sometimes required

• Helpful in making sure that adequate resources are available to

answer high-priority questions

Page 12: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

Evaluation Timeline Worksheet

Page 13: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

Budgeting Tools

Page 14: Evaluation Planning Presentation - YDEKC · Steps to Creating an Evaluation Plan 1. Identify evaluation purpose(s) and audience(s) 2. Use your logic model to clarify evaluation questions

“Bottom Up” Approach

Attributable Impact

Longer-Term Satisfaction or

Success/ Transfer Outcomes

Initial Perceived Satisfaction or Success/Learning

Outcomes

Participation

Your Own Activity

Adapted from Idealware, “10 Tips

for Measuring Programs through

Data”

Ou

tpu

ts

Ou

tco

me

s

Co

mp

lexity /

Difficu

lty / E

xp

en

se

o

f M

ea

su

rem

ent Requires

Rigorous

Research

Start

Here!

Consider if

Feasible