muskie school of public serviceinstitute for public sector innovation where we are trying to go?...

Muskie School of Public Service Institute for Public Sector Innovation

Where we are trying to go?

• Common outcome measures

• Quality data collection for outcomes

• A clear understanding of individual

program process measurement needs

• Program evaluation practiced locally


Purpose of Trainings

• To build capacity to move from reporting

inputs/outputs at program level (the

current state) to data-driven

performance measurement and

management linked to organizational

goals and priorities (the future state).


• Four Logic Model sessions starting in November

2008 and running through February 2009. These

sessions will be 3-4 hours each.

• Grantees will complete “Evaluation Planning”

Worksheets.

• Grantees will complete and submit a data

collection methodology.

• Grantees will submit data to Muskie by summer

2009.

Training Overview


• By early 2009, all JJAG grantees will have

developed a project-specific Logic Model(s)

and evaluation planning worksheets

• By mid 2009, grantees will have

developed/modified existing data collection

tools, developed an evaluation methodology,

and started to collect data.

Training Objectives - Overall


• Differentiate the 3 levels of evaluation

• Understand the Steps in the Evaluation

Process

• Recognize the advantages of Logic

Models

• Complete a Basic Logic Model

Training Objectives


• What have we done?

• How well have we done it?

• How much have we done?

• How effective has our program been?

• What could we do better or differently?

• Was it worthwhile?

• Was it important?

Program Evaluation Can Answer:


Use Three Levels of Evaluationto help answer the evaluation questions

• Process: (Interventions, Activities or Strategies)

• Impact: (Initial and Intermediate outcomes)

• Outcome: (Long-term outcomes)

Steps in the Evaluation Process

1. EngageStakeholders

2. DescribeProgram

3. Determine Evaluation

Design

4. CollectData

5. Analyze and

Interpret Data

6. Ensure Use and ShareLessonsLearned

START HERE


Program Overview Logic ModelProgram

ComponentsInitial

OutcomesLong-TermOutcomes

Interventions

IntermediateOutcomes

Process Impact Outcome


HIV Program Logic Model Template (for providers)

*remember YOUTH,RACIAL and ETHNICMINORITIES andPEOPLE with HIV throughout

*KANS=Knowledge, Attitudes, Norms, Skills; **B=Behavior

Unsafe Sex,Both Partners

Male

DecreasedHIV

trans-mission

Improved well-being

of HIVinfectedpeople

Program Components(priority populations)

Intervention Initial Outcomes(KANS)

IntermediateOutcomes

(B)

Long-TermOutcome(Health)

Group Level

Six session HIV prevention education group in Correctional settings.

Education will include condom use negotiation with sex partners.

Persons attending the groups will report an increase in the intent to negotiate condom use with sex partners.

Persons attending the groups will negotiate condom use with sex partners.

Persons attending the group will use condoms with their sex partners.


Data Sources ExerciseLong-Term

Outcome

Inter-mediate Outcome

Initial Outcome

Inter-ventions

Evaluation

Questions

Perform-ance

Indicators

Measures Data Sources

Timing


Expectations:

1. Grantees will be responsible for completing multiple worksheets between sessions.

2. We will monitor your progress and report any delays in submitting assignments.

3. Muskie will provide ample TA. You can call on us if you have any questions.

muskie school of public serviceinstitute for public sector innovation where we are trying to go?...

Documents