Objectives for Session TwelveObjectives for Session Twelve

Evaluate and Discuss Evaluation Designs Evaluate and Discuss Evaluation Designs in Two Assigned Articlesin Two Assigned Articles

Formative Designs Due on WednesdayFormative Designs Due on Wednesday

Evaluating Evaluation DesignsEvaluating Evaluation DesignsSummative evaluation, formative evaluation, or Summative evaluation, formative evaluation, or a summative-formative hybrid?a summative-formative hybrid?

What is the program theory? What is the program theory?

What is the implementation theory?What is the implementation theory?

How did the authors collect data? How did How did the authors collect data? How did they select cases or observations? they select cases or observations?

Evaluating Evaluation DesignsEvaluating Evaluation DesignsHow would you evaluate the strength of the How would you evaluate the strength of the research design? Assess the validity and research design? Assess the validity and reliability of the data.reliability of the data.

Where could the design be improved? What Where could the design be improved? What would a more “ideal” study look like?would a more “ideal” study look like?

When reading the article, what are the three When reading the article, what are the three most important insights generated about how most important insights generated about how administrators might improve program administrators might improve program implementation? implementation?

Readings for Next TimeReadings for Next TimeFormative Design Proposal Due on Wednesday at the beginning of class– 10 to 12 pages double-spaced, 12 point font, 1 inch margins– Cover sheet!!!

Weiss, Chapter 14

Patton, “Power, Politics, and Ethics”

Brown, J. Lynne and Nancy Ellen Kiernan. “Assessing the Subsequent Effect of A Formative Evaluation on a Program,” Evaluation and Program Planning, 24(2001): 129-43.

Review Weiss, Chapters 2 and 3