evaluation 101: how to find out if :kdw
TRANSCRIPT
![Page 1: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/1.jpg)
Evaluation 101: How to Find out if
Doing is Working
Jessica Dym Bartlett, M.S.W., Ph.D. Mallary I. Swartz, Ph.D.
Elisa Vele-Tabaddor, Ph.D.
Brazelton Touchpoints Center Division of Developmental Medicine
www.brazeltontouchpoints.org 1
![Page 2: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/2.jpg)
Introductions
2
![Page 3: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/3.jpg)
Where to Start
Start with a Good Question
What do you want to know about your program/initiative?
What do you want to know about your services/initiative activities?
3
![Page 4: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/4.jpg)
Types of Evaluation
Needs/Demand Assessment Systematic collection and analysis of information nature of problem and resources
Process/Formative Evaluation Whether programs and activities are operating as planned
Outcome Evaluation Whether programs and activities affect outcomes for participants
4
![Page 5: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/5.jpg)
Participatory Evaluation
Involve participants and programs in evaluation design and implementation Ensure all aspects of the evaluation are made accessible to participants Value process evaluations
View the evaluator role more broadly
5 Patton, MQ (2008). Utilization-focused evaluation: The new century text, fourth edition. Thousand Oaks, CA: Sage. Slide adapted -Tiered Approach 11/1/2012
![Page 6: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/6.jpg)
Developmental Evaluation
Long-term relationships between evaluators and program developers Ask evaluative questions and gather information to provide feedback to program Evaluator is part of collaborative team focused on continuous improvement.
Patton, M.Q. (2008). Utilization-focused evaluation: The new century text, 4th ed. Thousand Oaks, CA: Sage.
6
![Page 7: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/7.jpg)
Evaluation Design
Non-Experimental/Pre-Post One group of program participants
Quasi-Experimental Non-randomly selected comparison group
Experimental
Random assignment to treatment and control groups
7
![Page 8: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/8.jpg)
Sampling
8
Statistical (probability) sampling Random selection of individuals from the population to ensure sample is representative
Non-statistical (judgment) sampling Based on knowledge about population No structured statistical process
Purposeful sampling Selects specific informants best able to answer questions of interest
-
![Page 9: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/9.jpg)
Types of Data
Quantitative vs. Qualitative
Primary vs. Secondary
Cross-sectional vs. Longitudinal
Case-specific vs. Aggregate
9
![Page 10: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/10.jpg)
Common Data Collection Strategies & Measures
Document Review Interviews & focus groups Observations Surveys Standardized Measures Non-Standardized (Home-Grown) Measures
10 -
![Page 11: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/11.jpg)
Ethical Concerns
Informed consent Privacy, confidentiality, anonymity Harm or risk Intervention and advocacy Soundness of research Ownership of data Use of results
11
Adapted from: Miles, M.B. & Huberman, A.M. (1994). Qualitative data analysis: An expanded sourcebook. 2nd ed. Thousand Oaks, CA: Sage Publications.
![Page 12: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/12.jpg)
outside evaluation expert!
12
![Page 13: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/13.jpg)
Small Group Exercise: Creating an Evaluation Plan
13
![Page 14: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/14.jpg)
Large Group Discussion
How was this planning process for you?
What issues came up in your group?
14
![Page 15: Evaluation 101: How to Find out if :KDW](https://reader033.vdocument.in/reader033/viewer/2022043013/5fac59be54a2b013691cd86c/html5/thumbnails/15.jpg)
Wrap-up
15