![Page 1: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/1.jpg)
Key Performance Measures, Evaluation Plans,
and Work Plan
Shelley Kuklish
Epidemiologist
Arizona Nutrition Network
![Page 2: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/2.jpg)
Session Objectives
By the end of this session, participants will be able to:
1. Complete the Key Performance Measures, Evaluation Plans, and Work Plan Sections of the application
2. Write S.M.A.R.T. objectives
3. Write succinct action steps
4. Identify an evaluation plan for each objective
![Page 3: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/3.jpg)
Application
• It is recommended that you:– Complete Work Plan (Appendix B) before
completing Key Performance Measures and Evaluation Plans on the “Project Overview” sheet
![Page 4: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/4.jpg)
![Page 5: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/5.jpg)
Housekeeping
• We will be working on a ‘sample’ work plan one step at a time.
• Goal is that you leave here with at least one objective, one action step and one evaluation plan for that objective.– Can be used as an example for writing the rest of your FY10
work plan
• During the practice, Network staff will walk around to help as necessary.
• Be polite and tolerant of other’s opinions. – The goal of this training is to teach you HOW to write your work
plan, not WHAT you are doing to teach SNAP-ED.
![Page 6: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/6.jpg)
Work Plan
![Page 7: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/7.jpg)
![Page 8: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/8.jpg)
![Page 9: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/9.jpg)
Writing Objectives
![Page 10: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/10.jpg)
![Page 11: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/11.jpg)
Goals vs. Objectives
• A GOAL is:– A broad statement of intent– Non-specific, non-measurable
– Example:• Increase the proportion of SNAP recipients and
eligibles aged two years and older who meet dietary recommendations for fruit and vegetable consumption.
![Page 12: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/12.jpg)
Goals vs. Objectives
• An OBJECTIVE is:– A realistic target for the program– Answers: Who will do how much of what by
when?
– Example:• By the end of the class series, 50% of low income
3rd grade students participating in the FVMM classes will report an increase in fruit and vegetable consumption.
![Page 13: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/13.jpg)
S.M.A.R.T. Objectives
• S.M.A.R.T. objectives are:– Specific
– Measurable
– Achievable
– Relevant
– Time Bound
![Page 14: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/14.jpg)
• Specific • Measurable• Achievable• Relevant• Time Bound
• What are you going to do, with or for whom?– Focus on results, not
how they are achieved.
![Page 15: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/15.jpg)
• Specific
• Measurable• Achievable• Relevant• Time Bound
• Is the objective measurable?– Quality– Resources– Quantity– Time
![Page 16: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/16.jpg)
• Specific • Measurable
• Achievable• Relevant• Time Bound
• Can you achieve this objective? – Set objective after
considering the baseline
– Keep objectives within reach
• Is this objective realistic?– Can we do this?– Why are we doing
this?
![Page 17: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/17.jpg)
• Specific • Measurable• Achievable
• Relevant• Time Bound
• Is this objective logical as it relates to SNAP-Ed goals?
![Page 18: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/18.jpg)
• Specific • Measurable• Achievable• Relevant
• Time Bound
• What is the timeframe for this objective? – For the Network
purposes, the time frame generally is by September 30, 2010
![Page 19: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/19.jpg)
Objectives Apply to 3 Areas
• Process (Operational)
• Impact (Knowledge)
• Outcome (Behaviors)
![Page 20: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/20.jpg)
Process Objectives(Operational)
• Tells what you are doing and how you will do it– Tracks participants, interactions and activities– Example:
• By September 30, 2010 at least 5,000 Fun Food News will be distributed to SNAP-Ed participants at community events.
![Page 21: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/21.jpg)
Impact Objectives(Knowledge)
• Tells how you will change attitudes and knowledge– Example:
• By the end of the class series, 80% of low income 3rd grade students participating in the BBB classes will increase their knowledge of activities that help build strong bones.
![Page 22: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/22.jpg)
Outcome Objectives(Behavior)
• Tells what the long term implications of your program will be. – Example:
• By the end of the class series, 50% of low income 3rd grade students participating in the FVMM classes will report an increase in fruit and vegetable consumption.
![Page 23: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/23.jpg)
Easy Way to Write a SMART Objective
• Answer the following question:– Who will do– How much– Of What– By When?
• Example:– By the end of the class series, 50% of low income 3rd
grade students participating in the FVMM classes will report an increase in fruit and vegetable consumption.
![Page 24: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/24.jpg)
Your Turn!Write An Objective Statement
• Make sure that it meets the SMART requirements– Specific – Measurable– Achievable– Relevant– Time Bound
• Answer the following questions:– Who will do– How much– Of What– By When?
![Page 25: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/25.jpg)
By the end of the class series, 50% of low income 3rd grade students
participating in the FVMM classes will report an increase in fruit and vegetable consumption.
(FVMM survey baseline 48%)
By September 30, 2010, teach the importance of eating fruits and
vegetables through the FVMM classes to at least 500 low-income 3rd grade
students.
![Page 26: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/26.jpg)
Writing Action Steps
![Page 27: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/27.jpg)
![Page 28: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/28.jpg)
Action Steps vs Objectives
• Action Step– Focus on the activities– Provide the ‘How’
• Objective– Focuses on the results– Provide the ‘What’
![Page 29: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/29.jpg)
Action Steps
– Should work towards the objective.– Should provide how you will attain your
objective.– Be brief and succinct.
ObjectivesObjectives
Act
ion
Ste
ps
Act
ion
Ste
ps
![Page 30: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/30.jpg)
Example:
Objective: – By the end of the class series, 50% of low
income 3rd grade students participating in the FVMM classes will report an increase in fruit and vegetable consumption.
Action Step: – 1.Teach FVMM classes to low income 3rd
grade students in 18 schools.– 2. Conduct pre-/post-surveys
![Page 31: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/31.jpg)
Your Turn!Write an Action Step
• Using the objective statement you wrote in section 1, write at least 1 action step for this objective.
• Remember:– Action steps should work towards the objective.– Should provide how you will attain your objective.– Be brief and succinct.
![Page 32: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/32.jpg)
By the end of the class series, 50% of low income 3rd grade students
participating in the FVMM classes will report an increase in fruit and vegetable consumption.
(FVMM survey baseline 48%)
Coordinate with 18 schools to conduct FVMM classes.
Meet with teachers to schedule FVMM classes.
Teach FVMM classes to low income 3rd grade students in 18 schools.
Conduct pre/post-test evaluations.
By September 30, 2011, teach the importance of eating fruits and vegetables
through the FVMM classes to at least 500 low-income 3rd grade
students.
Teach FVMM classes to low income 3rd grade students in 18 schools.
![Page 33: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/33.jpg)
Writing Evaluation Plans
![Page 34: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/34.jpg)
![Page 35: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/35.jpg)
Evaluation Measures
• Formative – Collects data for improvement of
program/processes
• Process – Evaluates that the program is being delivered
as planned
• Impact/Outcome – Measure change in knowledge, attitudes or
behaviors
![Page 36: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/36.jpg)
Formative Evaluation
• Formative research is conducted before a program is designed and implemented, or while a program is being conducted.
• It helps you:– Decide on and describe your target audience, – Understand the needs of the audience and the factors
which influence their behavior– Helps you to design programs, services, and products
to address those needs.
![Page 37: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/37.jpg)
Examples of Formative Evaluation
• Needs assessments
• Focus group discussions
• In-depth interviews
• Market assessments
• Teacher evaluations
• Pilot programs where content of nutrition education is tested and evaluated, etc.
![Page 38: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/38.jpg)
Process Evaluation
• Process evaluation focuses on how the program operates, the services it delivers, and the function it carries out.
• It addresses whether the program was implemented and is providing services as intended.
![Page 39: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/39.jpg)
Examples of Process Evaluation
• Tracking:– Number of materials distributed – Number of clients viewing a food
demonstration – Number of classes held – Number of participants reached
![Page 40: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/40.jpg)
Outcome/Impact Evaluation
• An outcome or impact evaluation assess the change in knowledge or behaviors as a result of a particular program or intervention.
• The goal of an outcome or impact evaluation is to learn how effective the intervention was in changing the target populations' attitudes, awareness, and behaviors.
![Page 41: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/41.jpg)
Examples of Outcome/Impact Evaluation
• Impact– Pre-/post-test showing an increase in
knowledge
• Outcome– Pre-/post-surveys showing an improvement in
self-reported behaviors
• Point-in-time surveys, tracked over time
![Page 42: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/42.jpg)
Example:
• Objective: – By the end of the class series, 50% of low income 3rd
grade students participating in the FVMM classes will report an increase in fruit and vegetable consumption.
• Action Steps: – 1. Teach FVMM classes to low income 3rd grade
students in 18 schools.– 2. Conduct pre/post-test evaluations.
• Evaluation Plan:– Conduct pre- and post-surveys using FVMM
consumption survey. (Baseline 48%)
![Page 43: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/43.jpg)
Baselines
• Clearly defined starting point from where implementation begins, improvement is measured, or comparison is made
• The first data point for your evaluation– Allows you to create achievable objectives by
providing a starting point.– Allows for tracking trends over time.
![Page 44: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/44.jpg)
Evaluation Plans Should Tie Directly to The Objective
• Process objective=process evaluation– Example:
• Objective: Teach FVMM curriculum to 1,000 students in FY 2010• Evaluation: Track number of students participating via attendance
records
• Impact objective=impact evaluation– Example:
• Objective: 5th graders increasing knowledge of osteoporosis prevention
• Evaluation: Pre/Post-test measuring knowledge
• Outcome objective=outcome evaluation– Example:
• Objective: 3rd graders increasing fruit and vegetable consumption• Evaluation: Pre/Post-test measuring consumption
![Page 45: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/45.jpg)
Your Turn!Write An Evaluation Plan
• Remember:– Evaluation plans tie to the OBJECTIVE– Process objective=process evaluation– Impact objective=impact evaluation– Outcome objective=outcome evaluation
![Page 46: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/46.jpg)
By the end of the class series, 50% of low income 3rd grade students
participating in the FVMM classes will report an increase in fruit and vegetable consumption.
(FVMM survey baseline 48%)
Teach FVMM classes to low income 3rd grade students in 18 schools.
Conduct pre/post-test evaluations.Conduct pre- and post- surveys using FVMM consumption survey
Coordinate with 18 schools to conduct FVMM classes.
Meet with teachers to schedule FVMM classes.
Track number of students using attendance records
Teach FVMM classes to low income 3rd grade students in 18 schools.
By September 30, 2011, teach the importance of eating fruits and vegetables
through the FVMM classes to at least 500 low-income 3rd grade
students.
![Page 47: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/47.jpg)
Things to Note
• You can include evaluation plans for each action step, however at least ONE evaluation plan must directly apply to the objective.
![Page 48: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/48.jpg)
Project Overview
![Page 49: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/49.jpg)
![Page 50: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/50.jpg)
![Page 51: Key Performance Measures, Evaluation Plans, and Work Plan](https://reader035.vdocument.in/reader035/viewer/2022062805/56814d70550346895dbac24e/html5/thumbnails/51.jpg)
Appendix F
• Send in samples of each evaluation tool used for impact/outcome evaluations
• Stephanie will give you more information in her presentation.