program design and implementation are they the same thing? where does measurement fit? september...

Program Design and Program Design and ImplementationImplementation

Are they the same thing?Are they the same thing?Where does measurement fit?Where does measurement fit?

September 2013September 2013

Kansas State Department of Educationwww.ksde.org

Program Design vs. Implementation

Program Design – the key components – how the model works

Implementation – putting it into practice – the do


Begin with the PAT Logic Model


Essential Requirements Research informed key components identified

by the model developer as essential to the Program Design in order to achieve the stated outcomes.

Ensures that the model is implemented as intended.

Ensures a level of consistency from one model program to another.


How To Vote via Texting

1. Standard texting rates only (worst case US $0.20)2. We have no access to your phone number3. Capitalization doesn’t matter, but spaces and

spelling doTIPS

EXAMPLE


Essential Requirements


Quality Standards & Guidance Documents

Provide additional detail to aid in understanding program model design – the intention. How do I do this? How often? Who is responsible? How do I document?


Program Measure – where does it fit in?

Measurement: Program Outputs – how many Program Measurement – how well we are

meeting the program design through our actions. Outcome Measurement – Does what we do make

a difference?


Assessing for Continuous Quality Improvement


Quality Endorsement

Both a process and a recognition. Represents a shared commitment by the affiliate

and national office to comprehensive internal and external assessment.

Publicly affirms that an affiliate is meeting established standards of quality.


Making Data Work for YOU


Input: Declining $

Loss of $955,308 over 5 years


Inputs & Outputs: Total State and Local Funding & Number of Children Served


Performance Measures


2011-12 Statewide Performance on Essential Requirements

ER #9a 23%ER #9b 6%ER #10a 49%ER #12a 43%ER #12b 17%ER #15a 75%ER #15b 66%ER #15c 81%ER #16 21%

The chart below provides performance measure results that focus specifically on the essential requirements for service delivery to families. The purpose of this information is to assist you with understanding your affiliate's level of fidelity of implementation and to inform the process of continuous quality improvement (CQI). It is recommended that the service delivery areas presented in this chart that are below a 60% performance level are prioritized for CQI activities over the next program year.

Performance Measures for Service Delivery Essential Requirements: Kansas

23%

6%

49%43%

17%

75%

66%

81%

21%

0%

20%

40%

60%

80%

100%

120%

ER #9a ER #9b ER #10a ER #12a ER #12b ER #15a ER #15b ER #15c ER #16

Service Delivery Performance Measure


2012-13 Statewide Performance on Essential Requirements


Families Retained Annually


Families No Longer Enrolled at End of Year


Families Engaged/Attended At Least One Group Connection


Program Outcomes


Children Are Screened

NOTE: FY 12 PAT National data collection change – not comparable data. FY 13 data collection included prior screening question.


Children Received Follow Up Services


Children Are Fully Immunized

NOTE: New Immunization check practice implemented in FY 10


Parent Satisfaction Survey


Foundations for School Success


Always remember it’s about moving forward – even if that forward is baby steps. If you’re

moving, you can change direction.

program design and implementation are they the same thing? where does measurement fit? september...

Documents

total state

model program

orgprogram design

program outputs

understanding program

model developer

measurement fit

comparable data