understanding and using early childhood outcome (eco) data for program improvement
DESCRIPTION
Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement . TASN – KITS Fall 2012 Webinar August 31 st , 2012 Tiffany Smith Phoebe Rinkel Chelie Nelson. Online Resources www.kskits.org. Agenda. Overview of the Early Childhood Outcome (ECO) Data - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/1.jpg)
Understanding and Using Early Childhood Outcome (ECO) Data for Program
Improvement TASN – KITS Fall 2012 Webinar
August 31st, 2012Tiffany Smith
Phoebe Rinkel Chelie Nelson
1
![Page 2: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/2.jpg)
2
Tiffany SmithKSDE, ECSE Program [email protected]
Phoebe RinkelKITS, Part B, TA [email protected]
Chelie NelsonKITS, Part B, TA [email protected]
![Page 3: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/3.jpg)
Online Resourceswww.kskits.org
3
![Page 4: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/4.jpg)
AgendaOverview of the Early Childhood Outcome (ECO)
DataKansas Data Drill Down Guide Case Study
Examining Policies and ProceduresExamining APR ReportsExamining ECO Addendum ReportsExamining Data VerificationExamining Child Level Data in OWS
4
![Page 5: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/5.jpg)
Early Childhood OutcomesOSEP required states to
submit outcome data in their State Performance Plan (SPP) and Annual Performance Report (APR)
2010 – 2011 (Federal Fiscal Year 2009) first year Districts and Part C Networks were compared to State targets
5
![Page 6: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/6.jpg)
The Three Early Childhood Outcomes
1. Positive social-emotional skills (including social relationships)
2. Acquisition and use of knowledge and skills (including early language/communication [and early literacy*])
3. Use of appropriate behaviors to meet their needs
*for 3-5 6
![Page 7: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/7.jpg)
How Kansas Early Childhood Outcome Data
is Reported
7
![Page 8: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/8.jpg)
States Report Data in these categories
Percentage of children who:a) Did not improve functioningb) Improved functioning, but not sufficient to
move nearer to functioning comparable to same-age peers
c) Improved functioning to a level nearer to same-age peers, but did not reach it
d) Improved functioning to reach a level comparable to same-age peers
e) Maintained functioning at a level comparable to same-age peers.
8
![Page 9: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/9.jpg)
Entry
Kasprzak & Rooney (2010)9
![Page 10: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/10.jpg)
Entry Exit
Kasprzak & Rooney (2010)10
![Page 11: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/11.jpg)
Entry Exit
Kasprzak & Rooney (2010)11
![Page 12: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/12.jpg)
States Report Data in these categories
Percentage of children who:a) Did not improve functioningb) Improved functioning, but not sufficient to
move nearer to functioning comparable to same-age peers
c) Improved functioning to a level nearer to same-age peers, but did not reach it
d) Improved functioning to reach a level comparable to same-age peers
e) Maintained functioning at a level comparable to same-age peers.
12
![Page 13: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/13.jpg)
Entry Exit
a
Kasprzak & Rooney (2010)13
![Page 14: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/14.jpg)
Entry Exit
a
Kasprzak & Rooney (2010)14
![Page 15: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/15.jpg)
States Report Data in these categories
Percentage of children who:a) Did not improve functioningb) Improved functioning, but not sufficient
to move nearer to functioning comparable to same-age peers
c) Improved functioning to a level nearer to same-age peers, but did not reach it
d) Improved functioning to reach a level comparable to same-age peers
e) Maintained functioning at a level comparable to same-age peers.
15
![Page 16: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/16.jpg)
Entry Exit
b
Kasprzak & Rooney (2010)16
![Page 17: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/17.jpg)
17
Entry Exit
b
Kasprzak & Rooney (2010)
![Page 18: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/18.jpg)
Entry Exit
b
Kasprzak & Rooney (2010)18
![Page 19: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/19.jpg)
States Report Data in these categories
Percentage of children who:a) Did not improve functioningb) Improved functioning, but not sufficient to
move nearer to functioning comparable to same-age peers
c) Improved functioning to a level nearer to same-age peers, but did not reach it
d) Improved functioning to reach a level comparable to same-age peers
e) Maintained functioning at a level comparable to same-age peers.
19
![Page 20: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/20.jpg)
Entry Exit
c
Kasprzak & Rooney (2010)20
![Page 21: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/21.jpg)
Entry Exit
c
Kasprzak & Rooney (2010)21
![Page 22: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/22.jpg)
States Report Data in these categories
Percentage of children who:a) Did not improve functioningb) Improved functioning, but not sufficient to
move nearer to functioning comparable to same-age peers
c) Improved functioning to a level nearer to same-age peers, but did not reach it
d) Improved functioning to reach a level comparable to same-age peers
e) Maintained functioning at a level comparable to same-age peers.
22
![Page 23: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/23.jpg)
Entry Exit
d
Kasprzak & Rooney (2010)23
![Page 24: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/24.jpg)
States Report Data in these categories
Percentage of children who:a) Did not improve functioningb) Improved functioning, but not sufficient to
move nearer to functioning comparable to same-age peers
c) Improved functioning to a level nearer to same-age peers, but did not reach it
d) Improved functioning to reach a level comparable to same-age peers
e) Maintained functioning at a level comparable to same-age peers.
24
![Page 25: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/25.jpg)
Entry Exit
e
Kasprzak & Rooney (2010)25
![Page 26: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/26.jpg)
Entry Exit
e
Kasprzak & Rooney (2010)26
![Page 27: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/27.jpg)
Entry Exit
e
Kasprzak & Rooney (2010)27
![Page 28: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/28.jpg)
Summary Statements For Reporting Progress on Targets
Required Summary Statement 1: Of those children who entered or exited the program below age
expectations in each Outcome, the percent who substantially increased their rate of growth by the time they exited the program.
c+d __ a+b+c+d
Required Summary Statement 2: The percent of children who were functioning within age
expectations in each Outcome by the time they exited the program.
d+e __ a+b+c+d+e 28
![Page 29: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/29.jpg)
State ECO Targets FY 2010 (Reported on March 2012)
Outcome 1 Outcome 2 Outcome 3
Summary Statement 1
% of children who moved
closer to same age peers
Part C = 57.53%Part B = 86.43%
Part C = 61.14%Part B = 86.88%
Part C = 66.99%Part B = 86.74%
Summary Statement 2
% of children who exited at
age level
Part C = 56.33%Part B = 65.66%
Part C = 47.44%Part B = 64.10%
Part C = 63.44%Part B = 77.29%
29State targets change each year, always be sure to use the most current data for your data drill down
![Page 30: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/30.jpg)
PurposeDeveloped as a tool for local Part B Preschool
Special Education Programs To identify components of a high quality system To evaluate their existing Indicator 7 Data To encourage decision making that will support
program improvement efforts
30
![Page 31: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/31.jpg)
5 Sections A. Local Policies and Procedures for Data ReportingB. District APR DataC. Addendum Report DataD. Data VerificationE. Child Level Data from OWS
31
![Page 32: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/32.jpg)
Each Section includes; Information about the data to be examined and
where it can be foundQuestions to Guide your Review ProcessAction Planning Form
32
![Page 33: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/33.jpg)
Action Plan
33
![Page 34: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/34.jpg)
Suggested UseLocal Implementation TeamPart of an ongoing strategic
planning processMay be completed in total or in
sectionsReassess periodically
34
![Page 35: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/35.jpg)
Many Steps for Ensuring Quality DataGood Data Collection/TrainingGood data system and data entryOngoing supervision of implementationFeedback to implementersRefresher trainingReview of COSF RecordsData Analyses for validity checks
35Kasprzak & Rooney (2010)
Section A: Examine Local Policies and Procedures for
Data Reporting
![Page 36: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/36.jpg)
Section A: Examine Local Policies and Procedures for
Data Reporting
Administrator Quality Rating ChecklistData Entry Quality Rating ChecklistDirect Service Provider Quality Rating Checklist Questions to Guide the Review Process (pg. 4
Data Drill Down Guide)
36
![Page 37: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/37.jpg)
ECO City Example – HO#6
37
Section A: Examine Local Policies and Procedures for
Data Reporting
![Page 38: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/38.jpg)
Section B: Locating and Examining District APR Data
![Page 39: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/39.jpg)
Section B: ECO City APR Data – HO#7
![Page 40: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/40.jpg)
40
Comparing ECO City Data with State Data
7A1 7A2 7B1 7B2 7C1 7C20.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
DistrictState
![Page 41: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/41.jpg)
Section C: Locating and Examining Addendum Reports
41
![Page 42: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/42.jpg)
Section C: Examining Addendum Reports for ECO
City – HO#8
42
![Page 43: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/43.jpg)
Section C: Examining ECO City Addendum Reports –
HO#9
43
Progress and Slippage Reports
![Page 44: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/44.jpg)
Section C: Locating and Examining Addendum
Reports
44
![Page 45: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/45.jpg)
Section D: Data VerificationData Verification occurs each August 1st – 31st
45
![Page 46: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/46.jpg)
Section D: ECO City Data Verification HO#10
46
![Page 47: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/47.jpg)
Section E: Examining Child Level Data in OWS
47
![Page 48: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/48.jpg)
Section E: Examining Child Level Data in OWS
48
![Page 49: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/49.jpg)
Section E: Parameterized Data Report
49
![Page 50: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/50.jpg)
Section E: No Permanent Exit
50
![Page 51: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/51.jpg)
Section E: Permanent Exit Report
51
![Page 52: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/52.jpg)
Section E: Summary Statement Report
52
![Page 53: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/53.jpg)
53
Section E: ECO Report
![Page 54: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/54.jpg)
54
Sharing Your ECO DataSample messages that can be gleaned from your
ECO data:Data show that children are making progress from entry
to exit in the programMany children are catching up or getting closer to same
age peersPoint out how programs are contributing to school
readinessLink message to broader EC issues (i.e. cost
effectiveness of high quality EC programs)
![Page 55: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/55.jpg)
What the data look like:Nationally
55
![Page 56: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/56.jpg)
Part C and PreschoolAverage Percentage of Children in Each
CategoryOutcome 1: Social/Emotional
Kasprzak & Rooney (2010)56
![Page 57: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/57.jpg)
Part C and PreschoolAverage Percentage of Children in Each
CategoryOutcome 2: Knowledge/Skills
Kasprzak & Rooney (2010) 57
![Page 58: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/58.jpg)
58
Part C and PreschoolAverage Percentage of Children in Each
CategoryOutcome 3: Getting Needs Met
Kasprzak & Rooney (2010)
![Page 59: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/59.jpg)
Kasprzak & Rooney (2010) 59
![Page 60: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/60.jpg)
Kasprzak & Rooney (2010) 60
![Page 61: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/61.jpg)
Keeping our eye on the prize: High qualityservices for childrenand families that willlead to good outcomes.
Kasprzak & Rooney (2010) 61
![Page 62: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/62.jpg)
Questions?
62
![Page 63: Understanding and Using Early Childhood Outcome (ECO) Data for Program Improvement](https://reader036.vdocument.in/reader036/viewer/2022062520/56816191550346895dd12e9b/html5/thumbnails/63.jpg)
ReferencesHebbeler, K., Kahn, L., Taylor, C. & Bailey, A.
(2011). Data Workshop: Analyzing and Interpreting Data. Presented at the Measuring and Improving Child and Family Outcomes Conference, New Orleans, LA.
Kasprzak & Rooney (2010, March). Measuring Child Outcomes, Presentation for Delaware; ECO Center & NECTAC. Retrieved 10/3/11 from: http://www.fpg.unc.edu/~eco/assets/ppt/DE%20COSF%20training%20slides%20for%20web%204-12-10.ppt
63