Data Coach Training Day 3

Dr. Yuwadee WongbundhitCurriculum and Instruction

RecapMonitoring Tool

for FCAT 2.0 Content Assessed

Benchmarks

Purpose

Features

FCAT 2.0/EOC Scores

2011 Equivalent

Scores

Proposed New FCAT 2.0 Scores

New FCAT Achievement Level Policy

Definition

Data Report

Disaggregated Data

Year-at-a-Glance

Data Analysis Scheme

Recap (Continued)Data

Analysis

Dig Deeper into Data

Tips for Data Analysis

Protocol and Essential Questions

Data Sources

Acct. Reports

SPI andEdusoft Report

Builder files

Acct.-SPI Templates

Excel

Move/Copy Sheet

Freeze, hide, borders, filter,

Print Page Layout

Pivot Table and Vlookup Function

Data Coach Day 3 Topics

Predictive Scores of Fall IA

Fall IA School Performance Reports

Data Analysis and Science Fair Game Benchmarks

Update Data Base

Predictive Performance Levels of Interim Assessments

Satisfactory Progress: Predictive values within FCAT 2.0

Levels 3-5

Limited Progress (Not sure)

Insufficient Progress: Predictive values within FCAT 2.0

Levels 1-2

Performance Level of Interim Assessments

Default Proficient Levels

(70% or higher)•Proficient and Non-proficient:•Overall•Reporting Category•Baseline Assessments•First time implementation of new assessments, such as 2010-11 Reading Fall IA and Reading Winter IA.

Predictive Performance Levels•Performance band for total score:•Satisfactory Progress•Limited Progress•Insufficient Progress•No predictive value available for report category•Second Year or more of new assessments, such as Reading 2011-12 Fall IA and Winter IA.

Performance Level Definition

2011-12 Math Fall IA Predictive Performance Levels

Grade Total Points

Insufficient Progress

Limited Progress

Satisfactory Progress

%Insufficient Progress

% Limited Progress

% Satisfactory Progress

  Raw Score % Scores

3 30 0 - 14 15 - 17 18 - 30 0 to 47% 50% - 57% 60% or higher

4 34 0 - 15 16 - 18 19 - 34 0 to 44% 47% - 53% 56% or higher

5 34 0 - 18 19 - 20 21 - 34 0 to 53% 56% - 59% 62% or higher

6 37 0 - 15 16 - 18 19 - 37 0 to 41% 43% - 49% 51% or higher

7 39 0 - 15 16 - 18 19 - 39 0 to 38% 41% - 46% 49% or higher

8 40 0 - 17 18 - 20 21 - 40 0 to 43% 45% - 50% 53% or higher

ALG 34 0 - 11 12 - 14 15 - 34 0 to 32% 35% - 41% 44% or higher

2011-12 Reading Fall IA Predictive Performance LevelsGrade Total

PointsInsufficient Progress

Limited Progress

Satisfactory Progress

%Insufficient Progress

% Limited Progress

% Satisfactory Progress

  Raw Score % Scores

3 56 0 - 27 28 - 31 32 - 56 0 to 48% 50% - 55% 57% or higher

4 56 0 - 30 31 - 34 35 - 56 0 to 54% 55% - 61% 63% or higher

5 56 0 - 31 32 - 35 36 - 56 0 to 55% 57% - 63% 64% or higher

6 54 0 - 29 30 - 33 34 - 54 0 to 54% 56% - 61% 63% or higher

7 56 0 - 27 28 - 32 33 - 56 0 to 48% 50% - 57% 59% or higher

8 61 0 - 31 32 - 36 37 - 61 0 to 51% 52% - 59% 61% or higher

9 57 0 - 29 30 - 34 35 - 57 0 to 51% 53% - 60% 61% or higher

10 53 0 - 24 25 - 29 30 - 53 0 to 45% 47% - 55% 57% or higher

Where can you find the cut scores in Edusoft?

• Click on Benchmark• Click on Assessments• Select Assessment• Click on View Details• Under Performance Bands, click on View Details

School Performance Reports as of 11-25-2011

Analyzing Student Progress

Baseline

Aug. 2011

Fall IA

Oct. 2011

Jan. 2012

2012FCAT2.0

EOC

Apr./May

2012

Winter IA

PG Q1 PG Q2All All

Data Analysis Scheme (G3-8)Grade 3/6

BL, FIA, WIA, FCAT2010-11Grade 4/7

BL, FIA, WIA, FCATGrade 5/8

BL, FIA, WIA, FCAT

Grade 3/6BL, FIA, WIA, FCAT2011-12

Grade 4/7BL, FIA, WIA, FCAT

Grade 5/8BL, FIA, WIA, FCAT

Grade 3/6BL, FIA, WIA, FCAT2012-13

Grade 4/7BL, FIA, WIA, FCAT

Grade 5/8BL, FIA, WIA, FCAT

Data Analysis Scheme, High School in Reading

Grade 9BL, FIA, WIA, FCAT2010-11

Grade 10BL, FIA, WIA, FCAT

RetakerBL, FIA, WIA, FCAT

Grade 9BL, FIA, WIA, FCAT2011-12

Grade 10BL, FIA, WIA, FCAT

RetakerBL, FIA, WIA, FCAT

Grade 9BL, FIA, WIA, FCAT2012-13

Grade 10BL, FIA, WIA, FCAT

RetakerBL, FIA, WIA, FCAT

Data Analysis Scheme, High School - EOC

Algebra IBL, FIA, WIA, EOC2010-11

Algebra I BL, FIA, WIA, EOC2011-12

GeometryBL, FIA, WIA, EOC

BiologyBL, FIA, WIA, EOC

Algebra I BL, FIA, WIA, EOC2012-13

GeometryBL, FIA, WIA, EOC

BiologyBL, FIA, WIA, EOC

Year-at-a Glance Report Note

Year-at-a Glance Summary Report (E)

Year-at-a Glance Detailed Report (E)

Year-at-a Glance Summary Report (M)

Year-at-a Glance Detailed Report (M)

Year-at-a Glance Summary Report (H)

Year-at-a Glance Detailed Report (H)

Benchmark Analysis (E)

Benchmark Analysis (M)

Benchmark Analysis (HS)

Science Fair Game Benchmarks

Principals’ Liaison Committee Meeting

Dr. Yuwadee WongbundhitCurriculum and Instruction11/28/2011 and 11/30/2011

Science Fair Game Principle

Benchmark Classification SystemEach benchmark in the NGSSS is labeled with a system of numbers and letters.

Science Fair Game Benchmark, Grade 5

Science Fair Game Benchmark, Grade 5

Monitoring Tool

Science Fair Game Benchmark, Grade 8

Science Fair Game Benchmark, Grade 8

Monitoring Tool

Science Fair Game Benchmarks, Gr. 5

There are 25 AA Benchmarks.

Gr. 3

1 Benchmark

SC.3.L.14.1

Science Fair Game Benchmarks, Grade 8

There are 32 AA Benchmarks.

Gr. 6

10 Benchmarks

31%

Grade 8 Fair Game AA Benchmarks

Grade 6 (10 out of 32, 31%): SC.6.N.2.2 SC.6.P.13.1 SC.6.P.13.3 SC.6.E.7.4 SC.6.E.7.5 SC.6.L.14.1 SC.6.L.14.2 SC.6.L.14.4 SC.6.L.14.5 SC.6.L.15.1

Grade 7 (13 out of 32, 41%): SC.7.N.1.2 SC.7.N.1.5 SC.7.N.3.1 SC.7.E.6.2 SC.7.E.6.4 SC.7.E.6.5 SC.7.P.10.1 SC.7. P.10.3 SC.7. P.11.2 SC.7.P.11.4 SC.7.L.15.2 SC.7.L.16.1 SC.7.L.17.2

Science Data Interpretation

Do not compare the 2011 results to the 2010 results.

The average % correct can be compared from the baseline to the Fall IA and to the Winter IA.

For 2011 only, the % proficient (70% of higher) can be compared from the baseline to the Fall IA and to

the Winter IA

2011-2012 Fall Interim Assessment by Subgroup

2011-2012 Fall Interim Assessment by Subgroup

2011-2012 Fall Interim Assessment by Subgroup

2011-2012 Fall Interim Assessment by Subgroup

2011-2012 Fall Interim Assessment by Subgroup

2011-2012 Fall Interim Assessment by Subgroup

Student Master File

“Student ID” is used as a lookup value to merge the data from different files using Excel formula “V-Lookup”

Master File

Accountability

SPIBaseline and Interim

AssessmentFile Download Manager

=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)

Student ID

Student ID Stud

ent I

D

Student ID

Acct. Files

Reading

Math

2011-2012 School Database File Structure

VLOOKUP FUNCTION

=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)

Lookup_Value:What value are you searching for?Excel will look for a match to this value in the leftmost column of the lookup table

Table_Array:Where do you want to search?Use absolute references to “lock” the range by pressing F4 key

Col_index_numWhich column contains the search result?Count over from the first column to figure out what this number should be, starting with 1.

FALSETo force Excel to lookup value be exact match

=VLOOKUP($A3,‘IA File Name'!$B$13:$R$739,3,FALSE)

Practice Test Day 3

48

1 2 3

Student ID FIA R-%Corr FIA R-RawSC Student ID FIA R-RawSC FIA R-%Corr4 18 7 13%

5 12 9 16%

1 6 12 21%

7 1 17 30%

15 2 20 36%

9 3 22 39%

10 4 24 43%

20 5 25 45%

12 7 25 45%

3 8 26 46%9 27 48%

10 28 50%11 29 52%13 30 54%14 33 59%16 34 61%17 37 66%

=VLOOKUP(LOOKUP_VALUE, TABLE_ARRAY, COLUMN INDEX NUMBER, FALSE)

Go to Data Coach Website and down load “Practice Vlookup Day 3”

Merging File Structure

AJ3 = VLOOKUP($A3,‘IA File Name'!$B$13:$R$739,3,FALSE)

Interim Assessment Data

A1B

2C

3D

4E

5F

17R

Student

Name

Student

ID

Grade

Raw Score

% Correct

Performance

Data Base

A AG or AI

Student ID

Student Name

Accountability Report Data

FCAT

Reporting

Category Scores

Database with Interim Assessment Data

A AI AJ (3) AK (4) AM (5)

Student ID

Student Name

Raw Score

% Correct

Performance

AK3 = VLOOKUP($A3,‘IA File Name'!$B$13:$R$739,4,FALSE)

AM3 = VLOOKUP($A3,‘IA File Name'!$B$13:$R$739,5,FALSE)

Column Label with 4 Reporting Categories

50

Label Column Headers Report Builder Files (Baseline )

BL-Ra

wScBL-%Corr

BL-Perf

BL-CT1Ra

wSc

BL-CT1%Corr

BL-CT1Perf

BL-CT2Ra

wSc

BL-CT2%Corr

BL-CT2Perf

BL-CT3Ra

wSc

BL-CT3%Corr

BL-CT3Perf

BL-CT4Ra

wSc

BL-CT4%Corr

BL-CT4Perf

3 4 5 6 7 8 9 10 11 12 13 14 15 16 17

Label Column Headers Report Builder Files (Fall IA)

FL-Ra

wScFL-%Corr

FL-Perf

FL-CT1Ra

wSc

FL-CT1%Corr

FL-CT1Perf

FL-CT2Ra

wSc

FL-CT2%Corr

FL-CT2Perf

FL-CT3Ra

wSc

FL-CT3%Corr

FL-CT3Perf

FL-CT4Ra

wSc

FL-CT4%Corr

FL-CT4Perf

18 19 20 21 22 23 24 25 26 27 28 29 30 31 32

Download File Download Manager

Format File Download ManagerStep 1. Rename the sheet tab, sample “All Courses”. Next, Filter and Freeze PanesStep 2. Fill in leading zero on “Course Subject Code” Field (column F).

• Highlight Column F• On the Home menu, find Format. Next select “Format Cells”• Under Number Tab, select Custom• Under Type: type 0000000 (seven zeros)• Click OK

Step 3. Sort “Course Subject Code” by clicking on filter arrow and select from smallest to largest• Fill leading 2 zeros for Column I (Class Section)

Step 4. Convert Student ID from Number value to Text value• Highlight Column B• On the Home menu, select Insert Sheet Column. Now, Column B is blank.• Type “Student ID” on Cell B1 to be a new column header• On B2, type formula as follow: =text(A2,”0000000”)• File down from Cell B2 to the last row.• Highlight Column B and select copy. Next Select Paste “Value”• Delete Column A (old Student ID)

EOC Subject AreasAlgebra 1

• 1200310 - Algebra 1• 1200320 - Algebra 1 Hon.• 1200380 - Algebra 1B• 1209810 - Pre-AICE

Mathematics 1• 1200390 - IB Middle Years

Program – Algebra 1 Hon.

Geometry• 1206310 - Geometry• 1206320 - Geometry Hon.• 1206810 - IB Middle Years

Program Geometry Hon.• 1209820 - Pre-AICE

Mathematics 2

Biology

• 2000310 - Biology 1• 2000320 - Biology 1 Hon.• 2000322 - Pre-AICE Biology • 2000430 - Biology Technology • 2000800 - Biology 1 PreIB

• 2000850 - IB Middle Years Program Biology Hon.

• 2002440 - Integrated Science 3• 2002450 - Integrated Science 3

Hon.