GOALS OF TODAY’S PD Examination of how to use pre/post testing to

measure student achievement, and to address areas of strength and areas of weakness

Analysis of 2006 CMT scores to inform instruction.

Why?

“Until you have data as a

backup, you’re just another

person with an opinion.”

Dr. Perry Gluckman

Rationale for pre/post testing using the 2006 Summer School

model The objective of the CAMS Summer Enrichment Program is to take students who scored at the proficient level on their most recent CMT and to provide them with the skills and knowledge base to bring them up to the goal level

In order to continue to receive funding for the CAMS Summer Enrichment Program, we had develop a tool to measure whether or not the program was successful

Reading Comprehension Pre/Post Assessment

This is the piece we used for both assessments

Please refer to distributed copies

Reading Comprehension pre/post test

Same assessment Same students Same time-frame

and testing conditions

Focus Areas of Assessment

Point of View Classifying Cause and Effect Compare and Contrast Fact and Opinion Drawing Conclusions Thinking Further

Reading Comprehension 8th Grade Pre-Test Results—Identify Areas of

WeaknessA 100% B 90% C 80% D 70% F 60%

8th grade students Reading Comp pre-test LA Summer School

Total Points

Percentage Grade

Po

int-

of-

Vie

w

Po

int-

of-

Vie

w

Cla

ss

ify

ing

Cla

ss

ify

ing

Ca

us

e/E

ffe

ct

Ca

us

e/E

ffe

ct

Co

mp

are

/Co

ntr

as

t

Co

mp

are

/Co

ntr

as

t

Fa

ct/

Op

inio

n

Fa

ct/

Op

inio

n

Dra

win

g C

on

clu

sio

ns

Dra

win

g C

on

clu

sio

ns

Th

ink

ing

Fu

rth

er

Th

ink

ing

Fu

rth

er

Total Possible Points 31 2 8 3 4 4 5 5Name of Student 26 84% B 2 6 2 3 4 4 5

18 58% F 2 5 1 2 2 3 319 61% D 2 4 3 3 2 2 314 45% F 2 2 1 4 2 2 118 58% F 1 5 3 2 2 2 321 68% D 2 4 3 2 4 1 522 71% C 2 7 3 4 2 3 116 52% D 2 3 2 1 2 5 116 52% F 2 0 2 3 2 5 220 65% D 2 5 3 2 2 3 318 58% F 0 6 2 2 2 1 525 81% B 2 7 2 4 2 4 422 71% C 0 4 3 3 2 5 515 48% F 2 2 2 2 2 3 223 74% C 2 5 3 4 2 2 523 74% C 1 7 2 4 1 4 420 65% D 0 6 3 3 2 3 315 48% F 2 3 1 4 1 2 213 42% F 2 3 1 3 2 2 018 58% F 2 7 2 1 2 2 218 58% F 2 7 2 1 2 2 223 74% C 2 4 2 3 4 4 4

Class Average 19 61% D 2 4 2 3 2 3 3

Percent per Category 100% 50% 66% 75% 50% 60% 60%

Reading Comprehension Areas of Weakness

Classifying- Average score 63% Fact and Opinion- Average score 50% Drawing Conclusions- 60% Thinking Further- 60%

Based on this data we embedded mini-lessons into the unit to address the areas of weakness

We used our writing assessments to address “Drawing Conclusions” and “Thinking Further”

8th Grade Pre-test Results – Reading and Writing

8th grade pre-test Reading and Writing Summer School 2006

Total Points

Percentage Grade

Re

ad

ing

Co

mp

pre

-te

st

Re

ad

ing

Co

mp

pre

-te

st

Writ

ing

pre

-te

st

Writ

ing

pre

-te

st

Total Possible Points 200 100 100

52 26% F 0 52 0 X159 80% C 84 7585 43% F X 85

151 76% C 61 90136 68% D 45 91128 64% D 58 70168 84% B 68 100166 83% B 71 9552 26% F 52 X77 39% F 52 2596 48% F X 96

138 69% D 58 80162 81% B 81 81131 66% D 71 60118 59% F 48 70159 80% C 74 85153 77% C 74 79154 77% C 65 89103 52% F 48 5587 44% F 42 4540 20% F X 40

135 68% D 58 77171 86% B 74 9788 44% F 32 56

Class Average 135 67% D 0 60 0 75

8th Grade Post-test Results – Reading and Writing

8th grade LA post-test Results Summer School 2006

Total Points

Percentage Grade

Re

ad

ing

Co

mp

po

st-te

st

Re

ad

ing

Co

mp

po

st-te

st

Writ

ing

Po

st T

es

t

Writ

ing

Po

st T

es

Total Possible Points 200 100 100

0 0% F 0 X 0 X187 94% A 87 100185 93% A 100 85181 91% A 90 91161 81% B 65 96163 82% B 81 82176 88% B 87 89165 83% B 87 78187 94% A 87 10082 41% F X 820 0% F X X

157 79% C 90 67175 88% B 100 75135 68% D 68 67100 50% F X 100192 96% A 94 98164 82% B 90 74180 90% B 94 86180 90% B 94 860 0% F X X

198 99% A 100 98173 87% B 94 79195 98% A 97 98151 76% C 84 67

Class Average 175 87% B 0 89 0 86

Reading Comprehension 8th Grade Post-Test Results—Did we see

improvement?8th grade Reading Comprehension post-test Summer School 2006

Total Points

Percentage Grade

Po

int-

of-

Vie

w

Po

int-

of-

Vie

w

Cla

ssif

yin

g

Cla

ssif

yin

g

Cau

se/E

ffec

t

Cau

se/E

ffec

t

Co

mp

are/

Co

ntr

ast

Co

mp

are/

Co

ntr

ast

Fac

t/O

pin

ion

Fac

t/O

pin

ion

Dra

win

g C

on

clu

sio

ns

Dra

win

g C

on

clu

sio

ns

Th

inki

ng

Fu

rth

er

Th

inki

ng

Fu

rth

er

HW

/Tes

t/Q

uiz

HW

/Tes

t/Q

uiz

HW

/Tes

t/Q

uiz

HW

/Tes

t/Q

uiz

Total Possible Points 31 2 8 3 4 4 5 527 87% B 0 2 0 7 0 2 0 3 0 3 0 5 0 5 0 0 0 031 100% A 2 8 3 4 4 5 528 90% A 2 8 2 3 3 5 520 65% D 2 2 3 2 3 5 325 81% B 2 6 3 2 2 5 527 87% B 2 5 2 4 4 5 527 87% B 2 8 3 2 4 5 327 87% B 2 6 3 2 4 5 50 0% F X X X X X X X0 0% F X X X X X X X

28 90% A 2 8 3 2 4 5 431 100% A 2 8 3 4 4 5 521 68% D 2 3 3 4 1 5 30 0% F X X X X X X X

29 94% A 2 8 3 2 4 5 528 90% A 2 8 3 3 4 5 329 94% A 2 8 3 3 3 5 529 94% A 2 8 2 4 4 4 50 0% F X X X X X X X

31 100% A 2 8 3 4 4 5 529 94% A 2 8 3 2 4 5 530 97% A 2 8 3 3 4 5 526 84% B 2 8 2 2 4 5 3

28 89% B 0 2 0 7 0 3 0 3 0 4 0 5 0 4 0 0 0 0Percent per Category 100% 90% #### 75% 80%

Reading Comprehension Pre/Post-Test ComparisonsA 100% B 90% C 80% D 70%

8th grade pre/post-test Comparison Summer School 2006

Total Points

Percentage Grade

Re

ad

ing

Co

mp

pre

-te

st

Re

ad

ing

Co

mp

pre

-te

st

Wri

tin

g p

re-t

es

t

Wri

tin

g p

re-t

es

t

Re

ad

ing

Co

mp

po

st-

tes

t

Re

ad

ing

Co

mp

po

st-

tes

t

Wri

tin

g P

os

t T

es

t

Wri

tin

g P

os

t T

es

Total Possible Points 400 100 100 100 100

52 13% F 0 52 0 X 0 X 0 X346 87% B 84 75 87 100270 68% D X 85 100 85332 83% B 61 90 90 91297 74% C 45 91 65 96291 73% C 58 70 81 82344 86% B 68 100 87 89331 83% B 71 95 87 78239 60% F 52 X 87 100159 40% F 52 25 X 8296 24% F X 96 X X

295 74% C 58 80 90 67337 84% B 81 81 100 75266 67% D 71 60 68 67218 55% F 48 70 X 100351 88% B 74 85 94 98317 79% C 74 79 90 74334 84% B 65 89 94 86283 71% C 48 55 94 8687 22% F 42 45 X X

238 60% F X 40 100 98308 77% C 58 77 94 79366 92% A 74 97 97 98239 60% F 32 56 84 67

Class Average 309 77% C 0 60 0 75 0 89 0 86

Graph of Summer School overall LA results based on our

“dipstick”

0102030405060708090

ReadingComp

Writing

Pre-test

Post-Test

Reading Comprehension+29 pts

Writing+11 pts

?? Discussion ??

What are your thoughts on using pre and post-testing as “dipsticks” to drive instructional focus?

Were our focus areas related to CMT skills? How can we find out?

What data do you currently use to inform instruction in your classroom?

Do you think that Data-Driven Decision Making (D3M) would help us with grade level collaboration in examining student work and identifying areas of weakness?

D3M Rationale

“School decision-makers need a deliberate process to guide them through the examination and analysis of data. Without this, they may be apt to substitute strongly held opinions for the fact-based conclusions that would be derived from a review of the actual data.”

Dr. Douglas Reeves

Analyze 2006 CMT Results

Tools1. www.cmtreports.com

2. Curriculum Frameworks Packet

3. CAMS 2006 7th grade CMT results- Packet

4. “Treasure Hunt” Tasks 1 and 2

References

CREC- Wachovia Urban Leadership Academy

www.cmtreports.com Connecticut State Department of Education

http://www.state.ct.us/sde/ (2002)Tools for Thought by Jim Burke