document resume pollock, john s. · document resume. ed 412 519 cs 012 952. author pollock, john s....

17
DOCUMENT RESUME ED 412 519 CS 012 952 AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report 1996-97. Elementary and Secondary Education Act--Title I. INSTITUTION Columbus Public Schools, OH. Dept. of Program Evaluation. PUB DATE 1997-00-00 NOTE 29p.; Data analysis by Kathy Morgan. For 1995-96 report, see CS 012 949. PUB TYPE Reports Evaluative (142) EDRS PRICE MF01/PCO2 Plus Postage. DESCRIPTORS Elementary School Students; *Grade 1; *High Risk Students; *Instructional Effectiveness; Outcome Based Education; Parent Participation; Primary Education; Program Effectiveness; *Reading Programs; *Remedial Reading; Urban Education IDENTIFIERS Columbus Public Schools OH; Elementary Secondary Education Act Title I; *Ohio Reading Recovery Program ABSTRACT A study evaluated the effectiveness of the 1996-97 Reading Recovery program as implemented in the Columbus, Ohio, public schools. The program featured individualized one-on-one lessons provided by 58 specially trained teachers serving 470 grade 1 pupils. The treatment group consisted of the 230 pupils who were either discontinued (202) or received 60 or more lessons but not discontinued (28). Results indicated that (1) of the 230 treatment group pupils, 217 (94.3%) displayed over time each of the 3 strategic processing behaviors (monitoring reading, constructing meaning, and integrating sources of information); (2) of the 202 pupils who were discontinued from the Reading Recovery program, 197 had available scores from a benchmark reading assessment administered to all grade 1 pupils in the district, and of those, 173 (87.8%) passed the assessment; (3) of the 28 pupils who were not discontinued but received at least 60 lessons, 24 had available benchmark scores, and of those, 9 (37.5%) passed the benchmark; (4) of the treatment group of 230 pupils, 219 (95.2%) read 5 or more books at text reading level 8 or above (criterion was 75.0%); (5) a total of 1,639 parent contacts were made with program teachers, and average of 3.5 contacts for each pupil served; and (6) the 230 treatment group pupils represented 48.9% of the 470 pupils served, but represented 58.4% of the total number of contacts made with parents or guardians. Findings support continuation of the program with attention given to seven recommendations. (Contains eight figures of data.) (RS) ******************************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document. ********************************************************************************

Upload: others

Post on 12-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

DOCUMENT RESUME

ED 412 519 CS 012 952

AUTHOR Pollock, John S.TITLE Title I Reading Recovery Program. Final Evaluation Report

1996-97. Elementary and Secondary Education Act--Title I.INSTITUTION Columbus Public Schools, OH. Dept. of Program Evaluation.PUB DATE 1997-00-00NOTE 29p.; Data analysis by Kathy Morgan. For 1995-96 report, see

CS 012 949.PUB TYPE Reports Evaluative (142)EDRS PRICE MF01/PCO2 Plus Postage.DESCRIPTORS Elementary School Students; *Grade 1; *High Risk Students;

*Instructional Effectiveness; Outcome Based Education;Parent Participation; Primary Education; ProgramEffectiveness; *Reading Programs; *Remedial Reading; UrbanEducation

IDENTIFIERS Columbus Public Schools OH; Elementary Secondary EducationAct Title I; *Ohio Reading Recovery Program

ABSTRACTA study evaluated the effectiveness of the 1996-97 Reading

Recovery program as implemented in the Columbus, Ohio, public schools. Theprogram featured individualized one-on-one lessons provided by 58 speciallytrained teachers serving 470 grade 1 pupils. The treatment group consisted ofthe 230 pupils who were either discontinued (202) or received 60 or morelessons but not discontinued (28). Results indicated that (1) of the 230treatment group pupils, 217 (94.3%) displayed over time each of the 3strategic processing behaviors (monitoring reading, constructing meaning, andintegrating sources of information); (2) of the 202 pupils who werediscontinued from the Reading Recovery program, 197 had available scores froma benchmark reading assessment administered to all grade 1 pupils in thedistrict, and of those, 173 (87.8%) passed the assessment; (3) of the 28pupils who were not discontinued but received at least 60 lessons, 24 hadavailable benchmark scores, and of those, 9 (37.5%) passed the benchmark; (4)

of the treatment group of 230 pupils, 219 (95.2%) read 5 or more books attext reading level 8 or above (criterion was 75.0%); (5) a total of 1,639parent contacts were made with program teachers, and average of 3.5 contactsfor each pupil served; and (6) the 230 treatment group pupils represented48.9% of the 470 pupils served, but represented 58.4% of the total number ofcontacts made with parents or guardians. Findings support continuation of theprogram with attention given to seven recommendations. (Contains eightfigures of data.) (RS)

********************************************************************************

Reproductions supplied by EDRS are the best that can be madefrom the original document.

********************************************************************************

Page 2: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

LC

D /-

5' C

o.

PE

RM

ISS

ION

TO

RE

PR

OD

UC

E A

ND

DIS

SE

MIN

AT

E T

HIS

MA

TE

RIA

LH

AS

BE

EN

GR

AN

TE

D B

Y

K. 1

-T

O T

HE

ED

UC

AT

ION

AL

RE

SO

UR

CE

SIN

FO

RM

AT

ION

CE

NT

ER

(E

RIC

)

Ele

men

tary

and

Sec

onda

ry E

duca

tion

Act

- T

itle

I

FIN

AL

EV

ALU

AT

ION

RE

PO

RT

1996

-97

TIT

LE I

ED

412

519

U.S

. DE

PA

RT

ME

NT

OF

ED

UC

AT

ION

Offi

ce o

f Edu

catio

nal R

esea

rch

and

Impr

ovem

ent

ED

UC

AT

ION

AL

RE

SO

UR

CE

S IN

FO

RM

AT

ION

CE

NT

ER

(E

RIC

)T

his

docu

men

t has

bee

n re

prod

uced

as

rece

ived

from

the

pers

on o

r or

gani

zatio

nor

igin

atin

g it.

Min

or c

hang

es h

ave

been

mad

e to

impr

ove

repr

oduc

tion

qual

ity.

Poi

nts

of v

iew

or

opin

ions

sta

ted

in th

isdo

cum

ent d

o no

t nec

essa

rily

repr

esen

tof

ficia

l OE

RI p

ositi

on o

r po

licy.

RE

AD

ING

RE

CO

VE

RY

PR

OG

RA

M

Writ

ten

by:

John

S. P

ollo

ck,

Pro

fess

iona

l Spe

cial

ist

Dat

a A

naly

sis

by:

Kat

hy M

orga

n,P

rofe

ssio

nal S

peci

alis

t

Col

umbu

s (O

hio)

Pub

lic S

choo

lsD

epar

tmen

t of E

valu

atio

n S

ervi

ces

Kur

t T. T

aube

, Ph.

D.

Dire

ctor

The

Col

umbu

s C

ity S

choo

l Dis

tric

t doe

s no

t dis

crim

inat

e be

caus

e of

AK

" co

lor,

nat

iona

l orig

in, r

elig

ion,

sex

or

hand

icap

with

rega

rdto

adm

issi

on, a

cces

s, tr

eatm

ent o

r em

ploy

men

t. T

his

polic

y is

app

licab

le in

all

dist

rict p

rogr

ams

and

activ

ities

.

BE

ST

CO

PV

Mil

AP

I 03

ro-

Page 3: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

Ele

men

tary

and

Sec

onda

ry E

duca

tion

Act

- T

itle

I

FIN

AL

EV

ALU

AT

ION

RE

PO

RT

TIT

LE I

RE

AD

ING

RE

CO

VE

RY

TM

PR

OG

RA

M19

96-9

7

Exe

cutiv

e S

umm

ary

Pro

gram

Des

crip

tion:

Dur

ing

1996

-97,

the

Rea

ding

Rec

over

y pr

ogra

m s

erve

d 47

0 gr

ade

1 pu

pils

. The

pro

gram

was

a jo

int e

ffort

of e

duca

tors

in th

e C

olum

bus

Pub

lic S

choo

ls, t

he C

olle

ge o

f Edu

catio

n of

The

Ohi

o S

tate

Uni

vers

ity, a

nd th

e O

hio

Dep

artm

ent o

f Edu

catio

n, a

nd w

as fu

nded

by

Ele

men

tary

and

Sec

onda

ryE

duca

tion

Act

(E

SE

A)

Titl

e I m

onie

s.

The

pur

pose

of t

he R

eadi

ng R

ecov

ery

prog

ram

was

to p

rovi

de e

arly

inte

rven

tion

to u

nder

achi

evin

g fir

st g

rade

pup

ils w

ho a

ppea

red

unlik

ely

to le

arn

to r

ead

succ

essf

ully

with

out a

dditi

onal

rea

ding

inst

ruct

ion.

The

pro

gram

feat

ured

indi

vidu

aliz

ed o

ne-o

n-on

e le

sson

s pr

ovid

ed b

y sp

ecia

lly tr

aine

d te

ache

rs. T

he le

sson

sw

ere

base

d on

obs

erva

tiona

l tas

ks d

esig

ned

to p

rovi

de a

com

preh

ensi

ve a

sses

smen

t of t

he p

upil'

s de

velo

pmen

t of r

eadi

ng a

nd w

ritin

g st

rate

gies

. Dur

ing

1996

-97,

58 te

ache

rs s

erve

d pu

pils

in 3

8 sc

hool

s. E

ach

teac

her

serv

ed a

n av

erag

e of

8.1

pup

ils.

Tim

e In

terv

al. F

or e

valu

atio

n pu

rpos

es, t

he p

rogr

am s

tart

ed o

n S

epte

mbe

r 23

, 199

6 an

d co

ntin

ued

thro

ugh

May

9, 1

997.

Pup

ils in

clud

ed in

the

final

ana

lyse

s fo

rD

esire

d O

utco

mes

1 a

nd 2

mus

t hav

e ei

ther

bee

n su

cces

sful

ly d

isco

ntin

ued

(com

plet

ed)

from

the

prog

ram

reg

ardl

ess

of th

e nu

mbe

r of

less

ons

rece

ived

or

have

rece

ived

60

or m

ore

inst

ruct

iona

l les

sons

but

wer

e no

t dis

cont

inue

d. M

any

of th

ose

pupi

ls w

ho r

ecei

ved

few

er th

an 6

0 le

sson

s bu

t wer

e no

t dis

cont

inue

d ei

ther

mov

ed to

ano

ther

sch

ool d

urin

g th

e ye

ar w

here

Rea

ding

Rec

over

y se

rvic

e w

as n

ot a

vaila

ble

or b

egan

the

prog

ram

so

late

in th

e sc

hool

yea

r th

atit

was

not

pos

sibl

efo

r th

em to

rec

eive

60

less

ons.

Act

iviti

es: T

o he

lp p

upils

dev

elop

rea

ding

str

ateg

ies,

dai

ly 3

0-m

inut

e in

divi

dual

ized

less

ons

incl

uded

a v

arie

ty o

f ins

truc

tiona

l act

iviti

es s

uch

as r

eadi

ng a

nd r

e-re

adin

g bo

oks

whi

le th

e te

ache

r re

cord

ed p

upil

stra

tegi

es a

nd e

rror

s, w

ritin

g an

d re

adin

g pu

pil s

torie

s, le

tter

iden

tific

atio

n, a

nd s

ound

ana

lysi

s of

wor

ds.

Eva

luat

ion

Des

ign:

The

eva

luat

ion

desi

gn in

clud

ed tw

o de

sire

d ou

tcom

es: (

1) a

t lea

st 7

5 pe

rcen

t of t

he p

upils

who

had

rec

eive

d 60

or

mor

e le

sson

s or

who

wer

edi

scon

tinue

d w

ould

dis

play

at l

east

twic

e th

roug

hout

the

trea

tmen

t per

iod

each

of t

hree

rea

ding

str

ateg

ic p

roce

ssin

g be

havi

ors

(mon

itorin

g re

adin

g, c

onst

ruct

ing

mea

ning

, and

inte

grat

ing

sour

ces

of in

form

atio

n) a

nd (

2) a

t lea

st 7

5 pe

rcen

t of p

upils

who

rec

eive

d 60

or

mor

e le

sson

s or

who

wer

e di

scon

tinue

d w

ould

read

at l

east

five

book

s at

text

rea

ding

leve

l 8 o

r ab

ove.

In a

dditi

on to

the

two

desi

red

outc

omes

, par

ent i

nvol

vem

ent d

ata

wer

e al

so c

olle

cted

by

prog

ram

teac

hers

. Loc

ally

cons

truc

ted

inst

rum

ents

wer

e us

ed to

col

lect

enr

ollm

ent/a

ttend

ance

and

par

ent i

nvol

vem

ent d

ata.

Maj

or F

indi

ngs:

The

Rea

ding

Rec

over

y pr

ogra

m s

erve

d 47

0 pu

pils

in 1

996-

97, w

ith a

vera

ge p

upil

enro

llmen

t (da

ys s

ched

uled

) of

57.

3 da

ys. A

vera

ge p

upil

atte

ndan

ce (

days

ser

ved)

was

49.

8 da

ys a

nd th

e av

erag

e nu

mbe

r of

inst

ruct

iona

l les

sons

was

39.

5. T

he a

vera

ge n

umbe

r of

inst

ruct

iona

l les

sons

is le

ss th

an th

eav

erag

e nu

mbe

r of

day

s se

rved

due

to th

e fa

ct th

at p

upils

spe

nd th

e fir

st te

n da

ys o

f ser

vice

"ro

amin

g ar

ound

the

know

n."

The

se d

ays

are

not c

ount

ed a

s le

sson

s.T

he tr

eatm

ent g

roup

con

sist

ed o

f the

230

pup

ils (

48.9

% o

f tho

se s

erve

d) w

ho w

ere

eith

er d

isco

ntin

ued

(202

) or

rec

eive

d 60

or

mor

e le

sson

s bu

t not

disc

ontin

ued

(28)

. Pro

gram

dev

elop

ers

have

est

imat

ed th

at m

ost p

upils

nee

d ap

prox

imat

ely

60 le

sson

s to

com

plet

e th

e pr

ogra

m. T

he n

umbe

r of

less

ons

pupi

ls r

ecei

ved

rang

edfr

om z

ero

to 1

03.

PA

P50

1\F

NR

PR

R97

11-5

-97

3:10

PM

45

Page 4: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

The

two

desi

red

outc

omes

for

the

1996

-97

Rea

ding

Rec

over

y pr

ogra

m w

ere

met

. Of t

he 2

30tr

eatm

ent g

roup

pup

ils, 2

17 (

94.3

%)

disp

laye

d ov

er ti

me

each

of

the

thre

e re

adin

g st

rate

gic

proc

essi

ng b

ehav

iors

(cr

iterio

n w

as 7

5.0%

). O

f the

230

trea

tmen

t gro

up p

upils

, 219

(95

.2%

) re

ad fi

ve o

r m

ore

book

s at

text

rea

ding

leve

l 8or

abo

ve (

crite

rion

was

75.

0%).

In A

pril,

199

7, a

ben

chm

ark

read

ing

asse

ssm

ent w

as a

dmin

iste

red

to a

ll gr

ade

one

pupi

ls in

the

dist

rict.

Pup

ils r

ecei

ved

eith

er a

pas

sing

sco

re (

Yes

) or

a n

on-

pass

ing

scor

e (N

o) o

n th

e be

nchm

ark

asse

ssm

ent.

A p

assi

ng o

r no

n-pa

ssin

gsc

ore

was

det

erm

ined

by

the

pupi

l's c

lass

room

teac

her

usin

g a

mod

ified

mis

cue

anal

ysis

as

the

pupi

l rea

d a

desi

gnat

ed te

xt. O

f the

202

pup

ils w

ho w

ere

disc

ontin

ued

from

the

Rea

ding

Rec

over

ypr

ogra

m, 1

97 h

ad a

vaila

ble

benc

hmar

k sc

ores

.O

f the

se 1

97 p

upils

, 173

(87

.8%

) pa

ssed

the

benc

hmar

k as

sess

men

t. O

f the

28

pupi

ls w

how

ere

not d

isco

ntin

ued

but r

ecei

ved

at le

ast 6

0 le

sson

s, 2

4 ha

d av

aila

ble

benc

hmar

k sc

ores

. Of t

hese

24

pupi

ls, 9

(37

.5%

) pa

ssed

the

benc

hmar

k as

sess

men

t. T

his

diffe

renc

e is

stat

istic

ally

sig

nific

ant (

X2

= 3

7.27

, p<

.01,

one

-tai

led)

. Of

the

rem

aini

ng 2

40 p

upils

ser

ved

by th

e R

eadi

ng R

ecov

ery

prog

ram

but

who

rec

eive

d le

ss th

an 6

0 le

sson

s, b

ench

mar

ksc

ores

wer

e av

aila

ble

for

218.

Of t

hese

218

pupi

ls, 4

2 (1

9.3%

) pa

ssed

the

benc

hmar

k as

sess

men

t.

Rec

ords

of p

aren

t con

tact

s an

d ac

tiviti

es m

aint

aine

d by

pro

gram

teac

hers

for

the

470

pupi

ls s

erve

d in

dica

ted

a to

tal o

f 163

9 pa

rent

con

tact

s w

ere

mad

e w

ithpr

ogra

m te

ache

rs, a

n av

erag

e of

3.5

con

tact

s fo

r ea

ch p

upil

serv

ed. T

he 2

30 tr

eatm

ent g

roup

pup

ils r

epre

sent

ed 4

8.9%

of t

he 4

70 p

upils

ser

ved,

but

rep

rese

nted

58.4

% (

957)

of t

he to

tal n

umbe

r of

con

tact

s m

ade

with

par

ents

or

guar

dian

s.

6P

AP

501\

FN

RP

RR

9711

-5-9

7 3:

12 P

M

7

Page 5: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

Rec

omm

enda

tions

The

Rea

ding

Rec

over

y pr

ogra

m h

as b

een

cont

inue

d du

ring

the

1997

-98

scho

ol y

ear,

and

it is

rec

omm

ende

d th

at it

con

tinue

. With

that

in m

ind,

the

follo

win

gre

com

men

datio

ns a

re p

rese

nted

:

1. T

he p

roce

ss b

y w

hich

pup

ils w

ith le

ss th

an 6

0 le

sson

s ar

e tr

ansf

erre

d fr

om th

e R

eadi

ng R

ecov

ery

prog

ram

to th

e E

arly

Lite

racy

pro

gram

nee

ds to

be c

lose

lym

onito

red.

Dur

ing

1996

-97,

48.

9% (

230)

of t

he 4

70 p

upils

ser

ved

wer

e in

clud

ed in

the

trea

tmen

t gro

up. T

he s

mal

l per

cent

age

of p

upils

incl

uded

in th

etr

eatm

ent g

roup

is p

artly

rel

ated

to tr

ansf

errin

g pu

pils

from

Rea

ding

Rec

over

y to

Ear

ly L

itera

cy b

efor

e th

e pu

pils

rec

eive

d 60

less

ons,

whi

ch is

the

num

ber

ofle

sson

s ne

eded

to b

e in

clud

ed in

the

trea

tmen

t gro

up.

If pu

pils

are

mak

ing

prog

ress

in li

tera

cy a

cqui

sitio

n, p

rogr

am te

ache

rs s

houl

d m

ake

ever

y ef

fort

toco

ntin

ue to

ser

ve th

em b

eyon

d 60

less

ons.

2. E

ffort

s sh

ould

con

tinue

for

expl

orin

g w

ays

to m

inim

ize

the

amou

nt o

f tim

e ne

eded

to c

olle

ct d

ata

on p

upils

ser

ved.

Muc

h te

ache

r fr

ustr

atio

n ex

ists

bec

ause

of th

e vo

lum

e of

rec

ord

keep

ing

requ

ired

for

the

prog

ram

. Tea

cher

s m

aint

ain

reco

rds

for

both

Col

umbu

s P

ublic

Sch

ools

and

The

Ohi

o S

tate

Uni

vers

ityC

olle

ge o

f Edu

catio

n.If

both

inst

itutio

ns u

sed

the

sam

e se

t of d

ata,

rep

ortin

g by

bot

h in

stitu

tions

wou

ld b

e co

nsis

tent

and

the

amou

nt o

f pap

erw

ork

requ

ired

of te

ache

rs r

educ

ed.

3. A

s in

crea

sed

pare

nt in

volv

emen

t is

rega

rded

as

one

of th

e in

dica

tors

of e

ffect

ive

scho

ols,

eve

ry e

ffort

mus

t be

unde

rtak

en to

pro

mot

e pa

rent

al in

volv

emen

t in

the

prog

ram

, esp

ecia

lly in

the

area

s of

pla

nnin

g, o

pera

tion,

and

eva

luat

ion.

4. T

he e

arlie

st p

ossi

ble

iden

tific

atio

n of

pup

ils n

eedi

ng s

peci

al e

duca

tion

inst

ruct

ion

shou

ld b

e em

phas

ized

. Pup

ils w

ith s

peci

al n

eeds

can

be

bette

r se

rved

by

teac

hers

with

exp

ertis

e in

spe

cific

spe

cial

edu

catio

n ar

eas.

Rea

ding

Rec

over

y is

not

a s

peci

al e

duca

tion

prog

ram

.If

pupi

ls w

ith s

peci

al e

duca

tion

are

not

iden

tifie

d ea

rly, t

hey

rem

ain

in th

e R

eadi

ng R

ecov

ery

prog

ram

too

long

, cre

atin

g fr

ustr

atio

n fo

r bo

th p

upils

and

teac

hers

.

5. T

he in

stru

ctio

nal s

trat

egie

s an

d te

chni

ques

use

d by

pro

gram

teac

hers

nee

d to

be

shar

ed w

ith a

nd e

nhan

ced

by th

e re

gula

r cl

assr

oom

teac

her.

The

inst

ruct

ion

prov

ided

by

the

prog

ram

teac

her

and

by th

e re

gula

r cl

assr

oom

teac

her

mus

t com

plem

ent e

ach

othe

r. T

he a

cade

mic

ach

ieve

men

t of p

upils

will

suffe

r if

they

rec

eive

mix

ed m

essa

ges

in th

eir

read

ing

and

writ

ing

inst

ruct

ion.

Opp

ortu

nitie

s m

ust b

e m

ade

avai

labl

e fo

r pr

ogra

m te

ache

rs a

nd r

egul

arcl

assr

oom

teac

hers

to d

evel

op a

con

sist

ent w

hole

lang

uage

bas

ed a

ppro

ach

to in

stru

ctio

n.

6. In

serv

ice

mee

tings

sho

uld

be c

ontin

ued

to p

rovi

de p

rogr

am te

ache

rs th

e op

port

unity

to e

nhan

ce th

eir

inst

ruct

iona

l int

erve

ntio

n sk

ills,

to s

hare

inst

ruct

iona

lid

eas

with

one

ano

ther

, and

to c

larif

y an

y co

ncer

ns o

r m

isco

ncep

tions

they

may

hav

e ab

out t

he to

tal R

eadi

ng R

ecov

ery

prog

ram

.

7. A

n on

-goi

ng p

roce

ss o

f site

vis

itatio

ns b

y th

e pr

ogra

m e

valu

ator

nee

ds to

be

cont

inue

d. T

hese

vis

its p

rovi

de in

valu

able

info

rmat

ion

for

the

prog

ram

eva

luat

orin

the

area

s of

con

tent

and

inst

ruct

ion

and

prov

ide

prog

ram

teac

hers

the

oppo

rtun

ity to

cla

rify

ques

tions

they

may

hav

e ab

out e

valu

atio

n re

quire

men

ts a

ndre

cord

kee

ping

. The

se v

isita

tions

als

o he

lp b

uild

a r

appo

rt b

etw

een

the

prog

ram

teac

her

and

prog

ram

eva

luat

or.

PA

P50

1\F

NR

PR

R97

10-2

8-97

3:0

6 P

M8

9

Page 6: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

100

PE

RC

EN

T O

F P

UP

ILS

80 60 40 20

0A

LL P

UP

ILS

SE

RV

ED

TR

EA

TM

EN

T G

RO

UP

......

.

DIS

CO

NT

INU

ED

PU

PIL

S

FE

MA

LES

227

111

94%

FE

MA

LES

M48

.348

.346

.5M

ALE

S24

311

910

8%

MA

LES

51.7

51.7

53.5

TO

TA

LS47

023

020

2

FIG

UR

E 1

Tre

atm

ent

grou

p in

clud

es p

upils

who

rec

eive

d 60

or

mor

e le

sson

s or

who

wer

e di

scon

tinue

d.rr

gend

pr

11

Page 7: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

100

PE

RC

EN

T O

F P

UP

ILS

80--

......

......

......

......

......

......

......

......

..

1414

.4 4

.

20

0A

LL P

UP

ILS

SE

RV

ED

...

4444

14.4

+K

M

TR

EA

TM

EN

T G

RO

UP

14/4

4 41

414,

14:1

11.

DIS

CO

NT

INU

ED

PU

PIL

S

BLA

CK

357

76

177

77

154

76.2

% B

LAC

KM

NO

NB

LAC

K11

353

48

% N

ON

BLA

CK

U24

2323

.8

TO

TA

LS47

023

020

2

FIG

UR

E 2

Non

blac

k in

clud

es A

sian

, His

pani

c, N

ativ

e A

mer

ican

and

Whi

te p

upils

.T

reat

men

t gro

up in

clud

es p

upils

who

rec

eive

d 60

or

mor

e le

sson

s or

who

wer

e di

scon

tinue

d.12

Page 8: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

100 80 60 40 20

0

PE

RC

EN

T O

F P

UP

ILS

......

..

ALL

PU

PIL

S S

ER

VE

DT

RE

AT

ME

NT

GR

OU

PD

ISC

ON

TIN

UE

D P

UP

ILS

FR

EE

416

88.5

208

90.4

183

90.6

% F

RE

E1

RE

DU

CE

D17

54

% R

ED

UC

ED

3.6

2.2

2

PA

YIN

G37

1715

% P

AY

ING

R7.

97.

47.

4

TO

TA

LS47

023

020

2

FIG

UR

E 3

Tre

atm

ent g

roup

incl

udes

pup

ils w

ho r

ecei

ved

60 o

r m

ore

less

ons

or w

ho w

ere

disc

ontin

ued.

rrlu

ncpr

Page 9: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

FIG

UR

E 4

The

202

dis

cont

inue

d pu

pils

plu

s th

e 28

not

dis

cont

inue

d pu

pils

with

60

or m

ore

less

ons

com

pris

eth

etr

eatm

ent6

grou

p.17

Page 10: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

100

NU

MB

ER

OF

PU

PIL

S

80 60D

ISC

ON

TIN

UE

D P

UP

ILS

ALL

OT

HE

R P

UP

ILS

0-9

10-1

920

-29

30-3

940

-49

50-5

960

-69

70-7

9

NU

MB

ER

OF

LE

SS

ON

S

80-8

990

-99

100-

109

FIG

UR

E 5

The

202

dis

cont

inue

d pu

pils

plu

s th

e 28

othe

r pu

pils

with

60

or m

ore

less

ons

com

pris

eth

e

the

trea

tmen

tgr

pt19

Page 11: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

Ele

men

tary

and

Sec

onda

ry E

duca

tion

Act

- T

itle

I

Fin

al E

valu

atio

n R

epor

t19

96-9

7

Rea

ding

Rec

over

y P

rogr

amD

esire

d O

utco

me

Res

ults

Des

ired

Out

com

e 1:

At l

east

75

perc

ent o

f the

pup

ils w

ho h

ad r

ecei

ved

60 o

r m

ore

less

ons

or w

ho w

ere

disc

ontin

ued

will

dis

play

evi

denc

e of

eac

h st

rate

gic

proc

essi

ng b

ehav

ior

at le

ast t

wic

e du

ring

the

trea

tmen

t per

iod

whe

n re

adin

g ap

prop

riate

inst

ruct

iona

l tex

t to

the

satis

fact

ion

of th

e T

itle

I tea

cher

.

Des

ired

Out

com

e 2:

At l

east

75

perc

ent o

f the

pup

ils w

ho h

ad r

ecei

ved

60 o

r m

ore

less

ons

or w

ho w

ere

disc

ontin

ued

will

rea

d at

leas

t fiv

e bo

oks

at te

xt r

eadi

ng le

vel 8

or

abov

e as

cer

tifie

d by

the

Titl

e I t

each

er.

The

follo

win

g ch

art a

nd ta

ble

(Fig

ure

6) p

rese

nt th

e an

alys

es o

f the

num

ber

and

perc

ent o

f tre

atm

ent g

roup

pup

ilsw

ho m

et th

e pe

rfor

man

ce c

riter

ion

for

Des

ired

Out

com

es 1

and

2. T

he c

hart

and

tabl

e in

dica

te th

e nu

mbe

r of

pupi

ls in

eac

h tr

eatm

ent g

roup

, the

num

ber

of p

upils

mee

ting

the

perf

orm

ance

crit

erio

n, a

nd th

e pe

rcen

t of p

upils

mee

ting

the

perf

orm

ance

crit

erio

n fo

r ea

ch d

esire

d ou

tcom

e.

Sum

mar

y st

atem

ents

for

pupi

ls s

erve

d in

the

Rea

ding

Rec

over

y pr

ogra

m:

>O

f the

470

pup

ils s

erve

d, 2

30 (

48.9

%)

met

one

of t

he c

riter

ia fo

r in

clus

ion

in th

e tr

eatm

ent g

roup

for

Des

ired

Out

com

es 1

and

2.

>O

f the

230

trea

tmen

t gro

up p

upils

, 217

(94

.3%

) m

et th

e pe

rfor

man

ce c

riter

ion

for

Des

ired

Out

com

e 1,

indi

catin

g th

e de

sire

d ou

tcom

e w

as a

chie

ved.

>O

f the

230

pup

ils w

ho m

et a

crit

erio

n to

be

incl

uded

in th

e tr

eatm

ent g

roup

, 219

(95

.2%

) m

et th

e pe

rfor

man

cecr

iterio

n fo

r D

esire

d O

utco

me

2, in

dica

ting

the

desi

red

outc

ome

was

ach

ieve

d.

>O

f the

202

dis

cont

inue

d pu

pils

, 198

(98

.0%

) su

cces

sful

ly a

chie

ved

Des

ired

Out

com

e 1

and

199

(98.

5%)

succ

essf

ully

ach

ieve

d D

esire

d O

utco

me

2.A

P50

1\F

NR

PR

R97

10-1

6-97

2:4

2 P

M21

Page 12: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

300

250

7

50

0D

esire

d O

utco

me

1D

esire

d O

utco

me

2

n::

No.

in T

reat

men

t Gro

up23

023

0

No.

Mee

ting

Crit

erio

na

217

219

°A)

Mee

ting

Crit

erio

n94

.395

.2

rrde

sout

22

FIG

UR

E 6

23

Page 13: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

Ele

men

tary

and

Sec

onda

ry E

duca

tion

Act

- T

itle

I

Fin

al E

valu

atio

n R

epor

t19

96-9

7

Rea

ding

Rec

over

y P

rogr

amB

ench

mar

k A

sses

smen

t Res

ults

A b

ench

mar

k re

adin

g as

sess

men

t was

adm

inis

tere

d to

all

grad

e on

e pu

pils

in th

e di

stric

t in

Apr

il, 1

997.

Pup

ilsre

ceiv

ed e

ither

a p

assi

ng s

core

(Y

es)

or a

non

-pas

sing

sco

re (

No)

on

the

benc

hmar

k as

sess

men

t. A

pas

sing

or

non-

pass

ing

scor

e w

as d

eter

min

ed b

y th

e pu

pil's

cla

ssro

om te

ache

r us

ing

a m

odifi

ed m

iscu

e an

alys

is a

s th

e pu

pil

read

a d

esig

nate

d te

xt.

The

follo

win

g ch

arts

and

tabl

es (

Fig

ures

7 a

nd 8

) pr

esen

t the

ana

lyse

s of

the

num

ber

and

perc

ent o

f var

ious

subg

roup

s of

pup

ils w

ho w

ere

succ

essf

ul w

ith th

e be

nchm

ark

asse

ssm

ent.

The

cha

rts

and

tabl

es in

dica

te th

enu

mbe

r of

pup

ils in

eac

h su

bgro

up, t

he n

umbe

r of

pup

ils w

ho w

ere

succ

essf

ul, a

nd th

e pe

rcen

t of p

upils

who

wer

esu

cces

sful

.

Sum

mar

y st

atem

ents

for

pupi

ls s

erve

d in

the

Rea

ding

Rec

over

y pr

ogra

m:

> O

f the

197

dis

cont

inue

d pu

pils

with

ava

ilabl

e be

nchm

ark

scor

es, 1

73 (

87.8

%)

pass

ed th

e be

nchm

ark

asse

ssm

ent.

> O

f the

24

not d

isco

ntin

ued

pupi

ls w

ith 6

0 or

mor

e le

sson

s w

ith a

vaila

ble

benc

hmar

k sc

ores

, 9 (

37.5

%)

pass

edth

e be

nchm

ark

asse

ssm

ent.

> O

f the

218

pup

ils w

ho w

ere

not d

isco

ntin

ued

and

who

had

few

er th

an 6

0 le

sson

s, 4

2 (1

9.3%

) pa

ssed

the

benc

hmar

k as

sess

men

t.

25P

AP

501\

FN

RP

RR

97 2

410

-16-

97 3

:07

PM

Page 14: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

300

250

......

.

Dis

cont

inue

dN

ot D

isco

ntin

ued/

60+

Oth

er

No.

in S

ubgr

oup

197

2421

8

No.

Mee

ting

Crit

erio

n 0

173

942

% M

eetin

g C

riter

ion

87.8

37.5

19.3

FIG

UR

E 7

Dis

cont

inue

d(D

isco

ntin

ued

Pup

ils/A

ny N

umbe

r of

Les

sons

; Not

Dis

cont

inue

d/60

+(N

ot D

isco

ntin

ued

Pup

ilsw

ith 6

0 or

Mor

e Le

sson

s; O

ther

(P

upils

Ser

ved

Who

Wer

e N

ot D

isco

ntin

ued

with

Les

s th

an 6

0 Le

sson

s).

2627

Page 15: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

100 80

co .a60

= a_ 464

c''

0

20

Dis

cont

inue

dN

ot D

isco

ntin

ued/

60+

Oth

er

No.

in S

ubgr

oup

197

2421

8

No.

Mee

ting

Crit

erio

n17

39

42

% M

eetin

g C

riter

ion

11-

87.8

37.5

19.3

FIG

UR

E 8

Dis

cont

inue

d(D

isco

ntin

ued

Pup

ils/A

ny N

umbe

r of

Les

sons

; Not

Dis

cont

inue

d/60

+(N

ot D

isco

ntin

ued

Pup

ilsw

ith 6

0 or

Mor

e Le

sson

s; O

ther

(P

upils

Ser

ved

Who

Wer

e N

ot D

isco

ntin

ued

with

Les

s th

an 6

0 Le

sson

s).

2829

Page 16: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

eS0

U.S. DEPARTMENT OF EDUCATIONOffice of Educational Research and Improvement (OERI)

Educational Resources Information Center (ERIC)

REPRODUCTION RELEASE(Specific Document)

I. DOCUMENT IDENTIFICATION:

E IC

Title:ELEMENTARY AND SECONDARY EDUCATION ACT - TITLE 1 - FINAL EVALUATION REPORT1996-97 - TITLE 1 - READING RECOVERY PROGRAM

Author(s):John S. Pollock

Corporate Source:Columbus (Ohio) Public Schools

Publication DateNovember 7, 1997

II. REPRODUCTION RELEASE:

In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documentsannounced in the monthly abstract journal of the ERIC system, Resources in Education (RIE), are usually made available to usersin microfiche, reproduced paper copy, and electronic/optical media, and sold through the ERIC Document Reproduction Service(EDRS) or other ERIC vendors. Credit is given to the source of each document, and, if reproduction release is granted, one ofthe following notices is affixed to the document.

If permission is granted to reproduce the identified document, please CHECK ONE of the following options and sign the releasebelow.

V 0 Sample sticker to be affixed to document Sample sticker to be affixed to document

Check herePermittingmicrofiche(4"x 6" film),paper copy,electronic,and optical mediareproduction

"PERMISSION TO REPRODUCE THISMATERIAL HAS BEEN GRANTED BY

90°TO THE EDUCATIONAL RESOURCES

INFORMATION CENTER (ERIC)."

Level 1

Sign Here, Please

"PERMISSION TO REPRODUCE THISMATERIAL IN OTHER THAN PAPER

COPY HAS BEEN GRANTED BY

TO THE EDUCATIONAL RESOURCESINFORMATION CENTER (ERIC)"

Level 2

or here

Permittingreproductionin other thanpaper copy.

Documents will be processed as indicated provided reproduction quality permits. If permission to reproduce is granted, butneither box is checked, documents will be processed at Level 1.

"I hereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce this document asindicated above. Reproduction from the ERIC microfiche or electronic/optical media by persons other than ERIC employees and itssystem contractors requires permission from the copyright holder. Exception is made for non-profit reproduction by libraries and otherservice agencies to satisfy information needs of educators in response to discrete inquiries.'

Signature:

11-7----7---4-Position:

Director

Printed Name:Kurt T. Taubel Ph.D.

Organization:Columbus (Ohio) Public Schools

Address:1091 King AvenueColumbus, Ohio 43212-2204

Telephone Number:(614 ) 365-5167

Date:November 7, 1997

OVER

Page 17: DOCUMENT RESUME Pollock, John S. · DOCUMENT RESUME. ED 412 519 CS 012 952. AUTHOR Pollock, John S. TITLE Title I Reading Recovery Program. Final Evaluation Report. 1996-97. Elementary

III. DOCUMENT AVAILABILITY INFORMATION (FROM NONERIC SOURCE):

It permission to reproduce is not granted to ERIC , or. it you wish ERIC to cite the availability of this document from anothersource, please provide the following information regarding the availability of the document. (ERIC will not announce a documentunless it is publicly available, and a dependable source can be specified. Contributors should also be aware that ERIC selectioncriteria are significantly more stringent for documents which cannot be made available through EDRS).

Publisher/Distributor:

Address:

Price Per Copy: Quantity Price:

IV. REFERRAL OF ERIC TO COPYRIGHT/REPRODUCTION RIGHTS HOLDER:

If the right to grant reproduction release is held by someone other than the addressee, please provide the appropriatename and address:

Name and address of current copyright/reproduction rights holder:

Name:

Address:

V. WHERE TO SEND THIS FORM:

Send this form to the following ERIC Clearinghouse:

If you are making an unsolicited contribution to ERIC, you may return this form (and the document being contributed) to:

ERIC Facility1301 Piccerd Drive, Suite 300

Rockville, Maryland 208504305Telephone: (301) 258-5500

(Rev. 9/91)