pocoim mom - ericpocoim mom ed 157 036 0 cs 004 247 author anderson, thdmas h.; and...

67
pocoim mom ; ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others ,-TITLE - Development and Trial of a Model for Developing Domain'Referenced Tests of Beading Comprehension. Technical Report No. 86 Newman, Inc., Cambridge, Mass.; bana..Center for the Study of , INgTITUTION SPONSAGENCY f PUB. DATE CONTRACT- NOTE PRICE DESCRIPTORS Bolt, Beranek and Illinois Univ., Ur Reading. National Inst. of D.C., Nay 78 MO-76-0116 69p. Education (DEM, Washington, NF -$Q.83 HC-$3.50 Plus Postage. Criterion Referenced Tests; *Measurement Techniques; Performance Factors; *Reading Comprehension; *Aeading Redearch; *Reading Tests; .*Test Construction ; IDENTIFIERS *Center for the Study of Reading (Illinois); *Domain . Referenced Tests -ABSTRACT The dbaain-referenced approach, to assessment results in a set of tests that are .closely linked !td theoretical propositions , about aspects of reading comprehension. in this imper, the definition,s.validation, and use of domain's are described, and ote strategy for developing domain-referenced \measures is proposed. The strategy involves identifying a pladsible Candidate domain, identifying prototypic items from that domain, specifying relevant variables thought to affect the difficulty of responding correctly,to those items, creating sample items, and verifying the domain- . empirically. An attempt was made to implement this strategy in , measuring "ability to find the main point of a passage." In general, the strategy seems to be a useful approach tb test deielcpment and theory refineient, in that it effectively sakples and screens variables affecting performance in the dcmaih. On the basis of this stay, suggestions are made for further research On finding the main point, and approprilte next steps in developing domain-referenced measures are proposed. (Author) ****************************************************** Reproductions supplied by BURS are, the best that ca from thd original document. ************************************************************* 41************* be made * ******** a

Upload: others

Post on 29-May-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

pocoim mom;

ED 157 0360

CS 004 247

AUTHOR Anderson, Thdmas H.; And Others,-TITLE - Development and Trial of a Model for Developing

Domain'Referenced Tests of Beading Comprehension.Technical Report No. 86

Newman, Inc., Cambridge, Mass.;bana..Center for the Study of

,

INgTITUTION

SPONSAGENCYfPUB. DATECONTRACT-NOTE

PRICEDESCRIPTORS

Bolt, Beranek andIllinois Univ., UrReading.National Inst. ofD.C.,Nay 78MO-76-011669p.

Education (DEM, Washington,

NF -$Q.83 HC-$3.50 Plus Postage.Criterion Referenced Tests; *Measurement Techniques;Performance Factors; *Reading Comprehension; *AeadingRedearch; *Reading Tests; .*Test Construction ;

IDENTIFIERS *Center for the Study of Reading (Illinois); *Domain. Referenced Tests

-ABSTRACTThe dbaain-referenced approach, to assessment results

ina set of tests that are .closely linked !td theoretical propositions, about aspects of reading comprehension. in this imper, thedefinition,s.validation, and use of domain's are described, and otestrategy for developing domain-referenced \measures is proposed. Thestrategy involves identifying a pladsible Candidate domain,identifying prototypic items from that domain, specifying relevantvariables thought to affect the difficulty of responding correctly,tothose items, creating sample items, and verifying the domain- .

empirically. An attempt was made to implement this strategy in ,

measuring "ability to find the main point of a passage." In general,the strategy seems to be a useful approach tb test deielcpment andtheory refineient, in that it effectively sakples and screensvariables affecting performance in the dcmaih. On the basis of thisstay, suggestions are made for further research On finding the mainpoint, and approprilte next steps in developing domain-referencedmeasures are proposed. (Author)

******************************************************Reproductions supplied by BURS are, the best that ca

from thd original document.*************************************************************

41*************be made

*********

a

Page 2: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

F

-CENT FOR THE STUDY OF READING

Technical Report No. 86

DEVELOPMENT AND TRIAL OF A MODEL FOR DEVELOPINGDOMAIN REFERENCED TESTS OF READING COMPREHENSION

Thomas H. Anderson, James L. Wardrop,Wells Hively, Keith E. Muller,

Richard I. Anderson, C. Nicholas Hastings,and John Frederiksen,

US OE PARTMENT OF HEALTH,EDUCATION A WELFARE

NATIONAL INSTITUTE OF. ED.UCAT ION

THIS DOCUMENT , HAS BEEN REPRO-DUCED EXACTLY AS RECEIVED FROMTHE PERSON OR ORGANIZATION ORIGIN.ATING IT POINTS OF VIEW OR OPINIONSSTATED DO NOT NECESSARILY REPRESENT OFFICIAL NATIONAL INSTITUTE OFEDUCATION POSITION OR POLICY

Universi'ty of Illinoisat Urbana-Champaign

51 Gerty DriveChampaign, Illinois 61820

ti

May 1978

Bolt Beranek and N mien Inc.

50 Moulton StreetCambridge, Massa usetts 02138.

The researc reported herein was supported;Institute of Ed cation under Contract No. US-.NI

All authors are at the University of%Illinexcept for Wells iitirely, who is\pt the Spautdin

New Hampshire, Keith Muller, whckis now at Bel. New Jers.ey, ando4ohn FrederikseA, who is at BN, I ric. t Cambridge, Massachusetts.

.2A

n part by the NationalE C-400-76-0116.Is at Urbana-Champaign-Youth Center, Tilton,Labi, Middletown,

t Beranek and Newman

Page 3: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

fr;

Domain Referenced Tests

2

,Development and Trial of a Model for Developing'Domain Referenced

Tests of Reading ComorehensLon

Introduction

There are at least three approaches to constructing tests of reading

comprehension, The table-of-specifications approach used for most tan-:

dardized achievement rests results in general measures of achievement

based on performance over a broad range of content areas and tasks. The

objectives- referenced approach results in a set of discrete items, each

keyed to_a,specific instructional objectiye. The doplai,n7referenced

approach 'results in a set Of tests which are derived from and which feed

into a theoretical proposition about some aspect of reading comprehension.,

Because of their generality, tests derived using the first approach

are of liniAed value for helping practitioners make decisions a- bout in-

structio nafi.sequences or strategies. Their generality also results in

their having little value as outcome measures in research on comprehension

processes. v.Because ,of their specificity, tests derived using the second approach

permit ratherlprecise determination of whether pupils have attained par-

tiicular objectives, but are of little valve far assessing pupils' acquisi-.

tion of more brOadly-conceived skills or strategies for comprehending

written discourse. That same specificity severely limits their'utility as

outcome measures for research on comprehension processes.

Additionally, both theitableTof-specifications and the objectives-

referenced approaches are only remotely connett d to theoretical modes

111

3

Page 4: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

DoMain Referenced Tests

3

of reading comprehension. This lack of a validated theoretical base

further 1 imi tsthei utility.

K--D .

In this report, an argument is presented for the potehtial,value of-.

the domain - referenced approach. The report proceeds from an initial

definition of domains through a discussion of the validation and potental

(. . .

utility )of domains. It then presents one test-development strategy a

. .

describes the development, administration, and analysis of a tentativ

measure. (In this pilot effort, only a one-item "test" was develop..

.

Finally, 'the feasibility of the approach is discussed and somejug/

stions- /

,..

concerning the future roles of domain-referenced measures are pre hted.'s .

%.,

Defining, Validating, and Using "Domains"

Definition

In 'die context of this repOrt, a domain is a well-defined 'set of

items. There are at/

least three ways to define-a set of items: (1) in

the most primitive sense, by simply enumerating all the constituent items;

(2) in the most elaborate and comprehensive sense, by stating the complete

set of rules necessary to generate items in the domain--rules which can be

followed by a computer or a clerk; and (3) in the sense that is most,

I

likely to be useful for domains representing compigx behavior's b'' stating

I

the roles that a judge may apply in separating instances from non nstances

of the domain, as they occur in nature. .

Arriving at a complete specification of a domain involves kit

identifying the domai creating or collecting assessment" itelrs for'

the, domain. Since it is unreasonable' topresume that all the re ev nt

constraints and complexities Characterizing a domain can be pres'p fied,

A

A

Page 5: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Aeferenced

.

.

deekning domains is an interactive process invotvirig the intepiay of_J 1

'conceptuallzation and empiricism (thpory and observation). It is ip the

. .

procesSof translating yerbal labels (e.g., "finding the main point of a

passage" or "recognizing 'cause- and - effect relattonshis") into measure-

ment

,

tasksthat necessary constraints on the definition are identified

and the subtleties and complexities of the domain are elucidated. -

(Hively, f975).

In attempting to define a domain, one,usually begins with i collec-

tion of exeplary or prototype items: important things that learners do

in the area of interest. Then, a sampling space of comparable or related

items is generated by tranifor ing and generalizing the prototype items

and by deducing other related items from a theoretical analysis of the

process required to obtain c rrect answers.

Transformations and ge eralizations of the items are oftenttained

,through the development of m forms"'in which components of/an item are,

allowed to vary over a spe I led range of possibilities. Lifts of replace-

ments for the variable c ponents are prepared so that neVitems may be

generated by selecting f om these lists new values for the variables.

For example, compare sage "At.' and passage "1" which appear `in the

Appendix of this,-report'. Both are identical with, the exception of the

first paragraph,"a "component of an item," which is "allowed to vary" from

a paragraph that directly states the passage's main point-in passage

"A") to a paragraph that indirectly, states the passage's main point (as

in passage,"I"). New items may by generated by varying pther passage com-

.

po(lents in addition to the first paragraph.

Page 6: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

5

.

Other related items may be generated by analyzing hypothetical

- teaching sequences that would help learners acquire the skills necessary

to respond correctly to the prototyp items. Processing models of a

learner's behavior may also lead to the identification of related items

which the learner would have to answer correctly if he or she performed

according to the model. Such modelsat various levels of elaboration- -

may also be, used to generate predictions about variables affecting the

1 'difficulty of items.. Specifying different values of these variables

allows one to generate diffaent classes of items in the diain.

Typically, then, a domain consitti of a set of items partitioned

into subsets according to some_ theory, The domaift, together ytith the_

theory that rationalizes it., often redefihes the area of original interest.

.Validation

Given a skill or behavior and its associated items and theoretical

framework, the next step is to administer the items to a group of examinees

and to use their performance as a basis for validating and possibly rede-

fining the domain.

iiaare domains validated? The question is not simple to answer'---4

becaUse each of the several types of validation requires unique procedures.

Whatfolrows is a description of four types of domain validation, along

with a brief consideration of the crucial issues relating to the problem

of validafing domain-referenced tests.

The first type is internal construct validity. Following this approach,

the theory that defines and partitions the domain may be used to predict

the behavior of learners in several ways:

Page 7: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

'Domain Referenced Te.sts

6

(1) It may be used to predict the relative difficUlty of items over

some population of learners.

(2) It may be used to predict patterns or scalar relationships among

correct and incorrect' answers to items, perhapS, representative of under-.

'lying strategies used by individ als or subgroups of leorners.

(3)_ It may be used to pred ct generalization of difficulty relation-

ships or patterns of correct and incorrect answers to dther samples from

the subdomains, t.e., partitions of the larger domain.j To elaborate://14--,\

one draws one or two items from -ach subdomain of a larger domain and has

a theory that predicts which one. of those items an individual will answer

correctly (and the data sUpportIthe theory), then the generalityof the

findings needs tó be clinched b drawing other comparable items fom the

same subdomains and seeing whet er the same relationships hold. Findings4

must.be replicated with some degree of reliakility'across independently

sampled test formi. A single f st is a trivial domain:

(4) The theory may be use' to predict-transfer and gene4alization

among subsets in the domain fo learne o are-being taught new sk111

defined by those subsets. Thi is probably the strongest way to validate

a domain, and it should also b elaborated.

In the first three instan s above, no teaching took place. The

domain was validated simply by ooking for relatively stable and the t-

ically interpretable patterns f performance' from individuals or groups

encountering the items for*the first time. One, can goibeydnd this to

diagnose the pattern of an indi idual's initial performance, teach him1

o? her to respond correctly to ome previbusly'unknOwn set of items, and

7

Page 8: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

A

fa

./

Domain Referenced Tests '

7

then look'for theoretically predictable changes in performance in related -

subdomains.

The second type of domain validation is external construct validation.

The theory that defines and partitions the domain may be used to predict .a

learner's behavior on previously uncatalogued items. For example, if a

learner's behavior has been diagnosed with respect to the domain of "finding

the main point," a teacher might bring a new passage from the Reader's

Digest and ask the examiner to predict whether the learner could correctly

state" its main idea., The tester could then apply the thedry which has been

used to structure the domain and come up with a probability statement about

the learner's chances of success.

The third type is external predictive validity. The theory which

defines and partitions the domain may be used to predict judged performance

iR related real-world tasks. For example, can a student who does a good

job in the domain of "f-inding the main point" perform effectively in a

reading discussion group?

External predictive validity may be either correlational or-experi-

mental. In the correlational case, one finds' people who do well and

people who do poorly on the domain and looks at their related behavior in

the discussion group. In the experimental case, one finds people who do

poorly on the domain and poorly in the discussion group, then teaches

them to perform well in the domain to see if there is,any change i

performance in the discussion group.

The 1 st type of validation is face vafidity. Judges simply rate

the ekte to which the items' truly reflect the skill being assessed.

8

1

Page 9: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

.

Domain Referenced Tests-

8

echnjcally speaking, it is not necessary for a domain to have face

validity, but if it doesn't (a "cloze" domain Might be an example) then

its internal construct validatioNmay be of very little interest. Justi-

fication of the domain'l existence for practical pUrposes would-then have-01^

to depend on external predictive validation. And, "if its external pre-

./

dictive validity is good (the "cloze" test may. again be an example);

then that would seem to suggest a need for some intensive analysis to

tease out the actual basis for the correlations.

Use

Domains have both theoretical and practical applications. In terms

of theory, a domain serves as a concrete space for experimentation which

operationally defines an area of generalizbility for experimental results.

It allows one to make precise statements about generalization and transfer

and about relative difficulty among the items.. However, the main use ,of

domains is likely to be &practical one: as targets for instructional

interventions. If one has a well defined domain, one-can observe learners

acquiring it, try a variety of teaching and curriculum techniques, and--

given an elaborated set of items representing the domain -- closely monitor

the efficiency and effectiveness of instructional procedures.

A Development Strateg

One strategy for developing domain-referenced measures is as follows:

(1) identify a plausible candidate domain, (2) identify prototyPTCOtems

from that domain, (3) specify relevant variables thought to affect the 11

difficulty of responding correctly to those items, (4) create sample items,

9

Page 10: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

9

and' verify the &main empirically. As employed in this stuay,this

strategy emphasizes the internal construct validation ore domain-

referenced measure, using the first of the four approaches described

earlier.

Ideally, a theory of behavior will guide the choice of candidate

domains. The needs of both researchers and practitioners, in the-field

will determine the necessity to measure particular performance domains.'

Under such circulhstances, the research base itself will provide an adequate

set of initial specifications for the domaiw( Unfortunately, knowledge

,about components of reading, comprehension in the transitional stage (grades

4 through 8-, the focut- of the Center for the Study of Reading) falls- far

short of qualifying as a basis for 'theory." TOS, it.was necessary to

use another strategy (described in the next section of this report) to

identify a candidate domain for-our initial effort.

.

Following the identification of a candidate domain, prototypic items

for assessing behavior in that domain are located or produced. Some ways

of coming up with such prototypic -items are looking at existing tests,

observing instructional sequences, analyzing learner behaviors, and/or

studying inttructional materials. Essentially, the task is to come up

with stimulus situations that seem likely to evoke responses demonstrating

the presence or absence of the behavior(s) exemplifying the target domairi.

The next phase (steps 3-5 above) encompasses thesAevelopmeht which

, -

typically takes place in any experimental study: variables and techniques

are gpnerated from available theories. The choice of particular experi-

mental variablesis based upon theoretical predictions about their relative .

Page 11: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

DoMain Referenced Tests

10

processing demands.(e.g., manipulations of syllabic structure is expficted

to vary the load placed upon a decoding process in making lexical identi-,

fications).,Failure to find performance difffrences for different levels

of a variable then indicates that the theoretical surmises were incorrect,

and that revisions oil the theoretical model are required. Once thes

variables have been identified, items are constructed or collected which

differ systematically along the specified variables while other variables

)' '`are held at a constant level. The items should be at least partially

ordered in difficulty on 'the basis of the theory used to generate them.

That is, one would generally expect items that are easy on all the variables

affecting the behavior to be easiest, items that are easy on all but one

of- the variables affecting the skill to be next easiest, and soon.

Empirical verification may be carried out in at least two different.r

ways: (1)-a rating protedure by expert,judges, and (2) a collection of

performance data from learners. Although the rating procedure was not

employed-in the study described later, a description of both techniques

is,presented.

In the rating procedure, ratings are obtained of item difficulties

with respect to the skill domain from an independent group of,raters.

Scaling techniques are used that will reveal inconsistency in lodgment both

within a rater and from rater to rater. If rated itbm difficulties do not

correspond to predicted item diffiCulties, reasons for disagreement should

be analyzed and a revised"theory developed that specifies how much impact

particular variables have on item difficulty. Additional items are then

either constructed or selected following therevised set of principles.

tr-

Page 12: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

, Ratings are again obtained, and the iterative procedure is continued untFN

a set Of rules for item construction has been specified that can be-fdllowed

by item writers and that yields items that vary, systematically with respect

to the specified variables while not varying along irrelevant dimensions.,

Each of these requirements11411 haye been met when independent raters

affirm these claimed prOperties for the items. In other words, a satis-

factory set of rules for item Construction exists only when it is possible

to predict, based on those rules and the variables derived from'the asso-

ciated theory, the rated difficulty of the resulting items.

On each iteration of this procedure of theory specification and

revision, iteif# selectiqn or construction' and modif4ca:tion, and evaluation.4.

by'indeRendent raters, decisions have to be made about particular items.- . ..1.- ,r.:,.,.. .. .-:-.- -

1,,,!:-If an item is not transitivbly related to other items in rated difficulty,

>,.

,it should be elinfinated and a principle Written down which will serve to

avoid the construction Or selection of ,,siffAlar item in the future. This

amounts to refining the definition of the domain. _In other cases, items

might be_scarable but showsubstantial variability in scale 'position for

different raters; such items'should be retained, but modified in order to

increase their scalabiltty.- The principles used in modifying .items'should

be explicitly'stated, so that they.can be ,incorporated in the specifica-

tions used for generating additional ite6§. Finally, if 5 number of item

variables are being employed in the construction or selection of test

,items, it is possible that subsets 'of items Which represent a Single vari-.

able may have poor Scalability. In such cases, decisions should be made

.y.

12.

Page 13: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

N-. about whether or not to con tinue to5use this r ffi-variable as

0

Doman Referenced Tetts

o.

a means for manipulating difficdlty within the.specified-skIll domain.

The second way to validate empirically ..-i?`-tokollect performance data

, 'fro learners: Items are presented to a sample ykipil population and per-

formance data are obtained for each item. The validity of the items can

then, /in Oarl,be established by showing that the variables selected for

study are predictive o item difficulty. This technique was implemenIld

cs94.1

in the study described later..

, .

. Since a domain-referenced test assigns test scores on the basis of.,-

-4. -

lean iteM,difficulty metric, they statisticaA (test theory) models used to

represent subjects' performance-within the specified skill, domain should

provide scale values (item difficulty'parameters) for the individual items

and artegt score that Sharei the metriot associated with. the items. If

these requirements are met, then.sUbjects can be assigned test scores

which4riesent.the jevkl_of item dffficiilty'pt which theyocan success-

perform..

Three test theory models are suitable for.thispurpose: the Guttman

Model, the Rasch Model, and4.#the LQgist1c or' (equivalently) Normal-Ogive*

.

Model (See Lord & Novick, 1968). These models, all have the property that1

scale values areiassociated With the idividual items, and subjects' test5 . ,

, scores represent positions orr 'the item-difficulty :scale.'Thus, if the

item difficulties:are closely predictable from the final theory specifica-.

'tion and correspond to, the rated difficulties one has a test whose scoresA

A 1- , .

are doMain-rekrended,and donot require norming In order to provide metric

information atiout the processing domain of Werest. Each of the test

1,1r

s

Page 14: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

13

theory models mentioned above will yield a- set of item parametersesti-

mates that can be compared with predicted difficultiei obtained whenever

the rating procedure is useJ. If the correlation (perhaps the rank corre-

lation) between actual item difficulties-and predicted difficulties is

high, the test's validity (and that of the theory as currently specified)

is, at least partially, established. If em0011,14cal 'difficulties are founds

to be unrelated to predicted difficulties, then the test cannotbe said

to measure the skill domain for which,it was constructed. Given a close

correspondence between predicted item difficulties and the obtained diffi-.

. culty parameters, one would have a test with defensible'scale properties

and high,,inter:nal construc alidity.

An Applicatf'on of the'Strategy

The remainder of this paper describes one attempt to apply proceduresea

outlined above to one aspect of reading comprehension. Because of the

lack of a good theory ofreading comprehension, we began by reviewing

various taxonomies, curriculum packages, and reading tests in order to

locate 4 plausible "candidate domain," The choice--finding the main point

(FMP) of a passage -- appears (1) in most taxonomies of reading comprehensidn,

(2) as an explicitly-taught skill in several sets of reading curriculum

mate-Hatsand (3) as one of the skills to be assessed in mirtually every

standardized test of, reading comprehension.

Having identified this behavior as a possible domain, an attempt was

made to locate prototypic items requiring respondents to exhibit the be-.

havior. Moro than 20 question types were discovered (e.g.,4144 gOod title

-14

Page 15: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

0

Domain Referenced Tests

t4

1 , ' -, ..

\\. . .

for the passege,is ...,","This passage mainly 4.1.4s ...," "The main idea

o -

is ...," U.he author's p se in writing the passage was ...," "The topic:,

of this story is:.."). Al oseemery type was in he form of a 'multipre

choice item s6 that examines had to select the "best".response from

among the four or five al ernatives given. In contrestewe chose to ask

examinees bp complete the statement, "The story mainly tells ...."

A few trial passage were identified to administer to a small numberk

of, reade0., It was fou d that the question we were asking, and "main(

point" qUestions _go ly, were inappropriate for certain kinds of

passages traverogues), so the definitionof the domain was narrowed

by specifying not only question type but also general Passage Charac-,

teristics. The set of constraints on passages required that they be

expository and have a single main point. Further, they should contain1

relatively novel, but politically and emotionally neutral, content, and

.at least appear to be non - fiction.

Q

Method

To try out the strategy for validating a domain, we compiled a set

of experimental materials, developed procedures for using those materials,

administered the materials to a sample of examinees, and analyzed theOi

results.

Materials

Vocabulary test. In the development of experimental materials

(passages), an attempt was made to keep.the vocabulary simple so that

subjects with low vocabulary levels would not have 4ifficUlty finding

15

Page 16: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

the main point f

possibilitythat

Domain Referenced Tests

15

r this reason.' In an attempt to protect against the

,ciMe examinees might have an inadequate vocabulary for

the task:, 20 even-numbered items '(i.e., Items 10, 12, ..., 48) froi;1 the: . . '

.

Gates-Maainitie Reading Test',1 Sdrvey D,//FOrm 2 were administered to.

7 / .

.

the students.

Items. otlowing the seleckionrof FMP as our prototype domain,

variables considered to affect the/performance of individuals at the

task of FMP were identified. Table 1 presents a list of twelve variables

beach variable representing a characteriWc of a passage associated

with the to k of FMP) that was compiled by consulting relevant literature

and coltea ues,. Only four variables were selected for' manipulation in

our generation of 'the passages to be_incorporated into test items. A

brief diycusiion of each orthose four variables follows.

,/e*

Insert Table 1 about here

A'few preliminary investigations, led to.the identification of the

variable enit d "fit of passage structure to model reading strategy."

We found that many sophisticate& readers (college _graduates) have a pre-

'

ferred itrategotfor finding the Main point of passtges. These readers

typicalli read the initial one or two paragraphs rather_ carefully,

continue by reading the final paragraph or two, and then jumped to the

ragraphs to read tice first sentence of each. We thus antici-.

middle p

pated tha . if a passage was structured such that main point statements

"expected places (as,Operationally defined by the readingappeared

Page 17: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

4

DoMain Referenced Tests

16

str0 ateg) decribed above), readers would find the main point more

'r

than if information about the main, point appeared i.a "unexpected places.", .

asily

second variable selected fOr manipu latjohinvolves how'

.0

main point is stated. We anticipated that if the author of,. passage. . .

1

stated its main poiet in a clear and. direct manner, 'readers ould find

the maih point mol: eatily n in the case of an indirect tatement. Of

passage's

.the several ways to s6tp main points indirectly, wechqse'either (1) to

.

present examples and facts to'pbrtray a.passage's main pdi t, or (2) to

provide an analogy to suggest a passage's main point.

The frequency of mainpoint statements in a passage is the third

vaniable.AA high' frequency, condition had three main point ' tatements,

and a low frequency condition had one. It was hypothesized' hat the

high frequency condition would facilitate pe'rformance.

The final' variable selected for manipulation was the amou t of

r'illformation in the passage that did not directly support the main

Such information includes ideas which are tangential and/or irr:e\evant

to the main pointor its development.- In some passages virtually 11'

ideas supported the main point; in the other paSsages, various sentences

and clauses were incorporated which did relate to passage content b

did not lend support to the main point. This latter condition ' was hypoth-r

esIzed to make finding the main point more difficult..\\

A set of items way constructed which had thase, components;, (1) the

directions, "Please read this story and try to find out what it is mainly

abodt," j2) a passage, and (34 directions to complet& the folldwing sen-,.

'tence, "The story mainly,tells...." Item passages were generated by

17.!

e

Page 18: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

J r

Domain Referenced Test

I

systematically manipulating the four variablesiust described while holding .

all other variables at a constant level. 9The contents of the item passagest

were based on materials found in "DimiensLons in Reading -- Manpower

'Natural*Resources" (Science Research Associates, 1966).

Three versions of a passage we/re generated foiuse as Practice' items.

Each had the following main point/ "Bald eagles are being killed, possibly

to extinction." The vdriable'cl ssification emplqed'"in these three ver-

sions are presented in Table 2 With respect to the anticipated difficulty'

:!4='

InSeit Table 2 about Mere

, L.

. /

,

of these passages, vers on one was predicted to be the easiest, version twoi /.

.. was considered moderately difficult, and version three was considered the

most diffiCult. Ea h passage consisted of approximately 350 words, and

each had roughly a sixth grade readability. level.as determined by the SMOG . -/

./

readability. formula (McLaughliri, 1969) in combination with "A Living Word

Vocabulary:, The Words We Know" (Dale 6 WRourke, 1976). A of each4

practice 'itemNcan befound in the Appendix.

een versions of a passage were generated for use as experimental

item each had th& following main point% "Building the Mackinac Bridge.

was difficult job." The sixteen versions of_the passage represented

/ ,

all possible combinations.

of the

-

four manipulated Variables. Each passage/

/

consisted of approximatelY-600 Words. Each had roughly-a sixth grade

/,

'readability level as again determined by the SMOG readability formula

(McLaughlin, 0969) in combination with "A Living Word.Vocabulary: The.

4.

Page 19: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

'a

Domain Referenced Tests

18

Words We Know" (Dale 6 O'Rourke, 1976) \A copy of each experimental item

Can be hound in the Appendix.

uesticins about experimental passage ;details. In addition to items

about the main. point of the passage, four questions were designed to

assess students' knowledge of,,-,certain detaiTs about the passage. Two

of the four questions'assessed ideas-not directly in support.of the main

z.%

point,whP e fwo.others assessed supportive ideas.

Test Bookie 4dministration.

"Test booklets consisting of the vocabulary.testa practice item,-,'"

. feedback from iva piacilce item (presenting three pOssible "acceptable"'--- ,

responses }, and expertimental item, d the` four questions about experi-I.

,

mental passage detai .is were administered to student's by test monitors in1., b i

,I'

a classroom setting. The students Were allowed six minutes to complete.

..

N

theyocabulary test,:. thirty minut eito comObte the practice and experi-.

mental items, and, ten utes

4design of the test booklets

to =re pond 41:9. the detail questions. 5,he

not allow students to refer back to the.

experimental, pasSagdwhile resporiding to the four detail quesiiOns.

Subjects

Subjects

schools. The

g aders were

the eighth

J

.

were 46 'sixth graders and 46. eighth graders from two local

rAblWere 56 males and136 females in the sample. The 'sixth

fro a p'rogreiSie elementary school in the community, while

adgrs ere fro m a mu h, larger junior high schoOl.

19

Page 20: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced TeSts

1

.''

,.,)-- ,,, ,

C. Design4\ .

The dat4 analysis scheme was basically a factorial' analysis of '

1 -.° .

,

CO'vpriance with vocabulary scores uses] as a covariate.2- The five factors-4. w 13 (-, 'o . -

. in the complete factorial were the-Tour passage characteristics (detailed

, 4 .

.- .'.

in the mateflals section) and the difficulty ievel of the. praCtice passage.,...'

J.

Thi,s,gave a 24 X 3 layout, with two subjects per cell (except fOr four cells.

, .

.Ac' .

.

-4F J

in which there were one subject each. The use of vocabulary scores made ftt

unnecessary to include grade level. as a factor in the design. The estimate4

of error, was generated by poSling the fourth and fifth order interactions

with the within-cell variation. Primary dependent measures were: (1) a

measure of total score on finding the main point, (2) a score.on Ccuracy

of the topic, action, and modifitr of the main point, and (3) number Of

correct responses to the four detail questions. Except for measures about

detail questions, all measures were determined on both the practice and

experimental passages.

Response. Scoring Rules

All main point statements were scored by rules. Three categories

(topic, action, and modifier) were used for each statement, and each cate-a

gory could be . assigned a score of 0, 1, or 2., depending on the accuracy''

of the studnt's response. A response received 2 points if it was exactly

correct, V point if it was correct but either too'general or too specific,

or 0 points if the response was incorrect or absent. In addition, 1 point

could be subtracted from any category if irrelevant or' extraneous informa-

,

tion w inCluded with some COrrect information. Further, A point was. .

Page 21: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

20

subtracted from the total score (the sum of'topic, action, and modifier

scores) if additional information was included that codld not be identi-

fied as applying to any.011e of the specific categories; however, this

point was not subtracted if the total score was 0. Thus, each category

.score could range from 0 to,t, producing a total tcore srangYngfrom 0.to 6.

-The following shouleclarify the application of thescoring rules. A

correct=%tatement of the main point fon the experimental pissage is

"Big Mac (topic), was built (action) with great difficulty (modifjer).'i

Regardiing, the topic only, "Big Mac"Jor any response clearly identifying

that particular bridge, such as, "The bridge over the Straits of Mackinac")

is exactly the correct response and would receive 2 points. A response

like, "The bridge" or "Bridges" would betoo geperal, and one like, "The

.towers on Big Mac" would be'consiciered too specific; such responses would

receive 1 point. Responses which failed to mention the bridgeor which 4

mentioned the wrong topic received 0 points. . If the topic had been

awarded -Y or 2 points and had included extraneous information, then 1

point would be subtrdled. For example, "Big Mac and the highway leading

to it" would receive,d.score of 2-1=1 for jts topic score.

There were 184 resPO)ves altogether--92 from experimental. and 92 from

practice passages. Responses were scored by five independent raters. If

there was any question, regarding the storing of a response, iewas reviewed

by all fiv6 members and the score was determined by consensus of toe entire

group.

,

To obtain a'meature of the reliability of the scoring procedure as

fx was applied to the students' experimental responses, the following

21

#

Page 22: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Refe'r'enced Tests

21

procedure was employed: One half of Ihe 92 responses from experimental1

passages were randomly selected to be rated by, another group of five

independent raters. These raters were liven (1) written Instructions,

about the rules for scoring theiresponses7 (2) an example passage, and

44,wi

(3) the 46 randomly selected responses, tAh rater individu.411y scored

all 46 responses,'then all met as a group to review each response in

order to arrive at a grOup consensus. These scores (both individual

scores and group consensus scores) were then correlated with the'scores

, awarded by the initial raters.

Results

Reliability of Scoring Procedures

Consensus of total scores for 46 randomly selected experimental items

as determined by the initial group of raters were highly correlated with

the consensus of total scores fior the same items'as determined by the

second group of raters, r = .92. Total scores assigned by each of the five

raters of the:second group weme also highly correlated with consensus of

total scores of the initial group of raters, r's = .94, 93,'.93, .85, .85.

rp

Total $core Analysis

Table 3 presentspeans and standard deviations for the covariate

(vocabulary) and scores for '!main-point" statements from both practice and.

experimental-passages.

InSertTalile 3 about here

Page 23: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

22

'In an ANCOVA design, the main effec4,,first order interactions,

second order interactions, andithillsd order `interactions were determined

using the pooled higher order terms as an estimate of. error (as had been

planned a priori). The vocabulary score'was used as a covariate, with

the four experimental passage conditions and the practice passage condi-

tion as the five independent v riables. The total experimental passage

score was the ependept variable. The covariate had a correlation of

.45 with total score.

The main effects for "fit to strategy" and "direct/indirect" appeared

to be reliably different ftom zero (F = 6.39, df = .02 for."fit

to strategy"; F = 6.22, df = 1,54, p <,.02-for "direct/indirect"). A good

"fit to strategy" and a direct main point statement made the task of finding

the main point easier. None of the other variables reliably. affected the

dependerI variable.

Since the practice passage variable had been included only to(deal

Iwith what was perceived to be a nuisance factor, the data were collapsed

across. it and reanalyzed using a four-factor ANCOVA,(as had been planned).

The reanalysis led to exactly the same conclusions, with significant main 7

, -

effects for "fit to strategy" (F = 6.30; df = 1,75; P. < .02) and "direct/

indirect" (F = 5.31; df =,1,75; 2.< .03). Computation of an omega 'Squared

41.

statistic for these two factors indicated that "fit to strategy" accounted

for approximately 6% of the variance in finding the main point, while

'direct /indirect" accounted for 5%.

23

.= ,

Page 24: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

k 0

Domain Referenced Tests

23

Subsidiary Analyses

Additional analyses were performed using the same four-factor ANCOVA

as described above, except that three other dependent variables were used-

the part scores on topic, action, and modifier. For these analyses the

action and modifier variables were recoded so that 0 remained 0, while r

and 2 became ; this was done to correct the U-shaped.distributIon'of

.these measures. As expected, the multivariate test indicated that "fit

to strategy" and "direct/indirect were the only two reliable effects

(ja < .02). The "fit to strategy" variable affected the action and modifier

measures', but it did not affect the topic measure (2. < .02, 2. < .01 and

.a < .73, respectively). In contrast, the "d/rect/indirect" variable sig-

nificantly affected the topic measure, but "-did not affect the action

21or the modifier fil < .001, R < .93, k < .7 ).

The ANCOVA design again was used to a alyze the scores on the four4

detail questions. Since the analysis shoed that there was no main effect

due to the practice passage condition, a second ANCOVA with the four experi-

mental factors was performed. This analysis showed a main effect for only

non-supportirig_details" < .05). SObjects who read passages with many

"non- supporting" ideas ,did less well On the detail questions than did sub-,

jects who read passages with few nonrsupporting ideas. Since (1) this

main effect -was burly marginally significant and (2) the distribution

characteristics of the dependent variable were rectangular and probably

violated.some of the Covariance assumptions, addltiobal analyses and

Interpretations are not presented.

24

Page 25: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

24

The next analysis gives some indication of the extent to whrch the

major findings with respect to the,variables might generalize across

passages. 'Recall that each subject received a practiCe passage 'that was- -

\ .

.

classified as.either easy, moderate, or difficult (see Table 2). The

"easy" passage had (1) three statements of thg mein point (2) direct state--.

ments of the main point, (3) main point statements located in predictable

places in the passage, and (4) fdt, non-supporting details. The first and

third of these characteristics were altered for'the "moderate" passage

while all four were altered for the "difficult" passage. Of the f6 experi-

mental passages, three corresponded to the practice passages in terms of

these characteristics. By disregarding practice passage scores of those

17 subjects who responded to these three experiment51 passages and by.

utilizing their experimental passage scores instead, it was possible to

analyze performance according to the design in Table 4. Using this two-way

Insert Table 4 about, here

classification, we performed a two-factor ANCOVA with total score as the

dependent variable and vocabulary score as the.covari!late. The passage

difficulty effect'wassubstantial (l < .001) while text (p > .99) and the

Text x Difficulty interaction >'.29} were not. This result suggests

that the overall effect of the four manipulated variables was consistent

across texts, while the particular passage used did not affeci performance.

Furthermore, per.formence on easier passages was invariably superior to

performance on more di.fficult passages for both texts.

25r.

i

Page 26: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Dbmain Referenced Tests'

25

Regression Analysis

A potential payoff associated with the domain referenced approach is

the predlctiOn of the difficulty of a passage for a particvlar- person.

To investigate this possibility,a'regressitm analysis war: performed in 4

._

which the dependent Variable was total score on FMP and the predictors were

vocabulary, "fit to strategy," and "direc//indirect." EaCh of the latter

two variables was coded or 1. Since the resulting multiple correlation

was .54, the three variables account for approximately 30% of the va 1

,

ance in the total scopes. Jocabulary accounted, for 20% of the variance,

and the tw o passage variables eaa accounted for approximately 5%. The

standardized regression weights were .44 and .21 for the vocabulary,

"fit to strategy;" and "direct/indirect predictor's, respectively_.

Disc

This section begins wi/h a evaluation of the proposed-strategy'for

developia0doain referenced tests based on the,results just presented.

Some possible next steps in exploring tte FMP Omaln are considered.

Finally, further exploratpuls oflkile:development strategy are proposed.-

S oni

,%.

Evaluation-of' the.Development Strategy-,...,,,

'-- Each of the five component siagesin the strategy-For deVeloping ,

doOlain referenced measures is-evaluated below,%followedby 0 brief summary

statement.

*

Domain Jdentification. The initial step in the proposed. development

strategy is domain identification. Earlier, it was stated that "ideally;

. a theorV of behavior will guide the choice of candidate domains." inded,,- .

.

,

26

I

Page 27: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

aI

t.

I,

.

Domain Referenced Tess s. 8

r26

.

-,

. . . ,

the relariOnihip between research, measurement, and educational practice...

.

isone of symbiosis. Retearchers want to measure the effects of manipu

lating presumably-relevant variables on certain inteeesting (and hopefully

important) outcomes. Thus, meaningful research dependi on the availability

%

of adequate outcome measures. ip,thiS context, the outcomes to be measurett

. . . %,.......

are specified (perhaps incpmpletely, at first)' ifiy1:9ie theoretical.proposi-

01P

tions that guide the research.I

Some of the outcomes important in theory-building may'also be shown

, to be relevant to educational practice. In these instances, again, the

measurement of outcomes serves as a check on the efficacy of innovative

educational practice.o g .

..

In both of the above, contexts, the development-of domain-'referenced

measures is served and is guided by the needs of the potential users of-

the measures. However, in the present study we had no potential users

coming tdrus for help in creating a-measure of a chosen domain. Instead,,

we were trying to anticipate the need For such measures and to create

"proceduresJor developing them. Accordingly, our choice of a domain was

merely.an ad hoc attempt at identifying an interesting component Qf reading.

A i

comOehension that could be used try out and refine our development

estrategy. , . '

. ..

Under the circumstances, the selection of FMP seemrto have:been a

fortunate, one. It provided the,framework for implementinp_the approach;

it had "face validity" to those interested in studying reading.comprehen-

sion; and, it Permitted us to work through virtually every step of the P

proposed strategy.

4 -

Page 28: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

27

Prototypic item identification. Following the identification of a

domain, the next task is to locate,or genera

the desired behaviors. This.may produce an ncomfortably diverse ayillay,

e items that teem,to represent

of "item forms: For example, in the present study, numerous probes for

FMP were encountered "The. story mainly tells...," "The be title.1 le

"What was the auth6r's purpose?"). It was also discovered that

main point questions could hot,meaningfully be asked of certain typesof

material (e.g., anecdotes, travelogues). Further, various kinds of main

points were encountered .(e.g., theme, topic, moral) which affected the. .

utility of identified item's. Thus, the review'of existing measures rovedi,

useful to indicate some potentially confounding variables that might affect

performance in, the domain.

Specification of relevant variables. After the domain has been identi-

fied and prototypic,items have been located or generated, the next step

requires that relevant variables be identified which could affect performance.

In the absence of,a priori theoretical guides, we chose to do this by con-

4

suiting the literature, curriculum packages, tests, and reading teachers.

In addiliOn, we asked students to tell us how they read to. find the main

point, and we observed students at they did so. Since our list soon in-

cluded 12 potsible variables, we feel confident that a group of knowledge-

able teachers, researchers, and/or cdrriculum developers could quickly

generate a reliable list of variables.

Operationalization of relevantvariabies. Theneit step requires'

that I:Irrelevant variables be operationaliied. That is, activities or-,

operations which quanitfy levels along the,variable continuums need to

Page 29: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

:ti

0 DoMain ReferenceOests

28 N,

be specified. Problems of several types arise in this kind of activity.

/ One problem involves-a matter of preference as each of several models or

research paradigms can lead individuals to prepare different.operLional

strategies. Theoretically, their differences could lead to fundamental

disagreements.

Another problem arises when the designs become crossed, i.e., when one must

interpret the meaning of severandefinitions simultaneously. Sometimes,

nonsense_cells which represent non-existant "real life" conditions are .

produced. For example, while we wanted to use a text that has no main

point statement, we could not use the condition, "frequency of main point

statements equals zero." To have a zero main point condition woUld'have

negated the variable "direct/indirect statement of themen point."

The time and skill required' to generate the various text conditions*

is another problem. Selecting and/or writing the passage content, shaping

the text to conform to the operational variables, and editi.ng the 4ntire

discourse to,ihsure a coherent passage require skill and effort. Large

scale production of domain referenced tests may not be feasible.

Collection'and analysis of performance data. The final step in this

Ilkstudy was the collection and analysis of performance data. Perhaps the

most important information learned from the data was (1) the empirical

verification of the operailonalization of the variables chosen; (2) the\

potency of each variable; and,(3) a description of the relationships among

#

variables.

The results of ttlis study showed that the experimental varTibles

caused a small (5-6% of variance for each.of die two significant variables),

7

29 .

Page 30: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

aDomain Referenced Tests

,29

. ,

butleliable (2. < .02) difference in the performance of students on this

t...

task. 'HoWlarge these differences musi be before they become interestinginteresting,

depends primarily on the decision-making paradigms in which the measures

will be used.. Needless to say; at present the differences are not large

-,

' enough to serve any worthwhile function in decision-making. Ideally, more,

, I:,

,

.

11insight into t nature of these variables will enable them to be opera-

.

tionalized such that the differences will'belarge or to be discarded

ecaUse their effects are too small to meFit further.,consideration. In

the former case, a regVession technique could then be applied to predictr.7

the difficulty of an i%Em. When this can be- done, the model will have

changed'from a descriptive One to a predictive one.

Given that we began -with very little knowledge about FMP, the results

were encouraging. HOWever, only asfraction of the needed empirical- work

,

has been done. Yet, our data. collection seemed to- demonst to Clearly

the relative'effects of the variables. The major drawback to hfs

approach is the cost. Large amounts of subject time, experimenter time,

and materials are needed.

Summary. in general, the proposed strategy seems to be,a reason-

.

able. way. to develop domain referenced tests. By the time a domain has

been well developed, the evidence to support its psychometric propertits

.should be ample. The only potentiat drawback to the strategy is the

. large amount of time and resources required to develop the materials

(operationali;e the variables) and to go through the several model build-

ing iterations.

ft,

30

Page 31: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

JDomain Referenced Tests

3Q

What MbutdPBe Done Next with the FMPDomain?

0

First, those variables therhave not systematically_affected perfor-

4

=.

nce would be at least temporarily eliminated, namely, "frequency of

mainpoint statements" and "number of non-supporting details." They might

be re-introduced at some later time to determine whether or not they have

interactive effects with other variables. Second, additional important-

variables would be incorporated into the model. These might come from

. the list presented, iq,Table 1. At anYltate, the model would eventually

include cognitiie processing and individual difference variables. Third,

a sample of otheY 'similar texts would be used so that we can determine

how generalizable the technique is. To date we know that it works rather

well with only two p6ssages. Fourth, a sample of similar item formats

(i.e., other than "The story majnly tells....") would be used to explore

their impact on .thetask of FMP. And last, we would need to investigate

other forms of validity of the FMP domain,

It is impottant to keip-in mind that this was a pilot effort at

applying alprocedure for developing domain-referenced Measures. .The pro-.

cedure was a rather effective one for sampling and screening variables, -

affecting FMP and for creating what was in fact a oneritem "test." A

needed next step is to develop a test with multiple measures per ind4vigi

ual, employing a series of passages for which examinees are to 'ind,theo

main point. it would then be possible to apply one or another of the

.

test theory4mo discusse41 d earii order to determine scale values

for each of the items. Once this scaling was .accomplished, one could

-

obtain psychometrically defensible estimates of examinees' ability.

e. 31

Page 32: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

I

Domain Referenced Tests

31

Suggestions for Future Development of Domain Referenced Tests

To reiterate the earlier discussion, we concluded that_ developing

doma in referenced tests is a theoretical, model building,-research

activity. The basic steps. in the process are: (i) domain identifica-

tion,°(2) prototypic item identification, (3) specification of relevant

variables, (4) operationalization of relevant variables, and (5) colled=

tion and analysis of peef4rmance data. Depanafngson the way the var- iables

behave, steps 3 through 5 ar.= repeated until perforMance on domain items.

is predictable and a good metric can be determined.

With respect-to further refinement,of a domain, a two-pronge attacklI

seems called for. Validation of the theory upon which a domain i based

. , .

is intrinsic to our approach to test con truction. Empirical validatiin

of a domain reVeals which variables make difference. However, the

theory also can be enriched fromrelate search: (For instance, the

difficulty of finding the main point no dou t depends upon the' inferential

demands of t passage. ,Eventually, variables refleCting this characteristic

should be included in the definitions of the FMP domain.) A pointto be

/tmphasized, though, is that the development of domain referenced tests

,

must proceed in parallel with other resebrci. Because of the ability o

domain referenced tests to measure an individual's performance with res-.

pect to the domain being investigated, it would be unwise to wait until

linguists and psychologists believe they have a comprehensive model of

discqurse structure and propessing. Domain referenced tests could be

quite usefuFfo researchers' developing such 0,Model.

32

Page 33: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

4

In which additional ,do

Domain Referenced Testi

32

In should prototyix test research be done?

Research on the cognitive #rocesses involved in reading with comprehension

is revealing potent ally important domains. Examples includerdraWing

pragmatic inferences, detecting failures in comprehension, and taking

steps to overcome failures in bomprehension. The current state of theqt

art in reading education is also a source of ideas about significant do-,

or 1 `mains.

Now that a case ha's been made fora rational set of procedures_for

the development a r'and validation of tests, are the result-.%

ing products ofd any .use? Thetheoretita and practical applicationsf' *

mentioned earlier appear to be relatively straightforward. However,

currently implementing domain referenced t sts in practical settings Ne

pose some diffiCulty. ,For domain referenc tests of the type we have

been discussing to beeffectively utilized n schools, there may have to

be some changes in typical classroom procedu es andin conventional ideas

about how tests(-are used in the ongoing iduc tional(enterprise.

4

33

Page 34: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

1/4

References

Domain Referenced Tests "

133 -

Dale, E., & O'Rourke, J. A living word vocabulary--The words we know.

Chicago, 111.: Field Enterprises Educational Corporation, 1976.

Hively, W. (Ed.), Domain-referenced testing. Englewood Cliffs, N.J.:

.

Educational Technology Publications, 1974.

Lord, F. M., .0tovick; M. R. Statistical theories'of mental test scores.

Reading, Mass.: ,Addison-Wesley Publishing Co.,41968.

McLaughlin, G. H. SMOG grading:" A new readability formula. Journal of

Reading, 1969, 12, 639-646.

Science Research Associates. 'Dimensions in reading--Manpower and natural

resources. Chicago, Ill.: Science Research Associates, 1966.

34

r.

Page 35: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

1

Domain Referenced Tests

34

Footnotes

1965.by the Teachers College Press. Permission to use these'

items is gratefully acknowledged.fi

4 ecause the purpose-Of this study was to estimate the effects of the

"passage difficulty" variables on examinees' ability to find the main point,

it was important to statistically control for the influence of vocabulary,

Such control is appropriate in developmental research intended to yield

understanding of the characteristics of a domain. After this developmental

research has been carried out, it is no longer'appropriate to use ANCOVA

to analyze test results.

The use of vocabulary as a blbcking variable-was also considered. How-

ever, because.of the small number of subjects per cell in this study, including

vocabulary as a factor led to a large number of empty cells. Subsequent,

research might be designed to incorporate vocabulary,as a factor, but such an

7analysis wgs not possible in the,present study.

35

Page 36: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

sd

17

Table I

Domain Referenced, Tests

35

Variables Predicted to Affect:, the Difficulty. of 'Finding the Main Point'

Variable Values How tAecl.

-1. Frequen0,41pf statements of

2. S( tementoof main point

3. Fit cif passage ,structureaA

model reading strategy

4. Non-supportive ideas0

5: Text4ms denoting statement B

, of, main-loi,nt

High or low

Direct or indirect

Godd or podr

4

Manipulated

Manipulated

M4n4pulated

Few or many Manipulated"./ '..

Present or absent .Constant,

6. Text des denoting details Present or absent Constant

7. Vocabulary Simple or difficult Constant-

8. Syntax

9'. Structure

10. Style

II. Passage length

12. Number of mainpoints

Simple or complex Constant

'Nested or' flat Constant

Narra;ive or argumentative Constant4

Short orlong Constant-

Zero, one or.mcire Conitanit

36

Page 37: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

0-

-Table 2

Characteristics of the Practice Passages

Frequency of main point i Fit of text st ucture to ideas non-supportive ofstatements Statement of main point model readin strategy the main point

Passage No. Low High indirect Direct Poor, Good Many Few

1 ("Easy") , X X X X

2 ("Moderate") Xr

X X X

3 ("Diificuit") X ~ X X

37

8or

CD

-hCD

4) CD

Cr% M0CD

Q.

cnfY

Yn8

Page 38: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Table 3

Means and Standard Deviations of the Dependent Variables and Covariafe

Domain ReAenced Tests

4

\Varrable Possible range Mean Standard Deviation

Vocabulary test 0-20 14.15 2.811

Pract)ce passage.

Topic score 0-2 1.80 0.41

Action score 0-2 1.05.mow/

0.92

Modifier score 0-2 0.77 0.96

Total score. 0-6 S 3.58a 1.96

Experimental passage

Topic score 0 -2 1.27 441.63:

Action score 0 -2 1.50 0.82

Modifier score 0-2 0.66 . 0.84

Total score 0-6 3.28a 41.57

1

a"Rita] score" is not equal to the sum of the three component scores

because deductions were made for the inclusion -of extraneous material in

an otherwise correct, or partially7correct response.

A

39

-

Page 39: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

s

Table 4

eaI

Domain Referbnced Tests

38

Two-Factbr Design Used to Confirm Predicted Pasiage Difficulty

Diffrcuity categoryPassage

Practice 'Experimental

Easy n = 27 n = ,5

Moderate n = -25 n = 6

Difficult n = 23 n_ = 6

s

4

Page 40: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

M

V

,Appendix

Domain Referenced Tests

39

4D-42

Experimental Passage Classifications tro.....49

Experimental Passages

ti

.o

Alt

4 "4:

11cf

.

44-59

t.

I

Page 41: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

a'

"Easy"

Domain. Referenced Tests

gasses, dnd more bdld eagles are being senseTesSTYkillp by humans. So many are being killed that the danger of bald eaglesbecoming extinct is quickly' ncreasing. We must take steps to preventour nation's symbol om dying'out.

w.News of their deaths appea ery often. Recently in a midwestern

state, a'man saw a giant America , ald eaglecircling high in the sky.He was one of those so called sportsmen who kill anything in Sight: He ,

quickly stopped his car, aimed, And brought the might} bird down with oneshot. Then he drove off, having made his kill.

Another example occurred fn Florida. Two boys found an eagle's nestin a lonely pine. They climbed up to see if there were any eggs in it.lhere were two. The boys tossed them down Ito .splatter on the ground.The result: two eagles-that would never be hatched.

Thejfact is that acts such as these have made the bald eagle almsstextinct. At last count'there were fewer than 00-birds, and the numbe-is getting smaller all the time.

Lots of nonsense is spread about the bald eagle. Some say it is afierce thief that sweeps down to carry off-pets, poultry, and.evenchildren. Some think it is a clumsy,, cowardly creature that lives by

' stealing. Both views are wrong, but the views lead to trouble for the"bald eagle.

qt. e

In Wyoming a group of chicken farmers were angry about the loss of45,Pfel4 chickens. They banded together to get the suspected culprit--thebald eagle. Armed with rifles, the group rode irfto the hills and shotevery eagle they could find. Later they learned that a 1,410 dog hadstoken the chickens, but it was tbo late. Twenty-three bald eagles weredead.

,

Bald eagles are also endangered by Mistaken killings and-carelessacts. If mass murdet of the mighty bald eagle does not stop'soen, wewitl lose it forever- We 'bre having our last chance to stye the baldeagle.

4

4

Page 42: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

"Moderate"

eagle circling high in the sky. He was one of those so-called sportsmen .

who kill anything in sight. He quickly stopped his car, aimed, and broughtthe mighty bird down with one shot. Then he drove off, having made hiskill. ,

Odmain ReferenCed Tests.

J41

I.n Florida two boys found an eagle's nest in a lonely pine. Theyclimbed up to see if there were any eggs in it. There were two. Theboys tossed them down,to splatter on the ground. The result ofplesestories: one bird dealt and two that would never be hatched.

Lots of nonstnse is spread about the bald eagle. Some say it isaiercedthief that swaeps down to carry off pets, poultry, and evenchildren. Some think it-is a clumsy, cowardly creature that, rives bystealing. Both these views are wrong, but some people try to kill eagles'because,they believe those ideas.

In Wyoming, a group of chicken farmers were angry at the loss of afew chickens. They banded together to get the suspected culprit--thebald 4agle. Armed with rifles, the group rode high into the Kills andshot every bald eagle they could, find. Later they learned that a wilddog had stolen the chickens, but was too late. Twenty-three baldeagles were dead.

Adts like these, year after ye , have made the bald eagle almostextinct. At last count there were fewer than 4,000 of thbirds, andthe nUmber'is getting smaller 011 the time. We must take steps to preventthe bald eagle from dying out entirely.

Often, bald eagles are killed because of mistakes and carelessness.When young, bald eagles look quite dUbit like the golden eagle. Goldeneagles are not protected by law like the bald eagle is. Some peoplehave mistakenly killed a bald eagle when they thought they were shootinga golden eagle.

Bald eagles eet.mice-and rats and other pests. 4eople often usepoisons .to help get rid of such pests. But if an eagle eats a mousethat has poi on in it, then, the eagle.will also 4e accLdently poisoned.

4

43

r

tib

Page 43: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

A

/ I;

"Difficult"

Recent] in a midwestern state a fortsaw a,glantAmerican bald eagle circling high in the sky. Heyat one ofthose so-called sporttmenwho kill anything in sight. He quiCkly stoppedhit car and pulled out tWIt?gunhe had recently purchased in a local super-market. He aimed and brought the mighty bird down with one thot. Then

_ he, drove off .having made its kill.

`4 Lots of nonsense Is spread about the bald eagle./Some say it is afier:ce thief that sweeps dawn to carry off pets, poultry, and even children.Some think it,is a clumsy, cowardly creature that livei by stealing. Thoseare not true beliefs, but some people kill bald eagles anyway. Actually,the eagle is a meat-eating, bird that lives on animals.

KilTing a bald eagle Is prohibited by law, but tOo Many people are,.Willing to risk the $500 f e. Of course there are always the gun-happy\hunters-and those who are'$ ly careless.'

Domain Referenced Tests

42

°. . ..

,

Ihe.bald,eagle Is One.of the largest birds we have. Its wings cahreach seen"feet across, and a may weigh up to ten pounds. An eagle candive. at '60 miles all. hour; In fact, some -ogles have.been clocked at an .

attounding,100 mi.lesan hour. The eye sight of an eagle is outstanding;one was onCe'seen diving for a fish floating on a lake a full three milesaway.

/.

Each year, tine national park system makes an effort to count thenuMber of'bald eagles living In the United States. In 1962, roughly6,000 birds were counted by the"park system employees. 1968, the count

4was even less than 4,000 birds; Part rangers fear the count may neverstop decreasing.

Tfte,bald eagle is beautiful and mighty bird. Perhaps that is whythe fouriderstof our 'country chose it to be the natiohal symbol. Itsimage can be seen on money, like the quarter,or the one dollar bill,and is even found on the seal of the President of the United States.Some indians used to wear its feathers. to show acts of bravery like'Soldiers wear medals today:

0

44.4

Page 44: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

;

Experimental Passage Classificationsr_

.7*

Frequency of main pointstatements Statement of main po nt , model reading strategy

Fit of text structure to

1.Passage

version Low High Indirect D'rect Poor Good Many Few

Ideas ridn-supportive ofthe main point

A X

C

E

F

G

H

.1

K

L

M

0

P

X

X

X

X

X

X

4,

X

X

X

X

x

X

x

X

X

X

X

X

.X

X

0

X

X

4546

A

Page 45: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

, Domain Referenced Tests

44

A

One of the most difficult of all bridge-building feats was .

accomplished twenty years ago when a bridge called "Big Mac" was con-structed in northern Michigan. The task was so difficult that most_people had ,eaid that the bridge could riot be built. But hundreds ofpeople worked hard for severalAtears, and eventually the bridge wascompleted.

=I I " . - cf T...L.I.p uL

water that is both very deep and,very wide. The strip of water, calledthe Straits of Mackinac, sepatates Lake Michigan ,from Lake Huron andalso divides the state of Michigan Into two parts. In some places the,water is almost 400 feet deep, and the two parts of the state lie.almost four Mlles apart: t

Another problem wds,that the winds that blow through the straitsare ve* strong. It is not uncommon for wind speeds to reach 75 milesper'hour, especially during the winter season. Many people said thatno bridge would be etrong enough to withstand the strong winds.

11e,r,42.

Large waves were also' a concern to the bridge builders: When thewinds are blowing the strongest, the waves on the top of the water canbecome quite big. At one time so tany boats were being damaged by thewaves`that the United States Coast Guard was forced to forbid allpleasure-boating On the Straits,except when the water and the wind

. both calm.

'During part of the year, winter builds its own bridge betweenthe/two parts of Michigan. This bridge, however, is not safe enough"for vehicles to cross over. It is made ottt of ice. With winters asfierce as they are in northern Michigan, the grinding ice could "Possiblydamage the bridge. ,

Still, engineers began Fo work on the many problems. They decidedthat the difficult job could 1Wdone. They would build a suspentionbridge. (This is a bridge in which the roadway is hung, or suspended,from great cables. The cables are supported by tall towers.) Thebridge would be five miles long, and the suspension parts would be thelongest ever built.

People also said a bridge would cost toomuch--one hpndred milliondollars. How would the state pay for it? It was decided that money

A would be raised by selling bonds. The bond buyers would be paid backby all who used the bridge. Cars, trucks, and buses would pay a tollwhen they crossed the bridge.

In order to build the bridge, the engineers determined that thirty-four underwater supports, called caissons, would have to be sunk downthrough the water and mud to solid rock. Eaclytld to be placed withinless than an inch of the right spot. Otherwiee/the steel parts beingmade elsewV, would not fit. The job would be tricky, but they saidthey could it.

So they went to'work. Parts of the bridge were built in millsand shops all across the country.e The pieces of the bridge were,shipped to the Straits to be put togeth . They came on railroadcars,'on-barges, towed by tugs, and on 1 rge ships.

The caissons were put ih first. Next the steel cable towers,tall'as fifty story buildings were built. Then the two cables.thatwould support the road were spun., A total of 12;560 wires had to besqueezed into each round cable to make them strong enough. The cableswere put in place, huge steel frames were hung from the cables, and

the roadway was built.

On Labor Day, 1957, "Big Mac" was officially opened to traffic.The bridge that many thought would never be built had been built. All

the many problems that made buildj.ng,the'bridge so difficult had been

solved. 47

./

Page 46: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

B.

Domain Referenced Tests

145

One of thepost difficult of all bridge-building feats wasaccomplished. twenty years Ago whezi a bridge called "Big Mac" was con-structed in northern Michigan.. The task was so difficult that mostpeople had said that the bridge could never be built. But hundredsof p ople worked herd for several years., and eventually the bridgewan

The bridge had to be built over a strip of water thatris both ;Textdeep and very wide. The strip of water, called the S sits ofMackinac, separates Lake Michigan from Lake Huron and lso divides thestate of Michigan into two parts. In: some places the ter is almost

mos, 409 feet deep, and the two parts of the state lie al four milesapart.

The winds that blow through the Straits are very, v ry 'strong."'-It is not uncommon for wind speeds to reach 75 miles per our,'especially during the winter season. Many-people said th t nobridge would-be strong enough to withstand the strong winds.

.Large waves were'a concern to the bridge buildprs. When the winds

si4.-ane-4plowing the strongest, the waves on- the top of the water can become- . 4uite big. At one time so many boats were being,damaged by the waves

*that the United States Coast guard was forced to forbid all pleasure- ,

boating on the Straits except when the water and. the wind were both calm._

During part of thetwo parts of Michigan.vehicles to cross over.as they are in northerndamage a bridge.

year,lainter builds its own bridge between theThis bridge, however, is not safe enough forIt is made out of ice. With winters as fierce

Michigan, the grinding ice could possibly

The.engineers assigned to study the possibility of building thebridge decided they would build a suspension bridge. (This is a bridgein which the roadway is hung, or suspended, from great cables. Thecaliles'are supported 6 tall towers.) The bridge would be five mileslong, and the suspensi parts would be the longest ever built.

People said a bridg oulcost too muchOne hundred milliondollars. How would the sta .pay for it? It was decided that motleywould be raised by selling bo ds. The bond buyers would be paid backby all who used the bridge, Cars, trucks, and buses would pay a tollwhen they crossed the bridge.

In order 'to build the bridge, the engineers determined thatthirty -four underwater supports, .called caissons, would have-to be sunkdown through the water and mud to solid rock. Each had tp.be placed -

ithin less than an ihch'of the right spot. Otherwise, the steel parts, being made elsewhere would not fit. The job would be tricky, but they

said they could do it. 16:

So they went-to work. Parts of the bridge were built in mills andshops all across the country. The'piedts of the bridge were shipped to.the.Straits to be put together. They came on railroad cars, on bargestowed by tugS, and'on large ships.

The aaissons were put in first. Next the steel cable towers, tallas fifty story bdildings,-were built. Then the two giant cables thatwould support the road were spuj. A total of 12,580 wires had,tobesqueezed into each round cable'to make them strong enough. The cableswere put in plaOe, huge,steel frames were hUng from the cables, and theroadway Was.builf.'

On Labor Day, 1957, "Bic Mac" was officially opened to traffic.o Today cars, trucks, and buses can cross the bridge in ten minutes.

4-8

Page 47: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tbsts

46

C

Between the towns of Macknaw City and St. Igibce in Michigan liesa strip of water called the Straits of Mackinac. It separates LakeMichigan from Lake-Huron and also divides the state of Michigan intotwo parts. In some places thd water is almost 400 feet deep, and thetwo -parts of the state lie alm4st four miles apart.

A major problem through there is that the winds are very, verystrong. It is not uncommon for wind.speeds to reach 75 miles per hour,especially during the winter season. Many people said that a bridgebuilt across the Straits would not be strong enough to withstand.thestrong winds. 4"

Large waves can also be a problem in the Straits of Mackinac.When the winds are blowing the strongest, the waves on the top of thewater can become,qufte big. At one time so many boats were beingdamaged by the waves that the United States Coast Guard was forced toforbid all pleasure-boating on thd Straits except when the water andthemind ..vrere both calm.

'4hen,a bridge, nicknamed "Big Mac" was constructed across theStraits twenty years ago,:one of the most difficult of all bridge- -7building feats was, accomplished. The task was so difficult that mostpeople had said that the bridge could,neller be built. But hundredsof people worked'htrd fop several years, and eventually the bridgewas completed.

During part Of the year, winter builds its own bridge between thetwo parts of Michigan. This bridge, however, is not safe enough for ivehicles to cross over. It is made out of ice. With winters as fierceas'they acre in northern Michigan, the grinding ice could 'possiblydamage a bridge.

The engineers assigned to study the possibility of b ng the,bridge decided that they would build a suspension bride -. (Th is abridge in which the roadway is hung, or suspended, fr m great cables.The cables are supported by tall towers.) The bridg= would be fimiles long, and the suspension parts would be the lingest ever built.There were many problems to deal with in building Mis bridge, but theengineers decided that the difficult job could be doo&.

People also said a bridge would cost too much--one hundred milliondollars. How would the state'pay for it? It was decided that moneywould be raised by selling bonds. The bond buyers would be paid backby all who used the bridge. Cars, trucks, and buses would pay a tollwhen they crossed the bridge.

In order to build the bridge, the engineers determined that thirty-four underwater supports, called caissons, would,have to be. sunk downthrough the water and mud to solid rock. Each had to be placed withinless than an inch of the right spot. Otherwise the steel parts beingmade elsewhere would not tit. The job would be tricky, but they saidthey could do it.

On Labor Day, 1957, "Big Mac" was officially opened to traffic.,

The bridge that many thought could never be built had been built. Allthe many problems that made building the bridge so difficult had beensolvekt.

Parts of the bridge were built in mills and shops all across thecountry. The pieces'of the bridge were shipped to the Straits to beut together. They came on railroad cars,.on barge; towed by tugs, dhd

on large ships. -

The caissons were put in first. Next the steel cable towers, tallas fifty story buildings, were built. Then the two giant cables thatwould support the road were spun. A total of 12,580 wires had to besqueezed into each ound cable to make them strong enough. The cableswere put in place, huge steel, frames were hung from.tbe cables, and theroadway was bbilt. 49

1, 4

Page 48: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

.

Domain Referenced Tests

47

Between the towps of Mackiriaw City and St. Ignace in Michigan liesa strip of water called the Straits of Mackinac. It separates Lake,Michigan from Lake Huron and algo divides the state of Michigan into twoparts. In some places the water is almost 400 feet deep, and the two '

parts of the state lie.almost four miles apart.

T e winos roug t e raits o c inac ar very, very strong.is not uncommon for wind speeds,to-,reach 75 mile per hour, especiallyduring the winter season. Many people said that bridge built across theStraits would not be, strong enough to withstand he strong winds.

Large waves can be a problem in the Straits of Mackinac. When thewinds are.blowing the strongestA the waves on the top of the water can_become quite big. At one time so many boats were being damaged by thewaves that the United States Coast Guard was forced to forbid all pleasure-boating on the Straits except when the water and the Wind were both calm.

When a bridge nicknamed "Big Mac" was constructed across the Straitstwenty years ago, one of the moet.difficult of all bridge-building featswas accomplighed. The task was'so difficult that most people had saidthat the bridge could never be built. But hundreds of people worked hardfor several years, and eventually,the bridge was completed.

During part of the year, wpIter builds its own bridge between the twoparts of Michigan. This bridge, however, is not safe enough for vehiclesto cross over. It is made out of ice. With winters as fierce as they arein northern Michigan, the grinding ice could possibly damage a bridge.

The engineers assigned to study the possibility of, building thebridge decided they would buildra suspension bridge. (This is a bridgein which the roadway is hung, or suspended from great cables. The cablesare supported by tall towers.) ,The bridge would be five miles long, andthe suspension parts would be the pngest ever built.

, People said a bridge would cost too much- -one hundred million dollars!How would the state pay for it?, It was decided that money,would be raisedby selling, bonds. The bond buyers would be paid back by all who used thebridge. Cars, trucks, and buses would pay a toll when they crossed thebridge.

In order to build the bridge, the_engineers determined that thirty-four'nderwater supports, calledcaisons, would have to be sunk down throughthe water and mud to solid rock; Each had to be placed within less thanan inch of the right spot: Otherwise the steel parts being made elsewherewould not fit. The job would.be tricky, but they said thelcould do it.

Ott Labor Day, 1957, "Big Mac" was officially opened to traffic. Todaycars, trucks, and buses can cross the bridge in ten minutes.

Parts of the bridge were built in mills and-shops all across thecountry. The pieces of the bridge were shipped to the Straits to be put,together. They came on railroad cars, on barges towed by tugs, and on'large ships.

The caissons were put in ft,rst. Next'the steel cable towers, tallas fifty story buildings, were !gilt. Then the two giant cables thatwould support, the road were spun. A total of 12,580 wires had to besqueezed into each round,cable to make them strong enough. The cablesware put in place, huge steel frames were hung from the cables, and theroadway was built.

.k>1, 50

Page 49: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced tests

4

E--I

One of the Most,

difficult of al. bridge-building feats wased "Big Mac" was con -difficult- that most

accomplished twenty years ago when a bridge castructed in northern Michigan. The task was speople had said that the bridge could never,beilt.

A big problem was that the bridge had to be built over a strip of'watet that is both very deep and very wide. T e strip of water, called

Straitb of Mduitindu, separates Lake,michigan-Iftim Lake Huron, twoof'the five Great Lakes, all of which ark located on the northern borderof the continental United States, It alAo diyides the statiTof Michigan _

into two parts. These parts are called the Upper and Lower Peninsulas.In some places the water is almost 400 feet deep, and. the two parts ofthe state lie almost four miles apart.

'Another big problem was that the winds that blow through the Straitsare very strong. It is not uncommon for .wind speeds to reach 75 milesper hour, especially during the cold winter season. Michigan's wintersare the fifth coldest of all states, with an average seasonal snowfall.of 172 inches. Many people said that no_bridge would be strong enoughto withstand the strong winds.

Large waves were also aconcern to the }?ridge builders. When thewinds are blowing the strongest, the waves on the top of the water canbecome quite big. At one time so many boats were being damaged by thewaves that the United States Coast Guard was forced to forbid allpleasure-boating on the Straits except when the water and the windwere both calm.

Each day members of the Coast Guard constantly monitor weathericonditions. They Inform boaters whether or not it t, safe to go out on

the Straits.- Weather forecasts and ,coast Guard recommendations areannounced over the radio'every half hour. Different colored flags are ,

raised over the Coast Guard stations tO signal specific weather condi-tions to the boaters.

The engineerS assigned to work on a bridge that would cross theStraits began to work on the many problems.. They decided.that thedifficult job could be done. They would build a suspension bridge.(This is a bridge in which the roadway is hUng, or suspended, from greatcables. The cables are suppdrted by tall towers.) The bridge would befive miles long, and.the suspension parts would be the longest ever built.

People also said a bridge would cost too much--one hundred maim,dollars. How would the state pay for it? It was decided that moneywould be raised by selling bonds, The bond buyers would be paid backby all who used the bridge. Oars, trucks, and buses would pay a tollwhep they crossed the bridge.

Inrorder to build the bridge, the engineers determined tlatthirty-four underwater supports, called caissons, would have to be sunkdown through the water and mud to solid rock. Each had to be placedwithin less than an inch of the right spot. Otherwise, the steel partsbeing made elsehwere would not fit. The job would be tricky.

The builders went to work. Parts of,the bridge were built in millsand shops all across, the'country. No stone or brick was to be used inthe bridge. Bridges of years ago were exclusively made of such materials.The pieces of the bridge were shipped to the Straits to be put together.

The caissons were put in fiist. Next the steel cable towers, tallas fifty story buildifigs, were built. Then the two giant cables thatwould support the road were bpun. A total of 12,580 wires had to besqueezed into each round cable to make them strong enough. The cableswere so strong they could hold enough two-ton trucks to make a line 150miles long. The cables were put in place, huge steel frames were hungfrom the cable's, and the roadway was built.

On Labor Day, 1957 "Big Mac" was officially opened to traffic.' The, bridge that many, thought could never be built had beef built. All the '

many probleMs that made building the so difficult had been solve.

,

Page 50: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referj.enoed Tests

,49

One of the most ;difficult of all bridge - building feats wasaccomplished twenty years ago when a bridge called "Big Mac" was con-structed in northern Michigan. The task was so difficult that mostpeople had said that the bridge could never be built.

The bridge had to be' -built over a strip of water that is both verydeep and very wide. The strip of water, called the Straits of Mackinac,separates Lake Michigan from Lake Huron, two of the five Great Lakes, all

wnicri are coca e on the nor a ern border o t e continentsUnited States. It also divides the state of Michigandnto two parts.These parts are called the Upper and Lower Peninsulas. In some placesthe water is almost 400 feet deep, and the two parts of the state liealmost four miles apart.

The winds-'that blow through the Straits are very. very strong. Itis not uncommob for wind speeds to reach 75 miles per hour, especiAllyduring the cold winter season. Michigan's winters are the fifth coldestof all states, with an average seasonal snowfall of 172 inches. Manypeople said that no bridge would be strong enough to withstand the strongwinds.

Large waves were a concern to the bridge builders. When the windsare blowing the strongest, the waves, on the top of the water can become-quite big. At one time so many boats were being damaged by the wavesthat the United States Coast Guard was forced to forbidall pleasure-boating on th'e Straits except when the water and, the wind were both calm.

Each day members of the Coast Guard constantly monitor weatherconditions. They inform boaters whether or not it is safe to ga out onthe Straits. Weather, forecasts and Coast Guard recommendations areannounced over the radio every half hour. Different colored flags areraised over the Coast Guard stations to si al specific weather condi-tions to the boaters.

The engineers assigned to study the possibi ty of bbildin$ thebridge decided they would build a suspension bridge. (This is a bridgein which the roadway is hung, or suspended from great cables. Thecables are 'supported by tall towers.) The bridge woul be five mileslong, and the suspension parts would be the longest ever'built.

People said a bridge would cost too much--one hundred milliondollars. How would the state pay for it? It was decided that moneywou.ld be raised by selling bonds. The bond buyers would be paid backby all who used the bridge. Cars, trucks, and buses would pay a tollwhen they crossed the bridge.

In order to build the bridge, the engineers.determined that thirty-four underwater supports called caissons would have to be sunk downthrough the water and mud to solid rock. Each had to be placed withinless than an inch of the right spot. Otherwise the steel parts beingmade elsewhere would not fit. The job would be tricky.

*.

The builders went t6 work. Parts of the-bridge were built n millsand' shops all across the country. No stone or brick was to,be used inthe bridge. Bridges of years ago were exclusively made of such materials.The pieces of the bridge were shipped' to the Straits to be put together.

The caissons were put in first. Next the steel cable towers, tallas fifty story buildings, were built. Then the two giant cables that.would support the road were spun. A total of'12,580 wires had to besqueezed into each round cable to make them strong enough. The cableswere so strong they could hold enough two-ton .trucks td make a line 150milep long, The cables were put in place, huge steel frames were hungfrom the cables, and the roadway was built.

On Labor Day, 1957, "Big Mac" was pfficially opened to traffic.Today cars, trucks, and buses Can crosghpbridge in ten minutes.

Page 51: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

G

ti

Doffiain Referenced Tests'

50

Betwee the towns of Mackinaw City andiSt. Ignade_in Michigan liesa stri of ater called the Straits of'Mackinac. It 'separates LakeMichiga om Lake 'Huron, two of the five Great Lakes, all of which arelocated the northern border of the continental United States. Italso di es the state of Michigan into two parts., These parts arecalled Upper and Lower Peninsulas. In some plebe§ the water is almost400 feet deep, and the two partS of the state lie almostrfour miles

_apart.

'A major problem through there is that.the winds are very, very'strong. It is not uncommon formind speeds to reach 75 miles per hour,especially during the cold winter season. Michigan's winters ath thefifth coldest of all states, with an average seasonal snowfall of 172inches. Many people said that a bridge built across the Strait's wouldbe strong enough to withstand the strong winds.

Large waves 'can also be a problem in the of Mackinac. Whenthe winds are blowing the strongest, the waves on the top of the watercan become quite big. At tme time so many boats.were being damaged bythe waves that the United States Coast Guard was forced to forbid. allpleasure-boating on_the Straits except when the water and the windwere both calm.

Each day members of the Coast Guard constantly monitor weatherconditions. They inform boaters whether or not it is safe.to go out onthe"Straits. Weather forecasts and Coast Guard recommendations areannounced over the radio every half hour. Different colored flags areraised dyer the Coast Guard stations to si al specific weather conditionsto the boaters.

When a bridge nicknamedtwenty years ago, one of thewas accomplished. The taskthat the bridge could never

' ig Macn.was constructed acrosthe Straitsost Ilifficult of all bridge-building featss so difficult that most people had saidbait.

The engineers assigned to study the possibility of building thebridge decided they would build a .suspension bridge. (This is a bridgein which the roadway is hung, or suspended, from great cables. Thecables are supported by tall towers.) The bridge would be five miles .long, and the suspension parts would be the longest ever built. Therewere many problems to deal with in building this bridge, but theengineers decided that the difficult job could be done. ,

People also said a bridge would cost too much--one hundred milliondollars. How would the state pay for it? It was decided that moneywould be raised by selling bonds. The bond buyers,wo d be paid backby all who used the bridge. Cars, trucks, and buses ould pay a tollwhen they crossed the bridge.

In order to build the bridge, the engineer termined thdt thirty-four underwater supports, called caissons, wouil have to be sunk down'through the water and mud to solid rock. Each had to be placed withinless than an inch of the right spot. Otherwise the steel parts beingSmade elsewhere would not fit. The job would be tricky.

On Labor.Day, 1957, "Big Mac" was officially opened to traffic.he bridge that many thought could never be built had been built. .

A 1 the many problems that made building the bridge so difficult hadb solved.

Parts of the bridge were built in mills and shops all across thecountry. No stone or brick was to be used in the bridge. 'Bridges ofyears ago Were exclusively made of such materials. The pieces of thebridge were shipped to the Straits to be put together.

The caissons were put in first. Next the steel cable towers, tallas fifty story buildings, were built. 'Then the two giant cables thatwould support the road wererspun. A total of 12,580 wires had to besqueezed into each round cable to make them strong enough. The Cableswere put in place, huge steel frames were hung from the cables, and theroadway was built. 5

Page 52: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referedced Tests,

51

Between the:towns of Mackinaw City and St. Ignace in Michigan liesa strip of water called the Straits of Mackinac. It separates LakeMichigan from Lake Muron,.two of th ive Great Lakes, all of which arelocated ^on the northern border of tfllacontinental United States. -Italso divides the state of Michigan into two parts.- These parts arecalled the Upper and LowerPeninsulas. In some places the water isalmost-400 feet deep, and the, two parts of the state lie almost fourmiles apart.

The wind'S that blow th4ough the Straits are very, very strong. It, is not uncommon for wind-speeds to reach 75 miles per'hour, especiallyduring the cold winter season. Michigan's winters are the fifth coldestHof all states, with an average seasonal snowfall of 172,inches. Manypeople said that a bridge built across the Straits would not be strong

--J enough to withstand the strong winds.4'

Large waves can be a-problem in the .Straits of Mackinac. When the' winds are bloWing the strongest; the waves on the top-of the water can

11110pme quite big. At one-time-so many boats were being damaged by thewaves that the United States -Chest Guard was forced to forbid allpleasure-boating on the Straits except whin the water and the windwere both calm.

Each day members of the Coast Guard constantly monitor weatherconditions. They inform boaters whether or not it is safe to go out onthe Straits. Weather-fdrecasts,and Coast Girard recommendations areannounced over the radio every half hour. Different colored flags areraised over the Coast Guard stations to signal. specific weatherconditions to-the boaters.

When a bridge nicknamed "Big Mac " was Constructed across the Straitstwenty years ago, one of the most diffiCult Of all bridge-building featswas accomplished. The task was so difficult thatAlost people had saidthat the bridge could never be built:

2h

The engineers assigned to study the possibility of building-the'bridge decided they would build a suspension bvidge. (This is a_ bridgein which the roadway is hung, or suspended, from great cables. Thecableg are supported by tall towers.) The'bridge would 'be five mileslOng and the suspension parts would be the.longest ever built.

People said a bridge would cost too much--ode hundred milliondollars, How would the state pay for it?' It was decided that moneywould be".,raised by selling bonds. The' bond buyers would be+ paid backby all who used the bridge. ,Cars, trucks', and buses would pay a toll

-

when they crossed the bridge.

In order to build the bridge, the engineers determin ed thatthirty-four underwater Supports, called caibsont, woulOave to be sunk,down through the water and mud to solid rock. Each had to,be placedwithin less than an inch of...the right spot. Otherwise'the steel partsbeing made elseOhere_would mot fit, The.job would betricky.

Parts of the bridge were built in ills and shops all-acrdis thecountry. No stoneor brick -was to be used in the bridge. Bridges ofyears ago were exclusively, ade of.,such materials. The pieces of thebridge were shipped po the Straits4tobe put together.

Th e caissons were put in first: Next the steel cable towers, tall-. as fifty story buildings, were built. Then the two giant cables that

would support the road were-spun. A total of 12,580-ires had to besqueezed into .each round cable to make them strong enough. The cableswery so- strong they could hold enough two-ton trucks to make a line159 miles long. Cables were -put in ,place, huge steel frames were hurigfrom tbis. cables, 1%nd-the roadway wasipilt.

,

Ori,Labor Da , 1957, !Big Mac" was officially. opened to traffic. 54Today, cars trucgts, and buses can cross the bridge in ten.minutes.,

.

Page 53: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

IA.

t.4

I4

In the earty 1940s, lotus of time, effort, and money Were investedto build a bridge over a rather. wide body of water near Tacoma,Washington. Many had claimed it would require a miracle for workers tobuild a bridge-across...the Tacoma NarroWs: They said the job was too4 dangerous and would be too difficult._ But workers went ahead. Afteryears of d fficult struggle, the bridge wasoactiariy csoon the bridge collapsed. A strong Tacoma Narrow fridge could not bebUilt. 0 few years after a similar effor as being considered innorthern no Would this effort pxod another Tacoma Narrows.Bridge?-

Domain Referenced Tests

52

A nag problem in Michiganyashat the bridge had to be built over.,.

water, called the,Strai of M backiac, separates Lake Michigan froma slip of water that iipthzery deep and very wide. The strip of

Lake Huron and also divides the state of Michigan into two parts. InPlaces the water is almost 400 feet deep, and the two parts of theliAe,altbse.four,miles apart.

\..-=

A "ther problem was that the winds that blow through the straits

..---"*'------/-ev-(

y strong. It is not uncommon for wind speeds to.reach 75 milesar- et' hour, epsedially during 4e winter season. Many people said thatno bridge wou be strong FAO to withstand the strong winds:

-

Large,waves were also a,conpern to the' bridge builders. When the.--winds are blowing the strongest, the-waves on the top of the water Canbecome quite big. At one' -tithe so many boats were being damaged by thewaves that the United States Coast Guard was forced to forbid allpleasurg-boating on the Straits except when the water and thellipd weree ''both' calm. , -

...' ,

Miring part of the year, winter builds its own bridge between thetwo parts of Michigan. This bridge, however, is not safe enough forvehicles to cross over. It is made outof ice. With winters as fierceas they are in northern Michigan, the grinding ice-could possibly damagea bridge. f A.

The builders of the'Tadom a Narrows Bridge would probably have''

Thewith fear if faced with building a bridge across the Straits

Of Mackinac. But the engineers in Michigan went ahead. The decidedko hind :a suspension bridge. (This is a-bridge in which the roadway,is/hung, or suspended, from great cables. The cables are` support bytill towers.), The,bridge would be five miles long, and'the suspensionparts:would'bp the longest ever built.

, .

.

People also said a bridge would cost toomuah--one hundred milliondollars. How would the state pay for it? It was decided that money wouldbe raised by selling bonds. The bond buyers would be paid back by allwho used the bridge. Cars, trucks, and buses would pay a toll when theycrossed the bridge.

In order to build the, bridge, the engineers'determinedthat '

thirty-four underwater supports, called caissons, would have to be sunkdown through the water and mud to solid rock. Each had to be placedwithin less than an inchof the right spot. Otherwise the steel partsheinAMOde elsewhere would not fit. The job would be tricky, but theysaid Elfey could do it. '

. .

.

c, so, thVaInt to work. Partswof the bridge were built in mills and A6

shops all a the country. ,The pieces, the bridge were shipped to,-the Straits to be put together. They came on railroad cars, on barges-towed-by-tugt-, and on large ships: P .

,

., The caissons were put in first. Next the shelabletowers, tallas fifty-story buildings, were built.. Then the two giant cabled thatwould stpport the road were spun. A total of 12,580 wires had te,besqueezed into each round cable to.make them Strong enough. The cables .,

were put in place, huge steet frames were hung from the cables, and theroadway was.built-

. , rMany people had compared the task of biaildidng'a bridge across the

Straits ofoMackinac to the earlier task of building the Tacoma NarrowsBridge in Washington. The Tacoma Narrows Bridge was to stand'only ashort time; "Big Mad" is yet strong and in continual use a full twentyyears aftee,it was officially opened to traffic.

55',.,

I '- L

Page 54: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

f.

4s

3

tDomain Referenced Tests

53

- In the early 1940s, lots'of time, effort, an4 money were invested.to build bridge over a rather wide body of water near,Tacoma,

. Washihgto . Many had claimed it would require a miracle for workers tobuikd a b idge across the Tacoma Narrows. They Said the job was toodangerous and would be too difficult. But workers went ahead. After

.years of difkicutt struggle, the Bridge was actually completed. Butsoon the bridge collapsed. A strong Tacoma Narrows Bridge could notbe built. Only a few years later a similar effort was being considered -im northern Michigan. Would this effort produce another Tacoma NarrowsBridge?

The bridge in Michigan had to be built over a strip of water that-kis bath very deep and very wide. The strip of water,-Called theStraits of Mackinac, separates Lake Michigan from Lake Huron and also

idivides the state of Michigan into two parts. In some places 'the wateris almost 400 feet deep, and the two parts of the state lie almost fourmiles apart:

.The winds that blow through theStraits are very, very strong. Itis not uncommon for wind speeds to reach 75 miles Per hour, especiallyduring the winter season. Many people said that no bridge would bestrong enough to withstand the.strong winds:

Laig'e wav es were a concern to the bridge-builders. When the windsare blowing the strongest, the waves on the top of the water can bebecome quite big. At one time so many boats were being damaged by thewaves that the United States Coast Guard was forced to forbid allpleasure - boating on the Straits except whenthe water and the wind wereboth calm.

During part of the year, winter builds its oWn bridge between thetwoparts of Michigan. This bridge,, however,AS note safe enough for '

vehieles"to cross over. It is made out of 'ice.. Withiminters as fierceas they are 4i.n northern Michigan, the grinding ice cold possiblydamage a bridge.

The engineers assigned to study the possibility of building thebridge decided they would build a suspension bridge. ATMs is a bridgein which the roadway is hung, or suspended, from great cables. Thecables are supported by tall towers.) The bridge would be fiVe mileslong, and the suspension parts would be the longest ever built.

People said a bridge would cost too much--one hundred milliondollars. _Now yOuld the state pay for it? It was decided that moneywould be raised by selling bonds. The bond buyers would be.paid backbxall who used the bridge. Cars, trucks, and buses would pay g tollwhen_they.crossed thebridge.

In order to build the Pridge, the engineers determined that thirty -'four underwater supports, called caissons, would have to be sunk abwilthrough the water and mud to solid rock. Each had to be placqp-yithinless than an inch of the right spot. OtherwiSe.the steel.partsbeinqmade elsewhere would not fit, 'The, job would be tricky, but, they saidthey bould,do it. N

So they went to w ork. Parts of the bridge were built in millspandsops all, across the country. The pieces'of the biidge were shipped tothe Straits to be Put together. .They came on railroad cars, on bargestowed by tugs, and on large ships. '

,

The Caissons were put in first. Next the steel'cable towers, tallas fifty story buildings, were built. Then the two giant cables thatwould support the road were spun.' A totalOof 12,580 wires had to besqueezed into'each round cable to make them strong enough. Thekablesere put in place, huge'steel frames were hung from the cables, and theroadway was built.

On Labor Day, 1957,'"Big Mac" was officially opened to traffic.Today cars, trucks,-and buses cab cross the

6bridge in ten uiinutes.

,.

1

Page 55: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

AW'

Domain Referenced Tests

54

Between the towns Of Mackinaw City and St. Ignace in Michigan liesa strip of water called the Straits of Mackinac. It_separates LakeMichigan from Lake Huron and also divides the state of Michigan into--two parts. In some places, the water is almost 400 feet deep, and thetwo parts.,of the stale lie almost four miles apart. ,

A major problem through there,is that the winds are very, verystrong. It is not uncommon for wind speeds to reach 75 miles per hour,'especially during the winter season. Many people said that a bridgebuilt across the Straits would not be strong enough to wi4hstand thestrong winds.

Large waves can also be,a problem in the Straits of Mackinac.When the winds are blowing the strongest, the waves on the top of thewater can become quite big. At one time so many boats mere being'damaged by the waves,that the United States Coast Guard was forced toforbid all pleasure-boating on the Straits except when the water andthe wind were both Calm. .

4

In the early 1940s, lots of time, effort, and money were investedto build edge over a similar body of water near Tacoma, Washington.Many had med it would require a miracle for workers to build abridge across he Tacoma Narrows. They said the job was too dangerousand would be too difficult, But workers went ahead. After years ofdifficult s uggle, the bridge was actually completed. But soon thebridge collapsed. A strong Tacom4 Narrows Bridge could not be built.Only a few, years later a similar 4f fort was being considered across theStraits of Mackinac. Would this effort produce another Tacoma NarrowsBridge? .

During part of thetwo parts of Michigan,vehicles to cross over.as they are in northerna bridge.

year, winter builds its own bridge between theThis bridge, however, is not safe enough forIt is made out .of ice. With winters as fierce

Michigan, the.grinding ice could possibly damage#

The engineers assigned to Study the possibility of building thebridge decided they would build a suspension bridge. (This is a bridge +,

in which the roadway is hung, or suspended, from great cables. Thecables are supported by tall towers.) The bridge would be five mileslong, and the suspension parts would be the longest ever built. Thebuilders of the Tacoma Narrows Bridge would probably have shuddered withfear if faced with building a bridge across the Straits of Mackinac.

4People also said a bridge would cost too much-ppe hundred million

dollars. How would the state pay for it? was dcided that moneywould be raised by selling bonds. The bond buyers would be paid backby all who used the bridge. Cars; trucks, and blises would pay a toll,when they crossed the bridge.

n order to build the bridge, the ers determined-thatarty- ur underwater supports called sons, would have to be sunk

down through the water and mud to solid rock. Each had to'be placedwithin le s than an inch of the right spot. Otherwise the steel partsbeing made elsewhere.would not it The Tob would batrickye but theysaid they c uld.do it, 4' e

Many p ple had compared the task of building a'bridge across theStraits of ckinac to the earlier'task of building the Tacoma NarrowsBridge in 1a hington. The Tacbma Narrows Bridge was to stand only ashort time; =ig Mac" is yet strong and in continual use a fulltwentyyears after i was o cially opened to traffic.

parts of thCountry., The piesput together. They cameon large ships.

were built in mills and shops all across the.le bridge were shipped to the Straits to beon railroad cars, on barges towed by tugs, and

The caissons were put in first." Next the steel cable towers, tallas fifty story buildings.,..were built. Then the two'giant cables thatwould support the road were spun. A total of 12,580 wires had.tobesqueezed into each Vound cable to make theta strong enough. The cablesWere put,in place, huge steel freAs were hung from the cables, andthe roadway was built. 5

444

It

4

Page 56: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

v L

N\

DomaieReferenced Tests

55'

Between the towns 6f'Mackinew City and St. Ignace in Michi§an_lies0 a -Strip-of water called- theStraits of ,Mackinac. rt separates Lake

Michigan from Lake Huron and also divides the state of Michigan into*hoft,

two parts. In some places, the water is almost 400 feet 'deep, and...thetwo parts of the state lie albost four miles apart. ,

* ,

17he.winds through the Straits of Mackinac are very, very strong.tt is not uncommon for wind speeds to reach 75 miles per hour, especiallyduring the-winter season. Many people said that a bridge built acrossthe Straits would not be strong enough to withstand the strong winds.

Large waves can be a problem in the Straits of Mackinac. When thewinds are.blowing the strongest, 'the waves on the top of the water canbecome quite big. At one time so many boats were being damaged by thewaves that the United'States Coas4, Guard was forced to forbid allpleasure-boating on the Straits except -when the water and the wind 'were both calm.

In the early 1940s, lotS of time;' effort,' and money were investedto build' a btidge over a similar body of water near Tacoma, Washington.Many had claimed it would require a miracle for workers to build abridge across the Tacoma Narrows. They said the job was too dangerousand would be too difficult. But workers went ahead. After years of.difficult struggle, the bridge was actually completed: But soon thebridge collapsed. A strong Tacoma Narrows Bridge could nUt be built.Only a few yeais later a similar effort was being considered across the '

Straits of Mackinac: Would this effort produce another Tacoma Narrows'Bridge?

During part of the year, winter builds its own bridge between thetwo parts of Michigan. This bridge, however, is not safe enough,forvehicles to cross over. It is made out of ice. With winters as fierce.as they are in northern MiChigan, the grinding ice could possiblydamage'a twdge.

The engineer; assigned to study the possibility, of building the;

bridge decided they would build a suspension bridge. (This is a bridgein which the roadway is Ming, or suspended, from-great Cables. TheCables are suppbrteciby tall towers.)r The bridge would be five mileslong, and the suspension parts would,be the longest ever built.

People said a br.idge would cost too much--one hundred milliondollars. How would the state pay for it? It was ,decided that moneywould lot raised by selling bonds. The bond buyers would be paid backby allwho used the bridge. Cars, trucks, and buses would ,pay a toll

.). when they crossed the bridge..

, .

In order to build the bridge, the engineers-determined- Hat.thirty-four underwater supports, called caissons, would-have tb be stinkdown through the water and mud to solid rock. Each had to be placedwithin less than an inch Of the right spok. Otherwise the steel partsbeing made elsewhere would not fit. The-job would be tricky, but theysaid they could do it. 1

Parts of the bridge .were built in mills and shops all across thecountry. The pieces of tHe bridge were shipped to.the Araikto beput together: They came on railroad-uars, on barges towed by tugs,and on larg!e ships._ 4?

The caissons were put4in first. Next the steel, cable, towers, tallas fifty story buildings were built., Then the two gi/ant cables thatwould support the road were spun. A total'6f 12,580 wires had to besqueezed_ 'into each round cable to make them strong enough. Thecables were put in place, huge steel .frames we're hung' from the cables,and the ',roadway was built.

,

1

On Labor Day, 1957, "Big Mac" was officially opened to traffic.Tolay cars',, trucks`; and buses can cross the bridge in ten minutes.

. , ...

'44 5.8 .

Page 57: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests'

56

In the,early 1940s, lots of time, effort, and money were invested tobuild a bridge over a rather wide body of water near Tacoma, Washington.'Many had claimed it would require a miracle for workers to bRilpa bridgeacross the Tacoma Narrows. They said the job was too dangerous and wouldbe too.difficult. But workers went ahead. After yearn of difficultstruggle, thg bridge was actually completed.' But soon -the bridge collapsed.A strong Tacoma Narrows Bridge could not be built. Only a-few yeas latera similar effort was being considered in northern Michigan. Would this .

effort produce another Tacoma* Narrows Bridge?

A big problem In Michigan was that the bridge had to be built over astrip of water that is both very deep and very wide. The strip of water,called the Strait, of Mackinac, Separates Lake Michigan from Lake Huron,two of thefive Great Lakes, 411 of which are located on the northern borderof the continental United States. It also divides the state of Michigan,into two parts. These parts are called the Upper and LoWer Peninsulas.In some places, the water is almost 400 feet deep, and the two partbthe state lie almost four miles apart.

A

Another-'big problem was that the winds that blow through the Straitsare very strong." It, is not uncommon for wind speeds to reach ?Smilesper hour, specially during the cold winter season. Michigan's winters arethe fifth Coldest of all states, with an average seasonal snowfall of 172inches. Many people said that no bridge would. be strong enough towithstand the strong winds.

Large waves were also a concern to the bridge builders. When the windsare blowing the strongest, the'waves on-the top of the water can becomequite big. At one time so many boats were being damaged by the waves that'the United States Coast Guaid was forced tO forbid all pleasure-boating onthe Straits except when the water and Alhe wind were'both calm.

Each day Membereof the'Coast Guard constantly monitor weather-bonditions. They inform boaters whether or not it is safe to go out onthe Straits._ Weather forecasts and Cos Guard recommendations arannounced over the radio every half ho . Different colored flags eraised over the Coast Guard stations to signal specific weather conditionsto the boaters.

The builders of the TacOma Narrows Bridge would probably.haveshuddered with fear if faced with building a bridge across the Straits6f Mackinac. BUt the engineers in Michigan went ahead. They deoided tkqbuild a suspension bridge. (This is a bridge do which the roadway is hung,or suspended, from great cables. The cables are supported by tall towers.)The bridge would be five milei long, and the suspension.parts would be thebingest evgr built..

A. ..

. -

People also said'a bridge would cost too muchone huhdted million .

dollars., How would thestate pay for it? It was decided, that money wouldbe raised by Selling bonds. The bond buyers` would b4 paid back by all whoused the bri ge. Cars, trucks, and buses would pay a toll when theycrossed the ridg 4

*order to b the bridge, the engineers determinedthat , 0

thirty-tour underwater supports, callgd caissons, would have to be sunkdown through the water and mud to solid rock. Each had to be placedwithin less than an inch of the rig)* spot. Otherwise the steel partsbeing madd elsewhere would not fit, The job wodld be tricky.

j \The builders went to work. Parts of,the bridge were' built in mills

and shops all across the country. No stone or brick was to be used inthe bridge. Bridges of years ago were exclusively made of such materials.The'pieces of the bridge were shipped to the Straits to be put together.

The carssonstre put in first. N ext the steel cabletaWers, tall asfifty story buildings ?feral:milt: 'Then the two giant cables.that wouldsupport. the road were spun. A total of 12,580 wires had,to be squeezed into,each round cable to make them strong enough. The cables were so strong, they

, could hold enough two-ton trucks to make a line 150 miles long. The cableswere put in place, huge steel frames were hung from the cables, and theroadway was built.

Many people had compared the task, of building a bridge across theStraits of Mackinac to the earlier task of building the Tacoma Narrows '

Bridge in Washington. The Tacoma Narrows Bridge was to stand only a storttime; "Big Mac" is ye strong and in continual use a full-twenty yearsafter it was officially opened to traffic. 59 -

11

Page 58: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

Domain Referenced Tests

N 57

In the early 1940s, lots of time, effort, and Money were investedto build a bridge over a rather wide body of water near Tacoma,Washington. Many had claimed it would require a mirdcle for.workers tobuild a bridge across The Taco _ar cosy They said the job was too

'dangerous and would be too difficul . But workers went ahead. Afteryears of difficult struggle, the bridge,was actually completed. BUtsoon the bridge collapsed. A strong Tacoma Narrows Bridge couldinotbe built. Only a few years later a similar effort was being considered 'in northern Michigan.. Would this effort prdduce another Tacoma NarrowsBridge? . _ .

The bride in.Michigan had.toe built.over a strip of'water thatis both very deep and 'very wide. The strip of_water, called the Straiof Madkifiad, separates Lake Michigan'from Lake Huron, two of the fiveGreat'Lakes, all of whichire located on the northern border of the /

continental United States. It also divides the state of Michigan intptwo parts. These parts are called the Upper and' Lower Peninsulas. Tnsome places the water is almost 400 feet deep, and thd two parts ofvthestate lie almost four miles apart.

2,The Winds, that blow through the Straits are very, very strong. It

is .net uncommon for wink" speeds to reach 75 miles per,hour, especially.during ale cold winter season. Michigan's winters are the fifth coldest

of all states, with an average seasonal snowfall of 172 inches. Manypeople said egat no bridge wpuld be strong enough to withstand thestrong winds.

Large waves were a concern to the 'bridge builders. When the windsare blowing the strongest, the waves on the top of the water can becomequite big. At one t±me so many boats were being damaged by the wavesthat the United States Cdast Guard:was forced to forbid all pleasure-boating on the Straits except when the waterand the wind were both calm..

Each day members of the Coast Guard constantly monitor weather ---conditions. They inform boaters whether or not it is safe to go out onthe Straits. Weather forecasts and Coast Guard recommendations areapnounced over the radio every half hour. Different colored flags areraised"over the Coast Guard.stations to signal Specific.weather condi-tions to the boaters.

',The engineers assigned to study the possibility of building the bridgedecided they would build a suspension bridge. (This is a bridge in whichthe roadway is hung, or suspended, from great Cables. The cables aresupported by tall towers.) The bridge would be five miles, long, and thesuspension parts would be the longest ever built.

People said a bridge would .cost too much- -one hundred million dollars.How would the state pay for it? It was decided that money would be raisedby selling bonds. The bond buyers would be paid back by all:who used thebridge. Cars, trucks, and buses would pay a toll when they crossed thebridge. 0

In brder to build the bridge, the engineers determined thatthirty-four underwater supports, called caissons, would have to be sunkdown.through the water and mud to.solid'rock. tach had to be placed withinless than an inch of the right spot. Otherwise the steel parts being madeelsewhere would not fit. The job would-be tricky.

The builders went to work. Parts of the bridge were built in mills2 and shops all across the country. No.,stone or brick was to be used in

the bridge. Bridges of years ago were exclusively made of such ma)rials.The pieces of the bridge were Shipped to the Straits to be put together.

'The caissons were put inlirst. Next the steel. cable towers, tall asfiftx,_ story buildings, were built. Then the two giant cables that wouldhuppoitit the road were spun. A total of 12,580 wires had to be squeezedinto each round/cable to make them strong enough. The cables werestrong they could hold enough two-ton trucks to make a line 150 miles long.The cables were put in place, huge steel frames were hung from thq cables,and the roadway was built.

sit.

On Labor Dayc 1957; "Big 4.ac was, fficially'dpgned to traffic. 60Todiy cars, trucks, and buses ban crossthe bridge in tenminutes.

Page 59: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

44-

Zs/

o

Domain Referenced Tests

58

Between the towns of MackinaW City and St. Ignace in Ilichigan liesa strip of water called the Straits of Mackinac. It separates LakeMichigan from LakeHuron, two of the five Great Lakes, all of,which arelocated on the northern border of the nt/nental United States, It alsodivides the state of Michigan into two parts. These parts are called theUpper and Lower Peninsulas. In some places the water is almost 400 feetdeep, and the two parts ofthe state'lie almost four miles apart.

ro.A major problem through there is that the winds.are very, very strong.

It is not uncommon for wind speeds to reach 75 miles per hour, especiallyduring the cold winter season. Michigan's winters are the fifth coldestof"all states, with an average seasonal snowfall dif-172 inches: Many peoplesaid that a bridge built across the Straits would pot be strong enough towithstand the strong winds.

Large waves can also be a problem in the Straits of Mackinac. Whenthe winds are blowing the strongest the waves on the top of the water canbecome quite big. At one time so many boata,were being damaged by thewaves that the United States Coast Guard was-forced to forbid all pleasure-boating on. the Straits except when the water and the wind were both calm.

Each day members of the Coast Guard constantly monitor` weatherconditions. They inform boaters whether or not it is safe to go out ontrk7rptraits. `Weatherforecasts acid Coast Guard ieddibendations areannounced over the radio every half hour. Different colored flags areraised Over the,Coast Guard stations to signal specific weather conditionsto the boaters. 4

In the 4rly1940s, lots of time, effort, and money were vested tobuild a bridge over a similar body of water near Tacoma, Washington% Many,had claimed it would require;a miracle for workers to build a bridge acrossthe Tacoma Narrows. They said the job was too dangerous and would be toodifficult. But workers went ahead. After years of difficult struggle,the.bridge was actually completed. But soon the bridge collapsed. Astrong Tacoma Narrows Bridge could not be built. Only a few years later rr

a similar effort was being considsrpd across the Straits of Mackinac.Would this effort produce another Tacoma Narrows Bridge?

The engineers assigned to study thdappsibility of building thebridge decided they would build a suspensiOn bOdge. (This is a bridge inwhich the roadway is hung, or suspended,/from great cables. The cablesare supported by tall towers.) The bridge would be five milep long, andthe suspension parts would be the longest ever built. The builders ofthe-Tacoma Narrows Bridge would probably have shuddered with fear if facedwith building a bridge.across the Straits of Mackinac.

People also said a bridge would cost too much--one hundred milliondollars. bow would the state Ray for it? It was decided that money wouldbe raised hy,selling bonds. The bond buyers would be paid back by allwho used the bridge. Cars, trucks, and buses would pay a toll'when theycrossed the bridg

In order to buil e, the engineers determined that,thirty-four underwate supports, c- =. caissons would have to be sunkdown through the Water and mud o solid r Each had to be placedwithin' less than an inch of th right spot. Otherwise the steel partsbeing made elsewhere w laid no fit. The job would be ,tricky.

Many people had compared thetask of building a bridge across theStraits of Mackinad to the earlier task of building the Tacoma NarrowsBridge in Washington. The Tacoma Narrows Bridge was to stand only a shorttime; "Bigo Mac" is yet strong and in continual usesa full twenty yearsafter it was officially opened to traffic,

Parts of the bridge were built in mills and shops all across thecountry. No stone.or brick was to be used in the bridge. bridges of yearsago were exclusively madetof such materials. The pieces of the bridge,__were shipped to the Straits to ,be put together.

The.caissons were put jn first. Next the steel cable towers, tallas fifty 'Story buildings, were built. Thenthe two giant cables thatwould support the road were spun. A total of 12,580 wires had too besqueeied into each round cable to make them strong enough. The cableswere so strong they could hold enough two-ton trucks to make a line 150ranee long. The babies were put in Noce, huge steel frames were hungfrom the cables, and the roadway was built.

J .

Page 60: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

P

.

4- '

Ddinain Referenced Tests

59r

Between the towns of Mackinaw City and St. Ignace in Michigan liesa strip of water called the Straits-of Mackinac. It sepgrateg LakeMichigan from Lake Huron,, two of the five Great Lakes, all of-which arelocated'on the northern bordef-of the continental unTted.States.---Italso divides the state of Michigan into two parts. These parts are calledthe Upper and Lower Peninsula's. In .some places,the water is almost 400feet deep, end the two parts of the state lie almost four miles apart. ,

The winds that blow through the Straits are very, very strong. It,is not uncommon for wind speeds to reach 75 miles per ho r, especially

/1during the cold winter season. Michigan's winters are he fifth coldestof all states, with an. average seasonal snowfall of IT inches. Manypeople said that a bridge built across the Straits would not be strongenough to withstand the strong wirfds. ,

.

Large waves can be a problem in the Straits of Mackinac. When thewinds are blowing the strongest, the waves on'the top of the water canbecome quite big. At one time so many boats were being damaged by thewaves that the United States Coast Guard was forced to forbid all-pleasUre-boating on the Straits except when the water and the,wind wereboth calm.

Each day members of the Coast Guard coAstantly,monitor,weatherconditions.. They Inform boaters ,whether or not itPis safe to go out on,the Straits. Weather forecasts and Coa.St Guard recommendations areannounced over the radio every half hour. Different colored flags are-raised over the Coast Guard stations to signal specific weather conditionsto the boaters.

In the early 1940s, lots of time, effort, and-money were investedto build a bridge over a similar body of.water near Tacoma, Washington.Many had claimed it would require a miracle for workers to build a bridgeacross the Tacoma Narrows. They said the job was too dangerous andwould be too difficult._ But workers went ahead. After years of difficult,struggle, the bridge was actually completed.- But soon the bridge collapsed.A strong TaComa Narrows Bridge could not be built. Only a few years ,/

later a similar effort was being considered across the Straits of Mackinac..Would this effort produce another Tacoma Narrows Bridge?

The engineers assigned to study the possibility of building thebridge decides they would build a suspension bridge. (ThisIsoa bridge'in which the roadway is hung, or suspended from 'great cables., The cabledare supported,by tall towers.) The bridge would be five miles long, and_...

- the suspendion parts would be the longest ever built.

P People said a bridge would cost too much - -one hundred milliondollars. How would the state-pay for it?, It was decided that money,would be raised by selling bonds. The bond buyers would be paid backby all who used the bridge. Cars, truckt, and buses would pay a tollwhen they crossed the bridge.--

In order to build the bridge, the engineers determined thatthirty-four underwater supports, called caissons, would have to be sunk,-1,down through the water andtpud to solid rock. Each had to be placedwithin less than an inch or the right spot. Otherwise the steel partsbeing made elsewhere would not fit. T4e job would be tricky'.

.

\- .

Parts,of the bridge were'built in mills and shops all across thecountry. No stone:or brick was to be used in the bridge. Bridges ofyears ago, were exclusively made of such materials. The pieces of the,bridge were shipped to the Straits to be put together.

.

The caissons were put in first. Next the steel cable towers, tall.as fifty story buildings, were built. Then the two giant cables thatwould, support the road were spun. A, total cif 12,580 wires had to besqueezed into each round'cable to make them strong enough. The cableswere so strong they could hold enough two-ton trucks to make a line 150miles,long. The cables were put'in place, huge steel frames were hungfrom the cables, and thb foadway was built.

fa

On Labor Day, 1957, "Big Mac" was officially opened to traffic.,Today cars, trucks, and buses cp(Foss the bridge in ten minutes.

134

Page 61: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

No,' 1:

CENTER FOR THE STUDY OF READING

-READING EDUCATION REPORTS' 4

Ddrkin, D. Comprehension Instruction--Where-Are You ?, October 1977.

(ERIC Document Reproduction Service No. ED 146 566, 14p., HC-$1.67,MF-$.83)

No. 2: Asher, S. R. Sex Differences in Reading Achi(ERIC Document Reproduction Service No.MF-$.83)

evement, October 1977.ED 146'567, 30p., HC-$2.06,

.No: 3: Adams, M. J., Anderson, R. C., & Durkin, D. Beginning Reading: Theoryand Practice, November 1977.

No. 4: .Jenkins, R., & Pany, D. Teaching Redding.tomprehension in the MiddleGrades, January i978.

4

4

4

63

Page 62: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

CENTER FOR THE STUDY OF READING

. TECHNICAL REPORTS

* Available only through ERIC

*No. 1: Halff H. M. Graphical Evaluatibn of Hierarchical Clustering Schemes,October 1975. (ERIC Document Reproduction Service No. ED 134 926,11p., HC-$1.67, MF-$.83)

*No. 2: Spiro, R. J. Inferential Reconstruction in Memory for Connected Dis-course, October 1975. (ERIC Document Reproduction Service No.ED 136 187, 81p., HC-$4.67, MF-$.83)

*No. 3: Goetz, E. T. Sentences in Lists and in Connected Discourse,.November1975., (ERIC:Document Reproduction Service No, ED 134 927, 75p.,HC-$3.50, MF-$.83)

*.No. 4: Alessi, S. M., Anderson, T.-H., & Biddle, W. Z. Hardware and SoftwareConsiderations in Computer Based Course Management, November 1975..(ERIC Document Reproduction Service No. ED 134 928, 21p., HC-$1.67,MF-$.83)

*No. 5: Schallert, D. L. Improving Memory for Prose: The Relationship BetweenDepth of Processing and Context, November 1975. (ERIC DocumentReproduction Service No. ED 134 929, 37p., HC-$2.06, MF-$.83)

*No. 6: Anderson, R. C., Goetz, E. T.t Pichert, J. W., & Halff, H. M. Two

Faces of the Conceptual Peg Hypothesis, January 1976. (ERIC

Document Reproduction Servite No. ED 134 930, 29p., HC-$2.06If-$.83) A

*No. 7: Ortony, A. Names, Descriptions, and Pragmatics, February 1976. (ERIC

Document Reproduction Service No. ED 134 931, 25p., HC-$1.67,MF-$.83)

*No. 8: Mason, J. M. Questioning the Notion of Independent Processing Stagesin Reading, February 1976. (Journal.of,Educational Psychology,1977, 69, 288-297)

,*No. 9: Siegel, M. A. Teacher Behaviors and Curriculum Packages: Implications

for Research and Teacher' Education, April 1976. (ERIC Document.Reproduction Service No. ED 134 92, 42p., HC-$2.06, MF-$.83)

*No. 16: Anderson, R. C., Pichert, J: W., Goetz, E. T., Schallert, D. L., Stevens,K. V., & Trollip, S. R. Instantiation of General Terms, March1976. (SRI

$Document

Reproduction Service No: ED 134 933, 30p,.,

HC-$2.06; 83) '

*No. 11: Armbruster, B. B. Learning Principles from Prose: A Cognitive ApproachBased on Schema Theory, July 1976. (ERIC Document ReproductionService No. ED 134 934, 48p., HC-$.206, MF- $.83)(,

64

4 ''

Page 63: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

*No. 12: Anderson, R. C., Reynolds, R. E., SchalTert, D. L., & Goetz, E. T.Frameworks for Comprehending Discourse, July 1976. (ERIC Document

Reproduction Service No. ED 134 935, 33p., HC-$2.06, MF-$.83)

No. 13: 1Rubjn, A. D.; Bruce, B. C., & Brown, J. S. A Process-oriented languagefor Describing Aspects of,Reading Comprehension, November 1976.(ERIC Document ReproductionpService No. ED 136 188, 41p., HC-$2.06,MF-$.83)

No. 14: Pichert, J. W., & Anderson, R. C. Taking Different Perspectives on aStory, November 1976. (ERIC Document Reproduction Service No.ED 134 936, 30p., HC-$2.06, MF-$.83)

Schwartz, R. M. Strategic Processe5-tn Beginning Reading, November1976. (ERIC Document Reproduction Service No. ED 134 937, 19p.,HC-$1.67, MF -$.83)

No. 16: Jenkins, J. R., & Pany, D. Curriculum Biases in Reading AchievementTests, November 1976. (ERIC Document Reproduction Service No.ED 134 938, 24p., HC-$1.67, MF-$.83)

No. 17: Asher,'S. R., Hymel, S., & Wigfield,' A. Children's Comprehension ofHi and Low-Interest Material and a Comparison of Two ClozeScoring Methods, November. 976.. (ERIC Document ReproductionService No. ED 134 939, 32p , HC-$2.06, MF-$.83)'.

No. 18: Brown,-A. L., Smiley, S. S., Day, . D., Townsend, M. A. R., & Lawton,S. C. Intrusion of a Thematic Idea in Children's Comprehensionand Retention 'of Stories, December 1976. (ERIC Document Repro-duction Service No. ED 136 189, 39p.., HC-$2.(16, MF-$.83) -

" NO. 19; Kleiman, G. M. The Prelinquistic Cognitive Basis of ChildrenlsCommuniO4tive Intentions, February 1977. (ERIC Document Repro-duction Service No. ED 134 940, 51p., HC-$3.50, MF-$.83)'

-No. 20: Kleiman, G. M. The Effect of Previous Context on Reading IndividualWords, February 1977. (ERIC Document Reproduction Service No.ED 134 941,76p., HC-$4.67, MF-$.83)

No. 21: Kane, J. H., & Anderson, R. C. Depth of Processing and InterferenceEffects in the Learning and Remembering of Sentences, February a1977. (ERIC Document Reproduction Service No. ED 134 942, 29p.,HC-$2.06, MF-$.83)

No. 22: Brown, A. L., & Campione, J. C. Memory Strategies in Learning;Training Children to Study Strategical , March 1977. (ERIC

Document Reproduction Service No. ED 36 234, 54p., HC-$3.50,.MF-$.83)

No. 23: Smiley, S. S., Oakley, D. D., Worthen, D., Campione, J. C., & Brown,A. L. Recall of Thematically Relevant Material by AdolescentGood and Poor Readers as 4 Function of Written Versus OralPresentation, March 1977. (ERIC Docunient Reproduction Service

No. ED 136 235, 23p., HC-$1.67, 'MF-$.83)'

Page 64: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

.

No. 24: Anderson, R. C., Spiro, R. J., & Anderson, M.C. Schemata asScaffolding for the Representation of Information in ConnectedDiscourse, March 1977. (ERIC Document Reproduction Service No.ED 136 236, 18p., HC-$1.67, MF -$.8$)

No: 25: Pany, D., & Jenkins, J. R, Learning Word Meanings: A Comparison ofInstructional Procedures and Effects on Measures of ReadingComprehension with Learning Disabled Students, March 1977.(ERIC Document Reprodubtion Service No. ED 136 237, 34p.,HC-$2.06, MF-$.83)

t

No. 26: Armbruster, B. B., Stevens, R. J., Rosenshine, B. Analyzing ContentCoverage and Emphasis: A Study of Three Curricula and Two Tests,March 1977. (ERIC Document Reproduction Service No. ED 136 238,22p., HC-$1.671 MF-$.83)

No. 27: Ortony, A., Reynolds, R. E., & Arter, J. A. Metaphor: Theoreticaland Empirical Research, March 1977.

No. 28: Ortony, A. Remembering and Understanding"Jabberwocky and Small-Talk,March 1977. (ERIC Document Reproduction Service No. ED 137 753,36,p., HC-$2.06, MF-$.83)

No. 29: Schallert, D. L., Kleiman, G. M., & Rubin, A. D. Analysis of DifferencesBetween Oral and Written Language, April 1977. (ERIC DocumentReproduction Service No. ED 144 038,33p., HC-$2.06, MF-$.83)

No. 30: Goetz, E. T., & Osborn, J. Procedures for Sampling-Texts and Tasks.in Kindergarten through Eighth Grade, April-1977. (ERIC DocumentReprciduction Service No. ED 146 565, 8Qp., HC-$4.67, MF-$.83)

No 31: Nash-Webber, B. Anaphora: A Cross-Disciplinary Survey, April 1977.(ERIC Document Reproduction Service No. ED 144 039, 43p., HC-$2.06,MF-$.83) 4

No. 32: Adams, M. J., & Collins,,A. A Schema-Theoretic View of Reading Compre-hension, April 1977. (ERIC Document Reproduction Service No.ED 146 565, 801:14 HC-$47.67,MF-$.83)

No, 33: Huggins, A. W. F. Syntactic Aspects of Reading Comprehension, April1977. (ERIC Document Reproduction Service Nq. a 142 972, 68p.,HC-$3.50, MF-$..83)

'-

146. 34: Bruce, B. C Plang'and Social,Actions, April 1977.

NO. 35: Rubin, A. D. Comprehension Processes in-Oral and Written Language,April 1977:

No. 36: Nash-Webber, 8., & Reiter, R, Anaphor;Vid Logical Form: On Formal. Meaning gepresentations for Natural Language, April 1977..(ERIC Document Reproduction Service No. ED 142 97344.,HC-$2:06, MF-4.83)

No. 37: Adams, M. J. Failures to Comprehend and L9kels of Processing inReading, April 1977.

);:s

66.

Page 65: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

No. 38: Woods, W. A. Multiple Theory Formation in High-Level Perception,April 1977. (ERIC Document Reproduction Service No. ED 144 020,58p., HC-$3.50, MF-$.83)

No. 405 Collins, A., Brown, J. S:, & Larkin, K. M. Inference in Text 4der-,standing, December 1977.

No. 41: AndersOn, R. C., & Pichert, J. W. Rdcall of Previously UnrecallableInformation Following a Shift iniPerspective, April 1977.(ERIC Document Reproduction Service NO. ED 142 974, 37p.,HC-$2.06, MF-$.83)

No. 42: Mason, J., Osborn, J'., & Rosenshine, B. A Consideration of Skill '

Hierarchy Approaches to the Teaching of Reading, Decembe,p 1977.

No. 43: Collins, A., Brown, A. L., Morgan, J4 L., & Biewer, W. F. The Analysisof Reading Tasks and Texts, April 197J.

,

No. 44: McClure, E. Aspects of Code - Switching in the Discourse of 5ilingualMexican-American Children, April 1977. (ERIC Document ReproductionService No. ED 142 975, 39p., HC- $2.06, MF-$.83)

No. 45: Schwartz, R. M. Relation of'Context Utilization and OrthographicAutomaticity in.Word Identjfitation, May41977.

No. 46: Anderson, R.'C., Stevens, K. C., Shifrin, Z & Osborn, J. Instantia-

tion of Word Meanings in Children) May 1977. (ERIC DocumentReproduction Service No. ED 142 976, 22p., HC7S1-,.67, MF-$.83)

No. 47: Broom, A. L. Knowing When, Where, and How to Remember: A Problem ofMetacognition, June 1977. (ERIC Document Reproduction ServiceNo. ED 146 562, 152p., HC-$8.69, MF-$.83)

No. 48: Brown,,A. L., & DeLoache, J.'S. Skills, Plans, and elf-Ftegulation,

July 1977. (ERIC Document Reproduction Service'No. ED 144 040,66p., HC-$3.50, MF-$.83). .

No. 49: Goetz, E. T. Inferences in the Comprehension of and Memory for Text,July 1977.

No. 50: Anderson, R. C. Schema-Directed'Processes in LangUage Comprehension,July 1977. (ERIC Document Reproduction Service No. ED 1424977,33p., HC-$2.06, MF-$.83)

No,51: Brown, A. L. Theories of Memory and the Problems If Development:rActivity, Growth, and Knowledge, July 1977. -(ERIC DocumentReproduction Service No. ED 144 041, 59p., HC-$3.50, MF-$.83)

No. 52: Morgan, J. L. Two Types of Convention in Indirect Speech Acts,

July 1977.

No. 53: Brown,, A. L., Smiley, S. S., & Lawton,'-S. C. The Effects of Expe-rience on the Selection of Suitable Retrieval Cues for Studyingfrom Prose Passages, July 1977. (ERIC Document ReproductionService No. ED 144 042, 30p., HC-$2.06F-$.83)

67

Page 66: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

4'

No. 54: Fleisher, L. S., & Jenkins, J. R.

-

Effects of Contextualized-and De-contextualized Practice Conditions on Word Recognition, July 1977.(ERIC Document Reproduction Service.No. ED 144 043, 37p.,. HC- $2.06, 4

MF-$.83)

No. 56: Anderson, T. H., Sfandfford, S. N:, & Alessi, S. M. -Computer Assisted.Problem Solving in an IntroduCtory Statistics Course, August 1977.(ERIC Document Reproduction ServiCe No. ED 146 563, 26p.,

MF-$.83) ;

No. 57: Barnitz, J. Interrelationship of Orthography and Phonological Structurein Learning to ReadAugust_1977.

, No. 58: Masori, J. M. The Role of Strategy in Reading in the Mentally Retarded,September 1977.

No. 59: Mason, J. M.' Reading Readiness: A Definition and Skills Hierarchyfrom Presthoolers'TeNcloping"Conceptions of Print, September 1977.

No. 60: Spiro, R. J., & Esposito,. J. J. Superficial Processing of ExplicitInferences in Text, December 1977.

No. 61: Spiro, R. J., & Smith, D. Distinguishing Sub-Types of Poor Comprehenders:Overreliance on Conceptual vs. Data-Driven Processes,-April 1978.

No. 65: BreWer, W. F. Memory for the Pragmatic Implications of Sentences,

October 1977. (ERIC Document Reproduction Service No. ED 146 564,27p., HC-$2.06, MF-$.83)

No. -66: Brown, A.-L., & Smiley, S. S. The Development of Strategies forStudying Prose Passages, October 1977.

No. 68: Stein, N. L., & NezWorski, T. The Effects of Organization and Instruc-t tional Set on Story Memory, January 1978.

No. 69: Stein, N. L. How Children Understand Stories: A Developmental Analysis,

March 1978. -

No. 76: Thieman, T. J., & Brown, A. L. The Effects of Semantic and FormalSimilarity on Recbnition.Memory for Sentences in Children,November 1977.

No. 77: Nash-Webber, B. L. Inference in an Approach to Discourse Anaphora,

January-1978.

No. 78: Gentner, D. On Relational Meaning: The Acquisition of Verb Meaning,

December 1977.

No. 79: ROyer,'J. M. Theories of Learning Transfer, January 1978.

No: 80: Arter, J. A., & Jenkin, J. R. Differential Diagnosis-PrescriptiveTeaching: --A Critical Appraisal, Januall-$078. -

68ti

.1

L=.\L..:.mal

Page 67: pocoim mom - ERICpocoim mom ED 157 036 0 CS 004 247 AUTHOR Anderson, Thdmas H.; And Others,-TITLE-Development and Trial of a Model for Developing Domain'Referenced Tests of Beading

No. 81: ShoOn, E. J. Choosing a Model of Sentence Picture Comparisons: A.'Reply to Catlin and Jones,, February 1978.

ho. 82: Stkff_ensen; M. S. Bereitdr and Ergelmann Reconsidered: The Evidencilkm Children Ac uirin Black En lish Vernacular, March1978.

.''

'No.'83: Reynold ' E.,E. Standiford, S. N.,6&.Anderson, R.. C. Distributionof 'eading Timiipwhen Questions are Asked about a Ilestricted).Category,oflert Information, -April 1978. . ..,

, . , .

No. 84: Baker, L. Processing Temporal Relations in Sipple Stories: EffectsO of Input Sequence, April 1978. , -

-

Na. 85 Mason, J. M., ynisely, &=Kendall, J,on Sentence Comprehension, May 1978.

eats of Polysemous Words

No. 86:: Anderson, T. U., Wardrop, Hively, W., Muller, K. E., Anderson,R. 1., Hastingi,,C. N., & Frederiksen, J. Development and Trial,of a Model for Developing Domain Referenced Tests of ReadingComprehension, M4y 1978.

/1P

'4

69