alignment overview of the iowa tests - university of iowa · overview of the iowa tests alignment...

Align

men

t

Overview of the iowa testsThe Iowa Tests are designed to support large-scale assessment programs by:• Providinginformationtosupport

standards-based instructional decisions• Reportingindividualprogressandgrowth

to students, parents and educators• Reportinggroupprogressandgrowth

to educators, administrators andpolicymakers

• Providingrelativecomparisonsforinterpretationofassessmentresults

ThetestframeworkforTheIowaTestsisanextensionofthesestatementsofpurpose,expandingthepurposeintospecificaspectsofeachdomaintobemeasured.Theframeworkdescribesthefullscopeofthetestcontentandreliesonavarietyofresourcesforpurposesofcontentvalidity,including:• State,professionalandinternational

standards• Curriculumsurveys• NAEPframeworksandtestspecifications• Scholarlyresearch• Feedbackfromeducators,studentsand

parents• Assessmentdata

Acomprehensiveanditerativeprocessbasedonthecontentoftheframeworkguidestheitemdesignanddevelopment,extensivereviewprocesses,tryoutandfieldtestadministrations,andfinalformsassemblyofThe Iowa Tests.

Alignment Overview Comprehensivestandards-basededucationsystems demand a link between content standards, curriculum, instruction, assessment andprofessionaldevelopment.Tobeeffective,assessmentsmustbealignedtothelearninggoalsspecifiedwithincontentstandards.Webb(1997)definesalignmentas “the degree to which expectations and assessmentsareinagreementandserveinconjunction with one another to guide the system towards students learning what they are expected to know and do.”

Alignmentisacriticalcomponentoftestvalidity:thedegreetowhichevidencesupportsinterpretationsoftestscores.Byconductingalignmentstudies,validityevidenceaccruestosupporttheuseoftestscoresbyimpartialaudiences.Thereareseveralacceptedmethodsforconductingalignmentstudies.Someprogramshavetheadvantageofdevelopingstandards and assessments in sequence, thereby ensuring an alignment between the two.Otherprogramsinviteexternalcontentexperts to help determine the degree to which assessments align with existing standards. Stillotherprogramsuseacodingsystemtodetermine alignment by analyzing standards and assessments independently. In addition, toolsandmethodologieshavebeendesignedto empower state and district educators to conduct their own alignment studies. Manyprogramsuseacombinationoftheseapproaches in order make certain that the appropriate relationship exists between content standards and the assessments.

Alignment to the Common Core

All approaches to alignment share

the common goal of describing the match

between expectations and assessments. In

aligning The Iowa Tests to existing local,

district and state content standards an adaption of the

research-based Webb alignment has been

used. This adaptation was most recently used to align the content of

The Iowa Tests to the Common Core State

Standards (CCSS). In a manner similar to the

content analyses used to define domains for

the CCSS, The Iowa Tests were “developed

in collaboration with teachers, school

administrators, and experts, to provide a clear and consistent

framework to prepare our children for college and

the workforce” (Common Core State Standard

Initiative, 2010). This document

summarizes process used to complete the

alignment between the CCSS and The

Iowa Tests.

Overview of The Iowa Tests

Alignmentisanintegralpartofvalidity.Itcontributestothedegreetowhichallevidenceforatestsupportstheintendedinterpretationoftestscoresforproposedpurposes.Tothatend, the alignment process described here providestheappropriateevidencetosupporttheuseofTheIowaTeststomeasureessentialcontentoftheCommonCore.

Participants. ParticipantsforthealignmentofTheIowaTeststotheCCSSincludeeducators,contentexperts,testdevelopersandmeasurementspecialists.Participantsareassignedtothespecificgradelevelorcontentareaaccordingtotheirareaofexpertise.Thegoalistohaveeachitemreviewedandalignedbyateamofindividualsthatrepresentsknowledgeofgrade-level,contentandmeasurement.

Orientation.ThealignmentactivitiesusedforTheIowaTestsbeginwithanorientationsession in which content experts, test developersandmeasurementexpertsareintroduced to the process. This introduction explainshowthealignmentprocessfitsintotheoverallcontentvalidityevidenceofTheIowa Tests and describes the basic concepts andproceduresinvolvedinconductingthealignment.Primarygoalsoftheorientationare

Alignment Process for CCSS and The Iowa Teststo ensure that all participants understand the contextofalignment,becomefamiliarwiththeexpectationsoftheCommonCoreStandards,andthecontentandcognitivespecificationsofThe Iowa Tests.

Categorical Comparisons. The alignment process proceeds with a categorical comparisonbetweentheCCSSandTheIowaTeststoestablishpreliminaryvalidityevidence.Theextenttowhichthesameorconsistentcategoriesofcontentappearin the standards and the assessments is determined(CCSSO,2005)atthispointinthealignmentprocess.AnanalysisoftherelationshipbetweenthecontentofthetestsandthestandardsprovidesimportantvalidityevidencetosupporttheuseofTheIowaTestsasameasureoftheCommonCoreStateStandards.Contentexperts,testdevelopersand measurement experts conduct a thorough reviewoftheCCSStodeterminewhetherthestandardsandtheassessmentscoverthesamecontent.Theresultsofthesecategoricalcomparisons are outlined below. The shading onthetablesindicatescontentcoveredbytheCCSS,andthecheckmarks(3) indicate contentthatiscoveredonTheIowaTests.Cellswithbothshadingandcheckmarksindicate alignment.

Common Core State Standards: Mathematics Grades Domain 3 4 5 6 7 8 HSCounting and Cardinality Operations and Algebraic Thinking 3 3 3 Number and Operations in Base 10 3 3 3 Number and Operations—Fractions 3 3 3 Measurement and Data 3 3 3 Geometry 3 3 3 3 3 3 3

Ratios and Proportional Relationships 3 3 The Number System 3 3 3 Expressions and Equations 3 3 3 Statistics and Probability 3 3 3 3

Functions 3 3

Number and Quantity 3

Algebra 3

Common Core State Standards: English Language Arts Grades Domain 3 4 5 6 7 8 HSREADING Key Ideas & Details 3 3 3 3 3 3 3

Craft & Structure 3 3 3 3 3 3 3

Integration of Knowledge & Ideas 3 3 3 3 3 3 3 Range of Reading & Level of Text Complexity 3 3 3 3 3 3 3

LANGUAGEConventions of Standard English 3 3 3 3 3 3 3

Knowledge of Language 3 3 3 3 3 3 3

Vocabulary Acquisition & Use 3 3 3 3 3 3 3

Overview of The Iowa Tests

References

Common Core State

Standards. Retreived

from http://www.

corestandards.org/about-

the-standards.

Webb, Norman L., (1997).

Criteria for Alignment

of Expectations and

Assessments in

Mathematics and Science

Education, National

Institute for Science

Education, University

of Wisconsin-Madison,

Washington, DC, the

Council of Chief State

School Officers.

Item-level Comparisons — Round 1. Once alignment is established at the categorical level,participantsmusthaveagoodunderstandingoftheitemsthatappearontheassessments with respect to the knowledge, skills and abilities that each assessment item requires students to demonstrate in order to assigntheitemtoanindividualstandard.Participantsspendnumeroushoursreviewingitemsandidentifyingwhatstudentsmustknow and be able to do to answer each item correctly.Afterthisintensiveitem-reviewprocess, alignment participants assign each item in The Iowa Tests to a primary standard (andanyrelevantsecondarystandards)thatbestreflectstheacademiccontentbeingtestedbythatitem.Emphasisduringtheorientationandreviewingstagesisplacedonboththecontentandcognitivedemandrequiredbythe item and implied by the standard. It is imperativethattheassessmentreflectthetypeofcontent,levelofcognition,anddegreeofdifficultyreflectedinthestandards.ThegoalofRound1isforcontentexperts,measurementspecialistsandtestdeveloperstoapplyacommonunderstandingofboththecontentoftheitemsandthecontentstandards.

Item-level Comparisons — Round 2. The specificitemalignmentsarecompletedindividuallyinRound1.AtthebeginningofRound2,resultsfromRound1are

Alignment Process for CCSS and The Iowa Tests (continued)presented to participants in a group setting to helpclarifydifferencesbetweenitem-levelalignmentsmadebyindividualparticipants.Aconsensus-buildingprocessisusedinRound2torectifyanydifferencesbetweenalignmentsbyindividuals.Round2oftheprocessallowsforasystemofqualitycontrol, where checks are made to address questions,concernsordifferencesinratingsthat arise during the alignment.

Item-level Comparisons — Round 3. Afterconfirmingthealignmentoftheitems,amatrixisdevelopedthatcontainsallstandardsineachcontentareaforeachgradelevelofinterestandtheitemsalignedtotheindividualstandards.ThismatrixservesasevidenceofthealignmentbetweentheCommonCoreStateStandardsandTheIowaTests.Reviewofthematrixbyalignmentparticipantsservestovalidatetheoverallresultsandtoprovideaglobalviewofthecorrespondenceineachcontent category.

Results.Asdescribedabove,thegoalofthealignmentprocessistoassignindividualitemstocorrespondingstandardsintheCommonCoreStateStandards,takingintoconsiderationthecontentandcognitiverequirementsoftheitemsandthestandards.Providedaretwosampleitemsandtheresultsoftheiralignment.

Overview of The Iowa Tests

Iowa Testing ProgramsCollege of Education

University of Iowa Iowa City IA 52242-1529

steve-dunbar@uiowa.educatherine-welch@uiowa.edu

www.education.uiowa.edu/itp