assessment of aptitude, achievement, & learning disabilities
TRANSCRIPT
Aptitude Assessment
Purpose: measure an examinee’s capacity for learning and to predict whether he or she would likely benefit from an educational or training program.
Applications:1. Academic & Career Counseling.2. Selection & Placement Decisions.
American College Testing Program (ACT)
Academic Tests:1. English.2. Math.3. Reading.4. Science Reasoning. Standard Scores: M = 18 & SD = 6
(recent mean of college bound seniors: 20-21)
Scholastic Assessment Test (SAT):
SAT I: Reasoning Test, which includes Verbal & Mathematical Sections.
Standard Scores: M= 500 & SD = 100 SAT II: Subject Tests (e.g., History), which are
used for both admission decisions & determining course placement.
Current examinees’ raw scores are compared to the raw scores obtained by the 1 million examinees who took the SAT in 1994. Previous examinees were compared to a 1941 standardization sample.
Do ACT/SAT Tests Really Predict Academic Performance?
Technically, yes. But the relationship between aptitude test scores and college performance is only moderate.
Hypothetical Relationship between ACT Scores & GPA
GPA
4.54.03.53.02.52.01.5
ACT
30
28
26
24
22
20
18
16
14
r = .40 r2 = .16 Y = ACT(.073) +
1.39 Example: Given an
ACT score of 20, we would predict a GPA of 2.85.
Validity of Admissions Tests for predicting college performance:
ACT & SATI have equal validity for predicting college performance.
Prediction of Undergraduate GPA:
SAT (r .36) v. HSR (r .42).
HSR + SAT scores increases r to .50 to .60. Prediction of graduation from college:
SAT (r .33) v. HSR (r .29). *Validity coefficients are higher when researchers correct for GPA unreliability and restriction of range.
SAT I vs. SAT II(Geiser & Studley, 2002)
N =77,893 CA students. SAT-II scores were the best predictor of
UGPA (r = .25), followed by HSGPA (r = .24), and SAT-I (r = .18).
SAT I scores did not enhance the prediction of UGPA beyond that predictable by SAT II scores & HSGPA.
The predictive validity of the SAT-II is less affected by SES than the SAT-I.
Benefits of ACT or SAT
Students are directly compared on the same standard or set of tasks.
These tests do have modest predictive validity (r = .30 to .50).
Tests may identify underachievers who have the potential to succeed in college, but who did not do well in high school.
Problems with Alternative Criteria:
Standards and grading policies vary from school to school (and teacher to teacher).
Total GPA does not reflect quality and difficulty of courses completed.
Curriculum differences across school systems.
Grade inflation and other leniency errors. Nearly all letters of recommendation are
laudatory and lack any predictive validity.
Graduate Admissions Tests
Graduate Record Examination (GRE): Verbal, Quantitative, & Analytical Writing. Subjects tests are also available. Standard Scores: M= 500 & SD = 100
Miller’s Analogies Test (MAT). Medical College Admission Test (MCAT). Law School Admissions Test (LSAT). Graduate Management Admissions Test
(GMAT).
Adaptive Testing:
Selection of subsequent test items is based upon how well examinee performed on previous items; requires fewer items because examinee is not given items that are too easy or too difficult; typically the test items are administered by computer.
General Aptitude Tests
Purpose: (1) identify an examinee’s specific strengths & weaknesses and (2) match an examinee to specific jobs or training programs.
Examinees are assessed on several specific abilities, like mechanical reasoning, rather than a global attribute
Unlike tests like the ACT that measure scholastic aptitude, these inventories focus more on “real world” abilities.
Armed Services Vocational Aptitude Battery (ASVAB)
General Science Arithmetic
Reasoning Word Knowledge Paragraph
Comprehension Numerical
Operations
Coding Speed Auto & Shop
Information Mathematics
Knowledge Mechanical
Comprehension Electronics
Information
O*Net (formerly General Aptitude Test Battery)
Verbal Abilities. Arithmetic Reasoning. Computation. Spatial Ability. Form Perception Clerical Perception Motor Coordination Finder Dexterity Manual Dexterity
Achievement Tests
Purpose: asses what an examinee has already learned as a result of education or other training experiences.
Types of Achievement Tests
Survey Achievement Batteries: monitor students’ progress on basic educational domains from year to year; ex. TerraNova or the Iowa Tests of Basic Skills/Educational Development.
Individual Achievement Tests: diagnostic evaluations; ex. WIAT.
Criterion-Referenced Achievement Tests: evaluate whether a examinee has mastered certain material or a given academic standard has been met (e.g., high school graduation exams).
Specific Subject Tests: for example, the exams you will take in this course.
Lake Wobegon Effect
Amazingly, most students and school districts score above average on norm-referenced achievement tests.
How can this occur?1. Outdated norms; students are
performing better than older norm group.2. Cheating by teachers.3. Eliminating low-performing students from
the test pool.
No Child Left Behind Act
Purpose: increase the accountability of the public school system.
All students in grades 3-8 must be annually assessed in reading & math.
States must develop standards & objectives for educational achievement.
By the 2013-2014 school year, states must demonstrate that all of their students are proficient in basic academic skills.
School systems that fail to meet the new standards will be labeled as deficient; students in these schools may have the option of transferring to a higher performing school.
Aptitude v. Achievement Tests
Aptitude Purpose: predict
future performance. Predictive Validity. Evaluate more
general competencies that may be innate or acquired in the distant past.
Achievement Purpose: assess
current performance Content Validity. Evaluate more
specific competencies that have been recently learned.
What is a Learning Disability?
Definition: failure of an individual, despite adequate intelligence & training, to master a certain academic skill (Sattler, 1998) or a severe discrepancy between IQ & achievement
Disabilities are believed to result from problems in the central nervous system (i.e., information processing problems).
Need to rule out other explanations for low achievement, such as hearing impairments or emotional disturbance.