Test BiasTest Bias

SAT math differences SAT math differences betweenbetween

African-Americans, Whites African-Americans, Whites & Asians& Asians

Implications?Implications?

For minority students’ access to For minority students’ access to university education?university education?

For women’s entry into university For women’s entry into university programs requiring mathematical programs requiring mathematical skill (engineering, math science)?skill (engineering, math science)?

Other IssuesOther Issues Decline in SAT scores in USDecline in SAT scores in US

Over a 14 year period in 1970’s & 80’s:Over a 14 year period in 1970’s & 80’s: SAT verbal scores dropped by nearly 50 pointsSAT verbal scores dropped by nearly 50 points SAT math scores dropped by 30 pointsSAT math scores dropped by 30 points

Blamed by some on “dumbing down of Blamed by some on “dumbing down of schools”schools”

Solution: minimum competency testing (e.g., Solution: minimum competency testing (e.g., state-wide exams for high school diploma)state-wide exams for high school diploma)

Problem:Problem: If diploma sanction enforced, 20% of black high If diploma sanction enforced, 20% of black high

school students would have been denied diploma, school students would have been denied diploma, compared to only 2% of white studentscompared to only 2% of white students

Teacher TestingTeacher Testing Used in many states in the United StatesUsed in many states in the United States Proposed for use in Ontario by former Proposed for use in Ontario by former

Conservative governmentConservative government Consequences?:Consequences?:

Florida: SAT, ACT scores required for entry into Florida: SAT, ACT scores required for entry into teacher trainingteacher training

Eliminated 80% of black, 60% of Hispanic, but only Eliminated 80% of black, 60% of Hispanic, but only 37% of white applicants37% of white applicants

Alabama: 1995 state law requiring NTE for all Alabama: 1995 state law requiring NTE for all teachersteachers

Pass rates of Blacks & Hispanics, 40% to 50%; for Pass rates of Blacks & Hispanics, 40% to 50%; for Whites, 80%Whites, 80%

Lawsuit by black applicants resulted in new testing Lawsuit by black applicants resulted in new testing program where there wasn’t more than 5% difference program where there wasn’t more than 5% difference in pass ratesin pass rates

National Teacher National Teacher Examination (NTE)Examination (NTE)

Most commonly used of teacher competency Most commonly used of teacher competency teststests

ValidityValidity No correlation between NTE scores & principals’ No correlation between NTE scores & principals’

ratings of teachers in the classroomratings of teachers in the classroom Report done for National Education Report done for National Education

Association concluded that thousands of Blacks Association concluded that thousands of Blacks & Hispanics excluded from teaching profession & Hispanics excluded from teaching profession on basis of NTE & other teaching testson basis of NTE & other teaching tests

NTE became known as “Negro Teacher NTE became known as “Negro Teacher Eliminator”Eliminator”

Resulted in change of NTE by ETSResulted in change of NTE by ETS

Arthur JensenArthur Jensen 1969 article in Harvard Educational

Review Title: “How much can we boost IQ and

scholastic achievement?” “Compensatory education has been

tried and apparently it has failed” “genetic factors are strongly implicated

in the average Negro-white intelligence difference”

Reaction to Jensen Reaction to Jensen articlearticle Newsweek

“Dr. Jensen’s view put simply is that most blacks are born with less intelligence than most whites”

demonstrationsdemonstrations has had many notorious supporters

Richard Herrnstein differences in intelligence are inherited as environments are improved, mental abilities will become

more important, and “the closer will human society approach a caste system” with low IQ individuals in the lower castes

“if this is a fair picture of the future, then we should be preparing ourselves for it, rather than railing against its dawning”

Philippe Rushton, University of Western Ontario model of race is based on a division of humankind into

three major races: Mongoloid, Caucasoid and Negroid. proposes that consistent rank orders for these three races

can be seen in all kinds of data, including IQ scores, crime statistics, prevalence of AIDS, head size and penis length.

What Do Test Differences What Do Test Differences Indicate?Indicate?

Racial differences in intelligence?Racial differences in intelligence? Research in population genetics shows Research in population genetics shows

that there are few biological differences that there are few biological differences between racesbetween races

Diseases function equivalently in Diseases function equivalently in different races, and equivalent different races, and equivalent treatment produces equivalent benefittreatment produces equivalent benefit

What Do Test Differences What Do Test Differences Indicate?Indicate?

Test are culturally unfair?Test are culturally unfair? Children with disadvantaged or culturally Children with disadvantaged or culturally

different backgrounds have not had different backgrounds have not had chance to learn information contained on chance to learn information contained on intelligence testsintelligence tests

Language used on tests geared towards Language used on tests geared towards white children with middle-class white children with middle-class upbringingupbringing

SolutionsSolutions

Use “culture-free” tests (e.g., Raven’s) (reduces Use “culture-free” tests (e.g., Raven’s) (reduces but does not eliminate cultural differences)but does not eliminate cultural differences)

Administer test using African American dialect Administer test using African American dialect (little impact)(little impact)

Eliminate unfair items (little impact)Eliminate unfair items (little impact) Differential Item Functioning Analysis (little Differential Item Functioning Analysis (little

impact)impact) Use culturally-based tests (e.g., Chitling Test, Use culturally-based tests (e.g., Chitling Test,

BITCH)BITCH) System of Multicultural Pluralistic Assessment System of Multicultural Pluralistic Assessment

(SOMPA)(SOMPA)

Chitling TestChitling Test A "handkerchief head" is:A "handkerchief head" is:

            (a) a cool cat, (b) a porter, (c) an Uncle Tom, (d) a hoddi, (e) a (a) a cool cat, (b) a porter, (c) an Uncle Tom, (d) a hoddi, (e) a preacher.preacher.

Which word is most out of place here?Which word is most out of place here?

      (a) splib, (b) blood, (c) gray, (d) spook, (e) black. (a) splib, (b) blood, (c) gray, (d) spook, (e) black.

A "gas head" is a person who has a:A "gas head" is a person who has a:

      (a) fast-moving car, (b) stable of "lace," (c) "process," (d) habit (a) fast-moving car, (b) stable of "lace," (c) "process," (d) habit of stealing cars, (e) long jail record for arson.of stealing cars, (e) long jail record for arson.

"Bo Diddley" is a: "Bo Diddley" is a:

      (a) game for children, (b) down-home cheap wine, (c) down-(a) game for children, (b) down-home cheap wine, (c) down-home singer, (d) new dance, (e) Moejoe call.home singer, (d) new dance, (e) Moejoe call.

Black Intelligence Test of Black Intelligence Test of Cultural Homogeneity Cultural Homogeneity

(BITCH)(BITCH) Mother’s Day meansMother’s Day means

Black independence dayBlack independence day A day when mothers are honouredA day when mothers are honoured A day the welfare cheques come inA day the welfare cheques come in Every first Sunday in churchEvery first Sunday in church

Blood meansBlood means A vampireA vampire A dependent individualA dependent individual An injured personAn injured person A brother of colourA brother of colour

The following are popular brand names. Which The following are popular brand names. Which one does not belong?one does not belong? Murray’s Murray’s Dixie PeachDixie Peach Royal CrownRoyal Crown Preparation HPreparation H

Newfoundland Newfoundland Intelligence TestIntelligence Test

1.1. ““Duckish is a term which meansDuckish is a term which means1.1. Many ducks huddled together in a pond’Many ducks huddled together in a pond’2.2. A person who swims wellA person who swims well3.3. A person who shies away from dangerA person who shies away from danger4.4. The time of day between sunset and darkThe time of day between sunset and dark

2.2. Which is biggest?Which is biggest?1.1. A trap-boatA trap-boat2.2. A long-linerA long-liner3.3. A schoonerA schooner4.4. A rodneyA rodney

SOMPASOMPA

Assumes that all cultural groups Assumes that all cultural groups have same average potentialhave same average potential

Includes a medical portion Includes a medical portion (assessing vision, hearing, motor (assessing vision, hearing, motor functioning)functioning)

Incorporates WISC, but scores are Incorporates WISC, but scores are adjusted for socio-economic adjusted for socio-economic background & compared to own background & compared to own ethnic groupethnic group

What do test differences What do test differences indicate?indicate?

Differential validity?Differential validity? Do tests like SAT, GRE have same Do tests like SAT, GRE have same

validity when applied to different validity when applied to different groups?groups?

If test is valid for majority group, and If test is valid for majority group, and invalid for minority group, this presents invalid for minority group, this presents a problem in using the test as a a problem in using the test as a criterion for selectioncriterion for selection

Standard Regression PlotStandard Regression Plot

Single Regression Slope for Single Regression Slope for Two GroupsTwo Groups

Regression – Two Groups Regression – Two Groups with Equal Slopes but with Equal Slopes but Different InterceptsDifferent Intercepts

Regression Lines withRegression Lines withDifferent SlopesDifferent Slopes

What Do Test Differences What Do Test Differences Indicate?Indicate?

Social & economic inequality?Social & economic inequality? Accepting this explanation suggests that to Accepting this explanation suggests that to

reduce differences, need to address the reduce differences, need to address the problem of economic inequality & access to problem of economic inequality & access to quality educationquality education

Ralph NaderRalph Nader

report entitled “The Reign of ETS: The Corporation That Makes Up Minds” tests like SAT & LSAT have little power to

predict how well students will do in school and even less power to predict anything about life after school

tests are biased against minority-group and low-income students

despite disclaimers by ETS, coaching can be effective in boosting scores (and wealthier students have greater access to such coaching)

Astin (1971)Astin (1971) “to defend selective admissions on the

grounds that aptitude tests and high school grades predict performance is perhaps to miss the main point of education” (whether students learn and acquire skills and knowledge that are of value either to themselves or to society)

at elementary& high school level, we want to educate all students to fullest potential

at post-secondary level, “sorting and selecting” function seems to take over

Truth in Testing Truth in Testing MovementMovement

Lobbied for:Lobbied for: test-takers having access to test results

within a specified period after test administration

test publishers file information on test development, validity, reliability and cost with government agencies

testing agencies give individual test takers information on nature and intended use of tests prior to testing and guarantee their right of privacy concerning own test scores

Organized Psychology’s Organized Psychology’s ReactionReaction

Lerner’s 1979 APA address:Lerner’s 1979 APA address: ““The attack on tests is, to a very considerable and

very frightening degree, an attack on truth itself by those who deal with unpleasant and unflattering truths by denying them and by attacking and trying to destroy the evidence for them.”

suggested that leaders of National Education Association oppose standardized testing because tests reveal what an inadequate job educators have been doing; that leaders of NAACP attacked test results “because they show that integration alone cannot solve the problems of illiterate black youth”

ChoicesChoices Unqualified individualismUnqualified individualism

Tests used to select the most qualified individuals, Tests used to select the most qualified individuals, regardless of race, gender & other characteristicsregardless of race, gender & other characteristics

QuotasQuotas Recognizes race & gender differencesRecognizes race & gender differences Percentage of applicants selected from race or gender Percentage of applicants selected from race or gender

groups should be the same as the percentage of those groups should be the same as the percentage of those groups in the general populationgroups in the general population

E.g., if population of a province is 10% Black, then 10% E.g., if population of a province is 10% Black, then 10% of students selected for medical school should be black of students selected for medical school should be black

Qualified individualismQualified individualism Argues for the selection of the best qualified Argues for the selection of the best qualified

individuals; however, characteristics such as race, individuals; however, characteristics such as race, gender & religion taken into accountgender & religion taken into account

Affirmative ActionAffirmative Action

positive steps taken to increase the positive steps taken to increase the representation of women and representation of women and minorities in areas of employment, minorities in areas of employment, education, and business from which education, and business from which they have been historically excludedthey have been historically excluded

When those steps involve When those steps involve preferentialpreferential selection—selection on the basis of selection—selection on the basis of race, gender, or ethnicity—affirmative race, gender, or ethnicity—affirmative action generates intense controversy. action generates intense controversy.

Texas Campus Attracts Fewer MinoritiesBy Sue Anne Pressley

Washington Post Staff WriterThursday, August 28 1997

As classes begin today at the University of Texas, this flagship school in a highly diverse state has become distinctively whiter. Among the freshman class of 6,500, there are only 150 African American students, half last year's number. And the law school, for years one of the nation's major educators of minority lawyers, is welcoming only four African Americans and 26 Hispanics to its first-year class.

The experience of Texas is being watched closely around the country because its universities are the first under court order to dismantle affirmative action policies. That court ruling, the so-called Hopwood case, named for the white student who brought a discrimination suit after being denied admission to the university's law school, says that race cannot be used as a factor in admissions. Texas Attorney General Dan Morales ruled that this basic ban on affirmative action also must include financial aid, recruiting and undergraduate programs.

This is the first academic year in which the impact of Hopwood has been felt clearly in Texas. Before the ruling, the university, like others around the country, could use race as one factor in deciding which students to admit, a policy that led to acceptance of minorities with slightly lower test scores than those of white students.

What would you What would you do?do?