© peoplefluent 2014 testing the test presenter: lisa harpe, ph.d. peoplefluent research institute...
TRANSCRIPT
![Page 1: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/1.jpg)
© PeopleFluent 2014
Testing the Test
Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)
![Page 2: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/2.jpg)
2© 2014 PeopleFluent | Confidential Presentation Title | date
Agenda
• Regulatory Climate• What is a Test?• What is Validity?• Questions for a Third Party Test Vendor• Questions for a Test User• Documentation Checklists
![Page 3: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/3.jpg)
3© 2014 PeopleFluent | Confidential Presentation Title | date
Regulatory Climate• EEOC
• Experts on staff• Charges
• Some well known cases in the mid-2000s: Dial Corp, Whirlpool, Fed-Ex • Criminal Background Checks• ADA violations
• OFCCP• Experts on staff• Settlements (in last 2 years)
• Leprino Foods• GE• Lincoln Electric
![Page 4: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/4.jpg)
4© 2014 PeopleFluent | Confidential Presentation Title | date
UGESP• Uniform Guidelines on Employment Selection
Procedures (UGESP) (1978)
• Adverse impact (A.I)• No need to show validity if no A.I.• Justify, change, find alternative or eliminate if A.I.
• Justification• Validity evidence = job related• Business necessity
![Page 5: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/5.jpg)
5© 2014 PeopleFluent | Confidential Presentation Title | date
UGESP Citations• Section 60-3, Uniform Guidelines on Employee
Selection Procedure (1978); 43 FR 38295 (August 25, 1978).
• Equal Employment Opportunity Commission: 29 CFR Part 1607
• Department of Labor/ Office of Federal Contract Compliance Programs: 41 CFR Part 60-3
• Department of Justice: 28 CFR 50.14• Civil Service Commission: 5 CFR 300.103(c)
![Page 6: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/6.jpg)
6© 2014 PeopleFluent | Confidential Presentation Title | date
Resources• Uniform Guidelines on Employment Selection Procedures (UGESP, 1978)
• Department of Labor’s (DOL) Testing and Assessment: an Employer’s Guide to Good Practices (1999)
• American Psychological Association’s (APA) Standards for Educational and Psychological Testing (2014)
• Society of Industrial Organizational Psychologist’s (SIOP) Principles for the Validation and Use of Personnel Selection Procedures (4th edition, 2003)
![Page 7: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/7.jpg)
7© 2014 PeopleFluent | Confidential Presentation Title | date
What is a Test?• ‘Any instrument or procedure that samples behavior or
performance’ (DOL Guide)
• ‘Any device or procedure that samples behavior which is scored in a standard process’ (APA Standards)
• ‘Any procedure used singly or in combination to make personnel decisions’ (‘selection procedure, test, assessment, and predictor’ = interchangeable terms) (SIOP Principles)
• vs. basic qualification questionnaire
![Page 8: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/8.jpg)
8© 2014 PeopleFluent | Confidential Presentation Title | date
Types of Tests• Cognitive ability tests• Physical ability tests• Achievement tests• Personality tests• Job knowledge tests• Skills tests• Honesty and integrity tests• Biodata inventories• Work samples and simulations• Assessment centers
![Page 9: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/9.jpg)
9© 2014 PeopleFluent | Confidential Presentation Title | date
Types of Tests• Employment interviews• Education and experience requirements (including
licensing and certification)• Recommendations and reference checks• Criminal record check• Medical examinations• Drug and alcohol tests
![Page 10: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/10.jpg)
10© 2014 PeopleFluent | Confidential Presentation Title | date
What is Validity?
• Principles advocates the Standards’ definition as “the degree to which accumulated evidence and theory support specific interpretations of test scores entailed by proposed uses of a test” (AERA et al., 1999, p. 184)
![Page 11: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/11.jpg)
11© 2014 PeopleFluent | Confidential Presentation Title | date
Validity• Validity depends on the purpose of the test
• Measure of extraversion vs. predictor of job success vs. predictor of training success
• Selection vs. promotion vs. placement• Target population
• Validity depends on the use of the test results• Cut score (Pass/Fail)• Ranking• Part of assessment battery
![Page 12: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/12.jpg)
12© 2014 PeopleFluent | Confidential Presentation Title | date
Sources of Validity Evidence• Content validity
• Can you show a direct link between the test items and job behaviors, work outcomes or KSAOs?
• Criterion related validity• Can you show that the test is related to performance?
• Construct validity• Are there multiple lines of evidence that whatever is being measured by
the test is related to the job?
• Other• Response Process• Internal structure• Consequential
![Page 13: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/13.jpg)
13© 2014 PeopleFluent | Confidential Presentation Title | date
Content Validity
Test
Content Validity
Work behaviors, activities, outcomes
or KSAOs
![Page 14: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/14.jpg)
14© 2014 PeopleFluent | Confidential Presentation Title | date
Content Validity• Expert Judgment• SME
• Incumbents• Hiring manager• HR• Industrial Psychologists
• Define Important Work Behaviors, Activities and Outcomes
• Evaluate Test Content for Relevance
![Page 15: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/15.jpg)
15© 2014 PeopleFluent | Confidential Presentation Title | date
Content ValidityJob Representative
Work BehaviorTest Content
Administrative Assistant
Maintain supervisor’s calendar
Microsoft Outlook Skills Assessment
Administrative Assistant
Word processing Microsoft Word Skills Assessment
Truck Driver Drive truck Truck Driving Test
![Page 16: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/16.jpg)
16© 2014 PeopleFluent | Confidential Presentation Title | date
Criterion Related Validity• Criterion Measures
• Performance ratings• 6 month, annual• Supervisor, peer, customer / client
• Productivity• Sales revenue
• Turnover• Absenteeism
• Multi-dimensional
![Page 17: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/17.jpg)
17© 2014 PeopleFluent | Confidential Presentation Title | date
![Page 18: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/18.jpg)
18© 2014 PeopleFluent | Confidential Presentation Title | date
Criterion-related validity
• Predictive: Can test results tell us how well a person will perform in the job?
• Concurrent: Are test results related to job performance?
![Page 19: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/19.jpg)
19© 2014 PeopleFluent | Confidential Presentation Title | date
Criterion-related Validity
+1.0 Correlation Between Test Scores and Performance
40
50
60
70
80
90
100
40 60 80 100
Test Scores
Pe
rfo
rma
nc
e
Correlation Coefficient (r)
![Page 20: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/20.jpg)
20© 2014 PeopleFluent | Confidential Presentation Title | date
-1.0 Correlation Between Test Scores and Performance
40
50
60
70
80
90
100
40 60 80 100
Test Scores
Pe
rfo
rma
nc
e
Criterion-related ValidityCorrelation Coefficient (r)
![Page 21: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/21.jpg)
21© 2014 PeopleFluent | Confidential Presentation Title | date
Correlation Between Test Scores and Performance
40
50
60
70
80
90
100
40 60 80 100
Test Scores
Pe
rfo
rma
nc
e
Criterion-related ValidityCorrelation Coefficient (r)
![Page 22: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/22.jpg)
22© 2014 PeopleFluent | Confidential Presentation Title | date
• Question 1: Is the correlation statistically significant?
• Question 2: Is the correlation practically significant?
Criterion-related Validity
![Page 23: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/23.jpg)
23© 2014 PeopleFluent | Confidential Presentation Title | date
Criterion-related Validity
Correlation coefficient value Interpretation
above .35 very beneficial .21 - .35 likely to be useful .11 - .20 depends on circumstances below .11 unlikely to be useful
Guidelines for Interpreting Correlation Coefficients (DOL guide)
![Page 24: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/24.jpg)
24© 2014 PeopleFluent | Confidential Presentation Title | date
Test Job PerformanceR-sq = .75
Criterion-related ValidityCoefficient of Determination (R-squared)
![Page 25: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/25.jpg)
25© 2014 PeopleFluent | Confidential Presentation Title | date
Test
Job Performance
R-sq = .00
Criterion-related ValidityCoefficient of Determination (R-squared)
![Page 26: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/26.jpg)
26© 2014 PeopleFluent | Confidential Presentation Title | date
Test
Job Performance
R-sq = .2
Coefficient of Determination (R-squared)
Criterion-related Validity
![Page 27: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/27.jpg)
27© 2014 PeopleFluent | Confidential Presentation Title | date
![Page 28: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/28.jpg)
28© 2014 PeopleFluent | Confidential Presentation Title | date
What Influences the Validity Coefficient
• Validity of BOTH the test (predictor) and performance measure (criterion)
• Reliability of BOTH the test (predictor) and performance measure (criterion)
• Range restriction in the test (predictor) and / or performance measure (criterion)
• Sample size affects the significance of r
![Page 29: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/29.jpg)
29© 2014 PeopleFluent | Confidential Presentation Title | date
Construct validity• Construct = unobservable trait or
characteristic• Examples
• Extraversion• Customer service orientation• Intelligence• Oral presentation skills• Ability to trouble-shoot• Leadership
![Page 30: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/30.jpg)
30© 2014 PeopleFluent | Confidential Presentation Title | date
Construct ValidityPredictor Measure(e.g., CallCenterPro)
Criterion Construct Domain
(e.g., Interpersonal Interactions)
Criterion Measure(e.g., Supervisor Rating)
Predictor Construct Domain
(e.g., People Skills)
![Page 31: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/31.jpg)
31© 2014 PeopleFluent | Confidential Presentation Title | date
Other Types of Validity Evidence• Face Validity
• Response Process
• Internal Structure
• Consequential
![Page 32: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/32.jpg)
32© 2014 PeopleFluent | Confidential Presentation Title | date
Job Analysis• Why Do I Care About This?• Analysis of Work (SIOP)• 2 Purposes
• Develop predictors (tests / selection procedures)• Develop criteria (performance measures)
• Approaches• Questionnaires• Observations• Interviews• Documentation
• Currency
![Page 33: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/33.jpg)
33© 2014 PeopleFluent | Confidential Presentation Title | date
Reliability• Reliability = Consistency or Stability
• Why Do I Care About This?
• Types: • Test-retest• Interrater reliability• Internal consistency• Alternate form
![Page 34: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/34.jpg)
34© 2014 PeopleFluent | Confidential Presentation Title | date
ReliabilityGuidelines for Interpreting Reliability
Coefficients (DOL)
Reliability Coefficient Interpretation .90 and up excellent .80 - .89 good .70 - .79 adequate below .70 may have limited applicability
![Page 35: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/35.jpg)
35© 2014 PeopleFluent | Confidential Presentation Title | date
Validity Generalization• Meta-analysis• Synthetic Validity• Transportability
• Job similarity• Job context similarity• Criterion similarity• Test use similarity• Test taker similarity
• Test fairness
![Page 36: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/36.jpg)
36© 2014 PeopleFluent | Confidential Presentation Title | date
Third Party Tests• Sources of Validity Evidence
• Vendor manuals and tech reports• Independent reviews• Research literature
• Mental Measurements Yearbook (Buros Institute of Mental Measurements)
• Tests in Print (TIP) (Buros Institute of Mental Measurements)
![Page 37: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/37.jpg)
37© 2014 PeopleFluent | Confidential Presentation Title | date
Questions for a Test Vendor• What are your credentials and experience? Can you provide references?
• Do you have a technical report that describes the development and validation of the test? Will this report be updated over time? If so, how will you inform me of the updates?
• What costs are involved with using the test in my selection process?
• For which job(s) is the test valid? Can you show that the test is valid for my company and my job(s)?
![Page 38: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/38.jpg)
38© 2014 PeopleFluent | Confidential Presentation Title | date
Questions for a Test Vendor• Can you show that the test is reliable?
• Can you show that the test is not biased? Can you provide the results of adverse impact studies by race and gender? Can you conduct adverse impact studies for my job(s)?
• Can you provide information on test administration, scoring and interpretation?
• Will you evaluate the effectiveness of the test in my company? Will you make changes if warranted?
![Page 39: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/39.jpg)
39© 2014 PeopleFluent | Confidential Presentation Title | date
• Will the test by changed or updated? How will you inform me of any changes or updates?
• Can you document the validity of the test in accordance with the UGESP requirements?
• If the vendor can not provide an answer or does not know what you are talking about, run don’t walk!
What to ask a test vendor
![Page 40: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/40.jpg)
40© 2014 PeopleFluent | Confidential Presentation Title | date
Questions for the Test User• What employment tests are used in the selection process?
• For which job(s)?• Where in the process?
• Does the test have an adverse impact?
• Who developed this test? where did we get the test?
• Did we consider any alternatives?
• Where is the job analysis for this job?
![Page 41: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/41.jpg)
41© 2014 PeopleFluent | Confidential Presentation Title | date
• How are the test results used?
• Is the test reliable?
• Do we have evidence of the test’s validity? Does the evidence meet the UGESP and SIOP criteria for documentation?
Questions for the Test User
![Page 42: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/42.jpg)
42© 2014 PeopleFluent | Confidential Presentation Title | date
• Homemade Tests• See recommended process for work sample tests
• Tests found on the Internet
• Off the shelf tests ‘valid’ for a given industry
Common Issues
![Page 43: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/43.jpg)
43© 2014 PeopleFluent | Confidential Presentation Title | date
• Establish a ‘test’ panel of subject matter experts (individuals who know the job and what the job requires) – 1-2 supervisors, 2-3 incumbents (the more the better) with more than 1 year experience, HR rep.
• Is test related to job?• Identify and document what knowledge, skills or abilities (KSA) are
measured by the test.• Document that KSAs measured by test are required on the job
• Provide examples of tasks and duties representing the KSAs• Indicate frequency of performing tasks or duties requiring the KSAs• Indicate the importance of performing tasks or duties requiring the KSAs• Are the KSAs needed on the first day of the job?
RECOMMENDED PROCESS FOR WORK SAMPLE TEST
![Page 44: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/44.jpg)
44© 2014 PeopleFluent | Confidential Presentation Title | date
• How to score test?• Experts define criteria as specifically as possible• Panel of SMEs should score the test• Panel should agree on definition of success
• Conduct an annual review of the test• Relationship to performance (could include turnover)• Adverse impact
RECOMMENDED PROCESS FOR WORK SAMPLE TEST
![Page 45: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/45.jpg)
45© 2014 PeopleFluent | Confidential Presentation Title | date
• Other• Use test results as input to facilitate the interview process and not as
a defining step unless you have strong evidence to support a cut score
• Use samples of work required on first day of job• Standardize administration and scoring and use of results• Maintain records
• Test taker name• Test taker race and gender• Requisition test taker is being considered for• Test date• Test results – component, overall and any decision resulting from the
test
RECOMMENDED PROCESS FOR WORK SAMPLE TEST
![Page 46: © PeopleFluent 2014 Testing the Test Presenter: Lisa Harpe, Ph.D. Peoplefluent Research Institute (PRI)](https://reader030.vdocument.in/reader030/viewer/2022032804/56649e555503460f94b4d24c/html5/thumbnails/46.jpg)
46© 2014 PeopleFluent | Confidential Presentation Title | date
Thank YouPlease contact me with questions or comments
[email protected](919) 645-2975
For more information www.peoplefluent.com
Corporate Headquarters
(877) 820-4400 (toll free) or (919) 645-2800