using the internet to enhance testing in counseling · test-taker’s parents or guardians...

29
1 Using the Internet to Enhance Testing in Counseling James P. Sampson, Jr. Florida State University Copyright 2002 by James P. Sampson, Jr. All Rights Reserved

Upload: others

Post on 19-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

1

Using the Internet to Enhance

Testing in Counseling

James P. Sampson, Jr.

Florida State University

Copyright 2002 by

James P. Sampson, Jr.

All Rights Reserved

Page 2: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

2

Common Elements of Assessment

Selection

Orientation

Administration

Scoring

Interpretation

Page 3: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

10

Common Elements of Assessment

Selection

Orientation

Administration

Scoring

Interpretation

Page 4: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

11

Test Selection

• Identify potential instruments

related to client needs

• Select measure on technical quality

Page 5: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

14

Test Selection

• Download standardized descriptions of

potentially appropriate assessments

• Access links to published test reviews

• Cross-reference assessments with

literature on special populations

• Access links to test publishers to obtain

specimen sets or sample reports

Page 6: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

10

Common Elements of Assessment

Selection

Orientation

Administration

Scoring

Interpretation

Page 7: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

19

Test Orientation

• Delivered to test taker or

test-taker’s parents or guardians

– computer-assisted instruction

– frequently asked questions (FAQ’s)

• Theory-based or atheoretical

• Description of assessment process

• Orientation to self-assessment adds description of

circumstances where counseling may be needed

Page 8: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

10

Common Elements of Assessment

Selection

Orientation

Administration

Scoring

Interpretation

Page 9: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

21

Test Administration

• Access tests from password-protected publisher web sites

• Access self-assessments from free self-help web sites by completing links

• Access to fee charging self-assessments require individual or org. prepayment

• E-mail or videoconferencing to seek assistance when problems occur with self-help tests

Page 10: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

22

Test Administration

• Advantage

– Remote administration - fewer barriers

• Disadvantages

– potentially compromises standardization

– aptitude, achievement, IQ, neurological

– environmental factors (distractions)

– psychological factors (intimidation)

– no opportunity to record deviations

Page 11: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

23

Test Administration

• Use of visual images as well as text

• Benefits:

– manipulation tasks - card sorts

– individuals with limited reading ability

• Limitations:

– higher developmental costs

– reactivity to irrelevant data in images

Page 12: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

10

Common Elements of Assessment

Selection

Orientation

Administration

Scoring

Interpretation

Page 13: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

24

Test Scoring

• Proceeds immediately after

administration

• Self-assessment - no practitioner is

available to explain scoring

• “Black-box” scoring may increase

perceptions of “magical” answers

Page 14: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

14

Common Elements of Assessment

Selection

Orientation

Administration

Scoring

Interpretation

Page 15: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

15

Test Interpretation

Three aspects of test interpretation:

1. Client Preparation

2. Generalized Test Interpretation

3. Specific Test Interpretation

Page 16: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

16

Client Preparation

• Begins in orientation

• Purpose and process of testing

• Repetitive information - boredom -

poor counselor performance

• Computer effective with repetition

• Counselor provides specific info

Page 17: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

17

Specific Test Interpretation

• Counseling: Face-to-face or

distance

• Computer-based test interpretation

Page 18: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

18

Specific Test Interpretation

Four options:

1. Computer-based test interpretation

2. Two-way videoconferencing

3. Moderated list servers

4. Moderated computer conferences

5. Follow-up resource links

Page 19: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

19

Generalized Test Interpretation

• Basic terminology and concepts

• Repetitive information - bored

counselor - poor performance

• Counselor may appear disinterested

• Knowledge gaps - less prepared

• Better delivered by computer

• Time used for insight and application

Page 20: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

20

Computer-Based Test

Interpretation (CBTI)

• Provides an expanded and

consistent knowledge base

• Uses research data and practitioner

experience

• More objective and comprehensive

• Less subject to interpreter bias

Page 21: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

21

Types of CBTI

Four types of CBTI:

1. Descriptive

2. Clinician-modeled

(renowned clinician type)

3. Clinician-modeled

(statistical model type)

4. Clinical actuarial

Page 22: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

22

CBTI Variation

• Self-assessment

• Counselor-mediated assessment

– Client as consumer

– Practitioner as consumer

Page 23: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

23

Self-Assessment

• Designed for little or no practitioner

assistance

• Example: Self-Directed Search

• Both generalized and specific

interpretation

Page 24: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

24

Counselor-Mediated Assessment

• Client as primary consumer

• Designed to include practitioner

• Example: Strong Interest Inventory

• Password-protected web site

• Generalized test interpretation

• Practitioner intervention

• CBTI specific interpretation

Page 25: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

25

Counselor-Mediated Assessment

• Practitioner as primary consumer

• Example: MMPI-2

• Password-protected web site

• No generalized test interpretation

• CBTI specific interpretation

• Practitioner intervention

Page 26: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

26

Relationship Issues

• Videoconferencing and face-to-face

interaction - similar, but not identical

• Equivalency is not the issue

• Effectiveness is the issue

• Research and development needed

Page 27: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

27

Ethical Issues

• Confidentiality

• Attractive, but invalid assessment

• Lack of needed counselor intervention

• Misuse of, or dependency on, CBTI

• Awareness of local circumstances

• Limited access to the Internet - SES

• Limited auditory and visual privacy

Page 28: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

28

Ethical Standards

• National Board for Certified

Counselors - Practice of Internet

Counseling

• National Career Development

Association - Guidelines for the Use

of the Internet for Provision of Career

Information and Planning Services

Page 29: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based

29

For Additional Information

www.career.fsu.edu/techcenter/

Thank You