instructor: jessie jones, ph.d. co-director, center for successful aging california state...
Post on 21-Dec-2015
214 views
TRANSCRIPT
![Page 1: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/1.jpg)
Instructor: Jessie Jones, Ph.D.Co-director, Center for Successful Aging
California State University, Fullerton
Characteristics of Sound Tests
![Page 2: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/2.jpg)
Criteria for Evaluating Tests
ReliabilityValidityDiscriminationPerformance Standards Social AcceptabilityFeasibility
![Page 3: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/3.jpg)
Test Reliability
Refers to the consistency of a score from one trial to the next (especially from one day to another).• test-retest reliability• r = .80
![Page 4: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/4.jpg)
Test Reliability Test objectivity- refers to the degree of
accuracy in scoring a test.• Also referred to as rater reliability
![Page 5: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/5.jpg)
Rater Reliability
Is especially important if measures are going to be collected on multiple occasions and/or by more than one rater.• Intrarater reliability refers to the same
evaluator.• Interrater reliability refers to different
evaluators.
![Page 6: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/6.jpg)
Test Reliability
Chair Stand
How to increase scoring precision
•Practice giving the test to a sample of clients•Follow the exact published protocol•Provide consistent motivation•Provide rest to reduce fatigue•Help to reduce client fear•Note any adaptations in test protocol
![Page 7: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/7.jpg)
Reliability - Review
Reliability Test-retest reliability Test Objectivity• Intra-rater reliability• Inter-rater reliability
![Page 8: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/8.jpg)
Test Validity
A valid test is one that measures what it is intended to measure.• Physical fitness• Functional limitations• Motor and sensory impairments• Fear-of-falling
Tests must be validated on intended clients
![Page 9: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/9.jpg)
Types of Validity
ContentConstructCriterion
![Page 10: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/10.jpg)
Test Validity
Content Validity – the degree to which a test reflects a defined “domain” of interest.• Also referred to as “face” or “logical”
validity. Example: Berg Balance Scale
Domain of interest is balance. Participant performs a series of 14 functional
tasks that require balance.
![Page 11: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/11.jpg)
Test Validity
Construct-related - the degree to which a test measures a particular construct.• A construct is an attribute that exists in theory
but cannot be directly observed.
Example Test: 8’ Up & Go• Construct measured is functional
mobility
![Page 12: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/12.jpg)
Test Validity
Criterion-related – evidence demonstrates that test scores are statistically related to one or more outcome criteria.
Concurrent Validity Predictive Validity
![Page 13: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/13.jpg)
Criterion-Related
Concurrent validity – the degree to which a test correlates with a criterion measure.• Criterion measure is often referred to as the
“gold standard” measure. • > .70• Example: Chair Sit & Reach
![Page 14: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/14.jpg)
Criterion-Related
Predictive Validity evidence demonstrates the degree of accuracy with which an assessment predicts how participants will perform in a future situation.
![Page 15: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/15.jpg)
Predictive ValidityExample Test: Berg Balance Scale
Older adults who score above 46/56 have a high probability of not falling when compared to older adults who score below this cutoff.
![Page 16: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/16.jpg)
Validity - Review Content-related Construct-related Criterion-related• Concurrent validity• Predictive validity
![Page 17: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/17.jpg)
Discrimination Power
Important for measuring different ability levels, and measuring over time.
Continuous measure tests• Result in a spread of scores• Avoid “ceiling effects”- test too easy• Avoid “floor effects” – test too hard • Responsiveness
![Page 18: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/18.jpg)
Discrimination Power
Examples:• Senior Fitness Test (ratio scale)
Uses time and distance measures• FAB and BBS (5 pt. ordinal scale)
Allows for “more change in scores” than Tinetti’s POMA; FEMBAF which only have 2-3 point scales).
![Page 19: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/19.jpg)
Characteristics of Sound Tests
Performance Standards• Evaluated relative to a peer group (norm-
referenced standards). Example: Senior Fitness Test
• In relation to predetermined, desired outcomes (criterion-referenced standards)
Example: 8 ft Up & Go
![Page 20: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/20.jpg)
![Page 21: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/21.jpg)
Other Characteristics of Sound Tests
Social acceptability – meaningful Feasibility – suitable for
use in a particular setting
![Page 22: Instructor: Jessie Jones, Ph.D. Co-director, Center for Successful Aging California State University, Fullerton Characteristics of Sound Tests](https://reader030.vdocument.in/reader030/viewer/2022032522/56649d605503460f94a41a8d/html5/thumbnails/22.jpg)
Review!ReliabilityValidityDiscriminationPerformance Standards Social AcceptabilityFeasibility