risk assessment possibilities and impossibilities stephen d. hart simon fraser university
TRANSCRIPT
![Page 1: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/1.jpg)
Risk Assessment
Possibilities and Impossibilities
Stephen D. HartSimon Fraser University
![Page 2: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/2.jpg)
Violence Risk Assessment
Evaluations of people to: Characterize the risk they will commit
violence in the future Develop interventions to manage risk
The clinical task is to: Understand how and why people chose to act
violently in the past Determine whether these or other factors
may lead them to make similar choices again
![Page 3: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/3.jpg)
Goals of Risk Assessment
Prevent violence
More specifically... Guide intervention Improve consistency of decisions Improve transparency of decisions
Protect clients’ rightsLiability management
![Page 4: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/4.jpg)
Which Risk Factors Should We Assess?
![Page 5: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/5.jpg)
Identifying Risk Factors
Three primary criteria Empirical (predictive accuracy) Professional (practical utility) Legal (fairness and reasonableness)
![Page 6: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/6.jpg)
Problems: Empirical Criterion
Not everything that is important has been proven or validated scientifically Can lead to exclusion of “good” but rare
or difficult-to-assess risk factorsPrediction cause, explanation, or
intervention Can lead to inclusion of “bad” but
common or easy-to-assess factors
![Page 7: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/7.jpg)
Example: The SIEVE
Age Young is badSex Male is badFacial hair Dense is badFoot sizeBig is bad
![Page 8: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/8.jpg)
Problems: Professional Criterion
Focus on dynamic factors may bias risk assessments Can lead to exclusion of “good” but
static or easy-to-ignore factorsConventional wisdom of
professionals may be plain wrong Can lead to inclusion of “bad” but vivid
or dramatic factors
![Page 9: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/9.jpg)
Example: Clinical Intuition
Depression Present is goodAnxiety Present is goodIntelligence High is goodRorschach Seeing viscera is bad
![Page 10: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/10.jpg)
Problems: Legal Criterion
Useful for excluding risk factors, but not for including them
It can be argued that almost any risk factor is unfair or unreasonable in some respect
![Page 11: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/11.jpg)
How Should We ConductRisk Assessments?
![Page 12: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/12.jpg)
Methods of Risk Assessment
Discretionary Unstructured professional judgement Anamnestic assessment Structure professional judgement
Non-discretionary Psychological tests Actuarial tests
![Page 13: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/13.jpg)
Unstructured: Features
No constraints on evaluation Any information can be considered Information can be gathered in any
mannerNo constraints on decisions
Information can be weighted and combined in any manner
Results can be communicated in any manner
![Page 14: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/14.jpg)
Unstructured: Limitations
No systematic empirical support Low agreement (unreliable) Low accuracy (unvalidated) Foundation is unclear (unimpeachable)
Relies on charismatic authorityDecisions are too generalFocus is not on action
![Page 15: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/15.jpg)
Anamnestic: Features
Imposes some structure on evaluation Must consider, at a minimum, nature and
context of past violenceAction-oriented
Logically related to development of risk management strategies
Consistent with “relapse prevention” or “harm reduction” approaches
![Page 16: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/16.jpg)
Anamnestic: Limitations
Unknown reliabilityUnknown validityAssumes that history will repeat
itself Violent careers are static Violent people are specialists
![Page 17: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/17.jpg)
Structured Judgement
Designed to prevent an outcome Action-oriented
Imposes major structure on evaluation Must consider, at a minimum, a fixed and
explicit set of risk factors Specifies process for information-gathering
Imposes minor structure on decision Specifies language for communicating
findings
![Page 18: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/18.jpg)
HCR-20
HCR-20, version 2 Webster, Douglas, Eaves, & Hart (1997) Designed to assess risk for violence in
those with mental or personality disorders
10 Historical, 5 Clinical, and 5 Risk Management factors
![Page 19: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/19.jpg)
Historical
Previous violenceYoung age at first
violenceRelationship
instabilityEmployment
problemsSubstance use
problems
Major mental illness
PsychopathyEarly
maladjustmentPersonality
disorderPrior supervision
failure
![Page 20: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/20.jpg)
Clinical/Risk Management
Lack of insightNegative attitudesActive symptoms
of major mental illness
ImpulsivityUnresponsive to
treatment
Plans lack feasibilityExposure to
destabilizersLack of personal
supportNoncompliance with
remediation attempts
Stress
![Page 21: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/21.jpg)
Structured: Limitations
Requires “retooling” of evaluation process Systematized information-gathering New training and technology
Justification for use requires induction What works elsewhere and with other people
will here and with this personAssumes professionals can exercise
discretion appropriately
![Page 22: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/22.jpg)
Psychological Tests: Features
Measure some disposition that predicts violence, according to past research
Reliability and validity of test-based decisions has been evaluated
Imposes major structure On some part of the evaluation process On some part of the decision-making
process
![Page 23: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/23.jpg)
Psychological Tests: Limitations
Require professional judgment Which tests to use How to interpret scores
Justification of use requires induction What works elsewhere and with other
people will here and with this person
![Page 24: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/24.jpg)
PCL:SV
Symptom construct rating scale Requires clinical/expert judgment Based on “all data”
Data obtained from two primary sources: Review of case history (required) Interview/observation (recommended)
![Page 25: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/25.jpg)
Items
Part 1SuperficialGrandioseDeceitfulLacks remorseLacks empathyDoesn’t accept
responsibility
Part 2 ImpulsivePoor behavioral controlsLacks goals IrresponsibleAdolescent antisocial
behaviorAdult antisocial
behavior
![Page 26: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/26.jpg)
Risk Scales: Features
Designed to predict an outcomeHigh-fidelity
Optimized for specific outcome, time period, population, and context
Impose rigid structure On all of the evaluation process On all of the decision-making process
![Page 27: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/27.jpg)
Risk Scales: Limitations
Still require professional judgment Which scales to use How to interpret scores
Justification of use requires induction What works elsewhere and with other
people will here and with this personResults may be easily misinterpreted
Pseudo-objective, pseudo-precise
![Page 28: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/28.jpg)
VRAG
Violence Risk Appraisal Guide Quinsey et al. (1998) Constructed in adult male patients
assessed or treated at a maximum security hospital
12 items weighted according to ability to postdict violence over 7 year follow-up
Total scores divided into 9 bins, with estimated p(violence) from 0% to 100%
![Page 29: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/29.jpg)
VRAG Items
PCL-R scoreElem. school
problemsPersonality disorderAge (—)Separated from
parents under age 16Failure on prior
conditional release
Nonviolent offense history
Never marriedSchizophrenia (—)Victim injury (—)Alcohol abuseFemale victim (—)
![Page 30: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/30.jpg)
How Accurately Do We Assess Risk?
![Page 31: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/31.jpg)
A Complex Phenomenon
Studying the accuracy of risk characterizations is difficult due to the complexity of… The characterizations The violence The follow-up Indexes of accuracy
![Page 32: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/32.jpg)
The Violence
Nature: Victims (stranger vs. acquaintances); motivations (instrumental vs. reactive), context (co-factors)
Severity: Physical or psychological harm (threats vs. battery vs. homicide)
Imminence: Timing (sooner vs. later)Frequency: Number of events (single vs.
multiple)
![Page 33: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/33.jpg)
The Characterizations
Evaluator: Professional vs. researcher; novice versus expert
Process: Clinical vs. actuarial, contextual vs. context-free
Timing: Admission vs. discharge, static vs. dynamic
Metric: Uni- vs. multi-dimensional, categorical vs. continuous
![Page 34: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/34.jpg)
The Follow-Up
Data source: Patient vs. collaterals vs. records
Time at risk: Weeks vs. months vs. years
Interventions: Dynamic factors, life events
Monitoring: Continuous vs. endpoint
![Page 35: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/35.jpg)
Indexes of Accuracy
Comparison group: Other patients vs. normals
Statistic: Uni- vs. multi-variate, timeWeighting of errors: Equal vs.
differential Interpretation: Chance vs. status quo
vs. perfection
![Page 36: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/36.jpg)
OutcomePrediction Not Violent Violent
Low Risk High Risk
Science Responds to Complexity
![Page 37: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/37.jpg)
Example: Psychopathy
OutcomePrediction Not Violent Violent
Low Risk(Non-psychopath)
90 24
High Risk(Psychopath)
12 40
Harris, Rice, & Cormier (1991)
![Page 38: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/38.jpg)
Example (cont.)
In this study... Accuracy of positive predictions is 77% Accuracy of negative predictions is 79% Overall accuracy is 78% Chance-corrected agreement is 53% Correlation is .53 Odds ratio is 12.5
![Page 39: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/39.jpg)
Example (cont.)
So, how did we do? Relative to chance: Great! Relative to perfection: Awful! Relative to the status quo: ???
![Page 40: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/40.jpg)
What is the status quo?
Predictions of violence using the PCL-R typically have an effect size (r) of about .25-.35; the average effect size for psychosis is about .20-.30
An effect size of .40 may be the “forensic sound barrier”
But what is the status quo in other human endeavors?
![Page 41: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/41.jpg)
Meta-Meta-Analysis
Lipsey & Wilson (1993) reviewed 302 meta-analyses
Determined typical effect sizes for psychological, educational, and medical interventions
![Page 42: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/42.jpg)
Psychological Interventions
CBT — depression .44Psychotherapy — any .39Correctional programs (youths) .23
— any Diversion (youths) — recidivism.20Correctional treatment (adults) .12
— any
![Page 43: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/43.jpg)
Educational Interventions
Small classes — class climate .26Tutoring — grades .20Small classes — grades .10Media campaigns — seatbelt use
.06
![Page 44: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/44.jpg)
Medical Interventions
Speech therapy — stuttering .54Bypass surgery — angina pain .37Cyclosporine — organ rejection.15Bypass surgery — mortality .07ASA — heart attack .04
![Page 45: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/45.jpg)
Violence Predictions in Context
Speech therapy — stuttering .54CBT — depression .44Bypass surgery — angina pain .37Psychopathy — violence .25-.35Psychosis — violence .20-.30Small classes — class climate .26
![Page 46: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/46.jpg)
Possibilities
It is possible to assess violence risk in a reliable and valid manner Risk factors assessed should reflect
scientific, professional, and legal considerations
Risk can — and should — be assessed in different ways
Violence risk assessments are, on average, as good as most other prognostications
![Page 47: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/47.jpg)
Impossibilities
It is impossible to make specific predictions of future violence for a given individual with a high degree of scientific precision or certainty We never know risk; we merely
estimate it assuming certain contexts God doesn’t play dice
![Page 48: Risk Assessment Possibilities and Impossibilities Stephen D. Hart Simon Fraser University](https://reader036.vdocument.in/reader036/viewer/2022070409/56649e735503460f94b7282d/html5/thumbnails/48.jpg)
Contact Information
Stephen D. Hart, Ph.D.Department of PsychologySimon Fraser UniversityBurnaby, British ColumbiaCanada V5A 1S6Tel: 604.291.5485 / Fax: 604.291.3427E-mail: [email protected]: www.sfu.ca/psychology/groups/faculty/hart