Quality in Quality in Forensic ServiceForensic ServiceAccuracy & Reliability Are Accuracy & Reliability Are Present, Just Like on CSI, Present, Just Like on CSI,

Right?Right?

Massachusetts State Police Crime LaboratorySudbury, Massachusetts

Carl M. Selavka, Ph.D., D-Carl M. Selavka, Ph.D., D-ABCABC

DirectorDirector

And Now,And Now, A Word A Word From My From My Sponsor:Sponsor:

DisclaimersDisclaimersThe opinions The opinions expressed in this expressed in this presentation are presentation are those of the author those of the author and do not necessarily and do not necessarily represent the official represent the official positions of the:positions of the:

Disclaimed Disclaimed AgenciesAgencies

Commonwealth of Commonwealth of MassachusettsMassachusettsExecutive Office of Public Executive Office of Public SafetySafetyDepartment of State PoliceDepartment of State PoliceCrime Laboratory SystemCrime Laboratory System

Disclaimed Disclaimed AgenciesAgencies

NIJNIJ AAFSAAFSDHHSDHHS ASCLDASCLDABCABC NEAFS NEAFS FEPACFEPAC ACSACS

Disclaimed Disclaimed AgenciesAgencies

NCST&NCST&LL

(Participants, Attendees, Those Actually (Participants, Attendees, Those Actually Awake)Awake)

ThatThatTitleTitle

• The Real Forensic The Real Forensic World World • Quality is Easy, Quality is Easy, Right?Right?• Structure from ChaosStructure from Chaos• Legal SynergyLegal Synergy• This is GOOD!This is GOOD!

Presentation Presentation SummarySummary

• From Crime Commission to From Crime Commission to DiscoveryDiscovery• On-Site First-Responders & On-Site First-Responders & InvestigatorsInvestigators• Evidence Recognition, Presentation Evidence Recognition, Presentation to Key to Key Responders, Documentation, Responders, Documentation, Collection Collection & Transport Integrity& Transport Integrity• Triage to Avoid Exhaustive Triage to Avoid Exhaustive ExaminationsExaminations• The Examinations Themselves….The Examinations Themselves….

The Real Forensic The Real Forensic WorldWorld

• Interpretations of Elicited & Missing Interpretations of Elicited & Missing DataData• Contextual Elements Insure Contextual Elements Insure “Probative” “Probative” Forensic ReportsForensic Reports• Iterative Evidentiary Management Iterative Evidentiary Management Yields Yields “Non-Advocacy” Credibility“Non-Advocacy” Credibility• Presentation in Court Provides Presentation in Court Provides Forensic Forensic DefensibilityDefensibility

The Real Forensic The Real Forensic WorldWorld

Quality AssuranceQuality Assurance

• QualityQuality (Webster’s II – 1984)(Webster’s II – 1984)

Essential CharacterEssential Character An Inherent AttributeAn Inherent Attribute Degree of ExcellenceDegree of Excellence

• AssuranceAssurance A Statement Intended to A Statement Intended to Inspire Inspire ConfidenceConfidence

Quality in Forensic Quality in Forensic ScienceScience

Ideal Lab ManagementIdeal Lab Management• Is Our QA Program Is Our QA Program Proper?Proper?• Is the Personnel Is the Personnel System OK?System OK?• Do We Use Good Do We Use Good Science?Science?• Do We Report Do We Report Correctly?Correctly?• Are We Defensible?Are We Defensible?

InfrastructureInfrastructure

Accreditati

Accreditati

onon

Certi

ficat

i

Certi

ficat

i

onon

StandardizatiStandardizationon

Quality Quality ControlControl

QualityQualityAssuranceAssurance

NationalNationalStandardsStandards

InfrastructureInfrastructure

Accreditati

Accreditati

onon

Quality AssuranceQuality Assurance

ASCLD/LAASCLD/LABB

ASCLD / LABASCLD / LABAmerican Society American Society

of Crime of Crime Laboratory Laboratory Directors / Directors / Laboratory Laboratory

Accreditation Accreditation BoardBoard

Other AccreditationsOther Accreditations• ISO 17025 (Guide ISO 17025 (Guide 25)25)• NAME – NAME – Death Death InvestigationInvestigation• IAI – FingerprintsIAI – Fingerprints• AFTE – Firearms, AFTE – Firearms, TMsTMs• ABFT – ToxicologyABFT – Toxicology

Other AccreditationsOther Accreditations• NATA, SCC, NATA, SCC, NAMASNAMAS• See the URL for See the URL for More:More:

www.ascld-lab.org Click On “Resources”Click On “Resources” Click “Forensic Links” Click “Forensic Links” and and you’ll get 36 you’ll get 36 Recognized Sites!!Recognized Sites!!

Why ASCLD / LAB?Why ASCLD / LAB?

• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based

InfrastructureInfrastructure

Accreditati

Accreditati

onon

Certi

ficat

i

Certi

ficat

i

onon

Is the Personnel System OK?Is the Personnel System OK?

ABC ABC ((www.criminalistics.com)

ABFT ABFT ((www.abft.org)

IAI IAI ((www.theiai.org)

Certification is Certification is NOT an End Unto NOT an End Unto

ItselfItselfCertification is a Certification is a passageway - a passageway - a commitment to commitment to

continued professional continued professional developmentdevelopment

Proficiency Tests (PTs)Proficiency Tests (PTs)

RecognizeRecognizePossiblyPossiblyDeviantDeviantResultsResults

• Differentiate Anecdotal Differentiate Anecdotal Issues Issues From Systemic From Systemic Performance Performance Improvement Improvement OpportunitiesOpportunities• Document Corrective Document Corrective ActionsActions• Reestablish CompetencyReestablish Competency

DocumentationDocumentation

That QA That QA Guarantee…Guarantee…

Change theChange theExaminer’sExaminer’s

JobJob

Why Is This a Good Approach Why Is This a Good Approach to Certification?to Certification?

• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based

• AccreditationAccreditation – ASCLD/LAB & – ASCLD/LAB & OthersOthers

• CertificationCertificationAAFS Forensic Specialties AAFS Forensic Specialties Accreditation BoardAccreditation Board

2004 NIJ Guide 2004 NIJ Guide – Appendix – Appendix C C

9 FSAB-Recognized Programs9 FSAB-Recognized Programs 14 Organizations Listed14 Organizations Listed

Quality in Forensic Quality in Forensic ScienceScience

InfrastructureInfrastructure

Accreditati

Accreditati

onon

Certi

ficat

i

Certi

ficat

i

onon

StandardizatiStandardizationon

Do We Use Good Science?Do We Use Good Science?Do We Report Correctly?Do We Report Correctly?

T/SWG - T/SWG - ______

ASTMASTM

T / SWGT / SWG

Technical Technical oror Scientific Working Scientific Working

GroupGroupfor / on _____ for / on _____ (18 Total)(18 Total)

Technical WG = NIJTechnical WG = NIJ• TWG-BSITWG-BSI

Bombing Scene Bombing Scene InvestigationInvestigation• TWG-CSITWG-CSI

Crime Scene Crime Scene InvestigationInvestigation• TWG-DITWG-DI

Death InvesigationDeath Invesigation

• TWG-DETWG-DEDigital EvidenceDigital Evidence

• TWG-EYEETWG-EYEEEyewitness Eyewitness

EvidenceEvidence• TWG-FASITWG-FASI

Fire/Arson Scene Fire/Arson Scene InvestigationInvestigation• TWG-MFFITWG-MFFI

Mass Fatality Forensic IDMass Fatality Forensic ID

Scientific WG = FBIScientific WG = FBI• SWG-STAINSWG-STAIN

Bloodstain Pattern Bloodstain Pattern AnalysisAnalysis• SWG-DESWG-DE

Digital EvidenceDigital Evidence• SWG-DAMSWG-DAM

DNA Analysis MethodsDNA Analysis Methods

• SWG-GUNSWG-GUNFirearms and ToolmarksFirearms and Toolmarks

• SWG-FASTSWG-FASTFriction Ridge Friction Ridge

Analysis, Analysis, Study and Study and TechnologyTechnology• SWG-ITSWG-IT

Imaging TechnologiesImaging Technologies

• SWG-MATSWG-MATMaterials AnalysisMaterials Analysis

• SWG-MGFSWG-MGFMicrobial Genetics & Microbial Genetics &

ForensicsForensics• SWG-DOCSWG-DOC

Forensic Document Forensic Document ExamExam

Scientific WG = DEAScientific WG = DEA• SWG-DRUGSWG-DRUG

for thefor the Analysis of Seized Analysis of Seized DrugsDrugs

• TWG-FEXTWG-FEXFire & Explosions Fire & Explosions

InvestigationsInvestigations

Technical WG = NCFSTechnical WG = NCFS

ASTMASTMAmerican Society American Society

for Testing & for Testing & Materials – Materials –

Committee E30 on Committee E30 on Forensic SciencesForensic Sciences

(Now ASTM International)(Now ASTM International)

ASTM InternationalASTM International• 9 E30 Technical 9 E30 Technical GroupsGroups• 6 E30 Specialty 6 E30 Specialty GroupsGroups• 25 E30.01 25 E30.01 Criminalistics Criminalistics StandardsStandards

• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based

Why Is This a Good Approach Why Is This a Good Approach to Standardization?to Standardization?

• AccreditationAccreditation – ASCLD/LAB & Others– ASCLD/LAB & Others

• Certification Certification – AAFS FSAB & Others– AAFS FSAB & Others

• Standardization Standardization ASTM Committee E30 on Forensic ASTM Committee E30 on Forensic SciencesSciencesNIJ, FBI, DEA and NCFS SponsorsNIJ, FBI, DEA and NCFS Sponsors

2004 NIJ Guide 2004 NIJ Guide – Appendix D– Appendix D 19 Standardization Groups19 Standardization Groups

Quality in Forensic Quality in Forensic ScienceScience

InfrastructureInfrastructure

Accreditati

Accreditati

onon

Certi

ficat

i

Certi

ficat

i

onon

StandardizatiStandardizationon

QualityQualityForensicForensicServicesServices

• National Agencies?National Agencies?• State Agencies?State Agencies?

NY, OK, TX NY, OK, TX Crime LaboratoriesCrime Laboratories Exempt Categories PlentifulExempt Categories Plentiful Examiners = NOExaminers = NO

• Municipal Agencies?Municipal Agencies?• Local Governments?Local Governments?

RequiredRequired Quality Quality AssuranceAssurance

NO!NO!

What You What You Should Should Expect Expect From From

Forensic Forensic PractitionerPractitioner

ss

Practical Practical Quality Quality

GuaranteesGuaranteesWe ProvideWe Provide

FEPACFEPACForensic Forensic Science Science

Education Education Programs Programs

Accreditation Accreditation CommissionCommission

InfrastructureInfrastructureAccreditatiAccreditationon

Cert

ifica

tiCe

rtifi

cati

onon

StandardizatiStandardizationon

QualityQuality ForensicForensic ServicesServices

Educational Educational HarmonizationHarmonization

• Accuracy is NOT EnsuredAccuracy is NOT Ensured• Reliability is NOT Reliability is NOT EnsuredEnsured• In Our Advocacy In Our Advocacy Process, Process, Accuracy & Accuracy & Reliability Rest Reliability Rest in the Eye in the Eye of the Beholderof the Beholder

QA Take-Away:QA Take-Away:

Can You All Now Run Can You All Now Run With the Big Dogs?With the Big Dogs?

Yes, You Can.Yes, You Can.

AcknowledgementAcknowledgementssNCST&L Organizing NCST&L Organizing Committees & Leadership Committees & Leadership TeamTeam - - Professor Carol HendersonProfessor Carol HendersonMassachusetts State Massachusetts State PolicePolice -- Colonel Robbins & Command StaffColonel Robbins & Command Staff -- MSP Crime Lab SystemMSP Crime Lab System