interviewing and deception detection techniques for rapid screening and credibility assessment dr....
TRANSCRIPT
![Page 1: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/1.jpg)
Interviewing and Deception Detection Techniques for Rapid Screening and
Credibility Assessment
Dr. Jay F. Nunamaker, Jr.Dr. Judee K. Burgoon
![Page 2: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/2.jpg)
2
Agenda
• Introduction• Project Phases• Project Plan
– Year One: Unique Datasets– Year One: Sensors and Tools– Year One: Tasks
1. Analysis Psycho-Physiological Datasets 2. Lexical Analysis3. Interoperable Video Database 4. Collaborative Credibility Assessment Tools
• Conclusion
![Page 3: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/3.jpg)
Introduction
• Identify verbal/non-verbal behaviors and physiological cues that indicate deception and hostile intentions in rapid screening environments
• Experimental research to evaluate and develop automated deception detection technology
• Develop questioning and information elicitation strategies for border screeners
3
![Page 4: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/4.jpg)
Project Phases
• Experimentation and analysis of credibility assessment tools– Test new deception detection technology which incorporate verbal/non-
verbal behavior and physiological measures– Prototype automated systems and enabling technologies for detecting
deception– Replicate knowledge learned in experiments in the field
• Analysis of interviewing techniques in screening scenarios – Techniques for information elicitation– Behavioral analysis and questioning strategies
• Screening and border specific analysis of detection methods– Unobtrusive methods for behavior monitoring and deception detection– Interview and screening techniques
4
![Page 5: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/5.jpg)
Project Plan
Phase Schedule (year)
1 2 3 4 5 6
(1) Experimentation and analysis of credibility assessment tools
(2) Analysis of interviewing techniques in screening scenarios
(3) Screening and border specific analysis of detection methods
5
![Page 6: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/6.jpg)
Project Plan – Year 1Unique Datasets
• Datasets for original analysis:– Cultural Benchmarks
• 220 international participants• Professionally interviewed (25 questions)• Lie or truth instructions
– Mock Crime• 134 participants• Realistic Mock theft
scenario• New Proposed Experiments
6
![Page 7: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/7.jpg)
7
Project Plan – Year 1Mock Crime: Experiment Example
Stage 1: Subject arrival at separate building
Stage 2: Subject receives instructions by recording
Stage 3: Subject arrives at secretary’s office to steal ring
Stage 4: Subject completes credibility interview about involvement in theft
![Page 8: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/8.jpg)
Project Plan – Year 1Sensors and Tools
LDV THERMAL BLINK
EYE-TRACKING
PUPILOMETRY
KINESIC
Equipment supplied by:
![Page 9: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/9.jpg)
Project Plan – Year 1 Task 1: Analysis Psycho-Physiological Datasets
• Phase 1: LDV Data Analysis (Year 1)– Unintentionally leaked psycho-physiological cues may be indicative
of deceptive behavior – “Cultural Benchmarks” experiment captured Pulse and Respiration
data via LDV– Determine if the LDV can provide cues that are indicative of
deception• Phase 2: Data from multi-sensors (Year 2)
– Cultural Benchmarks Experiment – sensor data analyzed individually – not looked at collectively• Pulse Respiration, Kinesics (Blob, ASM, Gestures, Blinking,
Pose), and Pupilometry• Phase 3: Data-fusion techniques (Year 2)
– How do we fuse data from distinct sources?– Do fusion techniques provide greater accuracy in detecting
deception?
![Page 10: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/10.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1
Perform analysis of data from LDV collected during previous deception experiment. Determine if any psycho-physiological cues emerge that indicate deceptive behavior. Deliverable is the psycho-physiological cues provided by LDV indicative of deception.
6 months
(2) Phase 2
Gather additional experimental data collected from various sensors during deception detection experiment. Format and prepare for processing. Deliverable is a formatted data set ready for analysis.
6 months
(3) Phase 3
Explore methods to fuse data into one robust algorithm. Conduct statistical analysis to determine if collectively the combined sensor output is a greater predictor of deceptive behavior.
6 months
*Year one deliverables in green
![Page 11: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/11.jpg)
Project Plan – Year 1 Task 2: Lexical Analysis
• “words whose job it is to make things more or less fuzzy” (Lakoff, 1972)
• e.g. perhaps, might, maybe, approximately• Communicates speaker’s degree of
confidence (Hyland, 1998; Coates, 1987)
• Reduces strength of a statement (Zucker & Zucker, 1986)
• Expresses tentativeness and probability• Theoretically linked to deception use
![Page 12: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/12.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1Prepare transcriptions of cultural benchmarks interviews for analysis
1 month
(2) Phase 2Refine hedging dictionaries and lexical bundle software
1 month
(3) Phase 2bParse text, generate features, run classification algorithms, run statistical analyses
2 months
(4) Phase 3Write results and discuss implications for rapid screening, articulate future investigations
2 months
*Year one deliverables in green
![Page 13: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/13.jpg)
Project Plan – Year 1 Task 3: Interoperable Video Database
Currently have many large, disparate data sources. Challenges in managing large and diverse data sets include:
• Integrating the datasets efficiently• Querying integrated data sets intelligently
• Example: Retrieve all data associated w/specific gesture• Capturing tacit information• Determining the elementary/composite data elements• Creating semantic interoperability across the datasets
In order to begin addressing these challenges, we need to begin to create a framework which will help us understand the datasets and how to manage them holistically.
Mock Crime Interviews
Cultural Benchmarks Interviews
Retrieve all data associated with shrugs
![Page 14: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/14.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1
Initial Data Framework and Recommendations – an initial data framework that integrates video datasets from two experiments. This framework will serve as discussion for the future data management directions.
6 month
(2) Phase 2Prototype Implementation –implement prototype to demonstrate solutions to various data challenges.
Through Year 6
*Year one deliverables in green
![Page 15: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/15.jpg)
Project Plan – Year 1 Task 4: Collaborative Credibility Assessment Tools
Problem: Individuals are not as accurate as machines in credibility assessment
Proposal: Use group collaboration to discover more cues to deception
First phase Deliverable: Determine feasibility of and requirements for collaboration tools for credibility assessment. Create prototype(s)
![Page 16: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/16.jpg)
Milestones and Deliverables
Milestone Description and Deliverable Timeframe
(1) Phase 1Methodically identify and adapt most useful collaboration tools
3 month
(2) Phase 2 Design software 2 month
(3) Phase 2b Create initial prototype(s)* 1 month
*Year one deliverables in green
![Page 17: Interviewing and Deception Detection Techniques for Rapid Screening and Credibility Assessment Dr. Jay F. Nunamaker, Jr. Dr. Judee K. Burgoon](https://reader035.vdocument.in/reader035/viewer/2022081603/56649ecf5503460f94bdd5db/html5/thumbnails/17.jpg)
Conclusion
• Identify verbal/non-verbal behaviors and physiological cues that indicate deception and hostile intentions in rapid screening environments
• Experimental research using unique datasets to evaluate and develop: – Automated deception detection technology– Experimental research to evaluate and develop automated
deception detection technology
• Four proposed tasks with deliverables in Year One