development of computerized support tools for intelligence ...development of computerized support...
TRANSCRIPT
![Page 1: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/1.jpg)
Development of Computerized Support
Tools for Intelligence Work
Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian Mårtenson, Pontus Svenson
Swedish Defence Research [email protected]
![Page 2: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/2.jpg)
Outline
Review of the intelligence businessExamples of tools to be included in a toolbox to be used by the intelligence analystThe presentation contains some preliminary work, but at the core is the vision of an intelligence toolbox—which is work to be done
ToolboxToolboxFile Edit View Navigate Window Tool Help
Tools
Report Organization andVizualisation
Text Analysis
Strategic Awareness Assistant
Summarization
Threat Scenarios
Impactorium
Situation Picture Assistant
Social Network Analysis
Attack AnalyserAttack Analyser
Impactorium
Repost Organisationand Vizualisation
Social Network Analysis
Threat Scenarios
Text Analyser
Situation Picture Assistant
Summarization
Stategic Conflict AnalyserReport Organization and
Visualization
![Page 3: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/3.jpg)
Acknowledgement
Presentation material obtained from:the intelligence research project at the National Defence College (via Per-Arne Persson),the 2008 Swedish Armed Forces intelligence doctrine (via Mårten Frambäck),colleagues at FOI,…and probably more.
Thanks!
![Page 4: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/4.jpg)
Intelligence work: deliver basic data for decision-making to commanding officer
![Page 5: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/5.jpg)
The intelligence service is both the organization and the activity producing intelligence products that describe, explain and predict “non-own” phenomena.
The intelligence service
Own Neutral Hostile Unknown/Other
Intelligence service responsibility
![Page 6: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/6.jpg)
Weekly meetingsTargetingReflection
“Intelligence-internal” RFIs
Intelligence Management Plan (Br.)Daily Asset Reconnaissance Board
The intelligence cycle and its context
![Page 7: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/7.jpg)
The ISTAR-concept: a view taken by current Swedish research efforts
Sensor control (tasking)
Heterogeneity- Sensor status- Report data
Automation?Fusion technology?
Analysts value, interpret,produce
StoreRetrieval
Data base
Sensors
MethodsTools
![Page 8: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/8.jpg)
There is a new era in the intelligence businessWhat kind of support should we develop?When is automation possible?And to what extent?
![Page 9: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/9.jpg)
Intelligence regulations from the 1980’s: what can automation do?
![Page 10: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/10.jpg)
![Page 11: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/11.jpg)
Intelligence workflow
Searching
AnalysisInput/structuringPresentation
Computer aided
Today
Automation
Time spent [%]
Time critical
![Page 12: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/12.jpg)
Information fusionJDL-model
Multi-sensor fusionSituation assessmentImpact assessmentAdaptation
Role to support intelligence analysis processTools that help humans sort, filter, fuse information and data
![Page 13: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/13.jpg)
Mixed-initiative
Techniques for taking advantage of human and computer advantages synergisticallyIncreased interaction
Human provides experience and intuitionComputer provides processing power and memory
![Page 14: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/14.jpg)
Blackboard architecture
![Page 15: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/15.jpg)
Tools
![Page 16: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/16.jpg)
Report organization and visualization
ToolboxToolboxFile Edit View Navigate Window Tool Help
Report Organization andVisualization
Text Analysis
Strategic Awareness Assistant
Summarization
Threat Scenarios
Impactorium
Situation Picture Assistant
Social Network Analysis
Attack Analyser
File Edit Tools Databases
Demonstration central city 1/mar/08 1/mar/08 12:47Demonstration at central city- 200 – 300 persons- Aggressive atmosphere- caught sight of weapons
Report Organization and Visualization
Bombing at Foo square 2/mar/08
![Page 17: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/17.jpg)
Impactorium
Impactorium
![Page 18: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/18.jpg)
Three componentsCreate model Associate reports to indicators Compute and display results
![Page 19: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/19.jpg)
Hypothesis management
Analysts need tools that allow them to visualise their hypotheses about the futureCollaborative toolsEasy to visualise movementsHow to visualise more complicated intelligence analyses
![Page 20: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/20.jpg)
Semantically tagging information by extracting knowledge from data
Semantic tagging will be a major part of analysts’ work in the future
Social networks, RDF triples, semantic wikis,…
Automating (parts of) this work would be goodEntity extraction can be used to present a list of entities to the analystMore challenging: present relations between entities (in possibly different documents)
![Page 21: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/21.jpg)
Entity extractionToolboxToolbox
File Edit View Navigate Window Tool Help
Report Organization andVizualisation
Text Analysis
Strategic Awareness Assistant
Summarization
Threat Scenarios
Impactorium
Situation Picture Assistant
Social Network Analysis
Attack Analyser
Text Analysis
Report Organization andVisualization
File Edit Tools Databases
![Page 22: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/22.jpg)
Case-based reasoning crash course
Look at current situationFind similar previously encountered situations in case databasePresent most similar case(s) to user, if possible adapt solution to current case
Defining “similar” is difficult…
![Page 23: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/23.jpg)
Tools based on case-based reasoningThreat model construction assistant
Fusion tools need modelsIdea: use CBR to help analysts create models by letting the cases correspond to “situations”Situations can be described by the currently relevant parameters in, e.g., a probabilistic model
Situation picture construction assistantThe needed views, services, etc., changes from person to person and from time to timeIdea: help analysts to select the appropriate view using CBR
![Page 24: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/24.jpg)
Threat model construction
Threat Scenarios
![Page 25: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/25.jpg)
Situation picture constructionToolboxToolbox
File Edit View Navigate Window Tool Help
Report Organization andVizualisation
Text Analysis
Strategic Awareness Assistant
Summarization
Threat Scenarios
Impactorium
Situation Picture Assistant
Social Network Analysis
Attack Analyser
Situation Picture Assistant
CrowdLargeAggressiveWeapons
Related
Information
Reports
Location
Save
Zoom
Actions
New map
Actions
Map
Report Organization andVisualization
![Page 26: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/26.jpg)
Social network visualization and analysis
Attack president
StabbShoot
Knife Close locationGun Nearby location
Work in P:s staffWork where P
goes
Hairdresser Restaurant
By knife
Gym
Social Network Analyser
![Page 27: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/27.jpg)
Social network analysis: ultimately an interactive support tool with possibility to acquire data automatically at the discretion of the analyst
![Page 28: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/28.jpg)
Attack tree assistantToolboxToolbox
File Edit View Navigate Window Tool Help
Report Organization andVizualisation
Text Analysis
Strategic Awareness Assistant
Summarization
Threat Scenarios
Impactorium
Situation Picture Assistant
Social Network Analysis
Attack Analyser
Attack president
StabbShoot
Knife Close locationGun Nearby location
Work in P:s staffWork where P
goes
Hairdresser Restaurant
By knife
Gym
Attack Analyser
Tree
Analyze
Save
New
Draw
Related
Possibilites
Min/Max
Cost
Cost
Countermeasure
Add
Suggest
Report Organization andVisualization
![Page 29: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/29.jpg)
Strategic awareness assistantToolboxToolbox
File Edit View Navigate Window Tool Help
Report Organization andVizualisation
Text Analysis
Strategic Awareness Assistant
Summarization
Threat Scenarios
Impactorium
Situation Picture Assistant
Social Network Analysis
Attack Analyser
File Edit Tools Databases
Actors Coars of Action
Assessment
Strategic Awareness Assistant
Report Organization andVisualization
![Page 30: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/30.jpg)
Strategic and tactical intelligence
Need for strategicawareness
Need for tacticaldata processingand visualization
![Page 31: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/31.jpg)
Strategic awareness in practice according to intelligence expertise
Estimate possible courses of actions:Actor A can perform actions A1, A2, A3Actor B can perform actions B1, B2, B3Actor C can perform actions C1, C2, C3
Judge what will happen given some action:A1 => B3, C2…
The judgments result in 3–5 scenarios that are used for further discussion using cognitive decision making principles:
What scenario is the most dangerous one?What scenario is the most probable one?…
![Page 32: Development of Computerized Support Tools for Intelligence ...Development of Computerized Support Tools for Intelligence Work Joel Brynielsson, Andreas Horndahl, Lisa Kaati, Christian](https://reader034.vdocument.in/reader034/viewer/2022050501/5f936ab384d9ae3e12033904/html5/thumbnails/32.jpg)
A game-theoretic assistant for strategic awareness
GUI letting the analyst:List actors (including nature), available courses of actions, and possible outcomesEstimate probabilities for outcomes
Algorithms helping out with:Probability calculationsStrategic awareness in the form of equilibria taking opposing actors into account
VisualizationRequires user experiments and creative solutions