2004 05 intelligence processing seminar

26
® Processing Make the Most of What You Know Robert David Steele Intelligence Coach [email protected]

Upload: robert-david-steele-vivas

Post on 29-Jun-2015

87 views

Category:

Data & Analytics


0 download

DESCRIPTION

Overview of intelligence processing (not done well by anyone)

TRANSCRIPT

Page 1: 2004 05 intelligence processing seminar

®

ProcessingMake the Most of What You Know

Robert David SteeleIntelligence Coach

[email protected]

Page 2: 2004 05 intelligence processing seminar

®

Bangalore, IndiaNo computers, no bus passes

• If you think you have it bad, consider Bangalore, India.

• 99 people have to depend on one jeep, five motorcycles, and a scooter.

• No bus passes, no training, no computers.

Page 3: 2004 05 intelligence processing seminar

®

National Drug Intelligence CenterProcessing Makes A Strategic Difference

• Telling a story: DEA 900 files, FBI 90 files

• Case file benefits: visualizing the data for deep understanding

• Inter-agency benefits: providing an incentive for sharing leads

Page 4: 2004 05 intelligence processing seminar

®

• Automated processing is vital to making sense of vast quantities of information.

• Pattern analysis & anomaly detection are the primary objectives--the human mind will provide the understanding.

Processing ObjectivesPattern analysis & anomaly detection

Page 5: 2004 05 intelligence processing seminar

®

Collection ManagementCan’t do CM without processing

• If you don’t know what you already know, and if you don’t know what your critical information gaps are, you cannot do effective collection management or case development.

Page 6: 2004 05 intelligence processing seminar

®

• Our first mistake is to treat people as “free” goods.

• Our second mistake is to assume that an analyst can make sense of information simply by reading and thinking.

TH

E N

AK

ED

AN

AL

YST

AnalysisCan’t do analysis without processing

Page 7: 2004 05 intelligence processing seminar

®

Processing Pre-Requisite #1Data handling standards

• Digitization of data at the point of acquisition makes everything else easier.

• Agreeing on common data handling standards compatible with web-based information sharing is helpful.

Page 8: 2004 05 intelligence processing seminar

®

Processing Pre-requisite #2Geospatial attributes

• Adding geospatial attributes to your data will increase its processing value by 100X to 1000X!

• Geospatial and time attributes are what make automated fusion and pattern detection possible.

Page 9: 2004 05 intelligence processing seminar

®

Processing Pre-requisite #3Interoperability

• Interoperability of digital data is vital.– Among the seven

national tribes

– Among regional military commands

– Among military and non-governmental organizations including foreign businesses

Page 10: 2004 05 intelligence processing seminar

®

TECHNICAL HUMAN

III - External InformationEXTERNAL

INTERNAL

OrganizationalMemory System

DataConversion

DataVisualization

HeterogeneousSearch & Retrieval

TripReports

Churning(Rotationals)

LocalKnowledge

Expert Hires“Just Enough,Just in Time”

Internal Reporting

Vendor Reporting

Government Monitoring

Customer Monitoring

Environmental Monitoring

Technology Monitoring

CHUNKS(Intellectual Property)

PERSONALITY(Insight/Intuition)

Patents, Etc.

Trade Secrets

Meta-Data

Knowledge Capital™

Rolodexes/E-Mail

Personal Brand

Out-Sourcing ofInformationProcessing

Project/GroupManagement

Training

BusinessIntelligenceInstitutionalized

E-Commerce

Automated Analysis

Cell #

IV - Organizational Intelligence

I - Knowledge Management II - Collaborative Work

The Big PictureFour processing quadrants

Page 11: 2004 05 intelligence processing seminar

®

Processing Quadrant #1Knowledge Management

• Know what you know• Do not lose data,

insights, links• Integrate people,

projects, vendors, times, places, objects

• Optimize application of technology to internal information

INTERNAL

• Internal Reporting

• Vendor Reporting

• Project Management

• Data Conversion

• Automated Analysis

Page 12: 2004 05 intelligence processing seminar

®

Processing Quadrant #2Collaborative Work

• Human Capital• Inherent in People• Who They Know• How They Know• When They Know• What They Do• Who They Tell• How They Feel

INSIGHT• Employee BrandNames

• Rolodexes

• E-Mail Directories

• Cell Telephone Networks

• Trip Reports

• Rotationals

• Training

Page 13: 2004 05 intelligence processing seminar

®

Processing Quadrant #3External Information Acquisition

• Peter Drucker says this is the next 50 years of innovation

• OLD: spend on technology

• NEW: spend on external information in all languages, from all sources, all the time

EXTERNAL

• Local knowledge

• Expert hires “just enough, just in time”

• Customer monitoring

• Government monitoring

• Technology monitoring

• Environment monitoring

Page 14: 2004 05 intelligence processing seminar

®

Processing Quadrant #4Organizational Intelligence

• Data standards• Data entry mandated• Storage & retrieval• Historical access

without legacy system training

• Employee shoeboxes integrated/not lost

MEMORY

• Intellectual Property

• Organizational Memory

• Meta-Data

• History of Information

• Electronic/Human Links

• Survive Human Turnover

Page 15: 2004 05 intelligence processing seminar

®

Conversion of Paper Documents to Digital Form

Automated Extraction of Data Elements From

Text and Images

Standardizing and Converting Data Formats

Processing Images, Video, Audio, Signal Data

Automated Foreign Language

Translation

Open Literature Non-Text Data Restricted Information

Detection of Alert Situations

Clustering and Linking of

Related Data

Statistical Analysis to Reveal

Anomalies

Detection of Changing Trends

Interactive Search and Retrieval of

Data

Graphic and Map-Based Visualization

of Data

Modeling and Simulations

Collaborative Work

Notetaking and Organizing Ideas

Structured Argument Analysis

Desktop Publishing and

Word Processing

Production of Graphics, Videos and

Online Briefings

Revision Tracking and Realtime Group

Review

Finished Intelligence and Reporting

A

B

C

Processing Desktop:

Generic Analytic Functionalities

Page 16: 2004 05 intelligence processing seminar

®

Processing DesktopNo Easy Solutions

PlanPlan

ExtendExtend

ReportReport

ShareShare

OSALAT

Copernic CollectCollect

Excaliber

Topic

Analyst WorkbenchIdentifier, SIFT,

OnTopic, Labrador

GMS, Athens

Aerotext

Intelligent MinerFor Text

AnalyzeAnalyze

Content Extractor

Information Portal,Comprendium

ClearForest Suite

CrimeLink

Analyst Notebook

**C-4-U Scout

**CI Spider

**Knowledge.Works

**Market Signal Analyzer

**E-Sense

**Corporate Intelligence Service

**TextAnalyst**Plumtree Corporate Portal

**Powerize

**Strategy!

**Wincite

**WisdomBuilder

** Previously reviewed in the Fuld & Co. Software Report

Groove?

EDGE?

MindMap?

SYSTRAN+?

Other CATALYST

Elements?

Page 17: 2004 05 intelligence processing seminar

®

Emerging Technologies #1Digitization of documents

• Battlefield digitization is no longer an issue

• Battlefield translation is no longer an issue

• What is missing is the leadership willingness to link troops to both processing and expert translators.

Page 18: 2004 05 intelligence processing seminar

®

Emerging Technologies #2Visualization of links in text

• Visualization of links among people, vehicles, weapons, and bank accounts is no longer an issue.

• What is missing is the leadership commitment to arming troops with intelligence

Page 19: 2004 05 intelligence processing seminar

®

Emerging Technologies #3Peer-to-peer computing & communications

• Networked “side to side” intelligence is vastly more effective than up and down chain of command intelligence.

• What is lacking is a leadership commitment to training and then trusting the troops.

Page 20: 2004 05 intelligence processing seminar

®

Processing Solution #1Internet as common operating environment

• War and operations other than war are now a “come as you are” situation, with ad hoc allies that cannot be anticipated.

• Only the Internet offers a global C4I solution for mix and match people, equipment, and data.

Page 21: 2004 05 intelligence processing seminar

®

Processing Solution #2Open source software & security

• European Community has the right idea--open source software is the wave of the future

• Security must be in the software, not the hardware or the physical controls

Page 22: 2004 05 intelligence processing seminar

®

Processing Solution #324/7 “Plots” at every level

• Need “plots” at the township, city, province, and national levels, as well as special regional intelligence centers

• Sources, geospatial processing, and analysts must merge

Page 23: 2004 05 intelligence processing seminar

®

Recommendation #1National “skunkworks” for seven tribes

• Neither the government nor the business world will solve the processing problem alone.

• Need a national “skunkworks” where open sources and open software can be safely integrated

Page 24: 2004 05 intelligence processing seminar

®

Recommendation #2Push NATO and USA for web-based sharing

• Help the European Community focus on the urgency of insisting that NATO and the USA migrate to a web-based approach to sharing all information, at every classification level. This is a Native American ethic.

Page 25: 2004 05 intelligence processing seminar

®

Recommendation #3Internet, Wireless, Spectrum

• Extend the Internet to every street corner

• Go wireless, with encryption, quickly

• Free up as much spectrum as possible--South Korea is the leader, not the USA

Page 26: 2004 05 intelligence processing seminar

®

Creating a Smart NationConnect Content Coordinate C-ecurity

• Connectivity everywhere• Content is digitized• Coordination of

standards and investments

• C4 Security across all seven tribes--public safety at same level as safety of secrets