unclassified//for official use only unclass/fouo...

Click to edit Master title styleUNCLASS/FOUO

AMERICA’S ARMY:THE STRENGTH OF THE NATIONClick to edit Master title style

UNCLASS/FOUOAMERICA’S ARMY:THE STRENGTH OF THE NATION

UNCLASSIFIED//FOR OFFICIAL USE ONLY

Dr. Russell D. Richardson, G2/INSCOM Science AdvisorDr. Russell D. Richardson, G2/INSCOM Science Advisor

11UNCLASSIFIED//FOR OFFICIAL USE ONLY


UNCLASSIFIED

Semantic Enrichment of the DataSemantic Enrichment of the Data

Solving the Precision / Recall Conundrum with Semantic Enrichment of the Data

Solving the Precision / Recall Conundrum with Semantic Enrichment of the Data

Precision

Concepts/Summarization (e.g. Terrorist Cell Leaders)Concepts/Summarization (e.g. Terrorist Cell Leaders)

Resolved Entity (J h ith ID )Resolved Entity (J h ith ID )

IncreasingSemanticRichness Semantically

Labeled Data

Precision

y Centric

Resolved Entity (John with ID xxxxx)Resolved Entity (John with ID xxxxx)

Entity (Person, Object, Organization, Location)Entity (Person, Object, Organization, Location)

Entity

Multi‐token/Lemma/Contexual Element/Part of Speech (Noun, Pronoun, Punctuation)Multi‐token/Lemma/Contexual Element/Part of Speech (Noun, Pronoun, Punctuation)

Token (Aggressively Indexed Words)Token (Aggressively Indexed Words)Aggressively IndexIncreasingRecall

De‐Anonymization of Large Data SetsDetect / Match Behaviors and Patterns

Enabled by fine grain security and compliance enforcement

gg y

Determine that Two Patterns of Life are the Same butNot Necessarily Whose Pattern of Life Determine that Two Patterns of Life are the Same butNot Necessarily Whose Pattern of Life

IncreasingAnonymity

ntric

Massive Data Sets for Anomaly / Change Detection

Massive Data Aggregation for Machine Analytics, Baselining, and Trend Analysis

Indications and WarningsIndications and Warnings

Non‐Attributable Aggregate Behavior ‐ Determine Avg Traffic Speed by Tracking Cell MovementDetermine the Sentiment of a Town City Region Country

Non‐Attributable Aggregate Behavior ‐ Determine Avg Traffic Speed by Tracking Cell MovementDetermine the Sentiment of a Town City Region Country

Non-Attributable

opulation Cen

‐ Determine the Sentiment of a Town, City, Region, Country‐ Determine the Sentiment of a Town, City, Region, Country

Po

22UNCLASSIFIED


Extending Cloud-Enabled Advanced Analytics

Extending Cloud-Enabled Advanced Analytics

AllAll--Source Source Analytics for ‘Big Data’Analytics for ‘Big Data’AllAll--Source Source Analytics for ‘Big Data’Analytics for ‘Big Data’with Advances in with Advances in

Geospatial Indexing, Geospatial Indexing, Voice Index and Search, Voice Index and Search,

Bi t i E tit M tBi t i E tit M t

with Advances in with Advances in Geospatial Indexing, Geospatial Indexing,

Voice Index and Search, Voice Index and Search, Bi t i E tit M tBi t i E tit M t VoiceVoiceMobileMobileBiometric Entity Management, Biometric Entity Management,

Motion Imagery Tracks, Motion Imagery Tracks, MultiMulti--INT Visualization,INT Visualization,

C ll ti M tC ll ti M t

Biometric Entity Management, Biometric Entity Management, Motion Imagery Tracks, Motion Imagery Tracks, MultiMulti--INT Visualization,INT Visualization,

C ll ti M tC ll ti M t

VoiceVoiceMobileMobile

Collection Management,Collection Management,Support for Mobile Devices,Support for Mobile Devices,

Powerful Compute Platforms,Powerful Compute Platforms,MultiMulti Level SecurityLevel Security

Collection Management,Collection Management,Support for Mobile Devices,Support for Mobile Devices,

Powerful Compute Platforms,Powerful Compute Platforms,MultiMulti Level SecurityLevel SecurityMultiMulti--Level Security, Level Security,

IC Shared Software, IC Shared Software, ….….MultiMulti--Level Security, Level Security,

IC Shared Software, IC Shared Software, ….….

UNCLASSIFIED

Motion Imagery TracksMotion Imagery Tracks


AMERICA’S ARMY:THE STRENGTH OF THE NATION Fusion ChallengesFusion Challenges

INTs

SocialMedia Pattern of Life

Tipping and Cueing• Alerts & Notifications• Information and Situation

Media

All Source

Pattern of Life Analysis

Person

Location

• Sensors• Information requests

TacticalReports

HUMINT

Challenges1. Cross INT Correlation2 Entity Resolution and1. Cross INT Correlation2 Entity Resolution and

Threat Characterization

Persistent and Total Entity and Asset Tracking in Entity

Database

Org

Unit

…

Biometrics

2. Entity Resolution and Disambiguation

3. Scale of the Entity Database4. Velocity of Data Collection and

Processing5 D t i i P tt f Lif

2. Entity Resolution and Disambiguation

3. Scale of the Entity Database4. Velocity of Data Collection and

Processing5 D t i i P tt f LifCOABiometrics

DOMEX

5. Determining Patterns of Life and Major Combat Operations with Tolerance to Errors

6. Ranking Threat Severity and Timing

5. Determining Patterns of Life and Major Combat Operations with Tolerance to Errors

6. Ranking Threat Severity and Timing

ISR Optimization

COAAnalysis

SIGINT

GEOINT

Cyber

7. Optimizing / Synchronizing ISR8. Real‐time Tipping and Cueing 7. Optimizing / Synchronizing ISR8. Real‐time Tipping and Cueing

Continuously & Always Correlating All Data into the Entity Database

4

y Data into the Entity Database


AMERICA’S ARMY:THE STRENGTH OF THE NATION Need to Work Entity Tracking

SocialMedia

Threat Characterization

P1P2P3

(T1,L1) (T2,L1) (T3,L3)(T2,L3) (T3,L3) (T4,L3)(T1 O1) (T3 L3) (T3 L2)

Same Time, Same PlaceEntity Database

Persist Tracks 3 COAs

Person

Location

…

P3P4P5

L1L2

(T1,O1) (T3,L3) (T3,L2)(T1,L2) (T2,L2) (T3,L3)(T1,L1) (T2,L2) (T3,L3)

(T1,P1) (T2,P1) (T1,P4)(T3,P3) (T1,P4) (T2,P5)

Database

ted

base

FormLinks

L2 may be an important location as many P’s have been reportedOrg

Unit

…

Reports/

HUMINT

…

L3L4

O1O2O3

( ) ( ) ( )(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)

(*,L1) (T1,P1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)(T1 L1) (T2 L1) (T3 L3)

Precorrelat

Linked

Data as many P s have been reported

being there

…

Biometrics

DOMEX

…

O3O4O5

U1U2

(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)

(T1,L1) (T2,L1) (T3,L3)

(T1,L1) (T2,L1) (T3,L3)(T1 L1) (T2 L1) (T3 L3)

1 2 Patterns of Life Determined

DOMEX…

U2U3U4U5

(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)

T1 (P1 L1) (P3 L1) (T3 L3) Location of P1 over timeInfer P3 at L1 as O1 is at L1

P1 and P3 share location pattern

SIGINT

GEOINT

Cyber …

T1T2T3T4T5

(P1,L1) (P2,L3) (T3,L3)(P1,L3) (P3,L3) (T3,L3)(P2,L3) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)

(P1,L1) (P3,L1) (T3,L3)

Optimize ISR4

5

ISR


AMERICA’S ARMY:THE STRENGTH OF THE NATION

The DCGSThe DCGS--A ICITE Cloud (aka Red Disk) A ICITE Cloud (aka Red Disk) atat--Scale Entity DatabaseScale Entity Database

• EDH• Provenance• TDF• Metadata taggingG l i

Data Interoperability Enterprise Context

Decreases Information

Burden Sensors

Data Access Process ‐ User’s authorizations

• Geo temporal extraction• Entity extraction and nomination• Artifact enrichment• Security Labeling• Metrics• moreSources DIAS User’s

Full Spectrum Analytic Awareness

authorizations and roles are

matched to data security labels

UCD

NIFI / StormRTAAP

Sources

• SIGINT• MTI• WAMI• FMV• TED

Velocity &

Content

Authorizations

Artifacts,Real‐Time Community UCD• TED• Fires• Harmony• USMFT• Collection Mgmt

Artifacts, Terms

Statements

Analytics and indexes updated

h if

Advanced Analytics Pipeline … updating analytics earliest as possible. Analyst’s

conclusions enrich the UCD

yPartners

• Open Source

• Mission Command

• Audio• etc

M RM R

wrt to each artifact

• Maximally correlated data• Contextual‐based navigation• All data under a common representation to enable

• Classes of relationships determined at various points

• No all relationships need to be explicitly expressed – correlations enable this

• All analytic disciplines together withM/RM/R

• Enrichment• Analytics and indexes wrt

to the entire corpus,• Bulk and incremental

All data under a common representation to enable assess to all layers

• Cross corpus analytics without custom code• Signatures are analyzed in real time• Logical representation needs to be consistent in

order for the physical model and view to be

• All analytic disciplines together with correlated data among all disciplines

Analytic models are represented in the UCD

6

Bulk and incremental updates

• Data sharing

p ydynamic

unclassified//for official use only unclass/fouo...

Documents