sensor fusion technology assessment · to sensor fusion assessment the three parts consist of ......

John EdwardsJSSAP Office

Armament Systems Integration CenterUS Army Armament Research, Development and Engineering Center

Picatinny, NJ 07806

Presentedby

Sensor Fusion TechnologyAssessment

Program Sponsor:

MAJ Tom Young, Office of Naval Research, Expeditionary Warfare Operations Technology Division, Firepower Science & Technology Programs

Key Principal Scientist:Mr. George Ax, Northrop Grumman Mission Systems

Project Participants:Mr. Jack Lillie, US Army Night Vision Electronic Sensors DirectorateMr. Joe Costantino, US Army Armament Research, Development and Engineering Center


Objective:• Assess the state-of-the-art in small arms fire control

systems with, • Maturation projection• Outline a future road map.


Image Intensification

Thermal Imaging EO/IR Fusion Example

Project Approachto Sensor Fusion Assessment

The three parts consist of •Part One – Survey Assessment of Current Systems and Activities,

Completed; Over 125 reports identified. Addition areas of Display and Power Supplies supplement survey.•Part Two - Technology and Performance Assessment (includes discussion on Measures of Performance and Environment and Physical limits of Performance and Opportunities)

Complete•Part Three – Projection on Full Integration for a full complement of Sensor Fusion Target Acquisition/ Fire Control Systems. (Near, Mid & Far Term)

Wrapping up Final Report

Optical Systems Technology IncorporatedShared Aperature Fusion Weapon Sight

UncooledIR Camera

IR+I2 ImageCombiner

DUALBAND IR / I2 6XTELESCOPE

(IN PROTOTYPE)

CLIP-ON DUALBAND UNIVERSAL NIGHT SIGHT (DUNS)(UNCOOLED IR + IMAGE INTENSIFIER)

DUNS

(IN PRODUCTION)

UNIVERSAL NIGHT SIGHT ™ (UNS)I2 CLIP-ON 1X NIGHT SIGHT

ImageIntensifier

Dayscope

Images viewed at 4-10X

INTENSIFIED IMAGE

INFRARED IMAGE

COMBINED IMAGE

2.0 lbs

Sample Mature Available Technological Capability – Near Term

Program Goals• Dual Band Digital Image Fusion (I2/IR)

– HD I2CMOS and U7000 LWIR– 2X Digital Zoom– Fire Wire Digital Output

• Weight required: < 4 Lbs• Dimensions: 10.7”x 3.9”x 4.2” • 12 prototypes fabricated • Nested optical objectives• Digital display

Delivery Date to NVESD : May ‘04

Northrop Grumman EOS and NVESDFused Multi-Spectral Weapon Sight (FMWS)

Sample Maturing Technological Capability – Mid Term

Amplify and convert to video signal

Candidate Technologies for LLL Imaging (ITT)

• Sensor function is to create an video image based on signal inputs down to overcast starlight environment(4e-7 fL sensor illumination)

• Head mounted applications need light weight, compact, high MTF performance, low power, and low cost sensors

• Digital output desired for input into fusion systems

Light Input

Amplify and reconvert to light

Intensified Fiber-Optic Coupled Camera Sensors

Video output signal

MCPCMOS Solid State

Convert to electron signal

Light Input

Convert to electron signal

Light Input

Sample Maturing Technological Capability – Med Far Term

Focal Plane Growth

Figure 2-2. Growth in number of pixels (uncooled IR FPAs) over time.

Note: Increase in pixels have a associated cost and power increase

Value Model (selected Figure of Merit)

Task II

• Based on Multi-Objective Decision Analysis• A Means To Choose/Decide Among Competing Alternatives by

– Defining Objectives and Measures Relevant to a Decision• Quantitative• Qualitative/Subjective

– Organizing Those Objectives and Measures • Hierarchical Value Tree

– Rating Their Importance• Weights Assigned by Operational Subject Matter Experts (SME)

– Scoring Performance of Competing Alternatives on Each of the Chosen Measures

– Comparing Overall Desirability on a Consistent, Numerical Scale

What is a Value Model?

Example Value Model Baseline Suite

Normalized Weight: % Weight of Baseline SuiteAttribute's Contribution: % Weight: 100.00%Category's Overall Contribution: %

40 6040.00% 60.00%

30 40 10 20 30 409.09% 12.12% 3.03% 6.06% 9.09% 12.12%3.64% 4.85% 1.21% 2.42% 3.64% 4.85%

100100.00%

60.00%

40 40 40 20 20 012.12% 12.12% 12.12% 6.06% 6.06% 0.00%

4.85% 4.85% 4.85% 2.42% 2.42% 0.00% Sum Check: 100.00%

Value of Baseline Suite

Effectiveness Value

Performance Value

BB

Effectiveness of Baseline Suite in the Anti-Terrorist/Force Protection (AT/FP)

Scenario

A1B

Performance of

AN/PVS-7B/PEQ-2A

Performance of

Miniature Binoculars

A3B A6B

Performance of

AN/PAS-13 (V2)

Performance of

3x Mag. Device

A4B A5B

Performance of

RCO

A12B

Performance of

PEQ-6A

A11B

Performance of

AN/TVS-5A

A10B

Performance of

AN/PVS-4

A9B

Performance of

AN/PVS-17C/ PEQ-2A

A8B

Performance of

AN/PVS-17B/ PEQ-2A

A7B

Performance of

Unertl Scope

A2B

Performance of

AN/PVS-14/PEQ-2A

250

500

750

1000

1250

1500

1750

2000

2250

2500

RA

NG

EM

ETER

S

THERMALDETECTION

THERMALRECOGNITION

OPTICALIDENTIFICATION

FUSEDSENSOR

OPTICALRECOGNITION

OPTICALDETECTION

LASE

R

DES

IGN

ATO

R

WEA

PON

RiflemanM4

AutoRifleman

M4

GrenadierM4/M203

LeaderM4

60 mm(28m radius)

81 mm(38m

radius)

3500 m 6000 m

LMGA MULEACSWSJavelin

Fire Team Weapons Team

Networked Effects

Small Combat Unit Lethality

Note: Excluding the Religious Structure, no building is over two stories high (14 ft).

River

Religious

Structure

Market

Medical Facility

East Independence Blvd

Sout

h F r

eedo

m B

lvd

Government Building

School

Park

1st St. EastR

esi d

entia

l

Commercial

Residential

Shops

Open-AirMarket

(Many Small Buildings and Narrow Alleys)

Resi

dent

ial

Park

East Frontage Blvd

DefendedPerimeter

Main Gate/Checkpoint

Port/Harbor

Security

Com

mer

cial

1st St. West

West Frontage Blvd

A S

t. Ea

st East Commerce Road

Nor

th F

ree d

om B

lvd

A S

t. W

est

B S

t. W

est

C S

t. Ea

st

NarrowFootpaths

ShantyTown

(NOT TOSCALE)

500

m

750 m

West Independence Blvd

N

SS

Rifle Squad

RifleSquad

RifleSquad

MG

Fire Team Patrol Area

Alpha

B S

t. Ea

st


Bravo


Charlie

MG

Slide 22 of IPR #II Mod’d

• USMC Mission: Provide Humanitarian Aid to Local Populace

– Distribution Point at Pier– Persons Processed at Main Gate

• Marine Corps Forces– Reinforced Rifle Platoon

• 2 HMMWVs with M2 HMGs• Scout/Sniper Team• Roving Rifle Squad

• Indigenous Persons– Innocent Civilians (72)

• Non-Hostile (Seeking Food)• Proceeding Toward Port Area• If Challenged, Will Stop, Show ID Papers

And Proceed Toward Main Gate– Terrorists (24)

• Seek To Cross Defended Perimeter And Disrupt Aid Effort

• Avoid Main Gate• If Challenged, Fled But Not Fight (with

Marines in Pursuit)– Movement Began at Random Times

from Random Locations • Model fusion as sequential process (detect > pursue > acquire)

– Use Pdetection for IR devices– Use Precognition for LLL devices

Use of Pythagoras in an AT/FP Scenario

Projection on Full Integration of Target Acquisition Fire Control Small Arms

Task III

Utilize the Value Method to define sensitivity of effectiveness that includes multi aspects of consideration (maturity, technology, use, size, weight, power, weapon –sensor linkages, etc.)Task III technology forecast characterization

Not relevant eliminate from considerationMonitor: relevant, yet not mature and not ready for investmentDefine Further; opportunities for investment

Conclusions

• Conclusions– Assessment nearing completion– Physical Models are the first step to characterize

performance– Figure of Merit through Value Model aligns with JCIDs– Couples well with JCIDs for individual weapon– Logical next step to USMC Optical System Capability

Assessment

sensor fusion technology assessment · to sensor fusion assessment the three parts consist of ......

Documents