Submarine Electro-Optical Imaging:Future Imaging System Architecture

Presented to: National Defense Industrial Association2002 Joint Undersea Warfare Conference

Presented By: Mr. Swarn Dulai, PMS 435 I&EW Chief EngineerNaval Sea Systems CommandSubmarine Sensor Systems Program OfficeImaging and Electronic Warfare

E-mail:dulaiss@navsea.navy.mil Telephone:(202)781-4331

UNCLASSIFIED

UNCLASSIFIED

NDIA SEP 02 2UNCLASSIFIED

Submarine Imaging Systems

Tomorrow

Yesterday

Today

NDIA SEP 02 3UNCLASSIFIED

Background ClutterAerosols,Turbulence

Target

Sensor Motion/Jitter

Imaging System Overview

Background

Object

Optics SensorGeneral Purpose

Processor

VideoFront-endProcessing

ImageDisplay

HumanObserver

LOS training,vibration/motion

compensation

ImageryStorage

ATMO

TC/IM

Utilize an end-to-end system approach to ensure a balanced technology insertion program

NDIA SEP 02 4UNCLASSIFIED

Submarine Imaging Systems

• Current Systems– Submarine Imaging System (SUBIS)

» Implemented as Type 18 subsystem

» Color TV Camera – Sony XC-999 (768X494 pixels)

» Color Still Pictures – Nikon D1 (2000X1312 pixels)

» Low Level Light Television (LLLTV) Camera – Xybion ISS-850 (480 TV Lines)

» Workstation for Capture / Storage / Recall

– Photonics Mast Program (PMP) (VIRGINIA CLASS Only)» Non-Penetrating Mast

» Color TV Camera - Sony 007 (640X480 pixels)

» Monochrome – Sony XCH1125 (1940X1040 pixels)

» IR Cameras - Cincinnati Electronics Night Conqueror (640X512 pixels)

» Automatic 360-degree sweep

» Imaging Processing / Storage / Recall

• Near Term Demonstrations– Integrated Imaging System (I2S)

• Future Systems– UAV/UUV Sensors

NDIA SEP 02 5UNCLASSIFIED

Planned Installations

• SUBIS– 26 Systems Procured

• 14 Installed• 12 Completed By End of FY03

– Planned Procurement for All Submarines In Process

• Photonics– VIRGINIA CLASS (Forward Fit)

• Integrated Imaging System – Automatic Rangefinder, IR, Video Mosaic Remote Control

Imaging Sensor, Automatic Object Detection and Tracking, Super Resolution, Image Fusion, Etc.

– Development completed in FY04, Installations Start FY05– Backfit all In-Service Submarine Classes

NDIA SEP 02 6UNCLASSIFIED

Imaging as Part of Submarine Modernization

Secret & below

Potentially S+

Gate Guard

ModemECS

Time Data

TFDSSensor Data

Radar

Sensor Data

ARCI

Contact Data

ECP-4

Contact Data

GCCS-M

Sensor DataImaging

NAV DataRLGN

Sensor Data

ESM

NTCSS

SEA-08Users

IT-21Users

Central Mgr,IPSec & DAR

SIPRNET

TIDSTactical LAN

TS / SCI

Modem

ECS• Imaging system sensors

provide ‘eyes’ to the tactical picture– Raw Imagery (Present)

• Color Video

• Digital Still Frames

• Low Light Level Video

– Near Term Demonstrations (I2S)

• Video Mosaic (wide field of view)

• Remote Control Imaging Sensor

• Automatic Object Detection and Tracking

• Contact parameter estimation

• Super Resolution

• Image Fusion

• Infrared Sensor

• Supports push/pull to/from other SWS subsystems

• Automated Rangefinding

NDIA SEP 02 7UNCLASSIFIED

Objectives

• Address Fleet’s Imaging Requirements – Develop an Open System Architecture for Imaging

System Technology Insertion– Establish Process to Enable Rapid Insertion of New

Technologies into Submarine Imaging Systems.– Define Hardware and Software Architecture to

Support COTS Imaging Sensors, Image Processing Algorithms, and Advanced Displays.

– Fuse Sensors Data to Provide an Enhanced Common Tactical Picture.

– Balance Performance, Cost, and Schedule

NDIA SEP 02 8UNCLASSIFIED

Building Upon the Imaging System Architecture

Imaging Sensors

Remote Control

Mosaic generationImage Fusion Tactical Control

Information ManagerWorkstation

Automated contact detection,Classification,

Parameter extraction

ONI Ship Characteristic

DatabaseImage

Enhancement

Image and Video Indexing

NDIA SEP 02 9UNCLASSIFIED

Future Integrated Imaging System (I2S)

KBD TRK GRIP

Interfaces

Periscope Function

Image Processing

HMI Display Processing

Imaging Database

Display

Display

Video M

ultiplexer

SUBIS•Color•LLLTV•Digital Still

Photonics•Color•B&W•IR

Other / Future•Video•IR•Panoramic•Etc. SWS/TIDS

Nav Data

Range

ESM Data

Sonar Data

Sensor Control

FOV, AZ, EL,

LOS Control,

Camera SelectContact Analysis

G/G

NDIA SEP 02 10UNCLASSIFIED

Video and Image Processing

Frame-to-FrameImage Stabilization

Real TimeVideo

Processing

Real TimeVideo Image

Fusion

ImageMosaic

SuperResolution

FrameIntegrate

Display Systems

Contact Analysis

Video (Color) Video (IR) Digital Still Frames

NDIA SEP 02 11UNCLASSIFIED

Contact Analysis Flow

Manual TargetMensuration

ManualContact Report

GeneratedAutomatic

TargetBounding

ShipDatabase

Contact Report

RemoteControl

AutomaticTarget

Mensuration

TargetTracking

AutomaticTarget

Detection

Contact Report

Video/StillImage

Processing

StartContact Analysis

Search

-Mosaic-Super Resolution-Frame Integrated-Image Enhanced

-Video Frame Grab-Digital Still-Enhanced Video Frame Grab-Fused Video Frame Grab-Super-Resolution Frame

ClassificationRangeAngle on Bow

Bounding boxand/or targetcontour

Bearing

Hi PriorityTargets

Available inPhotonics Mast

Geosit &Trip WireDisplay

TimeBearing

Programmed search

NDIA SEP 02 12UNCLASSIFIED

Mapping New Capabilities to Imaging System Architecture

• High Speed Imaging Sensor Processor (front end)– Frame-to-frame registration– Frame store and distribution– Video rate image fusion

• General Purpose Processor– Video rate processing (simple FIR filtering)– Contact analysis capabilities– Remote control of periscope functions – External interface management– Video and image database management– Video and image server – GUI and support function processing

• Display Processor– Display processing– Head Up Display– Virtual Reality

NDIA SEP 02 13UNCLASSIFIED

Sensor Upgrades & APB Process

Improvement AP

B

Te

sti

ng

Fle

et

Intr

o

APBVideo Image Mosaic/Scene Stitching 2002 2003 XType 8 ESM 2003 2004Super Resolution of IR Digital Output 2003 2004 XPrecision Frame Integration 2003 2004 XPeriscope Radar Range Finder 2003 2004Image Stabilization 2003 2004 XImage Fusion of IR and Visual Mosaics 2003 2004 XAutomatic Target Detection 2003 2004 XAutomated Target Bounding Box 2003 2004 XTIDS Connectivity 2003 2004Imaging Mast Workstation Replacement 2003 2004Increase Imaging System Bandwidth 2004 2005 XDigital Still Image Mosaic/Scene Stitching 2004 2005 XSuper Resolution of all Imagery 2005 2006 XAutomated Target Classification and Identification 2005 2006 XAutomated Sensor Control (Programmable Searches) 2005 2006 X

NDIA SEP 02 14UNCLASSIFIED

Challenge To Our Industry Partners

Push Technology to Improve:• Advanced Imaging Sensors For Comprehensive Spatial,

Temporal, and Spectral Coverage• High Data Rate Interface • Modular Signal and Data Processing Equipment• High Resolution Displays• Applications Software (image processing, target

acquisition, display processing) • Software Reuse

Industry Participation is KEY to Achieving Our Submarine Imaging GoalsIndustry Participation is KEY to Achieving Our Submarine Imaging Goals