test & evaluation/science & technology (t&e/s&t) … & evaluation/science &...

Test & Evaluation/Science & Technology (T&E/S&T) Program

Ron Barrett Principal Engineer, T&E/S&T Program

Test Resource Management Center (TRMC)

Legend: Army, Navy, AF, Defense Agency

The STEWARD of the DoD Test Infrastructure Major Range and Test Facility Base (MRTFB): The “Critical Core”

24 Sites: Army-9; Navy-6; Air Force-7; Defense Agency-2

18,000 sq. mi. of land

180,000 sq. mi. of air space

( > ½ of all DoD land)

30,000 personnel

Military, Gov, Contractor

Replacement Value = $25B

Keyport

China Lake

30th Space Wing

Point Mugu

Air Force Flight Test Center

Yuma

Nevada Test and Training Range

Utah Test and Training Range

West Desert Test Center

White Sands Test Center

High Energy Laser Systems Test Facility

Electronic Proving Ground

PMRF

U.S Army Kwajalein Atoll

DISA,JITC 46th Test Wing (Includes 46th Test Group)

Atlantic Undersea Test

and Evaluation Center

45th Space Wing

Arnold Engineering Development Center

Naval Air Warfare Center-Aircraft Division

Aberdeen Test Center

DISA,NCR

Cold Region

Test Center, AK

Tropic Region Test

Center, HI & Puerto Rico

DoD Directive 3200.11

Established in FY2002

Develops technologies required to test future warfighting capabilities

BA 3 RDT&E funds

~$95M / year

8 Test Technology Areas Electronic Warfare

Cyberspace

High Speed/Hypersonics

Autonomous Systems

Net-Centric Systems

Directed Energy

Advanced Instrumentation

Spectrum Efficiencies


Provides infrastructure for distributed Joint and Cyberspace testing

BA 5 RDT&E funds

~$10M / year

68 current sites Expanding to 74 sites

Maintains Network connections

Security agreements

Integration software

Interface definitions

Distributed test tools

Reuse repository


Develops or improves test capabilities that have multi-Service utility

BA 4 RDT&E funds

~$150M / year

60 current projects

29 projects developing core Joint capabilities

– 3 projects improving interoperability test cap.

13 projects improving threat representations used in testing

18 projects addressing near-term OT shortfalls

T&E/S&T CTEIP JMETC

TRMC Investment Programs

Overview

T&E Capability Development Cycle

CTEIP and

Services I&M

Operations

and Support

C B A

Use T&E

Capabilities

IOT&E uses

capabilities

Articulate T&E

Requirements

Engineering and

Manufacturing

Development

Materiel

Solution

Analysis

Technology

Development

Production

and

Deployment

Begin

System

T&E

Planning

Cycle for Test Capability Development Must Begin Early

T&E/S&T

Program

Challenge: T&E Capabilities must be available in time to provide

useful insight to decision-makers and warfighters

T&E/S&T Test Technology Areas

•Technologies to Test Emerging Warfighting Capabilities

– Cyberspace Warfare

– Directed Energy Weapons

– Electronic Warfare

– High Speed Systems

– Net-Centric Systems

– Unmanned and Autonomous Systems

•Technologies to Enhance the Test Infrastructure

– Advanced Instrumentation Systems

– Spectrum Efficiency

Established in FY02

Joint DDR&E / DOT&E Initiative

Transitioned to TRMC in FY05

RDT&E Budget Activity 3 funds

Purpose

High Risk / High Payoff R&D for Testing

Foster technology transition to major DoD test ranges

Risk reduction for test capabilities developments

80 Active Projects

Annual Broad Agency Announcements (BAAs) Academia

Industry

Government Laboratories

Tri-Service working groups Validate requirements

Evaluate proposals

Facilitate technology transition

Central Oversight – Distributed Execution

High Speed

Systems

13 Active Projects

Eight Test Technology Areas

Directed Energy

17 Active Projects

Cyberspace

2 Active Projects

Net-Centric Systems

7 Active Projects

Electronic Warfare

16 Active Projects

Unmanned &

Autonomous Systems

3 Active Projects

Advanced

Instrumentation

8 Active Projects

Shaping Technology into Tomorrow’s T&E Capabilities

T&E/S&T Program Overview

FY 2011 FY 2012 FY 2013 FY 2014 FY 2015 FY 2016 FY 2017

$94.6M $96.6M $92.6M $94.0M $95.8M $98.4M $100.2M

Spectrum

Efficiency

14 Active Projects

Mission: Develop Technologies Required to Test Future Warfighting Capabilities

Arizona State University

Brigham Young University

Carnegie Mellon University

Case Western Reserve Univ.

Columbia University

Cornell University

Embry-Riddle Aeronautical Univ.

Fayetteville State University

Florida International University

George Washington University

Georgia Tech Research Institute

Harvey Mudd College

Johns Hopkins University

Lincoln University

Mass. Institute of Technology

Middle Tennessee State Univ.

University of Florida (Gainesville)

University of Hawaii at Manoa

University of Illinois (Urbana-

Champagne)

University of Iowa

University of Kansas

Univ. of Maryland (College Park)

Univ. of Minnesota

University of Missouri

University of Pittsburgh

University of Texas – El Paso

University of Virginia

University of Washington

Utah State University

Vanderbilt University

Virginia Tech

Morgan State University

Naval Post Graduate School

New Mexico State University

North Carolina A&T Univ.

North Carolina State Univ.

Ohio State University

Oklahoma State University

Purdue University

University of Alabama, Huntsville

University of Arizona

University of California Irvine

Univ. of California Los Angeles

Univ. of California San Diego

University of Central Florida

University of Delaware

Universities Supporting

Test Technology Development

Since FY03, University Efforts Total > $65M

7

Technology Readiness Levels

TRL 9 Actual system 'flight proven' through successful mission

operations

TRL 8 Actual system completed and 'flight qualified' through test

and demonstration

TRL 7 System prototype demonstration in an operational

environment

TRL 6 System/subsystem model or prototype demonstration in a relevant environment

TRL 5 Component and/or breadboard validation in relevant environment

TRL 4 Component and/or breadboard validation in laboratory environment

TRL 3 Analytical and experimental critical function and/or characteristic proof of concept

TRL 2 Technology concept and/or application formulated

TRL 1 Basic principles observed and reported

T&

E/S

&T

Pro

gra

m

CT

EIP

TRL 3: Analytical and Experimental Critical Function and/or Characteristic Proof of Concept

• Active R&D initiated

• Includes analytical and

laboratory studies

• Validation of analytical

predictions of separate

elements of the technology

• Example: Components that

are not yet integrated or

representative

Analytical Studies of

Spectrum Environment

Telemetry Network

Modeling

Evaluation of

Components

Example: Linear Power Amplifier for Telemetry

TRL 4: Component and/or Breadboard Validation in Laboratory Environment

• Integration of basic

technology components to

establish that they will

work together

• Relatively “low fidelity”

representation of eventual

technology

• Example: Integration of ad

hoc hardware; testing of

laboratory breadboard—

estimate of how

breadboard test results

differ from the expected

system goals


TRL 5: Component and/or Breadboard Validation in Relevant Environment

• Fidelity of breadboard

technology increases

significantly

• Basic technology

components are integrated

with reasonably realistic

supporting elements so they

can be tested in a simulated

environment

• Example: Integration of

components for testing at Air

Force Flight Test Center,

Edwards AFB; Naval Air

Station, Patuxent River or

White Sands Missile Range


TRL 6: System/Subsystem Model or Prototype Demonstration in a Relevant Environment

• Prototype tested in a relevant

environment

• Represents a major step up in

the technology’s demonstrated

readiness

• Near the desired configuration

in terms of performance,

weight, and volume

• Example: Testing a prototype at

Air Force Flight Test Center,

Edwards AFB; Naval Air Station,

Patuxent River or White Sands

Missile Range


T&E/S&T Project Progression

• Project Initiation (Decision Point) – Multi Track Awards – competing approaches for the same test

technology

– Advance technology from TRL 3 to 4

– Materials/Component Investigation (e.g., M&S analysis)

– Cost driver – Labor

• Technology Milestone (Decision Point) – Advance technology from TRL 4 to 5

– Fabricated investigative part/sub-assembly build-up

– Demonstrate in laboratory/simulation

– Cost driver – Transitioning from labor to material and testing

• Technology Milestone (Decision Point) – Advance Technology from TRL 5 to 6

– System Integration

– Demonstrate in representative environment

– Cost driver – brassboard to prototype development

T&E/S&T Program Broad Agency Announcements

• Topics for Industry, Academia, and Government Laboratories to propose test technology solutions

• In-cycle Process – Declared schedule for white paper submissions (deadline)

– Requires an allocation of available funding

– Priority over out-cycle white papers (must be processed first)

• Out-of-cycle Process – White papers submitted anytime after "in-cycle" deadline

– Offerors "highly encouraged" to contact Executing Agent before submitting white paper Ensures interest

Can address whether a 'chance' exists for funding

• All BAAs include an “Other Test Technologies” topic to enable offerors to propose test technology developments that were not previously identified by the Government

All T&E/S&T BAAs are always open for new white papers

Executing Agent Action Program Manager Action Offeror Action Contracting Officer Action

BAA Pre-FY Cycle

Draft BAA Topic Areas

Industry/Academia Days

BAA Topics Finalized

BAA Topics Announced

White Paper Submissions

Proposals Requested from

Selected Offerors

Proposal Submissions

Proposal Review &

Clarifications

Executing Agents

Recommendations to PM

Contract Awards Initiated

White Paper Reviews

Activity T&E/S&T New Project Selection Schedule

OCT NOV DEC JAN FEB MAR APR MAY JUN JUL AUG SEP

PM New Start Decisions

T&E/S&T New Project

Selection Schedule

Refine BAA Topics

18-20 October in Atlanta

Call for White Papers

White Papers were due 20 March

T&E/S&T Program

Test Technology Needs Structure • T&E/S&T Program

– Program Manager & Deputy Program Manager

• Test Technology Area (TTA) – Executing Agent in field organization within a Service

– Each TTA has a separate BAA announcement at http://www.fbo.gov

– There are currently 8 TTAs in the T&E/S&T Program

• Domains – Sub-division of TTA for categorization

– TTAs are currently divided into 2 to 6 domains each

– There are currently 27 domains across the T&E/S&T Program

• Topics – Test Technology Need for an offeror to propose a development

– There are currently 99 test technology topics across the 8 BAAs

• Enabling Technologies – Some test technology topics could be addressed by a multitude of different

technologies that could enable an aspect of the overall solution

– In some domains, we also identify enabling technologies to clarify different technology approaches to a test technology need

Location of T&E/S&T BAAs

www.fbo.gov

Keyword: TRMC

Note: Posted in January so may need to change search

for “Posted Date” to beyond “Last 90 Days”

T&E/S&T Test Technology Area Executing Agent Organizations

Spectrum Efficiency Edwards AFB

High Speed Systems Test Arnold Engineering

Development Center

Electronic Warfare Test PEO for Simulation, Training

and Instrumentation

Program Office TRMC HQ

Cyberspace Test TRMC HQ (Interim)

Advanced Instrumentation Systems Naval Undersea Warfare Center

Net-Centric

Systems Test Naval Air Systems

Command

TRMC HQ

Air Force

Army

Navy

Central Oversight – Distributed Execution

Unmanned & Autonomous Systems Test

Naval Air Systems

Command

Directed Energy Test PEO for Simulation, Training

and Instrumentation

Cyberspace Test Eglin AFB (Future)

Cyberspace Test T&E/S&T Test Technology Area

• Current Portfolio: 2 Projects

• FY12 Budget: $2.6M

• 3 Domains with 8 Current Topics

Cyberspace Test Planning: 3 Topics

Cyberspace Threats: 2 Topics

Cyberspace Test Execution/Analysis: 3 Topics

• Significant Technology Needs

Cyberspace test visualization

Defining cyberspace test measurements

Improved, scalable cyberspace threat

representations

Advanced cyberspace instrumentation

Improved cyberspace analysis

Interim Executing Agent

Arjuna “AJ” Pathmanathan

Test Resource Management

Center

571-372-2702 [email protected]

Improving Cyberspace Testing

Application Layer Attack: Virus Epidemics,…

Defense: Secure web, Access control, …

Transport Layer Attack: Flood Attacks, Denial of service

Defense: Cryptographic Protocol Security

Network Layer Attack: Wormhole, Rushing attackers…

Defense: Internet Protocol Security

Link Layer Attack: Tracking, Link disruption

Defense: Link encryption

Physical Layer Attack: Jamming, battery exhaustion,…

Defense: Spread spectrum…

Cyber Threat

Threat Test Team

Operational Tester

System Under Test (SUT)

StealthNet – Developing tools for T&E of mission assurance under

full-spectrum cyberspace operations

Realistic Cyberspace threat stimulation of single systems or networks of many systems,

scalable by incorporating simulated representations of unavailable components

Directed Energy Test T&E/S&T Test Technology Area




High Power Microwave: 6 Topics

High Energy Laser: 3 Topics

Special Interest Area: 1 Topic


Neutron Environment Simulator to replicate

required nuclear effects test environments

In Chamber HPM Source

HPM Electronic Failure Analysis

Characterizing beam propagation through

atmosphere & maximizing laser test windows

Executing Agent

Minh Vuong

U.S. Army PEO-STRI

407-384-5238

[email protected]

Providing High Power Microwave (HPM) Sensors for

CHAMP Joint Capability Technology Demonstration

Developed prototype 12-node system to collect data during CHAMP flight test

Field Strength Sensor Network (FSSN) -

Developed prototype wireless mesh

network of sensor nodes for capturing and

reporting the pulsed amplitude of radiated

HPM fields in a geographically dispersed

test configuration.

.

Ideally suited for new HPM

systems coming to the range

that may illuminate large areas

where standard diagnostics

approaches are ill suited.

Counter Electronics HPM

Advanced Munitions Project (CHAMP)

22

Electronic Warfare Test T&E/S&T Test Technology Area




Electro Optics: 8 Topics

Radio Frequency: 7 Topics


Full-Range Surrogate Missile Technology

High-Speed EO/IR Scene Generation

Missile Body & Plume Attitude Measurement

Real-time, High-Fidelity, High-Density

RF Signal Generation

Multi-Beam Characterization

Radar Clutter Simulation

Executing Agent

Minh Vuong

U.S. Army PEO-STRI

407-384-5238

[email protected]

High Speed Systems Test T&E/S&T Test Technology Area




Advanced Propulsion: 6 Topics

Aerodynamics & Aerothermal: 2 Topics

Flight Test and Evaluation: 3 Topics

Computational Tools for Flow Fields: 1 Topic

Instrumentation for Flow Fields: 4 Topics


Propulsion Scaling Test Techniques

Combined Cycle Propulsion Test Methods

Hypersonic Flight Erosion Test Methods

Thermal Protection System Ablation Testing

Executing Agent

Ed Tucker

Arnold Engineering

Development Center

931-454-7469

[email protected]

Hypersonic Aero-propulsion

Clean Air Test Bed (HAPCAT)

Air Storage

(Banks A/B)

PBAH Pressure Control

PBAH Isolation /

Flow Control

Valve

Test

Cabin

(Existing)

Diffuser

(Existing)

PBAH –

Pebble Bed

Air Heater

(Existing)

RSH – YsZ Regenerative

Storage Heater

Start

Valve

VMN – Variable Mach NozzleADS Mixer

ADS

Stilling

Chamber

RSH Flow Control

Air Storage

(Bank C)

Ejector Motive

Air Control

Bay VI

Vacuum

Valve

(Existing)

Ejector

Exh

au

st

Sile

nce

r

Exhaust

Manifold

(Existing)

Vacuum Sphere

(Existing)

Ejector

Isolation

Cold Air Injection

Ring

ADS Liner Cooling

Pressure Control

Cold Air

Flow Control Liner Cooling

Reinjection Flow

Exhaust

Liner Cooling

Exhaust Flow

ADS Liner Cooling

Flow Control

First-of-a-kind clean air, variable Mach test

capability

• Advanced storage heater with near-Mach 8

temperatures (4800 °R) and pressures

• Wide range of temperatures and pressures

from fixed-temperature sources

• Variable Mach nozzle (4.5 – 7.5)

• Integrated into ATK-GASL Test Bay VI

Net-Centric Systems Test T&E/S&T Test Technology Area




System of System Testing: 3 Topics

Improved Test Automation: 3 Topics

Modeling & Simulation for Test: 5 Topics


Flexible Test Harness Generator

Automated, Rapid, Agile Test Planning

Removing biases in Distributed Testing

Rapid Analysis of Voluminous Unstructured

Data (“Test Data to Decision”)

Determining Required M&S Fidelity in Tests

Executing Agent

Gil Torres

NAVAIR (Pt. Mugu)

805-989-9521

[email protected]

Unmanned & Autonomous Systems Test T&E/S&T Test Technology Area




Autonomous System Test Planning: 3 Topics

Autonomous System Performance

Assessment: 4 Topics


Predicting Autonomous Behavior for Testing

Enhancing Safety of Autonomous Testing

Testing of Autonomy Functional

Components

Measure Autonomous System Reliability and

Performance

Executing Agent

Bill Hamel

NAVAIR (Pax River)

301-342-6373

[email protected]

Advanced Instrumentation Systems T&E/S&T Test Technology Area




Time Space Position Info: 7 Topics

Advanced Sensors: 9 Topics

Advanced Energy & Power: 4 Topics

Non-Intrusive Instrumentation: 2 Topics

Range Environment Encroachment: 1 Topic

Human Systems: 1 Topic


TSPI without GPS (or with limited GPS)

Measuring body armor / helmet effectiveness

Measuring cognitive workload

Executing Agent

Dr. George Shoemaker

NUWC-Newport

401-832-5304 [email protected]

UHDGPS Breadboard

(203 X 305 mm)

Achievements

• GPS signals continually buffered and processed

• Unprecedented number of simultaneous search windows: 3

million windows performing 350 million searches/second

• Time-to-first-fix less than half a second

• First GPS receiver acquiring and tracking L2C to provide

ultra high dynamics capability up to 1,000g and 9km/s

• First GPS receiver acquiring and tracking L5

Improving Time-Space-Position (TSPI)

System Dynamics, Accuracy and Anti-Jam Capability

Current TSPI systems use only L1 frequency GPS receivers with limited dynamics

and accuracy. Ultra-High Dynamics GPS (UHDGPS) is developing a three-frequency

hybrid (L1, L2, L5) GPS receiver to support ultra-high dynamics, high-accuracy

GPS, and operation under GPS jamming.

Existing

Q20 HD GPS

Receiver Module

shown for

comparison

(22 X 26 mm)

Will provide ability to accurately track high-dynamic

Systems-Under-Test and incorporate GPS jamming into test scenarios

Path Forward

• Trade study to address application-specific

integrated circuit (ASIC) architecture designs

• Architecture of the existing receiver is being

reconfigured to increase the maximum

velocity capability to address extended range

hypersonic requirements

F-22 Launching AIM-120 AMRAAM HMMWV Launched AIM-120

29

Spectrum Efficient Technology T&E/S&T Test Technology Area




Wireless Technologies: 5 Topics

Telemetry Networking: 2 Topics

Spectrum Management: 1 Topics


Multiple Access Schemes for Serial

Streaming Telemetry

Modulation Agile Radio for Test Applications

Channel Estimation and Equalization

Steerable Multiband Antenna (L-band,

S-band, & C-band) for Airborne Test Articles

Executing Agent

Tom Young

Air Force Flight Test Center

(661) 277-1611

[email protected]

Developed new test technology to improve test data quality by reducing data errors;

investigating telemetry performance in C-Band spectrum to support test operations

M4A antenna

mounting on test

platform

Telemetry ground

antenna at

Edwards AFB

Multipath Modeling and Mitigation Using

Multiple Antennas (M4A) - Developing

technology to determine radio frequency

channel models for fixed-wing aircraft and

helicopters. The models will be used to

investigate ways to mitigate telemetry

multipath effects.

Improving Telemetry Data Quality and

Expanding Testing in C-band Spectrum

31

• Meets a T&E Need

• Requires S&T work

• High Payoff

• Broad application (more than one DoD test activity)

• High potential for transition to development of

a test capability

The Proposal — Key Criteria

33

T&E/S&T Program Summary

• T&E/S&T Program initiated to address critical T&E needs tied to S&T drivers

– Advancing the state of the art in T&E technologies

• The only DoD S&T program dedicated to T&E

• Annual Call to Industry, Academia, and Government

Laboratories to address test capability needs

• Competitive technology developments to get the best

technologies possible to the test community

• Focused on transition into needed test capabilities

Looking Ahead, Responsive, Agile

test & evaluation/science & technology (t&e/s&t) … & evaluation/science &...

Documents