improving interoperability through mission-based testing tiw/proceedings/hinton... · 1 improving...
TRANSCRIPT
1
Improving Interoperability
Through Mission-Based Testing
Mr. Derrick Hinton
Principal Deputy Director
Test Resource Management Center
May 11, 2016
2
• TRMC Overview
• Major Range & Test Facility Base
• Interoperability Testing
• Wireless Network Vision
• Final Thoughts
3
TRMC Overview
4
TRMC Organization
Director, NCR
Chief Financial Officer
Chief Operating Officer
Dr. C. David Brown
DASD(DT&E) Dir, TRMC
DD, T&E Range
Oversight
Agency RO
Army RO
AF RO
Navy RO
PM, CTEIP
PM, T&E/S&T
DD, Major Initiatives
and Technical Analysis
PM, JMETC
Principal Deputy, TRMC
Mr. Derrick Hinton
Under Secretary of Defense for Acquisition, Technology & Logistics
The Honorable Frank Kendall
Deputy EA for Cyber Test
Ranges
5
TRMC Mission
TRMC Mission
T&E Infrastructure T&E Investments
MRTFB Planning, Assessment
and Oversight
Strategic Plan for DoD T&E
Resources
Updated every 2 years in coordination
with the Military Departments, Defense
Agencies, and specified OSD offices
T&E Budget Certification
Certify to the Secretary of Defense
adequacy of DoD T&E Budgets
Test & Evaluation/Science &
Technology (T&E/S&T) Program
Central Test & Evaluation
Investment Program (CTEIP)
T&E advanced technology development
T&E capability development
Joint Mission Environment Test
Capability (JMETC)
T&E distributed test integration
National Cyber Range (NCR)
Cyber T&E Environment
6
Major Range & Test Facility Base
7
The STEWARD of the DoD Test Infrastructure Major Range and Test Facility Base (MRTFB): The “Critical Core”
23 Sites: Army-8; Navy-6; Air Force-7; Defense Agency-2
NUWC Keyport
(Nanoose & Dabob Ranges)
NAWC-WD China Lake
30th Space Wing
NAWC-WD
Point Mugu
412th Test Wing
Yuma Test Center
Nevada Test and Training Range
Utah Test and Training Range
West Desert Test Center
White Sands Test Center
Electronic Proving Ground
PMRF
U.S. Army Kwajalein Atoll
Reagan Test Site
DISA,JITC96th Test Wing (Includes 96th Test Group)
Atlantic Undersea Test and
Evaluation Center
45th Space Wing
Arnold Engineering
Development Complex
Aberdeen
Test Center
DISA
Cold Regions
Test Center
Tropic Regions
Test Center,
various locations
Legend:
Army, Navy, AF, Defense Agency
NAWC-AD
Patuxent River
• Created by Congress
• 25,000+ Personnel
• ~$4B in Funding Annually
• Army – 5.5M acres Land
• Navy – 1M acres Land, 165K
sq mi Sea, 103K sq mi Air
• Air Force – Western Ranges
ALONE 5M acres Land
• Total Plant Replacement Value $13.3B (1.6% of the DoD total)
(PRV Source: MRTFB MILCON Report (House Report 114-102 to Accompany H.R. 1735)
8
Condition of MRTFB Real Property Assets
Maintenance/repair of MRTFB
assets must compete with military
mission requirements for funding
No capability or capacity limitations to acquisition program test requirements were found
Source: MRTFB MILCON Report (House Report 114-102 to Accompany H.R. 1735
73%
17%
10%
MRTFB RPAAssessment
Good to Fair Poor Failing
27% Poor or
Failing
Cost to Mitigate Poor/Failing Assets
$1.2B
Total Plant Replacement Value of
Poor/Failing Assets
$4.9B
9
AT&L T&E
(FY15)
WORKFORCE
8,692
MRTFB (FY15)
WORKFORCE
16,933
OTA (FY15)
WORKFORCE
2,713
FY 2015 Government T&E Personnel Breakdown
9
Contractor personnel not included
Additional T&E
Personnel
Not to scaleTRMC FOCUS
Source: DASD DT&E (IDA)
10
0
5
10
15
20
25
30
35
40
Army Air Force Navy DISA
% Eligible to Retire
Time to Hire
Attrition rate
27.5%
2.7 mos.
4%
1) GAO averages (% of workforce) and OPM (months) benchmark for DoD based on studies of Federal Workforce
2) Source: Military Department and Agency 2015 TRMC Infrastructure Readiness Review (IRR) briefs
Well in excess of DoD
averages/benchmarks
2015 MRTFB Workforce Analysis
11
Interoperability Testing
12
Representative SoS Environment
Acoustic
Network
RF Sensor
Mesh Network
Sensor Data
SATCOM
Ground Station
Ground Station
Virtual Lab
Embedded
Sensor Data
Wireless Network
(Urban Environment?)
UAV
Test Article
LAN
Embedded
Instrumentation
(EISA)
Networked
Test DataSwarm UAV
Ad-Hoc Wireless
Network
Bluetooth
& Zigbee
Sensors
ConstructiveEntities
Each System brings its own set of Information Exchange Requirements (IERs)
Underwater Range
12
13
Impediments to Interoperability
• Requirement: conduct a holistic assessment in an operationally
representative environment
• Impediments: Systems, Systems of Systems (SoS), and Families
of Systems (FoS) are all designed, developed, and assembled
disparately
– Each system or sub-system is at a varying degree of maturity during
development
– Lack of access to systems that are high demand but low availability
– Lack or partial adherence to standards (e.g., only address those that are
required natively)
– Focus on native capability and not overall interoperability
• Consequence: interoperability issues are discovered in OT and
fielded systems
– Issues discovered early significantly reduced cost and schedule to resolve
14
Today 2030
Agile
Streamlined
Affordable
Continuous
Goal: Distributed, Integrated Testing and Training
The DoD T&E process must evolve to be:
Vision for Interoperability
Individual Systems &
Systems of Systems
Events
Decision-Makers
Mission-Level
Capabilities
Continuously
Decision-Makers
& Warfighters
15
Composability
Seamless
Interoperability
Interoperability
Modularity
Co-existence
A TRMC Perspective:Vision for a Common Test and Training Infrastructure
Vision
Goal
Objective
Threshold
Vision:
A highly flexible
infrastructure that will
allow us to conduct
more operationally
realistic testing and
training
16
Initiatives to Advance System Interoperability
• Operationally Representative Environments
– Work with the intelligence community (IC) to provide validated intelligence on
adversary environments and threats
– Develop capabilities to virtualize and sanitize systems and components not based
on traditional computing architectures (e.g., avionics, non-commodity chip based,
etc.)
– Expand reach of distributed testing infrastructures to include additional Live-Virtual-
Constructive (LVC) facilities and capabilities for low availability, high demand
systems
• Information Assurance/Cybersecurity
– Coordinate with the DoD CIO to tailor Information Assurance/Cybersecurity policy to
address the dynamic nature of the RDT&E community
– Work with Service CIOs and T&E Executives to ensure uniform implementation to
promote reciprocity across and within Services to reduce the accreditation and
reaccreditation burden for T&E systems
• Personnel
– Develop and implement processes to attract, develop and retain T&E SMEs
17
T&E Challenge: Spectrum Availability
0
100
200
300
400
500
600
700
800
900
1960 1965 1970 1975 1980 1985 1990 1995 2000 2005 2010 2015 2020 2025
Syst
em
Dat
a R
ate
s (K
bp
s)
Spe
ctru
m A
vaila
bili
ty (
MH
z)
Years
From F-15 to F-22 (25 years):
~7000% Increase in Data Rate
F-22 (1997): 10,000
Kbps
SDB (2010): 23,000
Kbps
• DoD Requirement of 865 MHz
by 2025
• 465 MHz Currently Available
• Shortfall of 400 MHz
AWS-3
Reallocation
• Increased complexity of weapon
systems coupled with decreased
availability of telemetry spectrum
limits testing at national ranges
(complexity of tests, data downlinks)
o Available spectrum will be further
reduced by potential loss of 1780-
1850 MHz and sharing spectrum
with commercial users
• Large amounts of data collected
onboard system and analyzed post-
test
• Continued investment in advanced
RF and network technologies can
partially mitigate the loss of
spectrum
o Advanced modulation schemes
o Networked telemetry
o Non-traditional portions of the RF
spectrum (e.g. C-band, Ka/Ku-Band)
Increased Weapon System
Complexity and Reductions in
Available RF Spectrum Limit the
Amount and Types of T&E Missions
a Range Can Support
F-15 (1972): 128 Kbps
F-16 (1985): 640 Kbps
BAMS (2013): 10,000
Kbps
1780-1850
MHz
Usable C-Band Assignment
Legacy Spectrum Assignment
Anticipated Future Loss
Near Term Loss (AWS-3)
18
Wireless Network Vision
19
Wireless Network Vision
Wireless Inter-Range Network Environment
That Seamlessly SupportsAny & All Range Operations
24/7/365in the Most Spectrum-Efficient
Manner Possible
20
Wireless Network Vision (Continued)
Routinely Support Networked Aeronautical Telemetry (ATM)
Between and Among the5 Southwest Test Ranges
by 2022
• IOC – networked ATM operations between China Lake and Edwards AFB
• FOC – networked ATM operations between and among all 5 SW ranges
Edwards AFB
China Lake
Point Mugu
WSMR
SCORE
21
Wireless Network Vision: Characteristics
Highly integrated / fully meshed network
Wireless
Provides seamless intra- and inter-range operations
Includes full test & training functionality
Spans across the CONUS (and beyond)
Available 24/7/365
Provides capability in the most spectrum-efficient way
possible (including sharing spectrum with commercial
carriers)
22
The network will support all test and training
range functions, to include:
Unmanned systems and networks
Mobile apps and adaptive networks
C2 / C4 operations
Aeronautical telemetry (ATM)
Other telemetry operations
Etc.
Wireless Network Vision: Functionality
23
Hypersonics Internal Adjustment
investments through the Central Test and
Evaluation Investment Program (CTEIP)
to close gaps in important test capabilities for
aero-propulsion, aerodynamic,
aerothermodynamic, and material evaluation
FY17 FY18 FY19 FY20 FY21 TOTAL
16 45 86 87 116 350
Funding shown in $M
24
Game-Changing TechnologiesManaging T&E of Autonomous Systems
We Must Transform T&E Culture
We Must Develop Accepted• Cross-domain standards, metrics, and test methodologies
• Human-Robot-Robot interactions
• Multiple interacting domains
(Air, Land, Sea, Undersea) ranges
Georgia Tech Research Institute Study To assess and develop an approach to gaps and
required investments in T&E infrastructure for
autonomous systems
25
Senior Leadership Needed
• We need a shared, Department-
wide vision for the future of our
range infrastructure
• We need a Department-wide
strategy to coordinate
investments that will implement
this shared vision
• This shared, Department-wide vision will be
the first step toward new DoD policies on TM
and spectrum utilization which will enable
better interoperability testing
26
Final Thoughts
27
2015 MRTFB Workforce Analysis
0
5
10
15
20
25
30
35
40
Army Air Force Navy DISA
% Eligible to Retire
Time to Hire
Attrition rate
27.5%
2.7 mos.
4%
1) GAO averages (% of workforce) and OPM (months) benchmark for DoD based on studies of Federal Workforce
2) Source: Military Department and Agency 2015 TRMC Infrastructure Readiness Review (IRR) briefs
Well in excess of DoD
averages/benchmarks
28
Do the “Nuts and Bolts” Matter?
For want of a nail, the shoe was lost;
For want of a shoe, the horse was lost;
For want of a horse, the rider was lost;
For want of a rider, the message was lost;
For want of the message, the battle was lost;
For want of a battle, the kingdom was lost,
And all for the want of a horseshoe nail.
29
Questions?
Test Resource Management Center
4800 Mark Center Drive, Suite 07J22
Alexandria, VA 22350-3700
Phone: 571-372-2700
FAX: 571-372-2678
http://www.acq.osd.mil/dte-trmc/
Dr. C. David Brown
DASD(DT&E) / Director, TRMC
(703) 697-3443
Mr. Derrick Hinton
Principal Deputy Director, TRMC
(571) 372-2761
Mr. Chip Ferguson
Deputy EA for Cyber Test Ranges
(571) 372-2697
Mr. Bruce Bailey
DD, T&E Range Oversight
(571) 372-2728