THE UNITED STATES AIR FORCE TEST PILOT SCHOOLSCIENTIA EST VIRTUS

“KNOWLEDGE IS POWER”

Colonel Noel “Shamu” Zamot

Commandant, USAF Test Pilot School

Real World Flight Test Projects at Your USAF Test

Pilot School

1

Scientia est Virtus

2

Agenda

• What are Test Management Projects (TMPs)

• Highlights from the Past

• Current Projects

• Plans for the Future

Scientia est Virtus

3

VISION:

World’s premiere school for applied

flight test engineering – where the world comes to educate future test leaders

MISSION:

Produce highly-adaptive, critical-thinking flight test professionals and future senior leaders to lead & conduct

full-spectrum test & evaluation of aerospace weapon systems

USAF TPS Vision & Mission

TPS Grads exert huge (often unseen) influence over weapon system development

LINE

AVIATORS

WEAPON SYSTEM

ACQUISITIONERSWAR-WINNING

CAPABILITIES

FLIGHT

TESTERS

Scientia est Virtus

4

• 48-week Program, MSFTE

• 3 Curricula:– Experimental Test Pilot

– Experimental Test CSO/RPA Pilot

– Flight Test Engineer

• 4 Major Subdisciplines– Performance

– Flying Qualities

– Systems

– Test Management

• 13 Academic Courses = 50 sem-hrs total – 2500 Graduate hrs Average (+300 Ancillary Training hrs)

– 21 Scored Academic Exams 19 Individual Academic Exams

Comprehensive Written & Oral Exams

– 85 Flights (or Airborne Laboratories)

– 38 Graded Reports (31 written + 7 oral) Capstone Test Management Project (Report + Defense)

Curriculum

Performance:

X-47, KC-46, JSF, C-130J

Flying Qualities:

JSF, B-1 DFLCS, F-15E/F-16

Stores Cert

Systems:

F-22 Inc 3.1, B-1B FIDL,

INSR, B-2 EHF

Scientia est Virtus

55

J F M A M J J A S O N D J F M A M J

TM 600 (4)TM 900 (9)

QE 900 (3)

PF 600 (3) FQ 600 (4)

SY 600 (3)FQ 700 (4)

FQ 800 (4)

FQ 900 (4)

PF 700 (3)

PF 800 (3)

SY 700 (3)

SY 800 (3) GR

AD

UA

TIO

N

AN

50

0/C

F 5

00

CU

RR

ICU

LU

M B

RE

AK

FIE

LD

TR

IP

TEST MANAGEMENT

QUAL-EVAL

SYSTEMS

FLYING

QUALITIESPERF

GR

AD

UA

TIO

N

CH

EC

KO

UT

CU

RR

ICU

LU

M B

RE

AK

FIE

LD

TR

IP

TMPTM 600 (4)

TM 900 (9)

QE 900 (3)

PF 600 (3) FQ 600 (4)

SY 600 (3)FQ 700 (4)

FQ 800 (4)

FQ 900 (4)

PF 700 (3)

PF 800 (3)

SY 700 (3)

SY 800 (3) GR

AD

UA

TIO

N

AN

50

0/C

F 5

00

CU

RR

ICU

LU

M B

RE

AK

FIE

LD

TR

IP

A - CLASS

B - CLASS

AN = Ancillary Training SY = Systems Subdiscipline

CF = Check Flights TM = Test Management Subdiscipline

PF = Performance Subdiscipline TMP = Test Management Project

FQ = Flying Qualities Subdiscipline QE = Qualitative-Evaluation Program

Phase / Course Layout

Scientia est Virtus

6

THEORY

PLAN

FLY

REDUCE

DEDUCE

REPORT

TEAMWORK

= Full-Spectrum Flight Test Professional

Graduate Core Competencies

• Diverse Aerospace Vehicle Exposure

• Flight Test Engineering

• Flight Test Techniques

• Flight Test Planning

• Safety Planning & Risk Management

• Flight Test Execution

• Data Management

• Flight Test Evaluation

• Flight Test Reporting

• Integrated Test Teaming

Scientia est Virtus

7

•What are TMPs?– End-to-End Staff/Student Real-World Flight Test Projects

– Conduct ~ 8 Projects/Year (4 in Spring, 4 in Fall)

– Peer-Reviewed, Published Written Report & Oral Defense

•Customer Provides:– Cutting edge research concept to be flight tested

– Funding for any specialized support or major acft mods

•TPS Provides:– Lots of Preliminary Planning and Preparation by Staff

– Test Aircraft - Usually flown on AFFTC Assets

– Dedicated Test Team of Pilots/Engineers (4-6 individuals)

– Flight Test Data, Data Reduction, Data Analysis

Test Management Projects

Scientia est Virtus

• Statement of Capability

• Test Plan Working Groups

• Technical Review Board

• Safety Review Board

• Approval Brief

• Test Execution

• Data Reduction & Analysis

• Program Assessment Reviews

• Technical Information Memorandum

• Report Murder Board

• Final Presentation

8

TMP Program Elements

REPORT

THEORY

PLAN

FLY

REDUCE

DEDUCE

TEAMWORK

Opportunity to apply

entire loop in a real

world exercise

Scientia est Virtus

HIGHLIGHTS FROM THE PAST

9

Scientia est Virtus

Successfully performed

Compatibility Flight Profile

testing to gain flight clearance

on F16 aircraft

Reconfigurable

Airborne Sensor,

Communications and

Laser (RASCAL) pod

Provides a platform for

testing avionics and

sensors without the cost

and schedule penalties

associated with

modifying aircraft

SENIOR RASCAL

10

Scientia est Virtus

TALON SPOT

• TMP Objective:

Determine the optimal combination of aimpoint,

glideslope and throttle modulation method, from a

selection of landing techniques, to perform a safe and

repeatable T-38C approach and landing within AETC

requirements.

11

Scientia est Virtus

12

NO GYRO

AFIT Dean’s Awd

#1 of 79 Aero/Astro Dept

AFIT Commandant’s Awd

#1 of 277+ all Depts

AIAA Awd

IoN Awd

1st ever for a Non-EE

7 Dec 2007

Scientia est Virtus

Other Recent TMPs

• Pace Maker (F-16D) – Pitot-static system calibration

• Huron Six-D and Have Haste (C-12) – C-12

aerodynamic stability derivative estimation

• Icarus (NF-16D Vista) – Handling Qualities evaluation of

interaxis control coupling

• Shuttermatch (C-12) – Precision weapon guidance using

a coupled INS and a high resolution camera

• Have Fins (F-16) – Aim-9 control surface effects on F-16

LCO characteristics

• Have Gas (T-38 and Learjet) – Optical tracking

combined with differential GPS to simulate unmanned AR

13

Scientia est Virtus

14

98B HAVE TRACK HUD Target as Substitute Aircraft Target for HQ Evals

00A HAVE OLOP PIO in the Presence of Rate Limiting

00B HAVE ATTITUDE Off-Axis Attitude Cueing for Helmet Mounted Sights

01A HAVE ROVER PIO Detection and Suppression

01B HAVE GRAPE Collect GPS TSPI data for follow-on TCAS testing

02A HAVE PREVENT Comparison of PIO Prevention Algorithms

02B HAVE SYCLOPS Flight Reference Displays

03A MAX GAP PIO Prediction Algorithms

03B SELF SERVE Autonomous Rendezvous for AAR

04A SOLO FORM Automatic Formation Flight

04B DOLLAR DRAFT Refine Positioning for Formation Cruise Drag Reduction

VISTA Projects: Students

Scientia est Virtus

15

05B HAVE JIVE Voice Recognition System functionality at elevated-g

06A BAT DART Limit Investigation of Boundary Avoidance Tracking Tasks

08A AT BAT Limited Investigation of Auxiliary Tasking during BAT

09A HAVE MURDOC Multi-Use Rate Disturbance Observer Controller

09B ICARUS Limited HQ Eval of Interaxis Control Coupling

10B BEAR CLAW Basic Envelope Air Refueling Control Laws

VISTA Projects: Students

Scientia est Virtus

16

2003 Auto Air Collision Avoidance Systems (Auto ACAS)

2004 Arc Segment Attitude Reference System, Heads Up Display

2006 Voice Recognition System

2006 Target Drone Mission (HAVE DEMO)

2008 F-16 Autoland System

2009 Advanced Vision Helmet System

In-work/Upcoming:

2012 Auto Air Collision Avoidance

2012 Automated Aerial Refueling Program

VISTA Projects: Staff

Scientia est Virtus

CURRENT PROJECTS

17

Scientia est Virtus

OBJECTIVE

Collect data to develop outer loop control

law design guidelines for the Variable

Stability In-Flight Simulator Aircraft (VISTA)

automated aerial refueling (AAR) with

KC-135 tanker

CONCEPT / CONDUCT

Characterize manned Air Refueling to

determine autonomous safety trips

IMPACT

AAR required for global RPA strike – VISTA

is designated test platform

CUSTOMER

•Automated Air Refueling Program,

AFRL/RBCCZ

• Fighter Risk Reduction Program, AFRL/RB

•RPA Surrogate Program, USAF TPS18

BEAR CLaw

Scientia est Virtus

HAVE RAVEN

14

OBJECTIVE

Determine the detection and track range of

small, low flying aircraft

CONCEPT / CONDUCT

•Various aircraft/sensors executing level

radar intercepts against small,

nontraditional targets

•Buildup to attempt detection of small

rotorcraft over mountainous terrain

IMPACT

•Improved capability to detect LO incursions

into CONUS

•First in a series of cooperative efforts

between TPS and external Government

Agencies

CUSTOMER

Department of Homeland Security

Scientia est Virtus

HAVE MABLE

20

OBJECTIVE

•Evaluate C-12J flying /handling qualities

with AN/ALQ-188v4 pod.

•Determine ECM POD performance

Differences between C-12J and AT-38B

CONCEPT / CONDUCT

•Qualitatively evaluate C-12J FQ/HQ with

AN-ALQ-188

•Fly C-12J and AT-38B with AN/ALQ-188 pod

versus APG-68 in IFAST and on F-16

IMPACT

Potential for significantly reduced cost,

timeline of testing ECM mission loads for

emerging threats

CUSTOMER

586th Flight Test Squadron, Holloman AFB

Scientia est Virtus

HAVE RPA

OBJECTIVE

Evaluate the ability of the Calspan Learjet to

function as a surrogate Remotely Piloted

Aircraft (RPA) for future test utility

CONCEPT / CONDUCT

•Determine datalink performance, autopilot

response to Ground Control Station inputs,

observe and evaluate Pilot-Vehicle Interface

•Demonstrate remotely-piloted approach

IMPACT

•Demo autonomous landing control

•Ability to do cutting edge RPA testing

without airspace control issues

•Significant risk, cost reductions in

developing future RPA capability

CUSTOMER

AFMC/A3 21

Scientia est Virtus

OBJECTIVE

Evaluate alternative pacer calibration

techniques

CONCEPT / CONDUCT

Compare results from the following

methods: atmospheric analysis, self-

survey, Orbis, cloverleaf, Beav, trailing

cone, tower flyby, level

acceleration/deceleration, and stabilized

cruise methods

IMPACT

A pacer aircraft is required to calibrate

the air data system of test aircraft (F-35,

F-22, KC-X)

CUSTOMER

Air Force Flight Test Center

22

SPEED PACER

Scientia est Virtus

OBJECTIVE

Compare the physiological response of

full coverage Anti-G Suits (Mustang and

Beaufort) to legacy g-suits

CONCEPT / CONDUCT

Test will collect physiological data on

pilot performance with each suit in high

g monitored centrifuge and flight

environments

IMPACT

Goal is to ultimately improve pilot

performance in a high-g environment

and reduce the number of GLOCs

CUSTOMER

•AFMC/A3 (initially)

•ACC, AETC, Foreign Allies (ultimately)

23

HAVE PAIN

Mustang Survival

Advanced

Tactical Anti-G Suit

(ATAGS)

RFD Beaufort

Full Coverage Anti-G

Trouser (FCAGT)

Scientia est Virtus

OBJECTIVE

Reconstruct the trajectory (position and

velocity) of an air-to-air missile (simulated by

aircraft) relative to a target (simulated by

sensors on ground)—vector scoring

CONCEPT / CONDUCT

•The vector scoring system will involve the

Lexus Doppler radar sensors mounted at

known ground locations

•C-12 will be flown over sensors at various

aspects and angles

•Sensors will then be moved and test repeated

IMPACT

Cost effective vector scoring system

CUSTOMER

Air Force Institute of Technology24

HAVE SPLASH

Scientia est Virtus

HAVE HAL

OBJECTIVE

Evaluate enhancements to the Calspan

Learjet functioning as a surrogate

Remotely Piloted Aircraft (RPA)

CONCEPT / CONDUCT

Determine upgraded datalink

performance, autopilot (including

autothrottle) response to Ground Control

Station inputs, observe and evaluate Pilot-

Vehicle Interface improvements

IMPACT

•Improve ability to do cutting edge RPA

testing without airspace control issues

•Significant risk, cost reductions in

developing future RPA capability

CUSTOMER

AFMC/A325

Scientia est Virtus

PLANS FOR THE FUTURE

26

Scientia est Virtus

27

Future Directions for TMPs

• RPAs

• Airborne Networks

• Cyber Warfare

• Continued Work with AFRL

• Projects for RASCAL Pod

• Collaboration with New Folks

– NPS

– DHS

– DARPA

– Civilian Universities

• Design of Experiments &

Statistically Relevant Test

Scientia est Virtus

28

Critical thinking flight test professionals need to have

hands-on experience with real world flight test

projects before wearing the TPS Grad Patch

TMPs provide the opportunity for small scope

advanced development projects that provide relevant

results to DoD customers

TMPs provide collaborative opportunities with other

Govt agencies, research centers, and universities

which help advance the state of the art in Flt Test

Bottom Line

Scientia est Virtus

29

Scientia est Virtus

Backup Slides

23

Scientia est Virtus

313131

Col

Noel ―Shamu‖ Zamot

Commandant

Mr. Dave Vanhoy

Technical Director

Lt Col

John ―Rider‖ Kanuch

Deputy Commandant

Lt Col (s)

Swami ―Shotgun‖ Iyer

Operations

DO

Maj

Clint ―Void‖ Armani*

Education

ED

Lt Col

Fred ―Steamer‖ Bivetto

Curriculum Standards

CS

Lt Col

Mike ―Slash‖ Young

Plans & Programs

XP

CDR

Mick ―Chum‖ Williams

Technical Support

TS

Master InstructorsPerformance Mr Russ Erb

Flying Qualities Vacant

Systems Mr Randy Kelly

Test Mgmt Ms Lyn McNeely

Manning Auth / AsgnAD Faculty 27 / 20 IMAs 11 / 8LTs 2 / 7Enlisted 5 / 4Civilian 24 / 22Contractor 24 / 24Matrixed 21 / 24Staff Total 114 / 109 Students 40 / 48School Total 144 / 157

USAF TPS Organization

MSgt Daniel Halverstadt

Superintendent

Mr. ―Evil‖ Bill Gray

Chief Test Pilot

Col

Dawn Dunlop

412 TW/CC

Brig Gen

Robert Nolan

AFFTC/CC

AFMC/A3

Brig Gen Bill Thornton

AETC/AU

Lt Gen Peck

Dr. Bruce Murphy

Scientia est Virtus

32

REPORT

THEORY

PLAN

FLY

REDUCE

DEDUCE

Teach the way we Test… …Test the way we Teach

TEAMWORK

Learning ParadigmAn Applications-Oriented pedagogy

Scientia est Virtus

24

Course (credits) Academic TopicsFlights, Sims &

ChecksReports

PF 600 (3)Fixed-Wing Aerodynamics

Intro to AerodynamicsCompressible AerodynamicsCruise

C-12 Mission directorAero ModelingCruise DataFighter Performance CheckGlider High L/DT-38 Low L/D

Aero Model Validation TLR

PF 700 (3)Performance Data Standardization

Pitot-Statics & Std AtmosphereData StandardizationModeling & SimulationPropulsion

Tower Fly-ByPacer / GPSPropulsion

Air Data Sys Calibration TLR

PF 800 (3)Performance Optimization

Takeoff & LandingEnergy Concepts

Level Accel / Sawtooth ClimbTurn PerformanceC-12 Practice CheckHU-16 Performance Final Check

Performance Oral PRRHU-16 Check Expanded 5314

Purpose • Basic Flight Test Methodology

• Learn Test Program conduct

• Motion of the aircraft C.G.

(e.g., “how far, how fast, how high…”)

Performance Subdiscipline9 sem-hrs 452 graduate hrs

Scientia est Virtus

25

Course (credits) Academic TopicsFlights, Sims &

ChecksReports

FQ 600 (4)Unaugmented Airplane Motion

Equations of MotionTrim & StabilityParameter Estimation

C-12 Long-Stat & Lat-DirLJ-24 Long-Stat & Lat-DirT-38 Long-Stat & Lat-DirT-38 Dynamics

T-38 Long-Stat 5314T-38 Long-Stat TRT-38 Lat-Dir 5314T-38 Lat-Dir TR

FQ 700 (4)Flight Control System(FCS) Testing

Intro to FCSAnalog & Digital FCSAero-Servo-ElasticityCriteria for FCS DesignFreq Content, Aliasing, FiltersFreq Response EstimationRedundancy Mgmt SystemsFCS Ground TestingFlight Test Simulators

FQ & HQ SimulatorsVISTA HQ DemoLJ-24 FCS Project

VISTA HQ 5314

FQ 800 (4)Stall, Departure, Spin,& Failure State Testing

Stall-Departure-Spin TestingFailure State Testing

Glider SpinT-38 Stall & HQC-12 & KC-135 Eng-OutF-16 Departure

T-38 HQ/Stall 5314T-38 HQ/Stall Oral PRREng-Out Expanded 5314F-16 Departure Oral PRR

FQ 900 (4)Handling Qualities (HQ)& Envelope Expansion

FQ Testing Config & OverviewTaxi testingFirst-Flight FQ TestingHandling Qualities EvaluationOne-Flight FQ EvaluationStores CertificationStructures

F-16 limit Cycle OscillationKC-135 & Glider FQC-12 First-Flight CheckF-16 HQF-15 CFP & Asymmetric StoresAT-38 FQ CheckF-16 Structural Loads Check

Purpose • Evaluate aircraft flying qualities

• Aero & Flight Control System models

• Motion of aircraft about its C.G.

Flying Qualities Subdiscipline16 sem-hrs 815 graduate hrs

Scientia est Virtus

26

Course (credits) Academic TopicsFlights, Labs, Sims &

ChecksReports

SY 600 (3)Human Factors& Avionics

Human FactorsIntegrated Navigation SystemsCommunications & Data LinksAvionics Systems IntegrationUnmanned Aircraft Systems

ASI Lab (IFAST)F-15E Systems Eval

Cockpit Eval Expanded 5314AMC Sims 5314

SY 700 (3)Airborne Sensors

Electro-Optics/Infrared SystemsRadar Systems

EO Lab (TPS & IFAST)F-16 EO DemoRadar Lab (TPS & IFAST)Air to Air Radar Lab (TPS)ASTARS Day/Night Sensor Eval

F-16C/D EO Expanded 5314ASTARS Expanded 5314

SY 800 (3)Weapons & IntegratedSystems Evaluation (ISE)

Electronic WarfareWeapons Delivery TestingF-16 Weapons DeliveryF-16C/D A/G Weapons DeliverySmart Weapons A/ASmart Weapons A/GWeapons & Tactics Overview

Elec Combat Gnd/Flight Test LabsT-38 ALQ Pod vs IFASTF-16C/D Wpns Delivery IFAST SimF-16C/D Weapons DeliveryT-38C ISE Check & Target

F-16 Wpn Del Expanded 5314T-38C Sys Eval Check Oral PRR

Purpose • Evaluate Aircraft Systems

Performance Suitability

Human Factors

Pilot Vehicle Interface

• Exposure to wide variety of Systems

Systems Subdiscipline9 sem-hrs 478 graduate hrs

Scientia est Virtus

36

Course (credits) Academic TopicsFlights, Sims &

ChecksReports

TM 600 (4)Test Planning& reporting

Probability & StatisticsTest ConductTest InstrumentationIntermediate T&E (TST-202)Test ManagementUnit Test Safety Officer (UTSO)Modification PlanningDesign of ExperimentsAll-Weather TestingDeficiency Reporting

TM 900 (9)Test Management Project& Comprehensive Exams

Comprehensive Written ExamComprehensive Oral Exam

TMP Data Flights Test Concept LetterTest PlanProgram Assessment Review #1Program Assessment Review #2Technical Info MemorandumFinal Oral PRR

Purpose • Spans Entire Curriculum

• Test Mgt / Sys Acquisition Process

• Reporting in Multiple Formats

• Capstone Test Management Project

Test Management Subdiscipline13 sem-hrs 635 graduate hrs

Scientia est Virtus

37

NF-16D VISTA

Airborne Laboratories

Scientia est Virtus

38

• Variable-Stability In-Flight Simulator Test Aircraft

• Rapidly reconfigurable H/W & S/W

• Capable of hi-fi sim of aircraft “model” in real flight environment

FQ700 Flight Control Systems Testing

Includes two flights to demonstrate & practice test

techniques in a variable stability aircraft to examine the

effects of differing flight control systems

TM 900 Test Management Project & Comp Exam

VISTA support provides cutting-edge research capability for

test management projects

What is VISTA?

A unique national asset…sets TPS apart!

Scientia est Virtus

39

RASCAL:

Reconfigurable

Airborne

Sensor

Comm

And

Laser Pod

Scientia est Virtus

RASCAL CONOPS

• Long Term Plan to Support TPS TMPs

– Especially Tailored to AFIT/TPS Joint TMPs

– May be transported for lab engineering

• ―PODular‖

– Fleet of 4 Pods

– NO specific A/C Mods Required

– Initial flight certification on AFFTC F-16C/D

– Any Fleet Support F-16 or T-38B A/C

– F-15/A-10/Other Certification Later if Desired

40

Scientia est Virtus

41

Telemetry Station• 2 IADS control rooms

• UHF/VHF comm

• 2 directional, 2 omni antennas

• Real Time PCM/TM recording

• L/S/C-Band Capable

• 125 control room missions / yr

• ILIAD Data Reduction Software

Control Rooms

Scientia est Virtus

Control Rooms

42

Scientia est Virtus

Pilot in-the-loop Sim

43

Scientia est Virtus

Philosophy

• TPS Teaches Discipline and Philosophy of Flight Test– Basic concepts and processes– Not how to conduct every possible test

• TPS Produces Well Rounded Test Professionals– Highly adaptive and critical thinking– Can apply flight test process to new programs and

situations– Grads won’t know all the answers – They will know

where and how to find them

• Pursue innovative ways to advance curriculum

– Collaboration with New Partners

44

Scientia est Virtus

45

Bottom Line Up Front

TPS grads are:

The cream of the crop of the operational world – we

take the best and make them better, educating

them in Test, Evaluation and Acquisition

A potential Cost Savings – TPS grads can test

weapon systems with minimal external

assistance/support

With the correct deliberate development, potential

future leaders in our Air Force: PEOs, Sq/Gp/Wg

Commanders, Materiel Leaders and more

Scientia est Virtus

What do our grads really do?

Given minimal resources,

Lead highly skilled personnel in flat organizations

through complex efforts. . .

Communicate arcane technical concepts clearly

and cogently to decision makers. . .

In order to extract truth from chaos.

46