ntps traffic advisory system evaluation mortenandersenmassimo salciccia goodrich skywatch sky 497...

31
NTPS Traffic Advisory System Evaluation Morten Andersen Massimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

Upload: crystal-wood

Post on 18-Dec-2015

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

NTPS

Traffic Advisory SystemEvaluation

Morten Andersen Massimo Salciccia

Goodrich SkyWatch SKY 497Cirrus SR - 22

Page 2: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

2 NTPS

Objective - PurposeIntroductionMethodTest ResultsConclusionRecommend.

General

• Execute a Limited Evaluation of SKY 497

• Not an approved TCAS-II system

• However similar displays / alerts

• Is it a viable system??

Specific (AC 20– 131a)

• Basic GND test (Para. 3.f.1.i-ix)

• Basic FLT test (Para. 3.f.2.i-iv, vii-viii)

• Encounter test (Para. 3.f.3.i-v)

Page 3: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

3 NTPS

Test TeamIntroductionMethodTest ResultsConclusionRecommend.

Test Team• Safety Pilot: ED• Pilot: Morten• FTE: Massimo

Mission Representative Operators• Like most GA operators – unfamiliar with TCAS• Yes - representative

Page 4: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

4 NTPS

MissionIntroductionMethodTest ResultsConclusionRecommend.

Expected Mission of the Aircraft• General Aviation• SGL pilot concept – possible inexperienced• Fully IFR certified• Ceiling: 13000ft MSL• Normal cruise speed: 120 – 150 KIAS

Page 5: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

5 NTPS

Test Item DescriptionIntroductionMethodTest ResultsConclusionRecommend.

• Cirrus SR 22 (Experimental)

• TAS SKY 497

• Production representative – YES!

Page 6: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

6 NTPS

IntroductionMethodTest ResultsConclusionRecommend.

SKY497

operation

• Track 32 AC

• Display 8 AC

• Eff. range: 8 NM

• Aural + vis.Alerts

• No RA!

Page 7: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

7 NTPS

InstrumentationIntroductionMethodTest ResultsConclusionRecommend.

• Intruder aircraftB-76 w. GPS

• Garmin 92• Aircraft Radios

Page 8: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

8 NTPS

Test ConditionIntroductionMethodTest ResultsConclusionRecommend.

Aircraft• Both aircraft CG and weight - STD• Minor electrical problem w. Cirrus on start up

– Considered no factor

Weather• Wind / Velocity • 240° / 13Kts• Visibility > 50 Km

Page 9: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

9 NTPS

Assumptions - LimitationsIntroductionMethodTest ResultsConclusionRecommend.

Assumptions• SR-22 production representative• Garmin 92 provides truth Data

Limitations• Only 1.5 Hrs Flight Evaluation

– Extensive test points req. to show compliance on a standard percentile confidence level

– Not possible – striving for a sound estimate• Only Day light evaluation

Page 10: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

10 NTPS

Test ChronologyIntroductionMethodTest ResultsConclusionRecommend.

Test assignment 16th February 2005

Data Card Review 21st February 2005

Flight Test TAS 24th February 2005

Oral Report 25th February 2005

Page 11: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

11 NTPS

Test MethodIntroductionMethodTest ResultsConclusionRecommend.

Ground Test Self Test Bearing Accuracy Test: +/- 15 deg

Observe wingman squawk on GND Sensor Failure

Pull CB’s

Electromagnetic Interference (EMI) Observe all instruments

Evaluate Controls & Display General impression

Page 12: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

12 NTPS

Test MethodIntroductionMethodTest ResultsConclusionRecommend.

Basic Flight Test Interference with other Aircraft Systems

Observe VOR/GPS/Radios Aural Messages

Present / non-present Acceptable Volume and Intelligibility

With and without headset Confirm Valid & Usable traffic info during

maneuver ± 15° of pitch & ± 30° of Bank

Surveillance Range Traffic info out to 11NM

Page 13: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

13 NTPS

Test MethodIntroductionMethodTest ResultsConclusionRecommend.

Planned Encounter Flight Test 2 x Head-on Test

Low & High Speed 2 x Crossing Test (90 deg) 2 x Converging Test

(45 – 60 deg) 1 x Overtaking Traffic

Method: Cirrus calls “Mark” Lat/Long/Baro/Track/GS

recorded

Page 14: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

14 NTPS

Test MethodIntroductionMethodTest ResultsConclusionRecommend.

Subjective Rating Scale TAS improve your S.A with respect to other traffic? TAS display is easily read and easily distinguished? TAS controls are easy to use?

21 6543

DisagreeStrongly Disagree

Moderately Disagree

Moderately Agree

Agree Strongly Agree

Page 15: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

NTPS

Test Results

Page 16: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

16 NTPS

Ground TestIntroductionMethodTest ResultsConclusionRecommend.

Self Test Very satisfactory – expeditious test!

Bearing Accuracy Test: req. +/- 15 deg High confidence in accuracy Short range… Satisfactory

Sensor Failure – Pull CB’s System CB pulled – immediately “Fail” Satisfactory

Electromagnetic Interference (EMI) None observed Satisfactory

Page 17: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

17 NTPS

Ground TestIntroductionMethodTest ResultsConclusionRecommend.

Evaluate Controls & DisplayDual Controls / Displays

Garmin 430: Too small a display Cumbersome controls

Avidyne: Good overview Easy to see display Full control

Overall: Very Satisfactory

Page 18: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

18 NTPS

Flight TestIntroductionMethodTest ResultsConclusionRecommend.

Basic Flight Test Interference with other Aircraft Systems

Possible interference observed on Storm Scope Frequent Lightning Alert (RNG 200NM!) Unknown cause [R-2]

Aural Messages Only “Traffic, Traffic” in system Apparently worked per intention Satisfactory

Acceptable Volume and Intelligibility Easy to hear, with and without Headphones. Satisfactory

Page 19: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

19 NTPS

Flight TestIntroductionMethodTest ResultsConclusionRecommend.

Basic Flight Test Valid & Usable traffic info during maneuvers

± 15° of pitch & ± 30° of Bank w. intruder Accuracy assessed accurate to within 15 deg

Track only observed lost twice during entire test Reacquired within ~5 seconds Satisfactory

Surveillance Range System spec: Traffic info out to 11NM Intruder and other traffic displayed at 11 NM Satisfactory

Page 20: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

20 NTPS

Flight Test – Planned EncounterIntroductionMethodTest ResultsConclusionRecommend.

Head On Encounter

• 8 seconds too late – non compliance?• Maybe… maybe not!• Only one datapoint [R-1]

SR-22GS

B-76GS

Ang.Closure

Cal.Alert

Range

RealAlert

RangeDiff.

ErrorBudget

Time out ofSpec.

160kt 135kt 287kt 14530’ 9175’ 5355’ 1575’ 8 sec.

120kt 100kt 212kt 10735’ 10730’ 5’ Pass

TRK X-ING ANGLE

165° / 195°

Page 21: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

21 NTPS

Flight Test – Planned EncounterIntroductionMethodTest ResultsConclusionRecommend.

Crossing Encounter

• Satisfactory!

SR-22GS

B-76GS

Ang.Closure

Cal.Alert

Range

RealAlert

RangeDiff.

ErrorBudget

Time out ofSpec.

150kt 130kt 215kt 10885’ 10585’ 300’ 1200’ Pass

TRK X-INGANGLE

100°

Page 22: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

22 NTPS

Flight Test – Planned EncounterIntroductionMethodTest ResultsConclusionRecommend.

Converting Encounter

• Satisfactory!

SR-22GS

B-76GS

Ang.Closure

Cal.Alert

Range

RealAlert

RangeDiff.

ErrorBudget

Time out ofSpec.

127kt 130kt 117kt 5925’ 5550’ 375’ 700’ Pass

TRK X-INGANGLE

63°

Page 23: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

23 NTPS

Flight Test – Planned EncounterIntroductionMethodTest ResultsConclusionRecommend.

Overtaking Encounter

• Satisfactory!

SR-22GS

B-76GS

Ang.Closure

Cal.Alert

Range

RealAlert

RangeDiff.

ErrorBudget

Time out ofSpec.

97kt 156kt 61kt 3040’ 2900’ 140’ 425’ Pass

TRK X-ING ANGLE

016°

Page 24: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

24 NTPS

Test MethodIntroductionMethodTest ResultsConclusionRecommend.

Subjective Rating Scale TAS improve your S.A with respect to other traffic? TAS display is easily read and easily distinguished? TAS controls are easy to use?

21 6543

DisagreeStrongly Disagree

Moderately Disagree

Moderately Agree

Agree Strongly Agree

Page 25: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

25 NTPS

ConclusionsIntroductionMethodTest ResultsConclusionRecommend.

Displays / Functionality / Usability• System is very easy to use• System gives good and instant SA on factor traffic• System seems consistent• Acceptable use of visual and auditory alerts• Possible interference with StormScope – should be

investigated [R-2]

Page 26: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

26 NTPS

ConclusionsIntroductionMethodTest ResultsConclusionRecommend.

Specifications• All but one test run showed compliant values• High speed Head On Encounter failed.• Too many uncertainties to fail the system on one

test point. [R-1] • Generally – high confidence in system

Page 27: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

27 NTPS

Overall ConclusionsIntroductionMethodTest ResultsConclusionRecommend.

The SKY 497 is estimated to be a

Viable and Usable

Traffic Alerting System in the role of

General Aviation

Page 28: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

28 NTPS

RecommendationsIntroductionMethodTest ResultsConclusionRecommend.

[R-1] The High Speed Head On Encounter alerting function of the SKY 497 should be evaluated under further flight test.

[R-2] The SKY 497 should be investigated for possible interference with the Storm Scope system.

Page 29: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

29 NTPS

Questions

Page 30: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

30 NTPS

Error Budgets

• GDOP of 4: 60ft• 2 seconds time delay in Mark

– Gives error budget along angular closure vector

– For two aircraft!• 1 second update rate for GPS

– Gives error budget along angular closure vector

– For two aircraft

Page 31: NTPS Traffic Advisory System Evaluation MortenAndersenMassimo Salciccia Goodrich SkyWatch SKY 497 Cirrus SR - 22

31 NTPS

Assignment