reference trajectories for performance review (et al. ;-)...1 who and why 2 status quo 3 our goal 4...

29
Reference Trajectories for Performance Review (et al. ;-) Enrico Spinielli, PRU/EUROCONTROL SID2017 - Nov 30, 2017 Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-) SID2017 - Nov 30, 2017 1 / 29

Upload: others

Post on 17-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Reference Trajectories for Performance Review(et al. ;-)

Enrico Spinielli, PRU/EUROCONTROL

SID2017 - Nov 30, 2017

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 1 / 29

Page 2: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

1 Who and Why

2 Status Quo

3 Our Goal

4 Our Approach

5 Done and ToDo

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 2 / 29

Page 3: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Who and Why

Who and Why

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 3 / 29

Page 4: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Who and Why

Performance Review Commission

PRC setup in 1995 by EUROCONTROL as an independent entity toreview its Member States’ ANS performanceintroduce strong, transparent and independent performance reviewand target setting to facilitate more effective management of theEuropean ATM system, encourage mutual accountability forsystem performance

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 4 / 29

Page 5: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Who and Why

PRU

supports the PRC work programme and EC on SES frameworkOPS analysisfinancial/cost analysis

feeds into ICAO performance frameworkGANP (Doc 9750), Manual on ANS economics (Doc 9161)supports ICAO Paris office for EUR region

EU-US comparison

collaborate w/ international partners (Brasil, Japan, Singapore, China)

PRU Data Portal http://ansperformance.eu/

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 5 / 29

Page 6: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

Status Quo

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 6 / 29

Page 7: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

Trajectories

Trajectories are a building block for Performance Indicators’ calculation

4D intersection with airspaces ==> counting flightsflown distanceshorizontal flight efficiency (en-route)vertical flight efficiency (en-route and continuous descent)traffic complexityadditional ASMA time, i.e. time spent in terminal airspace (holding,point merge,. . . )

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 7 / 29

Page 8: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

Which Trajectories

FTFM or Model 1: from (last) Flight PLan (FPL)

RTFM or Model 2: from FTFM when flight is regulated (i.e. delayed)

CTFM or Model 3: change Model x if CPR/MSG shows enoughdeviation

CPF: based on CPRs

all good for NM purposes: ATFCM mandate

BUT. . .

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 8 / 29

Page 9: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

CPRs and MSGs Reception

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 9 / 29

Page 10: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

Trajectories1 from NM 1/2

1just an example and not representative of all NM trajectoriesEnrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 10 / 29

Page 11: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

Trajectories2 from NM 2/2

2just an example and not representative of all NM trajectoriesEnrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 11 / 29

Page 12: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

Observations 1/2

FTFM: used to predict sectors load

CPF: zig-zag due to two overlapping radar reporting position and NMpicking one few times, then the other, than back. . .

CTFMmissed the side of the departure (East instead of West)does not capture holding at Zurichit sticks to FTFM unless reality deviated too much from it

20 NM horizontally5 min in time1000 ft vertically

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 12 / 29

Page 13: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

Observations 2/2

ADS-B:

can be noisy, especially time (back-forth zig-zag):receiver dependentfeeder dependentneeds server side quality assuranceartifacts seen w/ FlightRadar24 and FlightAware

BUT some sources are better than othersOpenSky Network is great at receiver quality assessment

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 13 / 29

Page 14: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

ADS-B zig-zag

click

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 14 / 29

Page 15: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

SID/STAR and RWYNM models of approach/departure are simple

good for ATFCM mandategood for system design (complexity, maintainability, performance[CPU/memory])

trajectory through SID/STAR are straight lines from last CPR to PointFix to Aerodrome

RWY L/C/R are not taken into account when connecting to en-routetrajectory

also NM systems build trajectories with SW designed for OPS (memoryand time constraint), i.e. limited time span

BUT not OK for studying holding patterns

and we need better ones for analysis of Continuous DescendOperations (CDO)

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 15 / 29

Page 16: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Status Quo

What’s new

ADS-Beasier to get than

ANSP radar, orairline data orairport ground movements

air and (more and more) groundSDR (Software Defined Radio):

cheap electronics: 15$ DBV TV donglefree software (!): dump1900

ubiquitous internet connectivitythe long tail effect: “small” % of aviation enthusiasts multiplied by hugenumbers of internauts –> makes big enough feeders for FA, FR24, OSN,ADS-B Exchange,. . .cheap/fast enough to spare capacity to feed ADS-B dataother aeronautical info easily available

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 16 / 29

Page 17: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Our Goal

Our Goal

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 17 / 29

Page 18: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Our Goal

Philosophy

science not marketing

be open to scrutiny (methodology, data, results)engage / collaborate with various communities

stakeholders (ANSPs, Airports, Airlines, International Organisations)aviation enthusiasts (OSN, . . . )

give back: from tax payers (States money + passengers fees) back tocitizens (research comunity, industry, general public)

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 18 / 29

Page 19: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Our Approach

Our Approach

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 19 / 29

Page 20: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Our Approach

Complementarity 1/2use CPR with ADS-B and APT data

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 20 / 29

Page 21: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Our Approach

Complementarity 2/2ADS-B alone knows nothing about APTs (from AlexanderRenz-Wieland and Hugo Wallenburg. Airport quality: holding andgo-arounds. Centrum Wiskunde & Informatica (CWI), Amsterdam,2016.)

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 21 / 29

Page 22: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Our Approach

Possible Uses

reproduce our results

complement/evolve our methodology (OK, maybe EVEN criticize it!)

CORPUS for research/analysis:compare solutionsfocus on research topics (not waste time again and again oncollecting/cleaning trajectory datadefine a usable, geographically and temporally extensive dataset

machine learningEuropean studiesmulti-year studiessimulations

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 22 / 29

Page 23: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Done and ToDo

Done and ToDo

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 23 / 29

Page 24: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Done and ToDo

Feasibility Study (end 2016 - beg 2017)Pipeline setup via AWS & scaling opportunitiesSharing of resourcesFirst implementation of trajectory and airspace intersections

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 24 / 29

Page 25: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Done and ToDo

Error at point i

di−1 = vi−1(ti − ti−1) and ei = min(ei − γ2 (ei−1 + ei+1), 0)

γ ∈ [0, 1] modulates the error propagation from the 2 neighboring points

Procedurally ei is calculated as follows:

1. sort all points by ei2. calculate ei3. (if γ 6= 0) repeat step 2. until ei converges.

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 25 / 29

Page 26: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Done and ToDo

Trajectory Error

E = 1|t|

∑t

(eΘ+1(t) − eΘ−1(t))t − tΘ+1(t)

tΘ−1(t) − tΘ+1(t)

graphically eΘ+1(t) − eΘ−1(t) is the black segment

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 26 / 29

Page 27: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Done and ToDo

Total error(A) E = total_error(T)(B) for i in T

remove node i from TE_i = total_error(T)

(C) if (min(E_j) < E)permanently delete node j from TE = E_jgoto (B)

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 27 / 29

Page 28: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Done and ToDo

Future (end 2017 - beg 2018)

ProductionFuse all ADS-B, CPRs, Airport movements: different algorithms?Reference Trajectory Dataset:

CuratedOpen (algorithms, datasets)Derived/supporting datasets: fleet, airspaces, etc.

use and compare ref trajectories for PI’sexplore/expand ADS-B and other data sources

OpenSky NetworkADS-B Exchange. . .

(think about) exploit predictive models to “fill the gaps”** BUILD a COMMUNITY **

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 28 / 29

Page 29: Reference Trajectories for Performance Review (et al. ;-)...1 Who and Why 2 Status Quo 3 Our Goal 4 Our Approach 5 Done and ToDo Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories

Done and ToDo

Enrico Spinielli, PRU/EUROCONTROL Reference Trajectories for Performance Review (et al. ;-)SID2017 - Nov 30, 2017 29 / 29