module n° 5icao state safety programme (ssp) implementation course 1 module n° 5 – alos related...

Module N° 5 ICAO State Safety Programme (SSP) Implementation Course 1

Module N° 5 – ALoS related to an SSP

Revision N° 5 ICAO State Safety Programme (SSP) Implementation Course

25/02/10


SSP – A structured approach

Module 2Basic safety management

concepts

Module 3 ICAO SARPs related

to safety management

Module 4 ICAO SSP framework

Module 5ALoS related to an

SSP

Module 6 Prescription / Performance

Module 8SSP implementation plan

Module 1 Introduction to the

SSP implementation course

Module 7 SSP training programme

Module 5ALoS related to an

SSP


At the end of this module, participants will be able to describe

the concepts and dimensions underlying the acceptable level

of safety (ALoS) related to an SSP

Objective


Introductory concepts

Acceptable level of safety (ALoS)

ALoS related to an SSP

Summary

Questions and answers

Points to remember

Contents


The development and implementation of ALoS builds upon certain basic concepts of systems theory

There is a hierarchy underlying the progression of these basic concepts towards the development and implementation of ALoS

Understanding of the concepts and hierarchy is an essential foundation for the development and implementation of ALoS and the SSP

Introductory concepts


1. Safety – as defined by Doc 98592. Level of safety – degree of safety of a system, representing

the quality of the system, safety-wise, expressed through safety indicators

3. Safety indicators – parameters that characterize and/or typify the level of safety of the system

4. Value of safety indicators – quantification of a safety indicator

5. Safety targets – concrete objectives to be achieved6. Value of safety targets – quantification of a safety target7. Acceptable level of safety – minimum degree of safety that

must be assured by a system in actual practice

Introductory concepts – The basic theory


The selection of appropriate safety indicators is an essential foundation for the development and implementation of ALoS

The selection of safety indicators is a function of the detail to which the level of safety of the system is to be represented

Meaningful safety indicators must be representative of the elements that characterise system safety

Introductory concepts – Selection of safety indicators


Safety indicators Fatal airline accidents/serious incidentsRunway excursion events/ground collision eventsDevelopment/absence of primary aviation legislationDevelopment/absence of operating regulationsLevel of regulatory compliance…

Safety targetsReduction in fatal airline accident/serious incidentsMaintain the number in runway excursion events/ground

collision eventsImprove the actual level of regulatory compliance…

Introductory concepts – The basic theory: examples


Value of safety indicators 1. [Rate/number] Fatal airline

accidents per [number] operations

2. [Rate/number] Runway excursion events per [number]

operations3. [Rate/number] Ground collision

events per [number] operations4. [Number] inspections to

operators completed [timeframe] ...

Value of safety targets1. [Reduce / maintain

by / maximum] fatal airline accidents per [number] operations

2. [Reduce / maintain by / maximum] runway excursion events per [number] operations

3. [Reduce / maintain by / maximum] ground collision events per [number] operations

4. [Minimum number] of inspections completed [timeframe]…

Introductory concepts – The basic theory: examples


Safety measurement (strategic)Generally associated to the SSPQuantification of outcomes of selected high-level or high-

consequence eventsAccident rates Serious incident rates

Quantification of selected high-level State functionsDevelopment/absence of primary aviation legislationDevelopment/absence of operating regulationsLevel of regulatory compliance

A measure of achievement of high-level safety objectives of safety interventions and/or mitigations strategies

Introductory concepts – A fundamental differentiation


Safety performance measurement (tactical)Generally associated to an SMS Quantification of the outcomes of selected low-level, low-

consequence processesNumber of FOD events per number of ramp operationsNumber of ground vehicle events in taxiways per

number of airport operations…

A measure of the actual performance of safety interventions and/or mitigation strategies, beyond accident rates and regulatory compliance



Safety measurement

Not a continuous processA spot checkConducted following pre-specified timeframes

Safety performance measurement

Continuous processMonitoring and measurement of selected operational

activities necessary for the provision of services



The acceptable level of safety (ALoS) to be achieved shall

be established by the State

When establishing ALoS, consideration must be given to

the level of safety risk that applies

the safety risk tolerance

the cost/benefits of improvements to the aviation system

the public expectations in civil aviation system

Basic safety management SARPs


Values of safety indicators and values of safety targets

Initial ALoS – Quantitative action statements on selected high level/high consequence outcomes (safety measurement)

Mature ALoS – Quantitative action statements on selected high level/high consequence events (safety measurement) and low level/low consequence outcomes (safety performance measurement)

Expressing the ALoS


Examples of values of safety indicators and safety targets based on safety measurement

Values of safety indicators

1. [Number] CFIT and approach & landing accidents per [number] departures

2. [Number] runway excursions per [number] operations

3. [Number] ground collision accidents per year on a [x-year] rolling average

4. [Number] of high-severity events captured through the State MOR yearly

5. [Number] inspections to operators completed quarterly

6. [Number] AIS facilities with QMS implemented

7. Electronic filing of differences completed within [number] months/weeks

Values of safety targets1. [Reduce by/maximum] CFIT and approach

& landing accidents per [number] departures

2. [Reduce by/maximum] runway excursions per [number] operations

3. [Reduce by/maximum] ground collision accidents per year on a [x-year] rolling average

4. [Minimum number] of high-severity events captured through the State MOR yearly

5. [Minimum number] inspections to operators completed quarterly

6. [Number] AIS facilities with QMS implemented by [time]

7. Electronic filing of differences completed within [revised number] months/weeks


In the longer-term, once States develop safety data collection

and analysis capabilities under the Safety Assurance

component of the SSP, ALoS should reflect a combination of

safety measurement

safety performance measurement

ALoS – Mature SSP


Examples of values of safety indicators and targets based on safety performance measurement

Values of safety targets

1. [Reduce by/maximum] number of level busts per [number] operations by [date]

2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports by [date]

3. [Reduce by/maximum] number of TCAS/airprox events per [number] operations by [date]

4. [Reduce by/maximum] number of non-conforming approaches (NCA) at 5 international [State] airports by [date]

5. [Reduce by/maximum] the number of apron FOD events at 5 international [State] airports by [date]


1. [Number] level busts per [number] operations

2. [Number] Cat B and C runway incursions in 5 international [State] airports per

[number] operations

3. [Number] TCAS/airprox events per [number] operations

4. [Number] non-conforming approaches (NCA) at 5 international [State]

airports per [number] operations

5. [Number] apron FOD events at 5 international [State] airports per [number] operations


Tools and means to deliver the safety targets of an SSP

Regulations

Training

Technology

Delivering ALoS – Safety action plans

TechnologyTrainingRegulations


Today

State Civil Aviation Authority


Service providers

Airport N° 1

Airport N° 2

Airport N° 3


Initial ALoS

State Safety Programme


Service providers

Airport N° 1

Airport N° 2

Airport N° 3

Initial ALoS


Initial ALoS



Service providers

Airport N° 1

Airport N° 2

Airport N° 3

Initial ALoS

Exchange of protected safety data


Mature ALoS



Service providers

Airport N° 1

Airport N° 2

Airport N° 3

Exchange of protected safety data

Exchange of protected

safety data

Exchange of protected

safety data

Mature ALoS


Establishing ALoS related to an SSPdoes not replace legal,

regulatory, or other already established requirements, but it must support compliance with them

leaves unaffected the obligations of States, and does not relieve States from compliance with SARPs

ALoS – Legal considerations


ALoS – Initial (Safety measurement)


1. [Reduce by/maximum] CFIT and approach and landing accidents per [number] departures

2. [Minimum number] inspections to operators completed quarterly 3. ...

Actionplans

1. CFIT training package distributed to industry and supported by training courses

2. Revision and if necessary update of hiring policy. Inspection manual updated

3. ...


1. [Number] CFIT and approach and landing accidents per [number] departures

2. [Number] inspection to operators completed quarterly3. ...

State Shall comply with all applicable international standards


ALoS – Mature (Safety performance measurement)


1. [Reduce by/maximum] Unstabilized approaches (NCA) at 5 international airports per [number] arrivals by [date]

2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports per [number] by [date]

3. …

Actionplans

1. Continuous Descend Operations (CDO) procedures implemented – Arrival procedures charts designed for stabilized approaches

2. Installation of ASDE/X in 5 international [State] airports3. ….


1. [Number] non-conforming approaches (NCA) at 5 international airports [State] per [number] operations

2. [Number] of Cat B and C runway incursions in 5 international airports [State] per [number] operations

3. …

State Shall comply with all applicable international standards


Transition from initial to mature ALoS

Initial ALoS

(Safety measurement)

Quantification of outcomes of selected high-level/high-consequence events

Quantification of selected high-level State functions

State safety assurance

Safety oversight

Safety data collection, analysis and exchange

Safety data driven targeting of oversight on areas of greater concern or need

Mature ALoS(Safety measurement and

safety performance measurement)

Quantification of outcomes of selected high-level/high-consequence eventsQuantification of selected high-level State functionsQuantification of outcomes of selected low-level/low-consequence events

Timeline


Summary

ATS Service provider

Aerodrome operator AMOAircraft

operator N° 1

SSPSSP(ALoS)(ALoS)

ATS Service provider

Aerodrome operator AMO

Aircraft operator N° 2

Training organization

SMSSMS SMSSMS SMS

State accepts and oversees individual service providers’ SMS

Safety performance

State accepts and oversees individual service providers’ SMS

State agrees and supervises individual service provider’s SMS safety performance

Safety performance Safety performance Safety performance Safety performance

Safety performance Safety performance Safety performance Safety performance Safety performance

Trainingorganization

SMS SMS SMSSMS SMS



ALoS related to an SSP



Q: Explain the fundamental differentiation between safety measurement and safety performance measurement?

A: ?

Slide number:


Q: What are the tools and means to deliver the safety targets of an SSP?

A: ?


Slide number:


1. The basic systems safety theory

2. Safety measurement and safety performance measurement

3. Initial and mature ALoS

4. ALoS does not replace legal, regulatory, or other already

established requirements

Points to remember

Revision N° 5 ICAO State Safety Programme (SSP) Implementation Course

25/02/10

Module N° 5 ALoS related to an SSP

module n° 5icao state safety programme (ssp) implementation course 1 module n° 5 – alos related...

Documents

ssp module

safety management module

module n

ssp implementation plan

ssp slide

icao ssp framework module

ssp training programme

meaningful safety indicators