pbn safety assessment apac pbn seminar f.lecat (icao) 10 june 2015

17
PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

Upload: joel-ryan

Post on 21-Dec-2015

261 views

Category:

Documents


10 download

TRANSCRIPT

Page 1: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

PBN safety assessment

APAC PBN SeminarF.LECAT (ICAO)

10 June 2015

Page 2: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

2

Outlines• Management of change• PBN Safety Assessment Initial Checklists:

Background• First and foremost: a project framework!• Safety risk management process• PBN oversight

03 March 2014

Page 3: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

3

SMS Element 3.2 The management of change

• ICAO Doc 9859 SMM “The service provider shall develop and maintain a formal process to identify changes which may affect the level of safety risk associated with its aviation products or services and to identify and manage the safety risks that may arise from those changes.”

• A new PBN procedure, an amendment to existing procedures, or a change in the airspace are changes that– aim at bringing more efficiency and even mitigating existing

risks… – but may also raise new risks

03 March 2014

Page 4: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

4

Background• PBNICG/1 in March 2015: PBN Safety Assessment

Initial Checklists for RNP APCH and SID/STAR• Transitional material until ICAO global guidance

material becomes available• Since PBNICG/1:

– clarification of checklist items, – provision of reference materials, – role distinction between safety assessor, a procedure

designer and a procedure reviewer– distinction between a new and an amended procedure

• Will be proposed for adoption by PBNICG03 March 2014

Page 5: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

First and foremost: a project framework!• Implementation matrix: 7 stages, 30 actions • Achieving measurable results

1. PROJECT PLANNING

2. DESIGN

3. SAFETY

4. COMMUNICATION

5. TRAINING

6. IMPLEMENTATION

7. POST -IMPLEMENTATION

Stage Number Action A Action B Action C Action D Action E Action F 1. PROJECT PLANNING Identify the

problem or improvement required

Assess applicability to operating environment and State regulations

Gather and review data related to the desired change

Assess economic feasibility and cost/benefit

Start the project, determine project budget and milestones

Plan tendering and maintenance contract process

2. DESIGN Determine initial design of the desired change, including alternatives

Determine Key Performance Indicators and/or success criteria

Design backup and transition procedures/ steps, including reversion

Determine maintenance considerations

Refine and agree on final design

Define system validation and verification (FAT, SAT)

3. SAFETY Form safety teams or engage relevant safety experts

Assess operational strengths and weaknesses, opportunities, and threats (SWOT)

Develop the safety case

Prepare and apply for regulatory approval or certification

4. COMMUNICATION Consult with key stakeholders

Coordinate Regionally and bilaterally

Conduct formal promulgation/ notification

Advertise and brief about the change

5. TRAINING Develop simulations and procedures

Source relevant training experts

Conduct simulation and relevant training

Assess competency and authorise

6. IMPLEMENTATION Conduct operational trials and testing

Assess stability and performance

Make a Go/No-Go decision

Implement and monitor

7. POST -IMPLEMENTATION

Develop review -Lessons learnt -KPI achievement -Report

Monitor medium and long term performance and safety

Implementing Seamless ATM in APAC5

Page 6: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

6

First and foremost: a project framework!

03 March 2014

Page 7: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

7

Safety risk management process• Should be conducted in accordance with the

State/Administration SMS:– a) the safety policy and objectives;– b) SMS requirements;– c) SMS processes and procedures;– d) accountabilities, responsibilities and authorities

for SMS processes andprocedures; and– e) SMS outputs.

• Oversight by an oversight entity03 March 2014

Page 8: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

8

Safety risk management process

03 March 2014

Page 9: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

9

Draft checklists available• PBN Procedure Safety Assessment Initial

Checklist – RNP APCH• PBN Procedure Safety Assessment Initial

Checklist – SID/STAR• PBN Safety Assessment Initial Checklist – ATS

Route

03 March 2014

Microsoft Word 97 - 2003 Document

Page 10: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

10

Qualitative safety risk assessment matrix

10 June 15

Tolerability Description Assessed Risk Index Suggested Criteria

5A, 5B, 5C, 4A, 4B, 3A

Unacceptable under the existing circumstances

, , , , , , , , , ,

Acceptable based on risk mitigation. It may require

management decision.

3E, 2D, 2E, 1B, 1C, 1D, 1E

Acceptable

Page 11: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

11

Safety risk assessment matrix• Unless otherwise specified by national SMS…

– Qualitative matrix could be used for a new or an amended domestic and continental ATS route.

– However, a quantitative method has to be applied when a target route is established in high seas and/or separation between aircraft or ATS routes is less than recommended in ICAO documents such as PBN Manual (Doc 9613) and PANS-ATM (doc 4444)

– Quantitative safety assessment can be assisted by sub-regional En-route Monitoring Agency (EMA) which is approved by Regional Airspace Safety Monitoring Advisory Group (RASMAG) of APANPIRG and provides airspace safety assessment, monitoring and implementation services for international airspace in the Asia/Pacific region

03 March 2014

Page 12: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

1203 March 2014

Record on Identification, Analysis and Mitigation of Hazard(can be used if no other document is available as part of the SMS procedures)

Page 13: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

13

Safety performance monitoring and measurement

• “3.1.1 The service provider shall develop and maintain the means to verify the safety performance of the organization and to validate the effectiveness of safety risk controls.

• 3.1.2 The service provider’s safety performance shall be verified in reference to the safety performance indicators and safety performance targets of the SMS.”

03 March 2014

Page 14: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

03 March 2014 14

Simple change/Amendment of existing

procedure

Complex change (airspace impacted)

Organization/People Procedures Equipment Data

Design of procedure

Identification of hazards and risk analysis (probability, severity)

Identify hazards through:- Brainstorming Sessions with ALL local stakeholders (Pilots, ATCO etc)- PBN Procedure Safety Assessment Initial Checklist – RNP APCH- PBN Procedure Safety Assessment Initial Checklist – SID/STAR- PBN Safety Assessment Initial Checklist – ATS Route- Analyse Incident Reporting

- Safety plan- Operational Hazard analysis, safety objectives - Collision Risk Model (CRM)- Airspace modelling- Fast-Time Simulation (FTS)- Real-Time Simulation (RTS)- Benchmarking- Analyse Incident Reporting

Contract an approved IFP designerInvolve operators from the beginning

Consider operating environment (including physical conditions, airspace and route design, runway and obstacles) and traffic density/complexity

Consider existing fleet capabilities and operational approvals

Consider modelisationWGS84Dataset (configuration) of the flight procedure desgin tool

Validation of procedure

Make flight validations- Make flight validations- OPS readiness evaluations, trials

HMI evaluationCrew workload

Contingency procedures

Consider airborne and ground sides- Airborne: airworthiness process (Manufacturer, System, Part Number, Software Version, sensors (GPS, DME/DME/IRU))

- Ground: ATM systems, human machine interface (HMI), Navaids

Operators should have processes for managing navigation databases

Data obtained from an approved supplier ( Letter of Acceptance (LOA) from Regulators) - RTCA/DO-200A

Risk control/mitigation (mitigation strategy)

Determine actions to take to mitigate the risk

Derive safety objectives into safety requirements (people/procedures/equipment/data)

Operators: Train crewANSPs: Train ATCOs

Job descriptions, training programme, training records

ANSPs: Assess outcome of flight validations and OPS readiness evaluations, trials, comply with AIM requirementsOperators: based on OPS approvals and direct consultation with operators

ANSPs: Based on satisfaction of safety requirements by ATM system and infrastructure Operators: Based on airworthiness approvals

Enforce a quality assurance processComply with AIM publication requirements

Safety assessment

Complete the mitigation part of Record on Identification, Analysis and Mitigation of Hazard

ANSPs: collect evidences from flight validations and trials

Operators: Collect evidences from OPS approvals

Operators: Collect evidences from OPS approvals

Operators: Collect evidences from OPS approvals

Dabase suppliers: collect Letter of Acceptance (LOA) from Regulators

Keep analysing incident reporting

Keep analysing incident reporting

Pre-implementation

ANSPs: monitoring of safety indicatorsOperators: based on continued airworthiness

Flight inspections of instrument flight procedures, including obstacle checks Post-implementation

Page 15: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

15

PBN oversight• Regulations as basis for procedure design in accordance with ICAO PANS OPS

provisions• PANS OPS inspectorate:

– functions and responsibilities, sufficiently staffed, job descriptions (minimum qualifications and experience requirements)

– training programme, periodic training plan appropriately implemented for PANS-OPS inspectorate staff

– OJT– maintenance of training records

• Oversight office or entity (delegation possible)– conducts oversight over its procedures specialists or service providers– oversees the process of development and maintenance of visual and instrument flight

procedures establishment of aerodrome operating minima– minimum qualification requirements for procedures specialists and/or service providers

who are responsible for the design of flight procedures– mechanism/system with time frame for elimination of deficiencies – periodic review of published procedure designs (changing criteria, user requirements)

03 March 2014

Page 16: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015

16

PBN oversight (cont’d)• PANS OPS service providers

– retain all procedure design documentation (correction of data anomalies or errors found during the production, maintenance or operational use of the procedure)

– job description for its PANS OPS technical staff– training programme for PANS OPS technical staff– training records – flight inspections of instrument flight procedures, including

obstacle checks– publishes obstacle clearance altitude/height – operating minima (e.g. visibility, minimum descent

altitude/height (MDA/H), decision altitude/height (DA/H)) for instrument approaches at aerodromes

03 March 2014

Page 17: PBN safety assessment APAC PBN Seminar F.LECAT (ICAO) 10 June 2015