pbn safety assessment apac pbn seminar f.lecat (icao) 10 june 2015
TRANSCRIPT
PBN safety assessment
APAC PBN SeminarF.LECAT (ICAO)
10 June 2015
2
Outlines• Management of change• PBN Safety Assessment Initial Checklists:
Background• First and foremost: a project framework!• Safety risk management process• PBN oversight
03 March 2014
3
SMS Element 3.2 The management of change
• ICAO Doc 9859 SMM “The service provider shall develop and maintain a formal process to identify changes which may affect the level of safety risk associated with its aviation products or services and to identify and manage the safety risks that may arise from those changes.”
• A new PBN procedure, an amendment to existing procedures, or a change in the airspace are changes that– aim at bringing more efficiency and even mitigating existing
risks… – but may also raise new risks
03 March 2014
4
Background• PBNICG/1 in March 2015: PBN Safety Assessment
Initial Checklists for RNP APCH and SID/STAR• Transitional material until ICAO global guidance
material becomes available• Since PBNICG/1:
– clarification of checklist items, – provision of reference materials, – role distinction between safety assessor, a procedure
designer and a procedure reviewer– distinction between a new and an amended procedure
• Will be proposed for adoption by PBNICG03 March 2014
First and foremost: a project framework!• Implementation matrix: 7 stages, 30 actions • Achieving measurable results
1. PROJECT PLANNING
2. DESIGN
3. SAFETY
4. COMMUNICATION
5. TRAINING
6. IMPLEMENTATION
7. POST -IMPLEMENTATION
Stage Number Action A Action B Action C Action D Action E Action F 1. PROJECT PLANNING Identify the
problem or improvement required
Assess applicability to operating environment and State regulations
Gather and review data related to the desired change
Assess economic feasibility and cost/benefit
Start the project, determine project budget and milestones
Plan tendering and maintenance contract process
2. DESIGN Determine initial design of the desired change, including alternatives
Determine Key Performance Indicators and/or success criteria
Design backup and transition procedures/ steps, including reversion
Determine maintenance considerations
Refine and agree on final design
Define system validation and verification (FAT, SAT)
3. SAFETY Form safety teams or engage relevant safety experts
Assess operational strengths and weaknesses, opportunities, and threats (SWOT)
Develop the safety case
Prepare and apply for regulatory approval or certification
4. COMMUNICATION Consult with key stakeholders
Coordinate Regionally and bilaterally
Conduct formal promulgation/ notification
Advertise and brief about the change
5. TRAINING Develop simulations and procedures
Source relevant training experts
Conduct simulation and relevant training
Assess competency and authorise
6. IMPLEMENTATION Conduct operational trials and testing
Assess stability and performance
Make a Go/No-Go decision
Implement and monitor
7. POST -IMPLEMENTATION
Develop review -Lessons learnt -KPI achievement -Report
Monitor medium and long term performance and safety
Implementing Seamless ATM in APAC5
6
First and foremost: a project framework!
03 March 2014
7
Safety risk management process• Should be conducted in accordance with the
State/Administration SMS:– a) the safety policy and objectives;– b) SMS requirements;– c) SMS processes and procedures;– d) accountabilities, responsibilities and authorities
for SMS processes andprocedures; and– e) SMS outputs.
• Oversight by an oversight entity03 March 2014
8
Safety risk management process
03 March 2014
9
Draft checklists available• PBN Procedure Safety Assessment Initial
Checklist – RNP APCH• PBN Procedure Safety Assessment Initial
Checklist – SID/STAR• PBN Safety Assessment Initial Checklist – ATS
Route
03 March 2014
Microsoft Word 97 - 2003 Document
10
Qualitative safety risk assessment matrix
10 June 15
Tolerability Description Assessed Risk Index Suggested Criteria
5A, 5B, 5C, 4A, 4B, 3A
Unacceptable under the existing circumstances
, , , , , , , , , ,
Acceptable based on risk mitigation. It may require
management decision.
3E, 2D, 2E, 1B, 1C, 1D, 1E
Acceptable
11
Safety risk assessment matrix• Unless otherwise specified by national SMS…
– Qualitative matrix could be used for a new or an amended domestic and continental ATS route.
– However, a quantitative method has to be applied when a target route is established in high seas and/or separation between aircraft or ATS routes is less than recommended in ICAO documents such as PBN Manual (Doc 9613) and PANS-ATM (doc 4444)
– Quantitative safety assessment can be assisted by sub-regional En-route Monitoring Agency (EMA) which is approved by Regional Airspace Safety Monitoring Advisory Group (RASMAG) of APANPIRG and provides airspace safety assessment, monitoring and implementation services for international airspace in the Asia/Pacific region
03 March 2014
1203 March 2014
Record on Identification, Analysis and Mitigation of Hazard(can be used if no other document is available as part of the SMS procedures)
13
Safety performance monitoring and measurement
• “3.1.1 The service provider shall develop and maintain the means to verify the safety performance of the organization and to validate the effectiveness of safety risk controls.
• 3.1.2 The service provider’s safety performance shall be verified in reference to the safety performance indicators and safety performance targets of the SMS.”
03 March 2014
03 March 2014 14
Simple change/Amendment of existing
procedure
Complex change (airspace impacted)
Organization/People Procedures Equipment Data
Design of procedure
Identification of hazards and risk analysis (probability, severity)
Identify hazards through:- Brainstorming Sessions with ALL local stakeholders (Pilots, ATCO etc)- PBN Procedure Safety Assessment Initial Checklist – RNP APCH- PBN Procedure Safety Assessment Initial Checklist – SID/STAR- PBN Safety Assessment Initial Checklist – ATS Route- Analyse Incident Reporting
- Safety plan- Operational Hazard analysis, safety objectives - Collision Risk Model (CRM)- Airspace modelling- Fast-Time Simulation (FTS)- Real-Time Simulation (RTS)- Benchmarking- Analyse Incident Reporting
Contract an approved IFP designerInvolve operators from the beginning
Consider operating environment (including physical conditions, airspace and route design, runway and obstacles) and traffic density/complexity
Consider existing fleet capabilities and operational approvals
Consider modelisationWGS84Dataset (configuration) of the flight procedure desgin tool
Validation of procedure
Make flight validations- Make flight validations- OPS readiness evaluations, trials
HMI evaluationCrew workload
Contingency procedures
Consider airborne and ground sides- Airborne: airworthiness process (Manufacturer, System, Part Number, Software Version, sensors (GPS, DME/DME/IRU))
- Ground: ATM systems, human machine interface (HMI), Navaids
Operators should have processes for managing navigation databases
Data obtained from an approved supplier ( Letter of Acceptance (LOA) from Regulators) - RTCA/DO-200A
Risk control/mitigation (mitigation strategy)
Determine actions to take to mitigate the risk
Derive safety objectives into safety requirements (people/procedures/equipment/data)
Operators: Train crewANSPs: Train ATCOs
Job descriptions, training programme, training records
ANSPs: Assess outcome of flight validations and OPS readiness evaluations, trials, comply with AIM requirementsOperators: based on OPS approvals and direct consultation with operators
ANSPs: Based on satisfaction of safety requirements by ATM system and infrastructure Operators: Based on airworthiness approvals
Enforce a quality assurance processComply with AIM publication requirements
Safety assessment
Complete the mitigation part of Record on Identification, Analysis and Mitigation of Hazard
ANSPs: collect evidences from flight validations and trials
Operators: Collect evidences from OPS approvals
Operators: Collect evidences from OPS approvals
Operators: Collect evidences from OPS approvals
Dabase suppliers: collect Letter of Acceptance (LOA) from Regulators
Keep analysing incident reporting
Keep analysing incident reporting
Pre-implementation
ANSPs: monitoring of safety indicatorsOperators: based on continued airworthiness
Flight inspections of instrument flight procedures, including obstacle checks Post-implementation
15
PBN oversight• Regulations as basis for procedure design in accordance with ICAO PANS OPS
provisions• PANS OPS inspectorate:
– functions and responsibilities, sufficiently staffed, job descriptions (minimum qualifications and experience requirements)
– training programme, periodic training plan appropriately implemented for PANS-OPS inspectorate staff
– OJT– maintenance of training records
• Oversight office or entity (delegation possible)– conducts oversight over its procedures specialists or service providers– oversees the process of development and maintenance of visual and instrument flight
procedures establishment of aerodrome operating minima– minimum qualification requirements for procedures specialists and/or service providers
who are responsible for the design of flight procedures– mechanism/system with time frame for elimination of deficiencies – periodic review of published procedure designs (changing criteria, user requirements)
03 March 2014
16
PBN oversight (cont’d)• PANS OPS service providers
– retain all procedure design documentation (correction of data anomalies or errors found during the production, maintenance or operational use of the procedure)
– job description for its PANS OPS technical staff– training programme for PANS OPS technical staff– training records – flight inspections of instrument flight procedures, including
obstacle checks– publishes obstacle clearance altitude/height – operating minima (e.g. visibility, minimum descent
altitude/height (MDA/H), decision altitude/height (DA/H)) for instrument approaches at aerodromes
03 March 2014