complimenting the emad-r process...complementing the emad-r process for non-eu recognition the pbp...
TRANSCRIPT
Complementing the EMAD-R process for non-EU recognition
The PBP Bow-Tie assessment and Iris Charts
FLTLT Leon Purton Mutual Recognition Research
DGTA-ADF
Dr Kyriakos Kourousis Senior Lecturer
University of Limerick (formerly RMIT) Military Airworthiness Conference 2014 – Rome, Italy
1
Context
• It was agreed at ASIC June 2013 that the EMAD-R process would be utilised by ASIC
• It was noted that the EMAD-R had a reliance on EMARs for establishing a baseline
• AU took an action to develop a method of assessing regulatory frameworks for base-lining (EMAD-R Step 5)
Military Airworthiness Conference 2014 – Rome, Italy
2
Scope
• Development of an assessment methodology
• What are test points
• Representing the assessment pictorially
• Types of representation
• Some examples
• Analytical comparison
Military Airworthiness Conference 2014 – Rome, Italy
3
Process • AU realised that attempting this while holding
down other duties would be difficult
• Established research position within RMIT University
• Focused on addressing this goal while assisting current recognition goals
• Assisted by intellectual rigour of academia
• Resulted in a published thesis
• Conducted a review of Western military aviation to understand requirements for diverse application
4 Military Airworthiness Conference 2014 – Rome, Italy
The PBP Bow-Tie – Technical Integrity
5
Loss of Technical Integrity
Thre
at t
o
Effe
ct o
f
Behavioural Integrity Behavioural Integrity
Good Product, Good People, Good Processes
Military Airworthiness Conference 2014 – Rome, Italy
The PBP Bow-Tie – Technical Lifecycle
6
Design Produce Maintain
Supply
Management
Technical Item Lifecycle
Military Airworthiness Conference 2014 – Rome, Italy
The PBP Bow-Tie – Making an Attestation
7 Military Airworthiness Conference 2014 – Rome, Italy
8
The PBP Bow-Tie – Overlaying the concepts
9
Identifying Regulator Interaction
10
Key to visualising regulatory framework
Military Airworthiness Conference 2014 – Rome, Italy
Examples - representation
12
Product
Behaviour
Process
ADF Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
Process
EASA Bow-Tie Assessment
Main
tenan
ce
Military Airworthiness Conference 2014 – Rome, Italy
Examples – internal comparison
13 Military Airworthiness Conference 2014 – Rome, Italy
Examples – External comparison
4th Meeting of the ASIC Airworthiness Working Group – San Diego 25-27 Feb 14 14
ASIC Nations
• I have assessed the seven service organisations within the five Nations.
• Detailed analysis based on Iris Chart visualisations of ADF comparison with:
• NZDF
• US Army
• US Navy
• Used to complement recognition activities
15 Military Airworthiness Conference 2014 – Rome, Italy
ADF and NZDF
16
NZD
F AD
F Design Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE
Example test point comparison
4th Meeting of the ASIC Airworthiness Working Group – San Diego 25-27 Feb 14 17
NZD
F AD
F Design
Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE INDUSTRY
ADF and US Army
19
US
Arm
y AD
F Design Design
Production Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENSE
US
Arm
y AD
F Design Design
Production Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENSE INDUSTRY
ADF and US Navy
21
AD
F Design Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE U
SN
AD
F Design
Design
Production
Production
Maintenance Maintenance
Process
Product
Behaviour
Product
Product
Product
Behaviour
Behaviour
Behaviour Behaviour
Behaviour
Process
Process
Process Process
Process
Product
Product
DEFENCE INDUSTRY
USN
The ASIC Nations
23
Product
Behaviour
Process
ADF Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
Process
UK MAA Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
Process
US Army Bow-Tie Assessment
Main
tenan
ce
Product
Behaviour
US Navy Bow-Tie Assessment
Main
tenan
ce
Process
(b) (d)
(e)
(a)
(c)
Product
Behaviour
Process
NZDF Bow-Tie Assessment
Main
tenan
ce
Summary • While the assessment is presented on a Bow-Tie,
it really defaults to a Layer of Protection Analysis since the right-hand side does not really translate
• It does, however, provide a powerful communication and discussion tool offering numerous methods of comparison
• Its use will be adopted into an ASIC AIR STD detailing how to complement ASIC recognition using EMAD-R
• It can be used/adapted in many different scenarios, as the same principles apply
24
Questions
25
PAPER 1 Purton, L. and K. Kourousis, Military airworthiness management frameworks: a critical review. Procedia Engineering, article in press.
PAPER 2 Purton, L., R. Clothier, and K. Kourousis, Assessment of Technical Airworthiness in Military Aviation: Implementation and Further advancement of the Bow-Tie Model. Procedia Engineering, article in press.
PAPER 3 Purton, L., et al., Mutual Recognition of National Military Airworthiness Authorities: A Streamlined Assessment Process. International Journal of Aeronautics and Space Sciences, http://ijass.org/PublishedPaper/topic_abstract.asp?idx=436
PAPER 4 Purton, L., et al., The PBP Bow-Tie Framework for the Systematic Representation and Comparison of Safety Regulatory Frameworks. RAeS Aeronautical Journal, article in press.