rce workshop - anac · rce workshop software/aeh benedito sakugawa. diego palma. ricardo alves....

56
RCE workshop Software/AEH Benedito Sakugawa Diego Palma Ricardo Alves São José dos Campos, 26-Oct-2010

Upload: others

Post on 29-May-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

RCE workshop

Software/AEH

Benedito SakugawaDiego Palma

Ricardo Alves

São José dos Campos, 26-Oct-2010

Page 2: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

2

RCE workshop – Software/AEH

FAA Notice 8110.110(overview and discussion)

Coffee Break

Early Involvement vs. Independence(brainstorming)

Type of Delegation vs. Activities Visibility(brainstorming)

Page 3: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

3

FAA Notice 8110.110

RCE workshop – Software/AEH

January 27, 2010January 27, 2011

Plan: revise FAA Order 8110.49

Page 4: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

4

FAA Notice 8110.110

Overseeing Suppliers

Software Problem Reporting

Databases

Software Environment

Page 5: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

5

Chapter 1:Properly Overseeing Suppliers

FAA Notice 8110.110

Page 6: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

6

Chapter 1 – Properly Overseeing Suppliers

When to Apply

Contemporary Issues

Oversight Plans and Procedures

Review the Applicant´s Plans

Page 7: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

When to Apply?

When an applicant uses suppliers and sub-tiersuppliers to perform system and software development,verification, and certificationactivities

7

Chapter 1 – Properly Overseeing Suppliers

Page 8: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Contemporary Issues

lack of expertise in compliance activities

V&V of LCData at transition point

Certification tasks in foreign countries

Retention of substantiating data8

Chapter 1 – Properly Overseeing Suppliers

Page 9: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Oversight Plans and Procedures

Create oversight Plans&Proc: ensure supplierswill comply with all regulations, policy, guidance, agreements and standards ...

Planning docs (e.g. CertPlan, PSAC): howvisibility of suppliers’ activities (including COTS vendors)

9

Chapter 1 – Properly Overseeing Suppliers

Page 10: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Review the Applicant’s Plans (1/2)

Visibility into compliance with regulations, policy, plans, standards, and agreements

Integration Management: ...

Designee tasks and responsibilities

Problem reporting and resolution

10

Chapter 1 – Properly Overseeing Suppliers

Page 11: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Review the Applicant’s Plans (2/2)

Integration verification activity

Configuration management

Compliance substantiation & data retention...

Cert.Data in the USA and in English

11

Chapter 1 – Properly Overseeing Suppliers

Page 12: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

12

FAA Notice 8110.110

Overseeing Suppliers

Software Problem Reporting

Databases

Software Environment

Page 13: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

13

Software Problem Reporting

FAA Notice 8110.110

Page 14: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Certification Issues

Aircraft impact analysis

Applicant visibility

Large number of OPRs

14

Chapter 2 – Software Problem Reporting

Page 15: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Oversight

15

Chapter 2 – Software Problem Reporting

Page 16: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Objectives

Reported & Resolved

Software Development Assurance Before Certification

16

Chapter 2 – Software Problem Reporting

Page 17: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Requirements

PR Management PlanSuppliers and sub-tiers processPR CategorizationApplicant notificationReview & change control boardsOPR acceptability criteria

17

Chapter 2 – Software Problem Reporting

Page 18: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Requirements

Suppliers and sub-tiers process

Reported

Assessed

Resolved

Implemented

18

Chapter 2 – Software Problem Reporting

Re-verified

Closed

Controled

Page 19: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Requirements

PR categorization

Aircraft and design assurance impact.

Before certification X Beyond certification

Criteria for deferring problem

19

Chapter 2 – Software Problem Reporting

Page 20: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Requirements

Applicant notification

Applicant X supplier PR system

Describe any tools (action items or observations)

Only one supplier PR system

Visibilities to appropriate disciplines

20

Chapter 2 – Software Problem Reporting

Page 21: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Requirements

Review & change control boards

Flight Test

Human Factors

21

Chapter 2 – Software Problem Reporting

Systems

Software

Page 22: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Requirements

OPR acceptability criteria

Safety, functionality, and operation impacts

Upper boundary or target limit on the number of OPRs

Time limit that OPR will be resolved

22

Chapter 2 – Software Problem Reporting

Page 23: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Authority Activities

Review all OPRs

Assure reassessment of PDS

Assure inter-relationship of multiple POR

Assure review of AD, SB, or Op. Limitation related OPRAssure compliance with DO-178B 11.20 (j)

23

Chapter 2 – Software Problem Reporting

Page 24: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

When to Apply?

Suppliers & Sub-tiers

Before & After Certification

24

Chapter 2 – Software Problem Reporting

Page 25: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

25

FAA Notice 8110.110

Overseeing Suppliers

Software Problem Reporting

Databases

Software Environment

Page 26: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

26

FAA Notice 8110.110

Databases

Page 27: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Database Types

Aeronautical Databases

Airborne System Databases

Other Applications and Databases

27

Chapter 3 – Databases

Page 28: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Certification Issues

Aeronautical Databases appropriate assurance level

Airborne System Databases properly verification

28

Chapter 3 – Databases

Page 29: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Authority Activities

Review loading procedures

Ensure maintenance instructions and limitations

Ensure a process for updating each database

29

Chapter 3 – Databases

Page 30: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Authority Activities

Aeronautical Databases

Ensure DO-200AEnsure appropriate assurance level

30

Chapter 3 – Databases

Page 31: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Authority Activities

Airborne System Databases

Review safety assessment

Ensure appropriate software level

31

Chapter 3 – Databases

Page 32: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

When To Apply?

Aeronautical Databases

Airborne System Databases

32

Chapter 3 – Databases

Page 33: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

33

FAA Notice 8110.110

Overseeing Suppliers

Software Problem Reporting

Databases

Software Environment

Page 34: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

34

FAA Notice 8110.110

Chapter 4: Managing Software Development and VerificationEnvironment

Page 35: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

35

When to Apply

How representative is the Environment?

Controlling the Development andVerification Environment

Chapter 4 – Managing Software Development and Verification Environment

Page 36: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

When to Apply?

When applicant is using a software development or verification environment thatmay not be completely representative of thetarget computer

36

Chapter 4 – Managing Software Development and Verification Environment

Page 37: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

How representative is the Environment?

DO-178B: target computer, target emulator, host computer simulator.

Go through several iterations

Environment Not-EQ final hardware

Needs: ConfigCtrl + PR system37

Chapter 4 – Managing Software Development and Verification Environment

Page 38: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Controlling the Software Development andVerification Environment (SDVE)

SVP should include:

difference between SDVE and production

SDVE description and DO-178B objectives

38

Chapter 4 – Managing Software Development and Verification Environment

Page 39: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Controlling the SDVE (cont’d)

SVP should include:

How SDVE will be used to comply with 178B for

entire .exe

Completed Verification Activities(SDVE-CIA + SDVE evolution + regression?)

39

Chapter 4 – Managing Software Development and Verification Environment

Page 40: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Controlling the SDVE (cont’d)

SCMP should include:

SDVE ConfigCtrl description + responsible

SDVE PR system available to all users(see Chapter 2)

40

Chapter 4 – Managing Software Development and Verification Environment

Page 41: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

41

FAA Notice 8110.110

Overseeing Suppliers

Software Problem Reporting

Databases

Software Environment

Page 42: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Discussion

FAA Notice 8110.110

30 minutes...

Page 43: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Discussion

5 minutes...

Page 44: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

44

RCE workshop – Software/AEH

FAA Notice 8110.110(overview and discussion)

Coffee Break

Early Involvement vs. Independence(brainstorming)

Type of Delegation vs. Activities Visibility(brainstorming)

Page 45: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

45

RCE Workshop – Software/AEH

20 minutes...

Coffee Break

Page 46: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Coffee Break

5 minutes...

Page 47: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

47

RCE workshop – Software/AEH

FAA Notice 8110.110(overview and discussion)

Coffee Break

Early Involvement vs. Independence(brainstorming)

Type of Delegation vs. Activities Visibility(brainstorming)

Page 48: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

48

Early Involvement vs. Independence

Consultant?

Not as an RCE yet ?

What is my technical role?

Commitment?

How am I involved?

+ + & - - ?

Page 49: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Early InvolvementX

Independence

49

Discussion

30 minutes...

Page 50: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Discussion

5 minutes...

Page 51: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

51

RCE workshop – Software/AEH

FAA Notice 8110.110(overview and discussion)

Coffee Break

Early Involvement vs. Independence(brainstorming)

Type of Delegation vs. Activities Visibility(brainstorming)

Page 52: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

52

Are we working together?

Enough autonomy?

Bureaucracy?

Identity crisis?

+ + & - - ?

Type of Delegation vs. Activities Visibility

Page 53: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Type of DelegationX

Activities Visibility

53

Discussion

30 minutes...

Page 54: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

Discussion

5 minutes...

Page 55: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

55

RCE workshop – Software/AEH

FAA Notice 8110.110(overview and discussion)

Coffee Break

Early Involvement vs. Independence(brainstorming)

Type of Delegation vs. Activities Visibility(brainstorming)

Page 56: RCE workshop - ANAC · RCE workshop Software/AEH Benedito Sakugawa. Diego Palma. Ricardo Alves. São José dos Campos, 26-Oct-2010

56