Integrating NASA Technical Standards with NASA Lessons Learned

PM Challenge

February 10, 2011

https://standards.nasa.gov

Agenda

I. Overview of Tech Standards ProgramII. NEN/LLIS/START IntegrationIII. Lessons Learned Program Overview

I. Applying the old to the new programsII. Capturing the old programs going away (Shuttle,

Constellation)IV. Demo - Use Cases

I. NASA Standard (show link & details )II. Industry Standard

V. QA

3

NTSP Overview

• NASA Technical Standards Program was established in 1997

• Program objectives: – Establish and Maintain “NASA Technical Standards” as a Common Baseline

for NASA Programs• Evaluate, Support, and Adopt National and International Standards where

they meet NASA’s needs• Develop Internal NASA Standards where available standards are not

adequate

– Support the Use of Technical Standards on NASA Programs in the Systems Requirement Process

• Provide Access for All <nasa.gov> Users to Full Text Standards ~ 370 Sources at http://standards.nasa.gov

• Link Standards to Lessons Learned for more effective use• Provide automated Notice of Updates for Standards registered by users

https://standards.nasa.gov

4

Primary Activities of NTSP

Document• Manage the development of NASA Standards where no industry

standard will suffice

Deliver• Provide access to government and industry standards through the

Standards and Technical Assistance Resource Tool (START)

Educate• Create awareness about the Program’s mission and activities

across the Agency• Assist and educate users on the functions of START

https://standards.nasa.gov

5

• Agency-wide access to ~1.4M Specifications, Standards, and engineering tools http://standards.nasa.gov

• Approximately 13,000 registered users

• Watch Lists/Alerts Feature– Provides electronic notification

of revisions for registered standards imposed on contracts by program/projects

• Technical Standards Tutorials to provide more information on high-profile standards

START Overview

https://standards.nasa.gov

6

• Haystack Gold®

– Logistics part information from over 40 databases

• 4D-Online Parts Universe– Electronic component database with more than 25 million

parts

• eFunda– Engineering reference resource

• MatWeb– Searchable database of materials properties

• Materials and Processes Technical Information System (MAPTIS)– Single-point access for materials properties for NASA and

NASA associated contractors and organizations

Engineering Tools

https://standards.nasa.gov

7

46 Subscription SDO (23 Added 7/30/2010)

• AA• AATC• ABMA• ACI• AIA• AIAA• API• ARINC• ASA• ASCE• ASHRAE• ASME (inc BPVC) (with historical)• ASSE/SAFE• ASTM (with historical)• ASQ• AWS• AWWA• BHMA• BMI/MMPDS (Battelle)• CGA• CSI• ECA• ESDU (GSFC – JPL - MSFC)• EOS/ESD

• GEIA• ICC• IEC• IEEE• IESNA• IEST• IPC• ISA• ISO• MSS• NBBPVI• NECA• NEMA• NETA• NFPA (fire)• NIBS• NSF• SAE• SMACNA• SSPC• TIA• UL• Government & Mil (with historical)

Unlimited access for 16 NASA locations - ~ 8000 registered users

NEN/LLIS/START Integration

Provide bidirectional navigation between NASA Lessons Learned and NASA/Industry/Government Standards to improve visibility of the related content to the users.

Integration of NEN, LL and Standards significantly improves the interoperability of the NASA Lessons Learned and the Standards program and increase the overall value to the NASA user community.

802/03/2010

NEN/LL/NTPS USER REQUIREMENTS

1. Quick, simple pointers and links.

2. Common (or more similar) look and feel.

3. Refine business processes and templates (for Standards, Lessons, etc.) to harvest more metadata as NEW products are developed/generated.

4. Update metadata on existing products (Lessons, Standards, etc).

5. Common search-retrieve device.

6. Live update device/process to allow users to update a reference within products.

902/03/2010

Search StandardsProduct

Search LLIS

10

Flow Overview Before Integration

NASA Standards

Industry/Government Standards

NASA Lessons Learned

NASA Center Level Lessons Learned

• A small subset of the linking between NASA/Industry/Government Standards and the Lessons Learned in LLIS

• Expand the bidirectional linking (red lines) between NASA/Industry/Government Standards to the Lessons Learned in LLIS

Other NASA Tools & Repositories

Cross Collection Keyword Search

11

Flow Overview After Integration

NASA Standards

Industry/Government Standards

NASA Lessons Learned

NASA Center Level Lessons Learned

• Cross collection keyword searching which significantly improves visibility in both systems

Introduction to the LLIS

• Web-based system developed in 1994

• Over 2,000 Lessons dating back to 1972

A lesson learned is knowledge or understanding gained

by experience. The experience may be positive, as in a

successful test or mission, or negative, as in a mishap

or failure. Both should be considered excellent

sources of lessons learned.

13http://llis.nasa.gov/http://nen.nasa.gov/web/LL

Lessons are available on a Public and Internal Site

14

Existing documents such as PowerPoint presentations, white papers and technical reports can be used to create lessons

A lesson learned entry 1) pertains to safety or

mission success2) is likely to be relevant to

other projects3) does not duplicate an

existing lesson learned

15

Lessons learned are important to future programs because they show insights from previous projects.

A lesson learned is knowledge or understanding gained by experience. The experience may be positive, as in a successful test or mission, or negative, as in a mishap or failure. Both should be considered excellent

sources of lessons learned.

Lessons Sources

Test

Mishap

Mission CompleteFacilitated Pause & Learn Session

To search the LLIS or submit a lesson, go to http://llis.nasa.gov

Lessons Learned Lifecycle

Customers

•Researchers•Designers•Project Managers

• Lessons Learned Entry: 0031 Maintenance of High, Exposed Equipment

• Lessons Learned Entry: 0138 GOX Vent Arm Air Receivers Bleed Manifold Venting Operations

• Lessons Learned Entry: 0154 Pneumatic and Fluid Quick Disconnects.

• Lessons Learned Entry: 0157 External Tank (ET) Vent Deceleration Unit

• Lessons Learned Entry: 0187 Hydrogen Vent Umbilical.

• Lessons Learned Entry: 0188 T-0 Umbilical Carrier Plate.

• Lessons Learned Entry: 1323 Interface Control Document (ICD) Violations by Payload Developer

• Proceedings of the 34thAerospace Mechanisms Symposium, Goddard Space Flight Center, May 10-12,2000

• Technical Memorandum 33-777 10th Aerospace Mechanisms ; Symposium April 22-23, 1976

• Lessons Learned Entry: 0031 Maintenance of High, Exposed Equipment

• Lessons Learned Entry: 0138 GOX Vent Arm Air Receivers Bleed Manifold Venting Operations

• Lessons Learned Entry: 0154 Pneumatic and Fluid Quick Disconnects.

• Lessons Learned Entry: 0157 External Tank (ET) Vent Deceleration Unit

• Lessons Learned Entry: 0187 Hydrogen Vent Umbilical.

• Lessons Learned Entry: 0188 T-0 Umbilical Carrier Plate.

• Lessons Learned Entry: 1323 Interface Control Document (ICD) Violations by Payload Developer

• Proceedings of the 34thAerospace Mechanisms Symposium, Goddard Space Flight Center, May 10-12,2000

• Technical Memorandum 33-777 10th Aerospace Mechanisms ; Symposium April 22-23, 1976

16

60% Design Review Lessons Learned Report Ares-1 Upper Stage

Liquid Oxygen Umbilical (LO2U)/Liquid Hydrogen Umbilical (LH2U)

LLIS Search -> Which Lessons Might Impact the Design?

17

LLIS Search -> Which Lessons Might Impact the Design?

Quick disconnect for different systems should be designed differently in order

to prevent cross-connections

18

End of Program Lessons Learned Collection KSC Shuttle Ground Ops (184 lessons identified)

• Many of these lessons learned entries concern the interface between the space shuttle system and the ground processing infrastructure.

• Design considerations & requirements can be mined for road mapping infrastructure upgrades for Commercial Crew, 21st Century Launch Complex, Heavy Lift and Flagship Technology.

Categories of technical standards that relate to this lesson

New Feature

Selecting the “torque” category provides this list of relevant standards

Selecting the “bolts” category provides this list of relevant standards

Selecting the “installing” category provides this list of relevant standards

Selecting the “space shuttle” category provides this list of relevant standards

24

Demo - Use Cases

I. Tech Standardsa. NASA Standard (show link & details )b. Industry Standard

Questions

27

BACK UP SLIDES

START Website

List of NASA Standards

Associated Lessons Learned

Lesson 0652

33

Search of NASA Tech StandardsWith the Keyword “systems engineering” specified

01/26/2010

3401/26/2010

35

From most CoP’sWe will have A StandardsAnd References Section

01/26/2010

5.0 - COMMUNITY LIST OF STANDARDS

36

Will be populated from search results of the Tech Standards collection based on the keyword of the Community

02/03/2010

NTSPO Standards Product - Current Functionality Standards Search By Document Number

Link to Documents Details page with Access to Lessons

Learned

3704/10/2023

NTSPO Standards Product - Current Functionality Document Details with Lessons Learned

Lessons Learned Number, Date, Abstract and link to

Lesson Learned

3804/10/2023

NTSPO Standards Product – with bidirectional linkingView Lessons Learned – Showing Document and References

Lessons Learned document

Links to the Referenced Standards

3904/10/2023

Requirements 5.0A - NTSPO Standards Product Search Lessons Learned – Showing Implicit Keyword Searching

Search returning Lessons Learned and keyword related

documents

4004/10/2023