IV&V Facility

Independent Verification & Validation (IV&V) Services Contract Industry Day

NASA/GSFC/IV&V Facility

Fairmont, West Virginia

January 6, 2011

IV&V FacilityAgenda

• 9:00 – 10:00– Welcome, Introduction and Logistics

– IV&V Program Vision and Mission

– Procurement Overview

• 10:00 – 11:00 – Technical Overview

• 11:00 – 12:00 – Question and Answer

• 12:00 – 2:00 – Break for Lunch

• 2:00 – 4:00 – Tour of the IV&V Facilities

• Adjourn

2

IV&V FacilityDisclaimer

In the event of any inconsistency between data provided in these charts or today’s tour and the Final RFP, the language in the

Final RFP, including any amendments, will govern.

3

IV&V FacilityLogistics

• No food in this Auditorium• Fire exits to the building• Restrooms are down the hall on the left• This presentation will be placed in procurement

proposal library• Please silence all cell phones• Vending machines with soda, coffee and snacks down

the hall on the left• You will be responsible for lunch• Internet access – free public wireless

4

IV&V Facility

Approach to Q&A Session

• Q&A session will allow attendees to pose questions regarding the procurement

• Please form line at microphone to pose question(s)– Provide name, company and question

• Government may not be able to or in position to answer all questions at this event– Government intends to post list of all questions/answers on procurement website

• Government will ensure each entity/attendee has equal opportunity to pose questions– Desire to avoid any one entity from domineering the Q&A session

• Please use index cards to document all questions (regardless of whether you are going to ask in person)

• Return index cards to Christina Moats5

IV&V Facility

Approach To IV&V Facility Tour

• What: – Walking tour of office location where potential offeror’s staff would be

located

• When: – 2pm

• Where: – 5000 NASA Blvd (new building)

– Enter via the rear entrance and to the left into the North Tower

– Meet in the lobby

• How:– Register out front of the auditorium, if you are not registered then there

will be no one available to provide the tour

• Parking: – In rear of the building

IV&V Facility

I-79 Technology Park Research

Center

NASA IV&V Facility

5000 NASA Blvd.

IV&V Facility

IV&V Program Vision & Mission

Vision•The NASA IV&V Program provides confidence and integrity in software that cannot be found elsewhere

Mission•The NASA IV&V Program will reduce the inherent risk in the Agency’s ability to procure, develop, deploy and operate software within desired cost, schedule and performance goals by

– Performing IV&V on safety and mission critical software– Providing software expertise to the Agency’s SMA activities– Conducting research that improves IV&V and software assurance

methods, practices, and tools– Performing Science, Technology, Engineering, and Mathematics

(STEM) outreach– Performing management and institutional services with excellence

8

IV&V Facility

Procurement Overview of

Draft RFP NNG11310421R

IV&V Facility

Procurement OverviewHistorical Information

• The IV&V services are currently provided through multiple award, CPAF, IDIQ contracts under NNG05CB16C with L-3 Services, Inc. and NNG05CB17C with Northrop Grumman (Recently novated to TASC).

• The maximum value of each contract is $200M for a five year ordering period May 11, 2005 through May 10, 2010.

• Both contracts were extended through November 10, 2011.

10

IV&V Facility

Procurement OverviewActivities to Date

11

IV&V Facility

Procurement OverviewRFP Information

12

IV&V Facility

Procurement OverviewRFP Information

13

IV&V Facility

Procurement OverviewRFP Information

14

IV&V Facility

Procurement OverviewRFP Information

15

IV&V Facility

Procurement OverviewRFP Information

16

IV&V Facility

Procurement OverviewContract Execution Information

17

IV&V Facility

Procurement OverviewMission Suitability Volume

18

IV&V Facility

Procurement OverviewProposal Submission Information

19

 Total Small Businesses (SB) 25.0%*Small Disadvantaged Business Concerns (SDB) (Includes SDBs in both targeted and non-targeted areas.)

8.0%

Women Owned Small Business Concerns (WOSB) 4.5%Historically Black Colleges and Universities (HBCU) 0.5%HUBZone Small Business Concerns (HBZ) 6.0%Veteran Owned Small Business Concerns (VOSB) 1.5%Service-Disabled Veteran-Owned Small Business Concerns (SDVOSB)

1.0%

IV&V Facility

Procurement OverviewCost Volume

20

IV&V Facility

Procurement OverviewPast Performance Volume

21

IV&V Facility

Procurement OverviewOverall Evaluation

22

IV&V Facility

Procurement OverviewOverall Evaluation (Cont.)

23

IV&V Facility

Procurement OverviewMiscellaneous

24

IV&V FacilityTechnical Overview

Areas of the IV&V Program within scope of this procurement25

IV&V Office

IV&V Projects Group

Research & Development Group

Technical Quality & Excellence Group

Software Assurance Tools Group

IV&V Office of the Director

Strategic Communications

Office

Safety & Mission Assurance Support

Office

Program Support Office

IV&V FacilityTechnical Overview

• Statement of Work (SOW)– Represents the set of requirements that shall be fulfilled by the Contractor

– Core set of functions relative to this procurement• Independent Verification and Validation (IV&V)

• Research and Development (R&D)

• Technical Quality and Excellence (TQ&E)

• Software Assurance Tools (SWAT) Support

• Safety and Mission Assurance (SMA) Support

• Management

• Mission Forecast– Identifies the specific projects that shall be worked on for the given time period

• Scope– This contract facilitates the above functions to be provided by a contractor and

applied to selected system software being developed by or for NASA, other Federal, State and local government agencies, commercial entities and/or other organizations and institutions as directed by NASA.

26All information contained within already exists, this is simply a summary

IV&V FacilitySOW: Core Set of Functions

• IV&V

– A systems engineering process that produces empirical evidence to reveal the correctness and completeness of the system’s software as it evolves through a development life cycle.

– Leverages technical references and IEEE 1012 standard• IV&V formulates an understanding of the system and operational needs of the

system software = IV&V’s Technical Reference

• Validation is the analytical process of evaluating the system’s software throughout the development life cycle to determine whether or not the system’s software satisfies its intended use and that user needs are satisfied within the context of the system and its expected use.

• Verification is the analytical process that determines whether or not the products of a given development activity conform to the requirements established for the activity.

– IV&V’s Technical Reference and developer artifacts are subject to the analytical processes to develop the needed evidence to determine whether or not the system’s software is going to satisfy the goals of the system. 27

IV&V FacilitySOW: Core Set of Functions (cont)

• IV&V (cont)

– IV&V is performed by an organization that is• Technically independent

– The IV&V Program develops their understanding of the system & operational needs

– The IV&V Program formulates their technical evidence in parallel with the developing organization

– The IV&V Program reports their technical results independently at milestone reviews (Critical Design Reviews, Flight Readiness Reviews, etc…) as well as they report directly to the Chief of the Office of Safety and Mission Assurance

• Managerially independent– The IV&V Program is managed through NASA Headquarters' Office of Safety and

Mission Assurance

• Financially independent– The IV&V Program is funded by the Agency and other reimbursable sources

28

IV&V FacilitySOW: Core Set of Functions (cont)

• Research and Development (R&D)– Based on understanding the trends, challenges, emerging requirements/needs and

problems with conducting IV&V and SMA on system software

– Based on integrating practical solutions into the engineering approaches employed by IV&V and SMA.

– R&D advances the IV&V and SMA processes, tools, and knowledge through the exploration and integration of practical solutions.

– Emphasis is geared towards practical solutions for validated problems and seamless integration of R&D solutions into the engineering approaches.

• Technical Quality & Excellence (TQ&E)– Quality and excellence function to ensure that the best services and products from

IV&V projects are being provided to our customers. • Ensures high quality IV&V products and services result from performing best engineering

approaches consistently across IV&V projects

• Ensures that IV&V engineering approaches are effective and efficient.

29

IV&V FacilitySOW: Core Set of Functions (cont)

• Software Assurance Tools (SWAT) Support– An enabling function for our prime IV&V contractor to work with and support our

SWAT prime contractor

– Responsible for supporting SWAT with the integration of tools advanced through R&D into the operational world.

– Responsible for supporting SWAT by providing knowledge and assistance in the use of the tools and tool based solutions.

• Safety and Mission Assurance (SMA) Support– Focuses on supporting SMA organizations, primarily NASA Center SMA

organizations, to provide software assurance support.

– Performs short-term focused tasks and provides trained staff to assist SMA personnel, including NASA Center SMA personnel, in accomplishing their SMA objectives, particularly where focused knowledge such as software analysis or software assurance expertise is required.

• Management– Responsibilities include planning, maintaining, monitoring, and adjusting program

and project plans as the above core functions are executing. 30

IV&V FacilityApproach to IV&V Services

• For IV&V, the mission forecast will identify the IV&V projects to be supported, the services to be performed, and the products to be developed– The mission forecast may identify specific items from the IV&V Technical

Framework and IV&V Catalog of Methods for the contractor to perform.• IV&V Technical Framework = IVV 09-1 IV&V Technical Framework

• IV&V Catalog of Methods = description of engineering approaches proven to be effective

• For R&D, the mission forecast will describe the technical areas of interest that are to be researched and advanced and/or direction for the contractor to identify such areas. – Areas of interest is also driven by the other work being defined in the mission forecast

• For TQ&E, the mission forecast will describe the specific IV&V projects that require support, as well as any other generic (across multiple IV&V Projects) services that are needed from a TQ&E perspective.

31

IV&V FacilityApproach to IV&V Services (cont)

• For SWAT Support, the mission forecast will describe the CASE tools that need supported (developed, procured/licensed, and/or maintained) and the resident experts that are needed for the CASE tools being offered.– Areas of interest is also driven by the other work being defined in the mission forecast

• For SMA Support, the mission forecast will describe the services needed to be provided in support of the SMA activities being conducted at the various Centers.

• For Management, the mission forecast will describe the services needed to be provided from the contract level as well as from an individual project level.

32

IV&V FacilityIV&V Project Interfaces

• The paradigm for interfacing with a development project in the performance of IV&V is as follows. – Some of the Contractor staff may be located at the Development Project site(s) to

function as the “eyes, ears, and advocates” of the IV&V effort.

– Most of the Contractor staff is located at the IV&V facilities to promote synergism across projects.

• The IV&V Program provides cubicle space and computers for analytical work to be performed

• If Contractors reside outside the IV&V facilities in Fairmont, then the Contractor’s company is responsible for providing the off site employees with electronic access to the NASA IV&V network

– All information and analytical work resides within NASA network so access for off site Contractors is the responsibility of the Contractor

– The Contractor staff is composed of both IV&V Project domain experts, software assurance experts and software discipline experts.

– Contractor management is located at the IV&V Facility to promote timely and effective working relationships with the NASA staff and management.

– NASA IV&V Project Managers are located at the IV&V facilities.

– The Development Projects do not have representatives at the IV&V facilities.33

IV&V FacilityOther Project Interfaces

• R&D Project Interfaces– Interact with IV&V/SMA project personnel in understanding challenges and

discussing practical solutions

– Interact with SWAT and TQ&E to ensure potential R&D solutions can adequately be integrated into IV&V operations

– Interact with the NASA civil servant serving as R&D Group lead for planning, statusing, monitoring accomplishments

– Interact with IV&V/SMA/System Software engineering community at large

• TQ&E Project Interfaces– Interact with other TQ&E members, IV&V project personnel, and TQ&E group lead

• SWAT Project Interfaces– Contractor personnel supporting SWAT activities will interface directly with the

SWAT Group Lead as well as with the primary contractor performing SWAT functions

– Contractor personnel supporting SWAT activities will also interface directly with IV&V project personnel and SMA Support personnel when needed

34

IV&V FacilityOther Project Interfaces (cont)

• SMA Project Interfaces– SMA support personnel will interface with the IV&V SMA Office Lead and other

support personnel (even across functional areas)

– SMA support personnel will also interface directly with other SMA professionals at various Centers

• Management Interfaces– It is expected that the Contractor will conduct and maintain dialogue at various levels

of the IV&V Program (Offices, Deputy Director, Director). • At times, the Government may request Contractor management to support interactions

external to the IV&V Program. – (Development Projects, SMA organizations, Center Management and associated personnel, etc.)

• Additionally, the Contractor shall notify the Government if they initiate or are invited to interface or interact with external interfaces regarding IV&V Program information.

• The Government expects routine dialogue and interactions amongst personnel supporting the functional areas defined in this SOW as to be standard practice

– The Government expects that, on some occasions, personnel supporting TQ&E, R&D and SWAT may need to interface with IV&V customers and stakeholders

35

IV&V FacilitySome Things to Note

• Specific requirements for the core functions are specified in the SOW

• There is potential for the Contractor to perform IV&V functions on Non-NASA projects

• There is potential for the Contractor to perform IV&V on classified projects

• The Contractor may be asked to serve as the Project Manager for an IV&V Project– This is not planned to be the typical case

• The Contractor is to manage the resources allocated across the projects and ensure optimal utilization of personnel in fulfilling project requirements across the core set of functions

• We are looking for a partner in leading the advancement of IV&V and its application on our customer’s systems

36

IV&V FacilitySome Things to Note (cont)

• In parallel with this procurement, we are procuring SWAT services/products this year as well

• There are requirements in this procurement package regarding SWAT: – Tools and methods cannot be integrated into our practices without IV&V

practitioners part of tooling process

– The requirements to be fulfilled in this SOW are to ensure that the IV&V Contractor is included in SWAT activities and proactively supports the objectives of SWAT

37

IV&V Facility

Q&A Session

• Q&A session will allow attendees to pose questions regarding the procurement

• Please form line at microphone to pose question(s)– Provide name, company and question

• Government may not be able to or in position to answer all questions at this event– Government intends to post list of all questions/answers on procurement website

• Government will ensure each entity/attendee has equal opportunity to pose questions– Desire to avoid any one entity from domineering the Q&A session

• Please use index cards to document all questions (regardless of whether you are going to ask in person)

• Return index cards to Christina Moats38