NASA IV&V Independent Test Capability JSTAR LabProjectSupportNASA IV&V Independent Test Capability

2011

Lab

ITC Framework

Support

Project Support

2011

AFSS MPCV JWSTGPM JUNO

Project Support

AFSS MPCV JWSTGPM JUNO�Acquire and setup AFSS test

configuration

- AFSS spare flight chassis

�Selected COTS test coverage software

GPM Operational Simulator

Components

�ASIST Ground System Interface

�Wind River Simics

ISIM Software

�Science Instrument Development Unit

(SIDU)

Socrrates-Heavy Simulation

ComponentsJUNO IV&V SUROM Investigation

Objective:

Increase assurance through independent �Selected COTS test coverage software

�Developed reusable mechanism to

generate system test coverage using

socket

- LDRA Funnel (VxWorks task)

�Wind River Simics

�Instrument Simulations (DPR, GMI)

�ITC Synchronous Bus

- 1553 communications

- Spacewire Communications

(SIDU)

�Hardware-in-the-Loop Test

Environment

�Components

- COTS PowerPC Board

Increase assurance through independent

stress testing of SUROM process.

Approach:

Systematically explore combinations of - LDRA Funnel (VxWorks task)

- LDRA Converter

- LDRA Receptor

Test Configuration (HWIL)

- Spacewire Communications

�GDS

�Wind River Simics (RAD750)

�Wind River Workbench Debugging

- 1553 Cards

- Spacewire Test Set (SWST)

- ASIST / Eclipse Ground SystemSocrrates-Lite Simulation Components

Systematically explore combinations of

page faults and image corruption.

Facilities:

- Wind River Simics

- Juno SUROMTest Configuration (HWIL)

Test Configuration (Software-Only)

- Juno SUROM

- Juno FSW Image Files

Test Setup:

Nominal

Spacecraft Flight Software

�Scoping development of software-only

test environment

� In-house Simics model development

Socrrates Features

�Software-only flight simulator

�Utilizes flight software binary

Nominal

- No image corruption

- No page faults

1. Run nominal boot, find setup of MMU

and BAT registers, verify values in IBAT

and DBAT

Test Coverage Results1,000 Monte Carlo Simulations

GO-SIM Features

�Load and run unmodified flight binary

� In-house Simics model development

- JPIM

- SBC

�Successfully loaded SBC code onto

Simics and see basic kernel scheduling

�Utilizes flight software binary

�Provides mechanism to test MPCV

flight software for IV&V

Kedalion

Provide a hands-on environment to

and DBAT

2. Verify image in SDRAM at boot

completionRUN 108/01/11 13:03:10Memory modifications:1,000 Monte Carlo Simulations

Statement Coverage 60%

The number of executable lines: 21,413

The number executed by all runs: 12,804

Branch/Decision Coverage 53%

�Load and run unmodified flight binary

�Execute flight scripts

�Single-step debugging

�Inject errors via ground system

�Stress system under test

Simics and see basic kernel scheduling

and idle calls – requesting additional

information from spacecraft developer

Provide a hands-on environment to

allow early and sustained engineering

analysis and risk mitigation of space

vehicle avionics and software

Test Output����

(Log File)

Memory modifications:Index orig_val mod_val0x25C04B 0xF0 0x180x17B22F6 0xFF 0xBD…Image modifications:Index orig_val mod_val

Branch/Decision Coverage 53%

Number of Branches/Decisions: 5,469

Number executed by all runs: 2,895

�Stress system under test

�Validate findings from other IV&V

analyses

Index orig_val mod_val0x11AA9 0x18 0xAB…Orig_data_crc mod_data_crcOrig_head_crc mod_head_crc

ITC Framework

Current Features Simulation and TestingCurrent Features

Launch and monitor simulations (GOSIM; JUNO)

Simulation and Testing

Common User Interface

Track and view data

Watch Window

Inject Fault Data

Data logging Data logging

Visualization Software Integration

Breakpoints Back-end

Breakpoints

Jon McBride Software Testing and Research “JSTAR” LaboratoryJon McBride Software Testing and Research “JSTAR” Laboratory

Tools Virtual Images

Wind River Workbench 3.2 GPM FSW Tool Chain / Build

Objectives

�Software and test environment

Lab Foundation = Server and Desktop Virtualization

Wind River Workbench 3.2 GPM FSW Tool Chain / Build

Environment

Wind River Simics 4.4 GPM Ground System (Sammi lic req.)

ASIST Ground System PITS

�Software and test environment

development by ITC Engineers

�Testing by IV&V analysts

- Using ITC developed test environmentsASIST Ground System PITS

MSDN Subscription Solaris 10 (x86)

Tornado CentOS version 5 (i386 & x86_64)

LDRA TestBed RedHat Enterprise 5 (x86_64)

- Using ITC developed test environments

- Using various tools

�Tools support (SWAT)

- Perform evaluations test tools LDRA TestBed RedHat Enterprise 5 (x86_64)

IBM Rational Synergy Ubuntu 10_4

IBM Rhapsody ISS MADE

MagicDraw UML Windows (XP SP3 (32 bit), 7 (32/64

- Perform evaluations test tools

(new, upgrades)

- Perform acceptance testing of tools

MagicDraw UML Windows (XP SP3 (32 bit), 7 (32/64

bit), Server 2003 R2, Server 2008 R2

Understand for C/C++ Socrrates Lite & Heavy (April 2011 ver)

�Training Environment

Validate Other IV&V Become Experts in Simulation for IV&V

Program and NASA Support Every

Project in the IV&V

Program in Five

Establish Jon

McBride Software

Testing and RepeatableMeasureable

Validate Other IV&V

Findings

Program in Five

Years

Testing and

Research (JSTAR)

Laboratory

Enable IV&V

Projects to

Independent Testing Value

RepeatableMeasureable

Unbiased Q2 and Q3

Infuse the ITC

Framework into the

Remain on the

Leading Edge in

New Simulation and

Projects to

Perform

Dynamic

Analysis

Unbiased

Develop Core Expertise

in Testing

Q2 and Q3

Team Members

Framework into the

IV&V ProgramNew Simulation and

Testing Toolsin Testing

Team Members

Justin Morris Jeff Joltes

Steven Seeger Justin McCarty

Brandon Bailey Dan Nawrocki http://itc.ivv.nasa.govBrandon Bailey Dan NawrockiShawn Carroll David Soto

ivv-itc@lists.nasa.gov

http://itc.ivv.nasa.gov