testing, verification and validation solutions for ...symmtech.com/forum/support and...
TRANSCRIPT
Software Requirements V&V Review of concept documentation (if not
performed prior to software requirements
development)
Traceability Analysis
Software Requirements Evaluation
Interface Analysis
Initial Planning for Software System Test
Reporting Software Design V&V
Traceability Analysis
Software Design Evaluation
Interface Analysis
Initial Planning for Unit Test
Initial Planning for Software Integration Test
Report Code V&V
Traceability Analysis
Code Evaluation
Interface Analysis
Completion of Unit Test Preparation
Reporting
Unit Test Unit Test Execution
Reporting
Software Integration Test Completion of Software Integration Test
Preparation
Execution of Software Integration Tests
Reporting
Software System Test Completion of Software System Test
Preparation
Execution of Software System Tests
Reporting
Software Installation Test Installation Configuration Audit
Reporting
Software Operation and Maintenance V&V Impact-of-Change Analysis
Repeat Management V&V
Repeat Technical V&V Activities
#224, 5th Cross, 2nd Block, RMV 2nd Stage,
80 Feet Road, Sanjay Nagar, Bangalore – 560094
Phone: 91-80-23519395/96/97 Fax: 91-80-23518594
Visit us at www.symmtech.com Email: [email protected], [email protected]
Testing, Verification and Validation Solutions for Aerospace and Defense
Independent Verification and Validation
Testing and Solutions
Range of Services Offered: • Independent Verification & Validation Testing
• Software Testing
• NRT Testing
• ATE‟s and Emulators
• Offshore Testing Services
Symmetric as a part of its Software Development Division,
offers Independent Verification and Validation, Non-Real
time Testing and allied System and Software Testing services
for Aerospace subsystems/Products. Delivery of these
services is offered through Customer friendly Models of
Offshore Test and Delivery center, Onsite Services or Hybrid
Models. Our experience includes avionics, engine, Space
and Defense Programs, as well as weapons and space
shuttle systems.
Our Deliverables Independent project estimate and modeling of current project plan
Periodic status briefings and/or reports
Clear Bug Reporting Process and Bug Tracking System.
IV&V test summary reports through STP, STD and STRs.
Final IVNV Observation Report
Periodic Project specific documentation support and adherence.
Our Focus Areas
End to End SDLC IV&V Cycle Coverage through a
well drawn our Blue Book Standard
Covers Unit, Integration Testing
Manual and Automated Testing
Project Operations Management through tailored
and Customer specific POMS
Traceability Analysis for all stages of IV&V Cycle
Project specific Team Structure with Subsystems and
IV&V Knowledge
Standards:
Symmetric has provided IV&V services for projects
adhering to IEEE/ EIA 12207, Mil -2167/498 and
DO-178B standards.
Our Independent Verification and Validation (IV&V) service ensures the project plans and deliverables are thoroughly inspected every step of the way to verify that the software satisfies requirements and validate that it meets your customers business objectives. Our IV&V and Testing services will enable you to deliver your most critical projects on time, within budget and, most importantly with quality that meets or exceeds your stakeholder expectations.
Our Approach to IV&V
Studies have consistently shown that the cost of rework goes up exponentially as a
project progresses through the life cycle phases (i.e. planning, requirements, design,
coding, testing, deployment, etc.). Our process is designed to leverage these lessons
learned by identifying and removing defects when they are least expensive to fix and,
where possible, by using proper planning to prevent many of them from being
introduced in the first place. A typical engagement will span the entire life cycle of the
project, with focused effort at key milestones.
1. Kickoff meeting to identify the individuals who will coordinate the engagement and
participate, determine any unique assessment requirements of the client, identify data
sources, establish a timeline and deliverables, brief out the process and the schedule to the
participants
2. Independent project estimate review To independently review the estimate against our
benchmark database to determine if it is realistic, given the established assumptions. Our
report will quantify the risk of the current estimate and provide recommendations.
3. Inspection of planning documents To inspect the project plan and other planning
documents against leading practices. Our report will identify potential risks and provide
recommendations for strengthening the plan.
4. Project tracking and oversight To track actual vs. plan through our POMS Team and
provide a forecast to complete. Our reports will show actual vs. planned for milestone
completion, functionality produced, cost, effort, and defect rates.
5. Inspection of requirements documents To inspect requirements documents such as a
system requirements specification to determine whether the requirements are complete,
clear, consistent, testable and maintainable. Our inspection report will include a prioritized
list of defects found.
6. Inspection of design documents To inspect design documents such as the system design
specification to determine whether they are traceable to requirements, complete, clear,
consistent and feasible. Our inspection report will include a prioritized list of defects
found.
7. Inspection of source code To inspect the source code and report on whether we believe it is
coherent, traceable to design, consistent, maintainable and does not contain performance
bottlenecks. Our inspection report will include a prioritized list of defects found.
8. Independent testing To develop a test plan and perform independent testing based on the
approved requirements. We will record defects found and help determine severity and
priority.
Our IV&V Activities
Planning and obtaining IV&V services shall begin early in the project‟s life. The Project Sponsor and governance entities shall consider IV&V activities depending on project size, risk and other factors, and select those appropriate to match the project requirements. At a high level, our IV&V activities shall include items such as:
Our Software IV&V Process
Determining the types and levels of product integrity to be verified and validated
Developing performance metrics to allow tracking of project completion against
defined milestones
Identifying an integrity schema to measure the project‟s conformity to requirements
Planning and scheduling of IV&V activities considering the project management
plan and schedule
Creating a verification and validation plan for the specific IV&V effort
Consulting with stakeholders to assess their involvement and buy-in regarding
system functionality and the system's ability to meet their needs
Reviewing and providing recommendations to improve both the management and
technical aspects of the project including evaluating project progresses, resources,
budgets, schedules, and reporting
Reviewing and analyzing project management and software development activities,
performance, and operational policies, processes, documentation, and products for
accuracy and completeness
Reviewing product architecture for feasibility, consistency, and adherence to related
industry and HHS standards
Reviewing traceability of product functions to original requirements
Documenting IV&V activities and assessment results in the form of task reports,
activity summary reports, anomaly reports, test documents, and eventually a final
IV&V summary report.
As a proven expert in this industry, we continually refine our approach so that we can
provide customers with the most complete, rigorous process possible. Our dedicated staff
will provide a high quality deliverable that includes documentation of the validation,
verification and simulation results, including a complete review of requirements tracked to
implementation, specific to each customer‟s individual needs.
Develop and IV&V plan.
Independent risk assessments
Traceability of requirements at all levels.
Active participation in design/code reviews.
Evaluate engineering changes and impacts.
Active participation in CM audits.
Monitor or perform testing at various levels.
Management support and reporting.
Special studies
IV&V Tasks and Services
Criticality Analysis
Requirements Analysis
Risk assessment
Milestone Reviews
Software Design and Dev. Analysis
Software Metrics
Test Witnessing
Test Planning, Execution &
Reporting
Defect Investigation
Code Analysis
Document Inspection
Practice Key Terms
Our Practice
Verification
Inspection - Inspection involves a team of people, led by a leader, which formally
reviews the documents and work product during various phases of the product
development life cycle. The work product and related documents are presented in front of
the inspection team, the member of which carries different interpretations of the
presentation. The bugs that are detected during the inspection are communicated to the
next level in order to take care of them.
Walkthroughs - Walkthrough can be considered same as inspection without formal
preparation (of any presentation or documentations). During the walkthrough meeting,
the presenter/author introduces the material to all the participants in order to make them
familiar with it. Even though the walkthroughs can help in finding potential bugs, they are
used for knowledge sharing or communication purpose.
Validation
Code Validation/Testing - Developers as well as testers do the code validation. Unit
Code Validation or Unit Testing is a type of testing, which the developers conduct in order
to find out any bug in the code unit/module developed by them. Code testing other than
Unit Testing can be done by testers or developers.
Integration Validation/Testing - Integration testing is carried out in order to find out
if different (two or more) units/modules co-ordinate properly. This test helps in finding
out if there is any defect in the interface between different modules.
Functional Validation/Testing - This type of testing is carried out in order to find if
the system meets the functional requirements. In this type of testing, the system is
validated for its functional behavior. Functional testing does not deal with internal coding
of the project, instead, it checks if the system behaves as per the expectations.
User Acceptance Testing or System Validation - In this type of testing, the developed
product is handed over to the user/paid testers in order to test it in real time scenario. The
product is validated to find out if it works according to the system specifications and
satisfies all the user requirements. As the user/paid testers use the software, it may
happen that bugs that are yet undiscovered, come up, which are communicated to the
developers to be fixed. This helps in improvement of the final product.
Document the IV&V effort and expected levels of commitment in a Statement of Work (SOW)
Budget accordingly for IV&V activities accounting for project scope, schedule, risk, etc
Select a qualified independent team to perform IV&V activities
Identify IV&V acceptance criteria within the SOW
Ensure that the IV&V team has accessibility to all required data and deliverables necessary to
perform effective IV&V services
Ensure that the IV&V team receives all project artifacts and is invited to all project meetings
Maintain IV&V team independence
Make Corrections based upon the recommendations of the IV&V team
Incorporate IV&V findings into project lessons learned activities & associated documentation
Tools Expertise
Mat lab
IDL
ADA
C
VHDL
VxSim
Libraries
VAX/VMS
Clear case
EV tool
RTRT
Rational Rose
VC++, SDK and DDK
Our Domain Expertise
Done 64 testing and 13 development
projects in Avionics field for ADA,
DARE, GTRE, ADE, RCI, LRDE and
many more.
All the projects are successfully
completed with the certified Project
Completion Report
Domain expertise on Software Testing,
IV&V, RTOS, SCM and Version
Control VC++, HPUX
IV&V – NRT Methodology
Implementation and performance evaluation of the Control law design shall be independently verified and validated
Engine Simulation Model shall be verified & validated
Non Real Time Testing of Control Law Code implemented in DECU shall be carried out.
IV & V – NRT Activities of Control Law
Authentication of Engine Model and the data used in the model.
Authentication of the procedure of generating linear State space Linear models of Engine
Authentication of Linear Models
Control Law Design Requirement document
Design Process Document
Control Law Design document
CLAW Functionality Requirement Document
Mapping of CLAW Functionality to Master code developed by CLAW Design Team
SRS & SDD of Engine system model & CLAW master code for the integrated s/w simulation
Certification of Hardware in the Loop Test Facility
Performance analysis (Normal & failure modes)
Integrated System Linear Model Analysis
Integrated Non linear Software Simulation Studies
Integrated Hardware in the loop Simulation (HILS)
Non real time Testing of Control Law Codes.
NRT Testing of Engine Control Law
NRT is required to ensure that Control law software as implemented in DECU embedded software is matching with the control law master code software developed by the Control law design team and used for the integrated software simulation studies.
Salient Approach for the NRT
Setup the Test facility. The test platform to execute the embedded code with the compiler as in the DECU and Test management software for automatic test and reporting of Test results
Preparation of detailed test plan and test vector/ test matrix and definition of acceptance criteria
Generate the dynamic test signals (Ramp, Sine/ toggle etc) to the various command and feedback inputs of Control law to invoke all the logics and schedules of the control law
Test the Embedded code with respect to the Master Control law code as cleared by the IV&V Team
Analysis of Test results and Clearance of software code
Features Optimized for Test-Speed
Test Accuracy, Reliability, and Repeatability
Designed for test flexibility
Device Test & Characterization
High / Low Fidelity Simulations
MATLAB/Simulink or LabVIEW-RT Plant Models
Reliable & Accurate
Flexible Software Suite
NRT Testing
ATE’s and Emulators
Testing the Flight Control Laws and the Airdata Algorithm form a major part of the Flight Control System development cycle. These two safety
critical software are validated and verified on very costly rigs in every aircraft development program through NRT Testing.
The concept of testing essentially involves the modeling of Real-Time systems in such a way that the systems can be tested with all possible test
conditions as they could happen in Real-Time situations. This could cover the system both as hardware environment and software system.
Our Offerings include Automated test equipment (ATE), a tailored and Embedded system, which is a computer-controlled equipment that tests
electronic devices for functionality and performance. ATE also conducts stress testing with minimal human interaction. ATE includes the control
hardware, sensors, and software that collects and analyzes the test results. ATE is considered cost efficient for high-volume testing. Specialization
is in developing Custom-made Test Systems, Test Beds as independent Job-Orders or as a part of HSI Testing and Turnkey Testing Projects
Delivery.
Automated test equipment uses a range of sensing techniques, including machine vision. In addition to the semiconductor industry, ATE is used in
the automotive, medical equipment, airplane, and other manufacturing industries
We offer ATE, component test systems, discrete semiconductor testers, IC test systems, handlers, semiconductor production equipment, probers,
temperature forcing systems, and In-Circuit testers (ICT).
Our IV&V Experience
Symmetric provides testing services to clients like ADA, DARE and many more with well constructed Independent verification and validation Testing plan. According to the requirements, standards are followed in Software development life cycle. Standards like IEEE/EIA 12207, Mil -2167/498 and DO 178B.
Project Name Description Duration Tools and Platforms
Activity Team Size
Effort Applied
Cust.
Non Real Time (NRT) testing of Air Data System for IV&V
Software Verification & Validation for IV & V :Project of Source code of Air Data system of LCA FCS (Flight control system) with execution of Test cases on Target Environment and Simulator written in Mat lab code for Validation
1 Year and 3 Months
ADA on VAX / VMS, Mat lab / Simulink, Windows NT, ICC Cross compiler for I80960 Target Environment
SRS, SDD Analysis, Code analysis, CSC / CSU Testing with Software Testing using MIL 2167 Standards and Documentation
3
36 Man Months
ADA
Development of tests Software to test the IFCS at the Iron Bird Site
Software Configuration Management Activity using LTM tool on VMS Platform, To built some of the User friendly Libraries for code Maintenance etc.
1 Year
VAX /VMS, LTM Tool , Source codes using ADA, C etc.,
Building the necessary programs using LTM tool for Software configuration Management, Version control etc
2 24 Man Months
ADA
IV&V of LCA FCS version 3.0 Software at ADA.
Software Verification & Validation activity , CSC / CSU Testing of Software‟s of various modules of LCA such as Control law, Launch computer, Mission computer, Actuator systems etc.,
3 Years
ADA, C, on VAX / VMS Platform, Windows; Mat lab / Simulink, Rational Rose, Testing tools such as Logiscope, db960 etc.,
CSC / CSU Testing of various modules for LCA FCS with Test Plan, design of test cases, Static and Dynamic analysis etc.,
10 360 Man Months
ADA
Maintenance of Operational Flight Software of the Project „DAWN‟
Code Maintenance and configuration Management with code modifications based on testing activity
1Year VAX / VMS, Windows, c, VC++
Code Maintenance and configuration Management with code modifications based on testing activity
2 24 Man Months
ASEIO
Customized Browser
Development of software for Internet Browser customized for defense.
3 Months Windows, Java, JSP, HTML, JDK
Development of software for customized Web Browser
2 6 Man Months
CAIR
Customized Proxy Server
Development of software for a Proxy Server for Defense
3 Months Windows, C, Java, HTML, JDK
Development of software for Internet Browser customized for defense.
2 6 Man Months
CAIR
Linear Design of KADECS Controller
Control design and linear design for control loops
3 Months Control design and linear design for control loops
Control design and linear design for control loops
6 18 Man Months
GTRE
Integrated Non linear real time simulation for KAVERI Engine Control System
Development of Integrated simulation model and Testing on Integration model
3 Months
Development of Integrated simulation model and Testing on Integration model
Development of Integrated simulation model and Testing on Integration model
6 18 Man Months
GTRE
Integration Projects
Southwest (Coimbatore, Kerala)
[email protected] Cochin
Western (Maharashtra, Punjab)
[email protected] Pune
Southeast (Tamilnadu, A.P)
[email protected] Hyderabad
Eastern & North (W.Bengal, Delhi, Calcutta)
[email protected] Calcutta
Regions:
Email: RO Location:
Our Value Proposition
Why should you choose Symmetric for your IV&V Needs
240 Customers and 1740 Systems with satisfaction level of 95%.
Has Released Quality Products for Service / Office Automation.
Successful Demonstration of 18 Pilot Models.
Highly Process Oriented Operations
140 Consultancy works in 8 years time
Services Augmented with Automation tools
CDM (Capability Demonstrator Model) for S/W products and DAS
Have the knowledge, skills, and experience.
Is an exclusive IV&V company. It is our bread and butter!
A record of successes of IVNV Projects across spectrum of DOD Customers
Our staff is experienced with Comprehensive IVNV/SDLC Phases.
POMS based Project Management for Quality Delivery
Domain expertise on Software Testing, IV&V, RTOS, SCM and Version Control
VC++, HPUX
Tailored/Customized Best value solution.
1. 240 Customers with satisfaction level of 95%
2. Customer Retention Efficiency of 94.5%
3. 140 Consultancy Activities in 8 years time
4. High Thrust on Product Based Development SymlS and PEDAS
5. Associated with Evolving Test Procedure for SI Project
6. Skilled Manpower for Development and Support
7. Backed by Quality Hardware and Software Resources
8. Strong 60 Members Organization
9. Customer Focus through Automated Tools “SymSAS”
10. Has Released Quality Products for Service / Office Automation
11. Successful Demonstration of 18 Pilot Models
12. Highly Process Oriented Operations
13. Services Augmented with Automation Tools 14. CDM (Capability Demonstrator Model) for Software Products and DAS
Ph : 91 - 484 - 2346882 Fax: 91 - 484 - 2346881
1. Development and Integration of the Hardware in loops Simulation Facility
2. Development and Integration of the ATE facility for ECU Testing
3. ATE development for testing Transducers
4. Development and Integration of Display System along with Software Development
5. Time code Reader Card for PCI supplied along with Device Drivers and Integrated
with existing setup
6. Developed Integrated Solution for DAS from Two Channels through LVDS
Projects Executed
Our Credentials and Value Proposition
# 224, 5th Cross, 2nd Block, RMV 2nd Stage, 80 Feet Road, Sanjay Nagar
Bangalore – 560094 Ph: 91-80-23519395 / 96 / 97 Fax: 91-80-23518594.
Email: [email protected], [email protected] Visit us at www.symmtech.com
ISO 9001: 2008 Certified
Organization Project and Head
Office:
Want a Pilot Model Demo? Call us
Southwest Eastern & North
Southeast Western