exactpro test tools extent feb 2011

Exactpro Test Tools

Maxim Rudovsky

EXTENT February 2011

ContentsThis presentation provides information about Exactpro Systems Testing Tools:

1. High-level presentation of all testing tools

2. Sailfish

3. Load Injector

4. Certification Testing tool

1. Testing Tools: High Level View

Sailfish Load Injector Reconciliation ToolMultiprotocols and transports:

•FIX •NATIVE •MITCH•QH

Multiprotocols and transports:•FIX •NATIVE •MITCH•QH

Multiprotocols:•FIX •NATIVE •MITCH•FAST

Multilayers:•Session Layer•Application Layer•Dirty Level

Simulation of multiple client connections with a specified load shape for each connection or a group of connections

Rich GUI for client activity tracking

Multiuser access to a testing environment

Throughput up to 80,000 msg per second

Storing client activity to DB for further analysis and report generation

Automative Matrix Language (AML)

Multiplatform Real-time analysis of client interactions with Exchange gateways

Test Report Generator Performance Reports Generator

2. Sailfish Components and Concepts

3. Sailfish Deployment

4. Steps to Automate a Test Case

1. Create and configure a particular service. Make sure it works properly.

2. Make sure there are all required actions for implementing a test case

(send message, receive message, execute request, etc.)

3. Create a csv. matrix with a particular number of actions and specify

required action parameters.

4. Execute a test case and check the generated report for faults and errors.

7. Sailfish Configuration Service Page

8. Sailfish Test Script Execution Page

9. Sailfish Test Report

5. Best Practice for Test Case Automation

Like all programming languages, AML has a number of rules which allow avoiding

several drawbacks and frustrations:

• Create independent test cases;

• Check a number of messages at the end of each test case to make sure there

are no redundant messages received;

• Check the order of received messages;

• Specify enough pauses between test cases to make sure there are no

redundant messages received after a test case has been completed.

6. Sailfish Future Improvements

• Add ability for several users to run a test script simultaneously

• Improve GUI of a test script and message pages

• Add interactivity in a test script running phase

• Separate WEB GUI from that part of the server

• Improve test report generator

• Improve the functionality to store messages to DB

7. Load Injector Components & Configuration

•Configure a number of connections

•Configure template messages

•Configure Load Shape for each connection or a group of connections

•Configure messages distribution for each connection or a group of connections

8. Performance Calculator

Protocols KPI Filters

FIX Throughput Per Client

Native Bandwidth Per Instrument

MITCH Latency Per Order type

Deviation Per Message Type

Hardware KPI

•Multiprotocols•Processing large dump files (up to the size of HDD)•Easily configurable (adding new filters, new protocols, new metric calculation)•Report Generator using templates

8. Performance Calculator (continued)

9. Load Injector - Future Improvements

• Message distribution configuration for each load shape step

• Template messages GUI editor

• Add expressions to template messages

• Add event-driven configuration onConnect eventonDisconnect eventonTime event

Thank you.

10. Questions & Answers