breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential1

Breaking lab barriers

A unified solution for Test Automation & Lab Management

April 13, 2023

Standards of E

xcellence

Maya Ber Lerner

QualiSystems Proprietary & Confidential2

Agenda

Introduction

Test Lab Automation Challenges

Breaking lab barriers – maximizing lab performance Solution demo Summary

9001:2000 90003:2004

International Software CompanySanta Clara, USALondon, UKMunich, GermanyTel-Aviv, Israel Shanghai, China APAC Channels: Japan, Taiwan, Australia, Korea, India

Founded 2004

Flagship product – TestShellTM Test-Automation Framework

“Customer First” Culture

President Aryeh Finegold, Founder & Formerly President of Mercury (now HP)

Chairman Moshe Egert, Formerly President EMEA of Mercury (now HP)

QualiSystems – Company Overview

QualiSystems Proprietary & Confidential3

QualiSystems Proprietary & Confidential4

Customers Snapshot

Test Lab – the goal is to test (a device, a setup, a service)Test equipmentTraffic GeneratorsNetwork EmulatorsNetwork MonitorsPhysical Layer SwitchesMany others

QualiSystems Proprietary & Confidential6

Breaking Lab Barriers

QualiSystems Proprietary & Confidential7

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

QualiSystems Proprietary & Confidential8

Breaking Lab Barriers

Controlling test equipment is a large part of test automationDirect communicationDriverVendorCustom

Automation may use different interfacesNetworking protocolsSoftware interfacesScriptsDrivers

QualiSystems Proprietary & Confidential9

Breaking Lab Barriers

EXE

GUI

VI

DLLTCL

Python

Java Script

VBScript

Perl

VISA

Telnet

SSH

SFTP

TCP

Serial

UDP

SNMP

SNMP Traps

GPIB

HTTP

SMTP FTPTFTP

SOAP

QualiSystems Proprietary & Confidential10

Breaking Lab Barriers

Tellabs Multiservice router

IXIA TrafficGenerator

Spirent TrafficGenerator

Alcatel Lucent OSS/BSS

GUI

Built in driver

TelnetBuilt in driver

QualiSystems Proprietary & Confidential11

Breaking Lab Barriers

GUI

Built in driver

Telnet

QualiSystems Proprietary & Confidential12

Breaking Lab Barriers

TestShell has been used to automate

IXIA IxExplorer IxNetwork IxLoad IxChariot

Spirent Test Center SmartBits AX 4000 Abacus

MRV MCC Layer1 Switch OCC Layer1 Switch

Shenick DiversifEye

Cisco 2600 seriesCatalyst

6500 seriesASR 1000

12000 series

Nortel Optical Multiservice Edge 6110

QualiSystems Proprietary & Confidential13

Breaking Lab Barriers

TestShell has been used to automate

Juniper ISG1000 Firewall

Tellabs

Nokia Siemens Networks A-Series carrier Ethernet Switch

Alcatel Lucent

Huawei 2*10G POS High Speed Router

D-Link

8800 Multiservice Router series

7450 Ethernet Switch Router OSS/BSS

Wireshark

DSL-2640B Modem with wireless router And many more…

QualiSystems Proprietary & Confidential14

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

QualiSystems Proprietary & Confidential15

Breaking Lab Barriers

In today’s fast pace environment, equipment aspects frequently changeUpgrade (e.g. new blade, new module)Switch vendorsThe test runs on a different station (lab > field etc.)

Start the traffic

What ports?

2 and 3

Done!

QualiSystems Proprietary & Confidential16

Breaking Lab Barriers

What happens when equipment aspects change?

Start the traffic

What???

QualiSystems Proprietary & Confidential17

Breaking Lab Barriers

How have we coped with equipment changes in the past?Rewrite\update tests…Custom driver – tedious maintenance, requires programming and specific knowledge, depends on the quality of the driver and architecture

Big effort – time, resources

Is automation really worth it?

QualiSystems Proprietary & Confidential18

Breaking Lab Barriers

TestShell overcomes the challenge of automation byA wide variety of easy to use wizard controlled interfacesA large collection of built-in drivers

TestShell overcomes the challenge of equipment change byAbility to add functionality to existing driversAbility to create drivers from scratch

QualiSystems Proprietary & Confidential19

Breaking Lab Barriers

TestShell framework allows adding functionality to an existing driver or creating your own driverUser friendly GUIDesigned to support full equipment interchangeabilityHigh speed performance and implementation

QualiSystems Proprietary & Confidential20

Breaking Lab Barriers

A

B

C

Login

Run

Get statistics

Configure

D

E

QualiSystems Proprietary & Confidential21

Breaking Lab Barriers

A

B

C

Login

Run

Get statistics

Configure

D

E

+

F

QualiSystems Proprietary & Confidential22

Breaking Lab Barriers

A

B

C

Login

Run

Get statistics

Configure

D

E

+

F

Get view

QualiSystems Proprietary & Confidential23

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

QualiSystems Proprietary & Confidential24

Breaking Lab Barriers

Increasing equipment utilizationTest equipment cost is highConflicts over shared equipmentNights, weekendsHigh Level AllocationEquipment tracking

QualiSystems Proprietary & Confidential25

Breaking Lab Barriers

TestShell’s solution Client-Server locking serviceScheduling serviceExposure & Integration with the test automation application

QualiSystems Proprietary & Confidential26

Breaking Lab Barriers

ResultMore people can use the equipment more often24/7 automated executionEasy equipment allocation and tracking

QualiSystems Proprietary & Confidential27

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

TestShell: End-to-End Test Automation Framework

28 QualiSystems Proprietary & Confidential

Manage

QualiSystems Proprietary & Confidential29

TestShell Product Demonstration

QualiSystems Proprietary & Confidential30

Test Lab Automation

Tellabs Multiservice router

IXIA TrafficGenerator

Spirent TrafficGenerator

Alcatel Lucent OSS/BSS

GUI

Built in driver

TelnetBuilt in driver

QualiSystems Proprietary & Confidential31

Summary

Set up a topology in minutesControl lab equipment easilyReuse test building blocksQuickly get automated tests runningSchedule executions without being worried about equipment conflictsModify a driver when equipment is upgraded and immediately deploy the new driver

QualiSystems Proprietary & Confidential32

Visit our website: www.qualisystems.com

Thank you

QualiSystems Proprietary & Confidential33

Key Benefits

Quick integration with equipment Wizard driven capture-replay interfacesBuilt in driversEasy creation of driversReusable building blocksControl of the entire lab

QualiSystems Proprietary & Confidential34

Key Benefits

Optimized utilizationCentral reservation & schedulingEfficient sharing of test equipment by multiple test teams & labs24/7 test executionIntegrated framework

QualiSystems Proprietary & Confidential35

Key Benefits

Minimal effort when equipment changesExisting driver updateAbstraction of equipmentImmediate deployment of shared assetsTests are easy to maintain

QualiSystems Proprietary & Confidential36

Key Benefits

More people can join the automation effortEnabling non-programmers to generate automationSimplification of complex vendor-specific command-sets into user friendly automation commandsStandardized frameworkOrganizational knowledge sharing