breaking lab barriers qa conference 1

35
QualiSystems Proprietary & Confidential 1 Breaking lab barriers A unified solution for Test Automation & Lab Management 7/3/22 Standards of Excellence Maya Ber Lerner

Upload: meda-conferences

Post on 23-Jun-2015

654 views

Category:

Education


1 download

TRANSCRIPT

Page 1: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential1

Breaking lab barriers

A unified solution for Test Automation & Lab Management

April 13, 2023

Standards of E

xcellence

Maya Ber Lerner

Page 2: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential2

Agenda

Introduction

Test Lab Automation Challenges

Breaking lab barriers – maximizing lab performance Solution demo Summary

Page 3: Breaking lab barriers qa conference 1

9001:2000 90003:2004

International Software CompanySanta Clara, USALondon, UKMunich, GermanyTel-Aviv, Israel Shanghai, China APAC Channels: Japan, Taiwan, Australia, Korea, India

Founded 2004

Flagship product – TestShellTM Test-Automation Framework

“Customer First” Culture

President Aryeh Finegold, Founder & Formerly President of Mercury (now HP)

Chairman Moshe Egert, Formerly President EMEA of Mercury (now HP)

QualiSystems – Company Overview

QualiSystems Proprietary & Confidential3

Page 5: Breaking lab barriers qa conference 1

Test Lab – the goal is to test (a device, a setup, a service)Test equipmentTraffic GeneratorsNetwork EmulatorsNetwork MonitorsPhysical Layer SwitchesMany others

QualiSystems Proprietary & Confidential6

Breaking Lab Barriers

Page 6: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential7

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

Page 7: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential8

Breaking Lab Barriers

Controlling test equipment is a large part of test automationDirect communicationDriverVendorCustom

Page 8: Breaking lab barriers qa conference 1

Automation may use different interfacesNetworking protocolsSoftware interfacesScriptsDrivers

QualiSystems Proprietary & Confidential9

Breaking Lab Barriers

EXE

GUI

VI

DLLTCL

Python

Java Script

VBScript

Perl

VISA

Telnet

SSH

SFTP

TCP

Serial

UDP

SNMP

SNMP Traps

GPIB

HTTP

SMTP FTPTFTP

SOAP

Page 9: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential10

Breaking Lab Barriers

Tellabs Multiservice router

IXIA TrafficGenerator

Spirent TrafficGenerator

Alcatel Lucent OSS/BSS

GUI

Built in driver

TelnetBuilt in driver

Page 10: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential11

Breaking Lab Barriers

GUI

Built in driver

Telnet

Page 11: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential12

Breaking Lab Barriers

TestShell has been used to automate

IXIA IxExplorer IxNetwork IxLoad IxChariot

Spirent Test Center SmartBits AX 4000 Abacus

MRV MCC Layer1 Switch OCC Layer1 Switch

Shenick DiversifEye

Cisco 2600 seriesCatalyst

6500 seriesASR 1000

12000 series

Nortel Optical Multiservice Edge 6110

Page 12: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential13

Breaking Lab Barriers

TestShell has been used to automate

Juniper ISG1000 Firewall

Tellabs

Nokia Siemens Networks A-Series carrier Ethernet Switch

Alcatel Lucent

Huawei 2*10G POS High Speed Router

D-Link

8800 Multiservice Router series

7450 Ethernet Switch Router OSS/BSS

Wireshark

DSL-2640B Modem with wireless router And many more…

Page 13: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential14

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

Page 14: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential15

Breaking Lab Barriers

In today’s fast pace environment, equipment aspects frequently changeUpgrade (e.g. new blade, new module)Switch vendorsThe test runs on a different station (lab > field etc.)

Start the traffic

What ports?

2 and 3

Done!

Page 15: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential16

Breaking Lab Barriers

What happens when equipment aspects change?

Start the traffic

What???

Page 16: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential17

Breaking Lab Barriers

How have we coped with equipment changes in the past?Rewrite\update tests…Custom driver – tedious maintenance, requires programming and specific knowledge, depends on the quality of the driver and architecture

Big effort – time, resources

Is automation really worth it?

Page 17: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential18

Breaking Lab Barriers

TestShell overcomes the challenge of automation byA wide variety of easy to use wizard controlled interfacesA large collection of built-in drivers

TestShell overcomes the challenge of equipment change byAbility to add functionality to existing driversAbility to create drivers from scratch

Page 18: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential19

Breaking Lab Barriers

TestShell framework allows adding functionality to an existing driver or creating your own driverUser friendly GUIDesigned to support full equipment interchangeabilityHigh speed performance and implementation

Page 19: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential20

Breaking Lab Barriers

A

B

C

Login

Run

Get statistics

Configure

D

E

Page 20: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential21

Breaking Lab Barriers

A

B

C

Login

Run

Get statistics

Configure

D

E

+

F

Page 21: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential22

Breaking Lab Barriers

A

B

C

Login

Run

Get statistics

Configure

D

E

+

F

Get view

Page 22: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential23

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

Page 23: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential24

Breaking Lab Barriers

Increasing equipment utilizationTest equipment cost is highConflicts over shared equipmentNights, weekendsHigh Level AllocationEquipment tracking

Page 24: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential25

Breaking Lab Barriers

TestShell’s solution Client-Server locking serviceScheduling serviceExposure & Integration with the test automation application

Page 25: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential26

Breaking Lab Barriers

ResultMore people can use the equipment more often24/7 automated executionEasy equipment allocation and tracking

Page 26: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential27

Breaking Lab Barriers

Automation - maximizing lab performance

Control of the entire lab , including SUTs, interconnects and test equipment

Create robust tests that can keep up with evolving equipment

Increase equipment utilization

Page 27: Breaking lab barriers qa conference 1

TestShell: End-to-End Test Automation Framework

28 QualiSystems Proprietary & Confidential

Manage

Page 28: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential29

TestShell Product Demonstration

Page 29: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential30

Test Lab Automation

Tellabs Multiservice router

IXIA TrafficGenerator

Spirent TrafficGenerator

Alcatel Lucent OSS/BSS

GUI

Built in driver

TelnetBuilt in driver

Page 30: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential31

Summary

Set up a topology in minutesControl lab equipment easilyReuse test building blocksQuickly get automated tests runningSchedule executions without being worried about equipment conflictsModify a driver when equipment is upgraded and immediately deploy the new driver

Page 31: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential32

Visit our website: www.qualisystems.com

Thank you

Page 32: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential33

Key Benefits

Quick integration with equipment Wizard driven capture-replay interfacesBuilt in driversEasy creation of driversReusable building blocksControl of the entire lab

Page 33: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential34

Key Benefits

Optimized utilizationCentral reservation & schedulingEfficient sharing of test equipment by multiple test teams & labs24/7 test executionIntegrated framework

Page 34: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential35

Key Benefits

Minimal effort when equipment changesExisting driver updateAbstraction of equipmentImmediate deployment of shared assetsTests are easy to maintain

Page 35: Breaking lab barriers qa conference 1

QualiSystems Proprietary & Confidential36

Key Benefits

More people can join the automation effortEnabling non-programmers to generate automationSimplification of complex vendor-specific command-sets into user friendly automation commandsStandardized frameworkOrganizational knowledge sharing