elvior company overview - · pdf fileelvior company overview cut your software testing...

35
Elvior company overview Cut your software testing expenses Functional black-box tests automation

Upload: vanque

Post on 20-Mar-2018

219 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

Elvior company overview

Cut your software testing expensesFunctional black-box tests automation

Page 2: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

Contacts

Elviorwww: www.elvior.comE-mail: [email protected]: +372 66 71 737

2

► Andres Kull

CEO

[email protected]

► Andrus Lehtmets

CTO

[email protected]

Page 3: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

What do we do?

Specialized in software test automation

since 1992

TTCN-3 test tool vendor-TTCN-3 standardized test language

-Applicable for any domain

3

Page 4: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

Elvior is creating world standards

4

2000 - 2003 2004

2007…today 2011…today

Page 5: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

International locations

► Customers based all around the

world from North-America to Asia

Locations:

► HQ: Tallinn, Estonia

5

Page 6: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

What do we do today?

► Programming

► Tool support

► Test automation services (e.g. setup, scripting)

► Training (TTCN-3 and MBT)

6

SUBCONTRACTING R&D PROJECTSELVIOR

PRODUCTS

Generator

Page 7: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

Some of our clients

7

Page 8: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

Tests automation products

TTCN-3 test platforms and MBT solution Test tool for XML messaging

8

Page 9: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TestCast Professional brief overview

9

Page 10: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TestCast a TTCN-3 black-box test platform

10

► SUT can be any device or software component

► SUT input and output events are discrete

► SUT inputs must be controllable and outputs must be observable

► Black-box functional test checks SUT external behaviour conformance to the specified behavior

Test inputs

Observable outputs - functional test tool by Elvior- executes TTCN-3 scripted tests

System Under Test(SUT)

Page 11: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TestCast - supported operating systems

11

► Windows (32, 64 bit)

► .NET 3.5 or higher

► Linux (32, 64 bit)

► Mono 2.6.7 or higher

► Ubuntu

► Red Hat / Fedora

► OpenSUSESupported TTCN-3 versions

TTCN-3: 2003 … TTCN-3: 2011

Page 12: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TestCast – full TTCN-3 development environment

12

► Editor

► Compiler

► Executer

► Debugger

► Logger

► Built in codecs

► Built in adapters

Page 13: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Difference in TTCN-3 native compiler

► Generic approach to TTCN-3 compilation

13

TTCN3- test scripts E.g. Java

EXECUTABLE

1 2 Byte code3

TTCN3- test scripts1 Byte code2

► Elvior’s approach with TestCast

Page 14: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Full IDE for ease of use, also command line option

► Test Management, command line option, test session report, project viewer

14

Page 15: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TTCN-3 editor: go-to-definition, auto-complete, test suite viewer

15

Page 16: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TestCast has graphical log view

16

Page 17: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TRI and TCI mapping

TRI: mapping for ANSI C, C++, .NET (C# and VB), Java

TCI-CD: mapping for ANSI C, C++, .NET (C# and VB), Java

TCI-TM: mapping for ANSI C, C++, .NET (C# and VB), Java

TCI-TL: mapping for ANSI C, C++, .NET (C# and VB)

Page 18: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Built in codecs

ASN.1 PER and BER Textual XML Binary

Page 19: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Editions and licenses

Editions:

Professional - full-featured TTCN-3 test development and execution environment

Runtime - low-cost test environment to execute precompiled TTCN-3 test cases

Licenses:

►Node-locked licenses

►Floating licenses

Page 20: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

ETSI SIP test suite with TestCast

TestCast

ETSI SIP test suite

SA

PATRI UDP

External SIP Codec

TCI-CD

Page 21: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Applicable areas for TTCN-3

21

Page 22: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Most popular domains for TTCN-3

► Mobile telecommunications: 3G, 3GPP LTE, WiMAX, GSM

► Internet protocols: SIP, IMS, IPv6…

► Smart Cards

► Automotive (conformance and acceptance testing)

► IOT (phones, building automation, smart metering, fleet management system, 6lowPan etc)

► Broadband technologies: ATM, DSL

► Middleware platforms: WebServices,

22

Page 23: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TTCN-3 basics

23

Page 24: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

What is TTCN-3?

► Testing and Test Control Notation Version 3

► TTCN-3 Testing Language

► Standardized modern high level language for testing

► TTCN-3 Architecture

► TTCN-3 TCI and TRI interfaces

► Black-box, functional testing of reactive systems

24

Page 25: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

25

TTCN-3 in a nutshell (general environment)

TestC

ast

Page 26: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Central TTCN-3 concepts

►TTCN-3 is a language for testing

►Abstract data layer: data are not bound to any specific binary representation

►Dedicated commands for communication

►Dynamic and concurrent test configuration

►Automated test result evaluation

26

Page 27: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Test dedicated concepts in TTCN-3 (1/2)

► Data types

► Events

► Templates (send/receive)

► Matching mechanism

► Behavior trees (ALT {[]…}

► Altsteps

► Paralellel test components

► TRI, TCI

27

Page 28: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Test dedicated concepts in TTCN-3 (2/2)

►TTCN-3 has clear model how to structure your test

►With TTCN-3, test design will follow the same model

►TTCN-3 allows exchange of test suites among the players

28

Page 29: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TTCN-3 benefits compared other languages

► Why to use TTCN-3 for testing and not some other high level programming language (python, java)?

► Tracing and lookup facilities are provided by TTCN-3 tool (no programming needed)

► In TTCN-3 operational semantics is clearly defined

► Cost factors:► Coding effort

► Results analysis efforts

► Maintenance effort

► Debugging efforts

► Skill/training efforts

29

Page 30: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

What type of coding effort is needed?

► Abstract Test Suite (ATS)

► Test dedicated language – coding effort reduced

► ATS concept makes test suite usable on different platforms and tools

► System Adapter (SA)

► TRI for C, C++, C#, Java mapping

30

Page 31: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TTCN-3 results analysis and debugging efforts

►When test was executed – how to know that the results are correct?

►TTCN-3 has built in verdict mechanism

►Tool offers means for analysis and tracing

►Tools have built-in debuggers (Elvior has a native TTCN-3 debugger)

31

Page 32: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TTCN-3 tests’ maintenance efforts

►Reduced maintenance effort, because of►Concept of test events (easier definition of test

functionality)

►Separation between abstract and concrete layers (TRI, TCI)

►Less code to look at given functionality

32

Page 33: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

TTCN-3 skill/training efforts

► TTCN-3 is high level test dedicated programming language

► Syntax similar to C and Pascal

► Test dedicated concepts ands constructions

► Incremental study

► Basics – within 1 day

► Advanced – within 3 days

► Skills build up during the time

33

Page 34: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Brief summary of TTCN-3

TTCN-3 is preferred to use for testing than other general programming language

►It separates abstraction from implementation details.

►It includes test dedicated concepts► Templates

► Behavior tree

► Altsteps

► Snapshot mechanism

► Dedicated communication commands (send/receive)

34

Page 35: Elvior company overview -  · PDF fileElvior company overview Cut your software testing expenses Functional black-box tests automation

© Copyright Elvior Ltd. | Confidential if not permitted otherwise.

Contacts

Elviorwww: www.elvior.comE-mail: [email protected]: +372 66 71 737

35

► Andres Kull

CEO

[email protected]

► Andrus Lehtmets

CTO

[email protected]