elvior company overview - · pdf fileelvior company overview cut your software testing...
TRANSCRIPT
Elvior company overview
Cut your software testing expensesFunctional black-box tests automation
Contacts
Elviorwww: www.elvior.comE-mail: [email protected]: +372 66 71 737
2
► Andres Kull
CEO
► Andrus Lehtmets
CTO
What do we do?
Specialized in software test automation
since 1992
TTCN-3 test tool vendor-TTCN-3 standardized test language
-Applicable for any domain
3
Elvior is creating world standards
4
2000 - 2003 2004
2007…today 2011…today
International locations
► Customers based all around the
world from North-America to Asia
Locations:
► HQ: Tallinn, Estonia
5
What do we do today?
► Programming
► Tool support
► Test automation services (e.g. setup, scripting)
► Training (TTCN-3 and MBT)
6
SUBCONTRACTING R&D PROJECTSELVIOR
PRODUCTS
Generator
Some of our clients
7
Tests automation products
TTCN-3 test platforms and MBT solution Test tool for XML messaging
8
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TestCast Professional brief overview
9
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TestCast a TTCN-3 black-box test platform
10
► SUT can be any device or software component
► SUT input and output events are discrete
► SUT inputs must be controllable and outputs must be observable
► Black-box functional test checks SUT external behaviour conformance to the specified behavior
Test inputs
Observable outputs - functional test tool by Elvior- executes TTCN-3 scripted tests
System Under Test(SUT)
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TestCast - supported operating systems
11
► Windows (32, 64 bit)
► .NET 3.5 or higher
► Linux (32, 64 bit)
► Mono 2.6.7 or higher
► Ubuntu
► Red Hat / Fedora
► OpenSUSESupported TTCN-3 versions
TTCN-3: 2003 … TTCN-3: 2011
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TestCast – full TTCN-3 development environment
12
► Editor
► Compiler
► Executer
► Debugger
► Logger
► Built in codecs
► Built in adapters
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Difference in TTCN-3 native compiler
► Generic approach to TTCN-3 compilation
13
TTCN3- test scripts E.g. Java
EXECUTABLE
1 2 Byte code3
TTCN3- test scripts1 Byte code2
► Elvior’s approach with TestCast
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Full IDE for ease of use, also command line option
► Test Management, command line option, test session report, project viewer
14
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TTCN-3 editor: go-to-definition, auto-complete, test suite viewer
15
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TestCast has graphical log view
16
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TRI and TCI mapping
TRI: mapping for ANSI C, C++, .NET (C# and VB), Java
TCI-CD: mapping for ANSI C, C++, .NET (C# and VB), Java
TCI-TM: mapping for ANSI C, C++, .NET (C# and VB), Java
TCI-TL: mapping for ANSI C, C++, .NET (C# and VB)
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Built in codecs
ASN.1 PER and BER Textual XML Binary
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Editions and licenses
Editions:
Professional - full-featured TTCN-3 test development and execution environment
Runtime - low-cost test environment to execute precompiled TTCN-3 test cases
Licenses:
►Node-locked licenses
►Floating licenses
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
ETSI SIP test suite with TestCast
TestCast
ETSI SIP test suite
SA
PATRI UDP
External SIP Codec
TCI-CD
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Applicable areas for TTCN-3
21
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Most popular domains for TTCN-3
► Mobile telecommunications: 3G, 3GPP LTE, WiMAX, GSM
► Internet protocols: SIP, IMS, IPv6…
► Smart Cards
► Automotive (conformance and acceptance testing)
► IOT (phones, building automation, smart metering, fleet management system, 6lowPan etc)
► Broadband technologies: ATM, DSL
► Middleware platforms: WebServices,
22
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TTCN-3 basics
23
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
What is TTCN-3?
► Testing and Test Control Notation Version 3
► TTCN-3 Testing Language
► Standardized modern high level language for testing
► TTCN-3 Architecture
► TTCN-3 TCI and TRI interfaces
► Black-box, functional testing of reactive systems
24
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
25
TTCN-3 in a nutshell (general environment)
TestC
ast
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Central TTCN-3 concepts
►TTCN-3 is a language for testing
►Abstract data layer: data are not bound to any specific binary representation
►Dedicated commands for communication
►Dynamic and concurrent test configuration
►Automated test result evaluation
26
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Test dedicated concepts in TTCN-3 (1/2)
► Data types
► Events
► Templates (send/receive)
► Matching mechanism
► Behavior trees (ALT {[]…}
► Altsteps
► Paralellel test components
► TRI, TCI
27
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Test dedicated concepts in TTCN-3 (2/2)
►TTCN-3 has clear model how to structure your test
►With TTCN-3, test design will follow the same model
►TTCN-3 allows exchange of test suites among the players
28
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TTCN-3 benefits compared other languages
► Why to use TTCN-3 for testing and not some other high level programming language (python, java)?
► Tracing and lookup facilities are provided by TTCN-3 tool (no programming needed)
► In TTCN-3 operational semantics is clearly defined
► Cost factors:► Coding effort
► Results analysis efforts
► Maintenance effort
► Debugging efforts
► Skill/training efforts
29
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
What type of coding effort is needed?
► Abstract Test Suite (ATS)
► Test dedicated language – coding effort reduced
► ATS concept makes test suite usable on different platforms and tools
► System Adapter (SA)
► TRI for C, C++, C#, Java mapping
30
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TTCN-3 results analysis and debugging efforts
►When test was executed – how to know that the results are correct?
►TTCN-3 has built in verdict mechanism
►Tool offers means for analysis and tracing
►Tools have built-in debuggers (Elvior has a native TTCN-3 debugger)
31
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TTCN-3 tests’ maintenance efforts
►Reduced maintenance effort, because of►Concept of test events (easier definition of test
functionality)
►Separation between abstract and concrete layers (TRI, TCI)
►Less code to look at given functionality
32
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
TTCN-3 skill/training efforts
► TTCN-3 is high level test dedicated programming language
► Syntax similar to C and Pascal
► Test dedicated concepts ands constructions
► Incremental study
► Basics – within 1 day
► Advanced – within 3 days
► Skills build up during the time
33
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Brief summary of TTCN-3
TTCN-3 is preferred to use for testing than other general programming language
►It separates abstraction from implementation details.
►It includes test dedicated concepts► Templates
► Behavior tree
► Altsteps
► Snapshot mechanism
► Dedicated communication commands (send/receive)
34
© Copyright Elvior Ltd. | Confidential if not permitted otherwise.
Contacts
Elviorwww: www.elvior.comE-mail: [email protected]: +372 66 71 737
35
► Andres Kull
CEO
► Andrus Lehtmets
CTO