opc ua – test automation for regression & application ... · pdf fileinternal opc ua...

INTERNAL

OPC UA –Test automation forregression & applicationtesting with RobotFrameworkValmetMika Karaila

INTERNAL

Agenda

ü Motivationü Robot Framework

– Basics & principles– OPC UA – FreeOpcUa– RIDE

ü Use cases– Unit & regression testing– CI – Jenkins build & test automation

ü Demoü Summary

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework2

INTERNAL

Motivation

ü How to test large software that is not totally in your hands?

ü Refactor code asset totally, will it work in the same way?

ü Did you improve your code or is it slower than earlier version?

ü Do you want to run manual 100 step tests every day 5 times?

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework3

INTERNAL

Robot Frameworkhttp://robotframework.org/

ü Robot Framework is a Python-based, extensible keyword-driven testautomation framework for end-to-end acceptance testing andacceptance-test-driven development (ATDD). It can be used for testingdistributed, heterogeneous applications, where verification requirestouching several technologies and interfaces.

ü The framework has a rich ecosystem around it consisting of variousgeneric test libraries and tools that are developed as separateprojects.

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework4

INTERNAL

Robot Framework architecture

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework5

INTERNAL

Extending Robot FrameworkAdd your own TestLibraries

ü In Valmet case two additional libraries– DNA communication (based on DLL library)– OPC UA communication (based on Free OPCUA)

ü Resource files for DNA and OPC UA:– Clear text keywords for test cases– Hide actual function complexity

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework6

INTERNAL

Valmet use cases

ü Basic unit test cases for type conversionsü Quality mapping between DNA and OPC UAü Table accessü Event testing:

– DNA alarms synced to OPC UA– Limit alarms– Discrete alarms

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework7

INTERNAL

DNA alarms & OPC UA EventsAlarm hierarchy, possible to get selected hierarchy alarms

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework8

INTERNAL

Demo

ü RIDE and running some testsü UaExpert to show OPC UA address space

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework9

INTERNAL

RIDE & run selected test cases

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework10

INTERNAL

Test report

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework11

INTERNAL

Test log

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework12

INTERNAL

UaExpert & address space

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework13

INTERNAL

OPC UA Diagnostics in Valmet DNA

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework14

INTERNAL

Summary

ü Automate your software production process– Jenkins for building, packaging & automated tests

ü Test automation importance, step by step evolution– Basic tests– Simple tests– Advanced tests– Stress & benchmark tests

ü Other benefits:– Interoperability (different implementations)– People learning new techniques– Test asset coming as important as software asset

13 October 2017 © Valmet | Mika Karaila / OPC UA Testing with Robot Framework15

INTERNAL