Download - The OMG UML Testing Profile in Use--An Industrial Case Study for the Future Internet Testing
FITTESTFUTURE INTERNET TESTING (ICT-257574, 2010-2013)
THE OMG UML TESTING PROFILE IN USE - AN INDUSTRIAL CASE STUDY FOR THE FUTURE INTERNET TESTING.
17th European Conference on Software Maintenance and Reengineering
March 8th, 2013, Genova, Italy
Alessandra Bagnato, Softeam R&D
FITTEST PROJECT PARTICIPANTS(SEPTEMBER 2010- DECEMBER 2013)
Participant organisation Country
Universidad Politécnica de Valencia (coordinator) Spain
University College London United Kingdom
Berner & Mattner Systemtechnik Germany
IBM Israel
Fondazione Bruno Kessler Italy
Utrecht University The Netherlands
Softeam France
Sulake Finland
FUTURE INTERNET
The Future Internet (FI) a complex interconnection of services, applications,
content
Society increasingly dependent on FI critical activities such as social services, learning,
finance, business, as well as entertainment.
Challenging problems for quality assurance/testing
FUTURE INTERNET: CHALLENGES (1)
CH1 Self modification Rich clients have increased capability to dynamically adapt
the structure of the Web pages; server-side services are replaced and recomposed dynamically based on Service Level Agreements (SLA) and newly discovered services.
CH2 Autonomic behaviour FI applications are highly autonomous; their correct behaviour
cannot be specified precisely at design-time.
CH3 Low observability FI applications are composed of an increasing number of 3rd-
party components and services, accessed as a black box, which are hard to test.
FUTURE INTERNET: CHALLENGES (2) CH4 Asynchronous interactions
FI applications are highly asynchronous and hence hard to test. Each client submits multiple requests asynchronously; multiple clients run in parallel; server-side computation is distributed over the network and concurrent.
CH5 Time and load dependent behaviour For FI applications, factors like timing and load conditions make it hard to
reproduce errors during debugging.
CH6 Huge feature configuration space FI applications are highly customisable and self-configuring, and contain
a huge number of configurable features, such as user-, context-, and environment-dependent parameters.
CH7 Ultra-large scale FI applications are often systems of systems; traditional testing adequacy
criteria cannot be applied, since even in good testing situations low coverage will be achieved.
FITTEST PROJECT
Aims at addressing FI testing challenges; Continuous evolutionary automated testing; Developing an integrated testing environment; Assessment of developed techniques on FI
applications provided by industrial partners: Softeam (Modelio CASE Tool); IBM (Highly scalable services for web applications); Sulake (Habbo Hotel).
HOW: THE GLOBAL PICTURE
MODELIO SAAS CASE STUDY
Modelio SaaS is a proof-of-concept project, it extends Modelio UML modeling tool sharing facilities by making the distributed environment configuration transparent for its users. Runs on different cloud platforms presenting high number of configurations to challenge testing.
MODELIO FOR SOFTWARE AND SYSTEM ENGINEERING
UML editor with more than 20 years’ history UTP SysML MARTE Code generation Documentation Teamwork
ww
w.m
odelio
soft.co
m
• Available under open source at Modelio.org
MODELIO SAAS CASE STUDY
MODELIO SAAS WEB UI PHP CONTROLLERS
MODELIO CASE STUDY
FI Applications Low Observability Modelio SaaS is composed by different components and
services, accessed as a black box, we will maximize users‘ interaction coverage of our test suite through FITTEST B&M CTE Combinatorial testing.
FI Applications Autonomic Behavior Explore possible inputs dynamically and look for
suspicious behavior by using FITTEST GUI Testing tool to evaluate the unexpected ways that users use the Modelio SaaS services .
FI Applications Asynchronous interactions Multiple clients run in parallel and server-side computation
is distributed over the network we will generate a model of the system that is human-readable.
UML TESTING PROFILE
UML natively lacks concepts for testing of systems/software Domain-independent specification of test concepts based on
UML A language for creation, documentation, visualization,
specification and exchange of model-based test specifications
It provides concepts for Test behavior, observations and activities during a test; Test architecture, the elementsinvolved in a test and their
relationships; Test data, the structures and meaning of values to be processed in
a test; Time constraints and time observation for test execution.
UTP PROFILE HISTORY 2001: RFP for a test-related UML profile 2003: Initial submission elaborated by testers, UML and
test solution vendors Industrial members (a.o. Ericcson, Telelogic, IBM, Softeam) Academic members (a.o. Fraunhofer FOKUS, University
Luebeck) 2005: Final adopted version 1.0 released by the OMG June 2010: UTP 1.1 RTF was chartered June 2011: UTP 1.2 was chartered September 2012: UTP v2 RFI .. June, 2013: RFP for a UML Testing Profile 2 specification
(hopefully ) during the OMG Technical Meeting in Berlin in June, 2013.
UML TESTING PROFILE IN MODELIOSAAS VM WORKGROUP
MODELIOSAAS PHP UNIT TESTS EXECUTED IN MODELIOSAAS.
USER-FRIENDLINESS OF THE MODELING ENVIRONMENT
The Modelio UTP Profile implementation includes all the OMG UML Testing Profile stereotypes and all the feedback received from the FITTEST consortium to include proper specific commands within the Modelio Graphical user interface
CONCLUSIONS
FI Applications Low Observability FITTEST B&M CTE Combinatorial testing.
FI Applications Autonomic Behavior FITTEST GUI Testing tool to evaluate the unexpected
ways that users use the Modelio SaaS services . FI Applications Asynchronous interactions
UTP Modeling and Fittest continuous testing ITE environment.
THANKS!
Alessandra BagnatoSofteam R&D, [email protected]
FITTEST: EU FP7 Project https://www.facebook.com/FITTESTproject RCIS 2013 _ Industrial Day Paris 31st May 2013
http://rcis-conf.com/rcis2013/document/INDUSTRIALDAY_RCIS2013.pdf
Modelio Web Site: http:// www.modelio.org
Modelio UML Testing Profile : http://www.modeliosoft.com/en/modelio-store/modules/modelin
g-extensions/utp.html