intelligent testing conference 2014 - t&vs · pdf fileintelligent testing conference 2014...
TRANSCRIPT
![Page 1: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/1.jpg)
Parasoft Proprietary and Confidential 1
2014-11-18
Intelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing
Andrew Thompson – Solution Architect
![Page 2: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/2.jpg)
Parasoft Proprietary and Confidential 2 Parasoft Proprietary and Confidential 2
Service Virtualization delivers a simulated dev / test environment allowing an organization to test
anytime or anywhere
Service Virtualization
![Page 3: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/3.jpg)
Parasoft Proprietary and Confidential 3 Parasoft Proprietary and Confidential 3
Complexity is a Barrier to Innovation
3rd Party System
Evolving Component Mainframe
Scheduled Access
![Page 4: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/4.jpg)
Parasoft Proprietary and Confidential 4 Parasoft Proprietary and Confidential 4
An application is not just “one application” …
![Page 5: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/5.jpg)
Parasoft Proprietary and Confidential 5 Parasoft Proprietary and Confidential 5
… it’s made up of „several components” …
![Page 6: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/6.jpg)
Parasoft Proprietary and Confidential 6 Parasoft Proprietary and Confidential 6
… and they are not all ready at the same time.
![Page 7: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/7.jpg)
Parasoft Proprietary and Confidential 7 Parasoft Proprietary and Confidential 7
How do we ensure quality of the components?
Static Analysis, Unit Testing, Code Review
![Page 8: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/8.jpg)
Parasoft Proprietary and Confidential 8 Parasoft Proprietary and Confidential 8
How to test without dependant components?
API testing
Reusable Virtual Assets
![Page 9: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/9.jpg)
Parasoft Proprietary and Confidential 9 Parasoft Proprietary and Confidential 9
Test as soon as the components are ready
![Page 10: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/10.jpg)
Parasoft Proprietary and Confidential 10 Parasoft Proprietary and Confidential 10
… it’s made up of several components.
![Page 11: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/11.jpg)
Parasoft Proprietary and Confidential 11 Parasoft Proprietary and Confidential 11
Dev/Test Environment Access Survey
Over 400 responses so far
http://bit.ly/x7UWkQ
![Page 12: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/12.jpg)
Parasoft Proprietary and Confidential 12 Parasoft Proprietary and Confidential 12
30
Survey Results…
The average number of dependent application associated with the System Under Test (SUT)
BUT, Dev/QA only have “trustworthy”
access to SIX of the applications
30 29 28 27 26 25
24 23 22 21 20 19
18 17 16 15 14 13
12 11 10 9 8 7
6 5 4 3 2 1
![Page 13: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/13.jpg)
Parasoft Proprietary and Confidential 13 Parasoft Proprietary and Confidential 13
Survey Results…
The average percentage of time spent configuring the test environment.
30%
50% The average percentage of the test plan able to complete once configured.
![Page 14: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/14.jpg)
Parasoft Proprietary and Confidential 14 Parasoft Proprietary and Confidential 14
Survey Results…
When testing with a dependent application only need access to a small percentage of the applications functionality
20%
![Page 15: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/15.jpg)
Parasoft Proprietary and Confidential 15 Parasoft Proprietary and Confidential 15
Survey Results…
75% of organizations must schedule time in order to access a test environment 75%
The average time block allowed to be schedule is hours
4
![Page 16: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/16.jpg)
Parasoft Proprietary and Confidential 16 Parasoft Proprietary and Confidential 16
Survey Conclusions
1. Test environment access hampers testing activity
2. Development needs access to dependent components much earlier in the SDLC
3. Test environment configuration is complex and eats into test execution time
4. The risk of application failures persist as testers are unable to complete testing cycles
![Page 17: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/17.jpg)
Parasoft Proprietary and Confidential 17 Parasoft Proprietary and Confidential 17
Service Virtualization
![Page 18: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/18.jpg)
Parasoft Proprietary and Confidential 18 Parasoft Proprietary and Confidential 18
When to use SV? Access vs Configuration
Access Dependent applications difficult Scheduling conflicts High access fees Geo-political boundaries 3rd party or partner applications
Configuration Complex to configure No control Limited variability Consumes test time
Test Access
Simple Difficult
Configura
tion
Complex
Internal
Service
Internal
Application 3rd Party
Service
ERP
Mainframe
External
Application
External
Database
Internal
Database
Cloud
App
Message
Queue
ESB
Web
Server
![Page 19: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/19.jpg)
Parasoft Proprietary and Confidential 19 Parasoft Proprietary and Confidential 19
When to use SV? Access vs Configuration
Access Dependent applications difficult Scheduling conflicts High access fees Geo-political boundaries 3rd party or partner applications
Configuration Complex to configure No control Limited variability Consumes test time
Test Access
Simple Difficult
Configura
tion
Complex
Internal
Service
Internal
Application 3rd Party
Service
ERP
Mainframe
External
Application
External
Database
Internal
Database
Cloud
App
Message
Queue
ESB
Web
Server
Service Virtualization
Virtual Lab / Server
Virtualization
(i.e. VMWare)
![Page 20: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/20.jpg)
Parasoft Proprietary and Confidential 21 Parasoft Proprietary and Confidential 21
So, What are you Virtualizing?
• SOA / Web services
• XML
• WSDL
• WADL
• UDDI
• WSIL
• SOAP
• PoX (Plain XML)
• REST
• JSON
• BPEL
• Web Applications
• SQL/Stored Procedures
• JDBC/ODBC
• Mainframe CICS/IMS
• Copybook
• Mobile Interfaces
• AJAX
• JSP
• JavaScript
• HTML
• CSS
• WS-*Standards
• SAP RFC/IDoc
• MTOM(XOP) / MIME / DIME
• OAuth
• TCP/IP
• webMethods Broker
• webMethods IS
• HL7
• FTP
• HTTP/HTTPS
• JMS
• IBM WebSphere MQ
• Sonic MQ
• RMI
• EJB
• SMTP
• Tibco Rendezvous
• .NET WCF
• ISO 8583, FIX, SWIFT
• Mainframe CICS, IMS
• EDI
• Java JVM calls
• Extendable Formats and Protocols
AUT
![Page 21: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/21.jpg)
Parasoft Proprietary and Confidential 22 Parasoft Proprietary and Confidential 22
How to create a Virtual Asset
Direct from Recorded traffic
Wizard extracts data and creates parameterised virtual asset
From a WSDL/XSD/WADL schema
From sample messages provided by architects
![Page 22: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/22.jpg)
Parasoft Proprietary and Confidential 23 Parasoft Proprietary and Confidential 23
Parasoft Virtualize: How does it work?
Application Under Test
2 Capture
4 Deploy
3 Create
Application
Database
Service
QA and Test
Performance Test Engineer
Mainframe
Define Monitors 1
Development
Service
Test
LoadRunner
![Page 23: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/23.jpg)
Parasoft Proprietary and Confidential 24 Parasoft Proprietary and Confidential 24
Parasoft Virtualize: How does it work?
Application Under Test
Application
Database
Service
Mainframe
Environment Manager
5 Manage
6 Consume
QA and Test
Performance Test Engineer
Development
QC/ALM
Rational
![Page 24: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/24.jpg)
Parasoft Proprietary and Confidential 25 Parasoft Proprietary and Confidential 25
What is ‘Inside’ a Virtual Asset?
Responder Correlation
Datasource Correlation
Response message
Transport configuration
![Page 25: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/25.jpg)
Parasoft Proprietary and Confidential 26 Parasoft Proprietary and Confidential 26
And more advanced features
Create time stamps on the fly
Performance profiles
Multiple data sources
Data extraction tools
Persistence
![Page 26: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/26.jpg)
Parasoft Proprietary and Confidential 27 Parasoft Proprietary and Confidential 27
Example: Parabank Cloud Deployment
Parabank Retail Services
Virtual Loan Processor
Service
Virtual Loan Processor
Service
Virtual Loan Processor
Service
Virtual Loan Processor
Service
QA Engineer
Accounts DB
Loan Processor Service
Loan Processor Service
Different data/behavior/performance profiles
![Page 27: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/27.jpg)
Parasoft Proprietary and Confidential 28 Parasoft Proprietary and Confidential 28
Demo
![Page 28: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/28.jpg)
Parasoft Proprietary and Confidential 29 Parasoft Proprietary and Confidential 29
Stubs Vs Service Virtualization
Stubs Inside-out approach that disassociates a test case from a system Brittle No reuse Static response
Service Virtualization Creates an environment in which to run “rich” test scenarios Assets represent real system behavior All assets reusable Assets are programmable and extensible
Service Virtualization provides a complete environment for developing and
testing against complex, dependent systems
![Page 29: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/29.jpg)
Parasoft Proprietary and Confidential 30 Parasoft Proprietary and Confidential 30
30 Second Virtualization
But its simpler to get someone to quickly throw a stub
together for me!
Really?
YouTube: “Parasoft Service Virtualization: 30-second demo”
![Page 30: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/30.jpg)
Parasoft Proprietary and Confidential 31 Parasoft Proprietary and Confidential 31
Who Creates the Virtual Assets?
Developers
Testers
Virtualisation SME’s
![Page 31: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/31.jpg)
Parasoft Proprietary and Confidential 32 Parasoft Proprietary and Confidential 32
Reduces time to configure applications for test
Significantly lowers hardware costs or system access fees
Reduces the cost for “Test/QA” licenses
Increase software quality
Increases productivity
Summary - Benefits Service Virtualization
![Page 32: Intelligent Testing Conference 2014 - T&VS · PDF fileIntelligent Testing Conference 2014 Service Virtualization and its Benefits to Testing ... webMethods Broker • webMethods IS](https://reader033.vdocument.in/reader033/viewer/2022052710/5ab1bb397f8b9ac66c8ce125/html5/thumbnails/32.jpg)
Parasoft Proprietary and Confidential 33
2014-11-18
Thank you
Questions?