5. rational testing of soa application
DESCRIPTION
TRANSCRIPT
®
IBM Software Group
© 2007 IBM Corporation
IBM Rational Proof of Technology
Discovering the Value of IBM Rational’s Web Services Testing Solution
IBM Software Group | Rational software
2
TechWorks
Agenda
Overview of Quality Management of SOA Applications
Challenges of Testing SOA Applications
Overview of IBM SOA Quality Management Solution
Key SOA Concepts and Terminology
Functional Testing of Services
Performance Testing of Services
Management and Monitoring of Services
IBM Software Group | Rational software
3
TechWorks
Decades of proven processexpertise & customer success
IBM Rational softwareA strategic partner in business innovation & transformation
Go
vern
an
ce &
lif
ecy
cle
man
agem
en
t
Business flexibility
Global capability
Time to value
Risk & compliance management
Business imperativesBusiness innovation& transformation
Alignment
Control
Efficiency
Governing the businessprocess of software& systems delivery
IBM Software Group | Rational software
4
TechWorks
March ‘07
Oct ‘06
Service Development & Delivery
Management
Apr ‘06
Infrastructure and Management
In Support of SOA
Service Development and
Delivery Management
SOA Governance Method
Dec ‘06
What is IBM SOA Quality Management? An Integral Part of SOA Governance & Service Lifecycle Management
IBM Software Group | Rational software
5
TechWorks
SOA Quality Management is the process to assure services meet business requirements by validating service
functionality and operations throughout the SOA Lifecycle
SOA Lifecycle
SOA Quality Management is continuous and takes place within each phase of the SOA Lifecycle
What is SOA Quality Management?
IBM Software Group | Rational software
6
TechWorks
The SOA Testing Strategy
Test early, test often is more important now than ever (due to the domino affect a bug in a service may have on a given business process and the
possibility of that service being in many business processes)
The only way to effectively test SOA projects is to…. start from the ground up.
test the inputs and outputs of individual modules.
assemble sections of logic together and test smaller sections of the integration flow.
Assemble those smaller sections into a finished SOA project and perform an end-to-end test on the fully assembled project.
Key tenants Focus on the business processes in requirements and testing
Create test plans that account for assembly of services
Create an automated and repeatable testing process Plan for typical SOA testing hurdles (e.g. security access, unavailable systems)
IBM Software Group | Rational software
7
TechWorks
Agenda
Overview of Quality Management of SOA Applications
Challenges of Testing SOA Applications
Overview of IBM SOA Quality Management Solution
Key SOA Concepts and Terminology
Functional Testing of Services
Performance Testing of Services
Management and Monitoring of Services
IBM Software Group | Rational software
8
TechWorks
SOA adoption increases modularity & changeBringing quality to the forefront
Pain of modularity
Lower level of functionality & performance both at individual service level & composite application
Increased risk and need to manage distributed assets
Increased management of a larger number of services including custom, outsourced & packaged
Business impact
Service and application SLAs will be impacted by more frequent updates
Cross-organization Business/IT organizations will have increased complexity
Decentralization, modularity and increased risk drives need for a structured approach of integrated requirements, architecture & lifecycle quality management
IBM Software Group | Rational software
9
TechWorks
Quality Management of Service Oriented ApplicationsExamining the fundamental challenge…
Challenges of testing Service Oriented Architecture
Applications
Ensuring system fulfils requirements
Validating system functionality
Validating system performance
Validating component web services
Tracking test cases and defects
IBM Software Group | Rational software
10
TechWorks
Quality Management of Service Oriented ApplicationsA new twist on an old problem…
Challenges of testing Service Oriented Architecture
Applications
Validating component web services
IBM Software Group | Rational software
11
TechWorks
Quality Management of Service Oriented ApplicationsThe IBM Rational Solution.
Quality Management of Service Oriented Architecture Applications
The IBM Rational Solution is a three pronged approach
Traditional user centric requirement, test and defect management
New Web Service Quality functionality to address building blocks of SOA Apps
Post Deployment monitoring of service oriented architecture applications
IBM Software Group | Rational software
12
TechWorks
“Everyone uses different tools – there’s no way to share data between the team.”
“There’s too much to test. Where do we begin ?”
“I have requirements, I have tests and I have defects…but nothing ties them together”
Challenge: The Cost - Time - Quality TradeoffGovernance of the software delivery process
Your job is to deliver quality applications. On Time. On Budget. You need to coordinate teams, data, schedules, requirements, models, code, tests, results and reports. Are you ready?
IBM Software Group | Rational software
13
TechWorks
Challenge: Validating SOA component functionality & performanceEnsuring functionality of composite application units
“The Web Service is ready for testing, but there is no user interface to exercise it.”
“How can we leverage our Business Process analysis in our services testing efforts?”
“We don’t want to pull Programmers off their projects to write complex test harnesses.”
Web Services are the building blocks of SOA applications. A single service is a stand-alone component but may be used in dozens of systems. Some of those services will be yours, some not. How do you test a service without the rest of the system? Does it work? All the time? Under load? Are you sure?
IBM Software Group | Rational software
14
TechWorks
Challenge: Post Deployment Monitoring of ServicesCreating a feedback loop from operations to development
Congratulations you’ve gone live. How are things going out there? Do you know? What happens when you need to make a change? And what if operations found a problem – how would it get back to development? Do these groups communicate?
“How can I monitor web services running on many different platforms against thousands of users?”
“How do I change policies and ensure those changes don’t break the implementations?”
“How can I communicate problems foundin the field back to development?”
IBM Software Group | Rational software
15
TechWorks
Agenda
Overview of Quality Management of SOA Applications
Challenges of Testing SOA Applications
Overview of IBM SOA Quality Management Solution
Key SOA Concepts and Terminology
Functional Testing of Services
Performance Testing of Services
Management and Monitoring of Services
IBM Software Group | Rational software
16
TechWorks
IBM Rational Quality Management Solutions Process and products to ensure quality throughout the delivery lifecycle and deployment
Define & AnalyzeEnable requirements
based testing
ImplementIncrease
code quality
Build & Deploy Automate & trace
the quality process
Test & ProductionEnsure functionality,
system performance & compliance
Assessbusinessanalytics
IBM Software Group | Rational software
17
TechWorks
SOA Lifecycle
Validate the business requirements
Discover and assess against current services
Model service requirements
Create service update plan Create/modify the service to meet the
business requirementsAssess service against governance
policies Approve assembly completion
Manage & monitor the service throughout its lifecycle
Track the service in the registry Report on the service against
SLAs
Quality assure the servicesFunction testing Performance testingCompliance testing Approve service deployment
IBM Rational Quality Management Solutions Process and products to ensure quality throughout the delivery lifecycle and deployment
IBM Software Group | Rational software
18
TechWorks
Create, document and prioritize business requirements
Rational RequisitePro WebSphere Business Modeler
Define, approve & monitor Rational Portfolio Manager Rational ClearCase Design, code, build Rational Application Developer Rational Build Forge
Deploy, build & monitor in production environment
Tivoli CompositeApplication Manager
Tivoli Provisioning Manager
Evaluate & execute functional & performance test cases
Rational Tester for SOA Quality and Performance Tester Extension for SOA Quality
Rational ClearQuest
Publish Find Enrich GovernManage
WebSphere Service Registry and Repository
What does the toolset provide? Automate business processes to achieve improved business flexibility Proactive response to quality issues earlier in the lifecycle Collaborative process automation & enforcement Extensible framework and registry/repository
SOA Lifecycle
IBM Toolset
IBM Software Group | Rational software
19
TechWorks
Test Management with ClearQuest The Hub for Life-Cycle development
Track requirements, test cases, change requests and defects from a single interface
Consolidated reporting for full lifecycle process governance
Global test project coordination unifies distributed teams on a centralized data infrastructure
Configurable, enforceable processes ensures the tool adapts to your process
IBM Software Group | Rational software
20
TechWorks
Service Quality Management Functional and Performance Testing of Web Services from a common interface
Rational Tester for SOA Quality
Automated regression and functional testing for GUI-less Web services
Rational Performance Tester Extension for SOA Quality
Performance Testing for Web Service based applications
IBM Software Group | Rational software
21
TechWorks
Agenda
Overview of Quality Management of SOA Applications
Challenges of Testing SOA Applications
Overview of IBM SOA Quality Management Solution
Key SOA Concepts and Terminology
Functional Testing of Services
Performance Testing of Services
Management and Monitoring of Services
IBM Software Group | Rational software
22
TechWorks
Service (in the context of SOA)
A self contained business function in which consumers interact through a well defined interface (contract).
The consumer does not know (or care) "how" the service implements the requested business action - only that the service performs "what" is defined by its published interface (contract).
A service in the context of
an SOA
An abstracted view of SOA concepts
IBM Software Group | Rational software
23
TechWorks
WSDL – Web Service Description Language
An XML-based service description on how to communicate using web services.
Defines services as collections of network endpoints, or ports.
Specification provides an XML format.
The abstract definition of ports and messages is separated from their concrete use or instance, allowing the reuse of these definitions.
WSDL is often used in combination with SOAP and XML Schema to provide web services over the Internet.
IBM Software Group | Rational software
24
TechWorks
Agenda
Overview of Quality Management of SOA Applications
Challenges of Testing SOA Applications
Overview of IBM SOA Quality Management Solution
Key SOA Concepts and Terminology
Functional Testing of Services
Performance Testing of Services
Management and Monitoring of Services
IBM Software Group | Rational software
25
TechWorks
Functional & Regression Testing Strategy
Quickly test Web Services and setup desired regression Test Cases.
Ease-of-use in setting up these tests will help promote testers to test their Web Services early and often.
Easy Test Case Management and Setup is vital to a productive establishment and maintenance of functional & regression tests.
Setup an environment where the impact of requirement and business process changes can be quickly analyzed and realized
IBM Software Group | Rational software
26
TechWorks
IBM Rational Tester for SOA QualityCode free test development
Simplify testing of GUI-less service Automated generation of web service test client
No programming knowledge is necessary to create, comprehend, modify, and execute a functional or performance test
Support a wide variety of users Automated data correlation and data driven testing
through a code-free test environment
Simplify service integration testing Automated test creation from WebSphere Business
Process Execution Language resources
Create, comprehend, modify, and execute a functional or performance test Graphical test editor enables both high-level and
deeper detail views
Support Web services standards (e.g. SOAP, HTTP(S), JMS, WS-Security, UDDI)
Code FreeTest Editor
IBM Software Group | Rational software
27
TechWorks
Agenda
Overview of Quality Management of SOA Applications
Challenges of Testing SOA Applications
Overview of IBM SOA Quality Management Solution
Key SOA Concepts and Terminology
Functional Testing of Services
Performance Testing of Services
Management and Monitoring of Services
IBM Software Group | Rational software
28
TechWorks
Performance Testing Strategy
QA Testers & Network Engineers should test the scalability and robustness of web services and determine performance and endurance characteristics of their WSDL operations.
Performance Tests should determine: response times
latency
throughput profiles
endurance
robustness
scalability
IBM Software Group | Rational software
29
TechWorks
IBM Rational Performance Tester Extension for SOA QualityPerformance testing for Web applications
Web Service Response Time
Validate system scalabilityAutomated generation of web service
performance tests
Real-time reporting of server response time and throughput
Eliminate need for costly development of test codeAutomated generation of web service
test client
Get real time feedback on SOA efficiencyBroad platform monitoring support for
deployed web services
User action throughput
IBM Software Group | Rational software
30
TechWorks
Agenda
Overview of Quality Management of SOA Applications Challenges of Testing SOA Applications
Overview of IBM SOA Quality Management Solution
Key SOA Concepts and Terminology
Functional Testing of Services
Performance Testing of Services
Manage and Monitoring of Services
IBM Software Group | Rational software
31
TechWorks
Analyze SOA Service Quality Deploy with confidence with Tivoli Provisioning Manager
Dependency CheckingAnalyzing the environment to ensure the
change will be successful
Integrity Checking Analyzing relationships and the impact the
change will have on them
Increased service modularity within SOA will require additional and regular dependency and integrity checking
IBM Software Group | Rational software
32
TechWorks
Health Monitoring of SOA components NEW! Application Management dashboards for IT and
business reporting supports Web Services, ESB and Process Server
Performance Monitoring and Transaction Management Populate WSRR with live service performance data NEW! Response Time dashboards
Change and Configuration management DataPower configuration support
Reroute services by making changes and upgrades while staying in full production mode
Auto-discover services for populating WSRR with services information
Monitor Deployed Services and Service QualityTivoli Composite Application Management (ITCAM)
“Show me the flow details in my service development tool!”
ITCAM supports production and development needs with a unified
console!
IBM Software Group | Rational software
33
TechWorks
Response Time BreakdownMapping imported operations monitoring data to code
Import ITCAM and ITM data to your development environment to discover bottlenecks in hardware and code
Feed back operations data to development to provide insight into live deployed application response
Monitor both resource data such as CPU, Network and RAM as well as code performance data
Export operations alert data for analysis by
development
IBM Software Group | Rational software
34
TechWorks
Next Steps – Learn and Explore Rational Tester for SOA Quality
http://www-306.ibm.com/software/awdtools/tester/soa/index.html
IBM Rational Tester for SOA Quality test execution and performance reports http://www-128.ibm.com/developerworks/ration
al/library/07/0327_kelly2/index.html?ca=drs-
IBM SOA http://www-306.ibm.com/software/solutions/soa
/
Tutorials on developerWorks http://www-128.ibm.com/developerworks/
views/rational/libraryview.jsp?search_by=Design+SOA+services+with+Rational+Software+Architect,+Part/
IBM Software Group | Rational software
35
TechWorks
Enable quality management
throughout the lifecycle
IBM Rational software quality management: Connecting software results to business objectives
Continuous, comprehensive, and collaborative quality
management throughout the lifecycle reduces costs and
improves credibility
Ensure businessflexibility
Enhanceorganizational
efficiencies
Functional and performance testing of business services
helps ensure compliance and improve customer
satisfaction
Automating workflows across business processes by
streamlining and eliminating redundancies to improve
return on investment
Quality Management of Service Oriented Applications A complete solution