copyright © panaya oracle ® e-business suite testing: how to get your business users on-board amir...
TRANSCRIPT
Copyright © Panaya
Oracle® E-Business Suite Testing:How to Get Your Business Users
On-Board
Amir FarhiDirector, Product Marketing
Copyright © Panaya
Agenda
2
• The challenges IT faces when testing Oracle EBS changes
• Improving cooperation by business users in the testing process
• SaaS accelerated manual testing technology
Copyright © Panaya
Panaya at a Glance
Leader in Oracle EBS & SAP SaaS-based Testing and Impact Analysis Automation software Serving customers in 60+ countries1,000+ enterprise customers, 2,000+ successful ERP projects3,000+ ERP systems analyzed500,000+ test cases in past year
3
Copyright © Panaya4
Constant Need for Change
Chart of Account Changes
Functional Enhancements
Mergers & Acquisitions
New Business Processes
Regulations
Upgrades
Patches
System Consolidation
InfrastructureChanges
Migrations
Business-Driven
IT-Driven
Copyright © Panaya5
Panaya Quality Management Cloud
Change Impact SimulationOracle R12 upgrades, point-release upgradesOracle patchesChart-of-Account (CoA) changesCustom-code releases
Code Remediation
Collaborative Test Management & Test AccelerationAutomated test script creationAutomated documentation and test evidenceAccelerated manual testingALM integration (HPQC, Oracle ATS)
“Cloud Wisdom” – transforming common practices to best practices
Scope & Accelerate changes in Enterprise Applications, Cutting Cost &
Risk
Copyright © Panaya
Panaya on Oracle.com
http://www.oracle.com/us/products/applications/ebusiness/ebs-upgrade/index.html#cost
6
Copyright © Panaya7
Business Users
IT Group
Initiate: Plan:Build:Test:
Business RequirementIT Requirement
Prepare Spec & Scope
Develop
IT ManualTesting
Automatic Testing
Off-ShoreTesting
Limited knowledge of real-life business processes…
Which constantly change!
Please test
Please test
Please test
Please test
Please test
Please test
Please testPlease test
Please testPlease test
Please test
Please test
Please testPlease testPlease test
The Change Process, Today
Copyright © Panaya8
The Constraints of Change, Today
Sponsor
Methodologies
Compliance
IT has no other choiceBut to follow these practices
Copyright © Panaya
Enable IT and Businessto Accelerate Change, Together
9
Copyright © Panaya10
Manual & Automated Testing
• Regression testing of static, critical business processes
• Unattended execution (“lights-out”)
• Developed by test engineers
• Unit testing, functional testing, user acceptance testing,regression testing
• Performed by functional experts & business key users Performed by
HP QTP, OATS, …
Automated
TestingManual Testing
Copyright © Panaya11
Panaya Manages & Accelerates Manual Testing
Accelerated Manual Testing
• Regression testing of static, critical business processes
• Unattended execution (“lights-out”)
• Developed by test engineers
Managed &
Accelerated by
Panaya
Performed by HP QTP, OATS, …
Automated
Testing
• Unit testing, functional testing, user acceptance testing,regression testing
• Performed by functional experts & business key users
Copyright © Panaya12
Competing Forces of Testing
Quality & Risk
Cost
Time toMarket
• Redundant testing • Creating & maintaining test scenarios• Executing & documenting manual tests
• Testing cycles take too long• Capturing business process knowhow• Lack of collaboration with the business
for test execution
• Scoping what to test based on risk• Capturing test evidence for auditing• Eliminating critical production issues• Test process governance
Copyright © Panaya13
ERP Manual Testing Challenges
Source: Panaya ERP survey
Capturing business process knowledge
Maintaining Test Documentation
Creating Test Documentation
Test Execution
Scoping & prioritizing the test plan
Test project management
Passing Audits
52%
43%
41%
38%
38%
20%
6%
Copyright © Panaya14
Customers’ Testing Methodologies
20%Ad-Hoc
50%Organized
30%Scripted
Copyright © Panaya15
Testing Methodologies Characteristics
• Oracle EBS system is stable, minimal changes• Use email to communicate testing tasks• No test catalog (no test scenarios)• Test runs need not be documented• No test automation
Ad-hoc
Copyright © Panaya16
How Panaya Addresses Your Testing Needs
• Visibility into testing progress• Visibility into business process testing coverage• Improved test run documentation• Improved defect management• Specific implementation methodology: onboarding &
ongoing
Ad-hoc
Copyright © Panaya17
• Excel to manage & track testing process• Rely on Business Process owners knowledge (SME) to
execute the test• Test scenarios documented up to the transaction level in
Word/Excel• Low use of test automation
Testing Methodologies Characteristics
Organized
Copyright © Panaya18
• Easily manage, assign, and track testing activities• Automate test evidence documentation• Manage defects• Building block for regression test suite• Specific implementation methodology: onboarding &
ongoing
How Panaya Addresses Your Testing Needs
Organized
Copyright © Panaya19
• Excel to manage & track testing process• Tests executed by non-SME (QA Team, Offshore or System
Integrator)• Test scenarios documented to the screen/field level in
Word/Excel• Likely to use test automation
Testing Methodologies Characteristics
Scripted
Copyright © Panaya20
• Easily manage, assign, and track testing activities• Accelerate test scenario creation, test execution, defect
reporting, and test evidence documentation• Manage defects• Building block for regression test suite• Specific implementation methodology: onboarding & ongoing
How Panaya Addresses Your Testing Needs
Scripted
Copyright © Panaya
Panaya Collaborate Testing - Demo
21
Copyright © Panaya23
Recording Test Scenarios
Click to start recording your test scenario
Copyright © Panaya24
Follow Your Business Process
Copyright © Panaya25
Panaya Automatically Generates a Test Script
Copyright © Panaya26
Add manual steps or external systems
Add comments and special instructions
Attach documents (e.g. test variations, test data)
Append more business functions
Tailor Test Script Details
Copyright © Panaya27
Easily Export to Microsoft® Word or Excel
Copyright © Panaya28
Manage Test Catalog
Copyright © Panaya29
Manage Test Catalog Details
Copyright © Panaya30
2. Panaya code analysis automatically identifies which functional tests are covering those unit tests
3. Adjust testing scope- risk of failure (for
upgrade or patching)- business usage
1. Panaya impact analysis identifies required unit tests for project
Integrated Test Coverage Assessment (via automated impact analysis simulation)
Copyright © Panaya31
1. Panaya impact analysis identifies project code corrections impacting each functional scenario
2. Panaya marks functional scenario as “not ready to test” due to pending project code corrections. When code corrections completed, status changes to “ready to test”, and tester is notified.
Integrated Test Coverage Assessment (via automated impact analysis simulation)
Copyright © Panaya32
Open test task
Assign test run to user
Select scenario
Accelerated Functional Test Execution
Copyright © Panaya33
Tester’s task list
Record Oracle session
Initiate test evidence recorder
Automated Test Evidence Recording
Copyright © Panaya34
Report test failure&
Create defect
Assign and manage defect
Re-test and record evidence View test evidence
Functional Test ExecutionManage defects & re-test
Copyright © Panaya35
Assign Adhoc Test
Tester’s task list
Record Oracle session
Initiate test evidence recorder
Functional Test ExecutionAdhoc/Instant Testing
Copyright © Panaya36
Monitor Test Progress
Copyright © Panaya37
Panaya myTestBrowserless Desktop Web Application
Tasks are fed to Business User desktops
Testers don’t need to go to ALM or Panaya portal
Copyright © Panaya38
Running a Scripted Test
IT or Business User is assigned a task from ALM
User selects Manual Run & Document
Original Script is presented
User completes testing (Panaya will sync with ALM)
Copyright © Panaya39
Panaya also works with other ALMs(HP Quality Center or Oracle ATS)
Use Panaya Test Builder to build your functional test scripts automatically creates HP/OATS test designs, with step-by-step details
HPQC/OATS manages test results and defect management
Copyright © Panaya40
Key Takeaways
Even with Test Automation, Manual Testing still dominates
Accelerate the process!
You rely on your users to help with the testing
Make it easy for them!
SaaS is easy to start; easy to deploy and easy to manage
Test drive Panaya’s Collaborative
Manual Testing!
