oracle business intelligence 11g peak eta – product overview · • oracle exalytics “summary...
TRANSCRIPT
Oracle Business Intelligence 11g
Peak ETA – Product Overview Antony Heljula / Paul Oprea
January 2013
© Peak Indicators Limited 2
Agenda Peak ETA – Product Overview
• What is Peak ETA? • Real Business Value – 2 Examples • Optimised ETA • System Components • Supported Data Sources • Development Approach • How it Works • Further Notes
© Peak Indicators Limited 3
Peak ETA – Product Overview What is Peak ETA?
© Peak Indicators Limited 4
What is Peak ETA? Introduction
• Peak ETA (Extract Transform Aggregate) is a unique innovation developed by Peak Indicators
• It delivers real business value to Organisations by significantly extending the capabilities of the Exalytics “Summary Advisor” and the Oracle BI 11g “Aggregate Persistence Wizard”
• The key benefits are: In-memory aggregates loaded incrementally and in parallel No downtime (aggregates are fully available whilst being loaded) A GUI console to orchestrate and monitor the loading of aggregates Error Detection Automatic code generation BI Dashboards with alerting capability
• All this is achieved using standard Exalytics technology and methodology
© Peak Indicators Limited 5
What is Peak ETA? Extract, Transform, Aggregate!
Oracle Business Intelligence
11g
Aggregate Tables
ETA Data Warehouse
BI Dashboards
© Peak Indicators Limited 6
Peak ETA – Product Overview Real Business Value
© Peak Indicators Limited 7
Real Business Value Example 1
• A Global provider of Mobile Satellite Communications: • A 27x performance gain achieved using TimesTen in-memory aggregates • Peak ETA reduced daily aggregate load time from >14 hours to less than 30 minutes
© Peak Indicators Limited 8
Real Business Value Example 2
• A UK Retailer: • 88x performance gain across 9 dashboard achieved using in-memory aggregates • Peak ETA reduced daily aggregate load times from >4 hours to 25 minutes
© Peak Indicators Limited 9
Peak ETA – Product Overview Optimised ETA
© Peak Indicators Limited 10
Optimised ETA 1) Incremental Loading
• The most important Peak ETA optimisation for loading aggregates is the ability to perform and incremental extract and load
• This means we only need to extract the latest changes from the source system
• The BI Developer provides a simple filter condition that defines the incremental subset for each aggregate
Oracle Business Intelligence
11g
TimesTen for Exalytics
Incremental load
Incremental Extract
© Peak Indicators Limited 11
Optimised ETA 2) Use Aggregates as a Source
• Secondly, Peak ETA makes it far easier to load aggregates directly from other aggregates
• So we can have multiple layers of aggregates, with each layer using a previous layer as its source:
• Populate “Monthly” aggregates from “Daily” aggregates
• Populate “Quarterly” aggregates from “Monthly” aggregates
• This brings a huge efficiency saving, especially as
the source database is now only used to incrementally load the first layer of aggregates – all subsequent processing is done within TimesTen
Oracle Business Intelligence
11g
TimesTen for Exalytics
Incremental load
Incremental Extract
Day
Mth
Qtr
© Peak Indicators Limited 12
Optimised ETA 3) Parallel Loading
• Finally, the whole process from beginning to end runs completely in parallel
• Zero additional configuration required to achieve parallel loading
Oracle Business Intelligence
11g
TimesTen for Exalytics
Parallel load
Parallel Extract
Day
Mth
Qtr
© Peak Indicators Limited 13
Peak ETA – Product Overview System Components
© Peak Indicators Limited 14
System Components Overview
• Peak ETA consists of 4 components:
1. Peak ETA Console: A J2EE user interface
2. Peak ETA Server: A java-based parallel execution engine to drive the loading of aggregates 3. Peak ETA Repository: A small database repository to store metadata
4. Peak ETA Dashboards A BI Repository (RPD) and BI Dashboards used for read-only monitoring and analysis
© Peak Indicators Limited 15
Peak ETA Console
• The Peak ETA Console is a Java application written using Oracle ADF Framework
• It us built using the same technology used by Oracle Fusion Applications
• Deployed to Weblogic, alongside Oracle BI 11g
• No additional Oracle licenses required
System Components
© Peak Indicators Limited 16
System Components Peak ETA Server
• The Peak ETA Server is a parallel execution engine designed for loading aggregates.
• It can be initiated using a command-line script or via a button in the Peak ETA Console
• Being Java based, it can be initiated on any platform
• Scripts are provided for both Windows and Linux/Unix
• Compatible with any central scheduling tool
© Peak Indicators Limited 17
System Components Peak ETA Dashboards
• BI Dashboards have been created so that anyone can monitor the load process
• Drill-downs provided for detailed analysis of the loading process for each aggregate
• BI Delivers can also be configured to send out email alerts based on load start/completion/failure
© Peak Indicators Limited 18
Peak ETA – Product Overview Supported Data Sources
© Peak Indicators Limited 19
Supported Data Sources Everything that Exalytics Supports!
• Peak ETA reuses the exact same code generated by the:
• Oracle Exalytics “Summary Advisor” or • Oracle BI 11g “Aggregate Persistence Wizard”
• This means Peak ETA can extract data from
any data source supported by Oracle Exalytics
• Peak ETA is designed to load aggregated data into Oracle TimesTen for Exalytics
Oracle Business Intelligence
11g
Any Data Source Supported by Oracle BI 11g
TimesTen for Exalytics
Peak ETA
© Peak Indicators Limited 20
Peak ETA – Product Overview Development Approach
© Peak Indicators Limited 21
Development Approach Step 1
• The first step is simple: you build and fully populate your aggregates using the exact same tools as you currently use with Oracle BI 11g:
• Exalytics “Summary Advisor” or • “Aggregate Persistence Wizard”
• These tools will automatically perform the following:
• Create of aggregate tables and indexes • Fully load of the aggregate tables • Model the necessary aggregate metadata
into the RPD
Oracle Business Intelligence
11g
TimesTen for Exalytics
“Summary Advisor” or “Aggregate Persistence Wizard”
Full Load
© Peak Indicators Limited 22
Development Approach Step 2
• Step 2 is even simpler! You just need to do the following:
1. Register the name of each aggregate in the Peak ETA Console
2. Define how each aggregate should be incrementally updated
• All other code is automatically
generated
• That’s it! You now have parallel incremental loading capability for your in-memory aggregates
Oracle Business Intelligence
11g
TimesTen for Exalytics
Peak ETA
Incremental Load (in parallel)
© Peak Indicators Limited 23
Peak ETA – Product Overview How It Works
© Peak Indicators Limited 24
How It Works Process Flow - START
• As the starting point, you have some TimesTen In-Memory Aggregates which have already been built and populated using the Exalytics Summary Advisor (or Aggregate Persistence Wizard)
Oracle Business Intelligence
11g
Target Aggregates
© Peak Indicators Limited 25
How It Works Process Flow – STEP 1
1. Peak ETA Server issues commands to build a set of “Staging Aggregates” (identical to the target aggregates).
Done automatically – no coding required
Oracle Business Intelligence
11g
Target Aggregates
Staging Aggregates
1
Peak ETA
© Peak Indicators Limited 26
How It Works Process Flow – STEP 2
1. Peak ETA Server issues commands to build a set of “Staging Aggregates” (identical to the target aggregates).
Done automatically – no coding required 2. Peak ETA Server instructs Oracle BI Server to
populate the Staging Aggregates using an incremental extract and load
Oracle Business Intelligence
11g
Target Aggregates
Staging Aggregates
Peak ETA
2
© Peak Indicators Limited 27
How It Works Process Flow – STEP 3
1. Peak ETA Server issues commands to build a set of “Staging Aggregates” (identical to the target aggregates).
Done automatically – no coding required 2. Peak ETA Server instructs Oracle BI Server to
populate the Staging Aggregates using an incremental extract and load
3. Peak ETA Server issues commands to incrementally update the Target Aggregates from the Staging Aggregates
Done automatically – no coding required
Oracle Business Intelligence
11g
Target Aggregates
Staging Aggregates
Peak ETA
3
© Peak Indicators Limited 28
How It Works All Steps Performed in Parallel
• For maximum efficiency, all parts of the process can be done in parallel
Oracle Business Intelligence
11g
Target Aggregates
Staging Aggregates
© Peak Indicators Limited 29
Peak ETA – Product Overview Further Notes
© Peak Indicators Limited 30
Further Notes Recap
• The combination of Peak ETA and Oracle Exalytics offers real business value
• Peak ETA customer examples: • 27x faster dashboards with <30 min load process • 88x faster dashboards with <30 min load process
• Virtually zero coding required
• No “physical” SQL code required
• Aggregate “Surrogate Keys” are supported
• It takes less than 2 minutes to configure each
aggregate table!
© Peak Indicators Limited 31
Further Notes More Information
• If you are interested in seeing a complete demonstration or finding out further details then please visit our web-site:
• http://www.peakindicators.com
• 31 day free-trial available!
• Demonstration licenses also available for Oracle Sales and Oracle Partners
• Feel free to email us if you have any questions: • [email protected]
© Peak Indicators Limited 32
Questions?
Helping Your Business Intelligence Journey