alfred adams avanco international, inc. [email protected] (703) 749-7749 ext. 218 developing a...
TRANSCRIPT
Alfred AdamsAlfred AdamsAvanco International, Inc.Avanco International, Inc.
[email protected] (703) 749-7749 ext. 218
Developing a Corporate Business Intelligence Portal
Business IntelligenceBusiness Intelligence Agenda Agenda
• What is Data Warehousing? • What is Business Intelligence?• What are Enterprise Information Portals?• The Oracle 9iAS BI Architecture• BI Overview• A BI Portal Methodology
– Project Team– Project Definition– Requirements Definition– Design Prototype– User Interface
• Q&A
Avanco Corporate Oracle Expertise
• ORACLE Customer Advisory Program (BI and Oracle Portal)• ORACLE Certified Developers
• Oracle 9iAS Portal, Discoverer, Developer, JDeveloper• Known Oracle authors (Oracle Press)
• Steve Vandivier ‘Oracle 9iAS Portal Handbook’ • Anissa Stevens ‘Oracle Security Handbook’
• Oracle Data Warehousing expertise
• Oracle 9iAS expertise
IT Doesn’t MatterIT Doesn’t MatterHarvard Business Review, Harvard Business Review, May May
20032003
““……Information Technology has become a commodity. Affordable and accessible to everyone, it no longer offers strategic value to anyone. Scarcity – not ubiquity – makes a business resource truly strategic. Companies gain an edge by having or doing something others can’t have or do.”
Data Rich - Information PoorData Rich - Information Poor
Users who could take data and turn it into competitive advantage can’t get the level of access they need.”
Forrester Research
““The typical Fortune 1000 company has a big problem: it collects a lot of important business data that never gets used.
Ad Hoc Operational Data Ad Hoc Operational Data AnalysisAnalysis
• Jeopardizes operational processingJeopardizes operational processing
• Data is a moving targetData is a moving target
• Information fluctuatesInformation fluctuates
• Data accuracy diminishes over timeData accuracy diminishes over time
• Inefficient database structure for queryInefficient database structure for query
• Result - Users don’t trust the dataResult - Users don’t trust the data
BI and Data WarehousingBI and Data Warehousing
• Data Warehousing is the process of assembling Data Warehousing is the process of assembling enterprise information into a report only format enterprise information into a report only format that mirrors your business processesthat mirrors your business processes
• Business Intelligence is the User Interface and Business Intelligence is the User Interface and set of reporting tools that are assembled and set of reporting tools that are assembled and constructed to offer strategic reportingconstructed to offer strategic reporting
• In combination they offer significant In combination they offer significant Return on Investment (ROI)Return on Investment (ROI)
Data Warehouse - DefinedData Warehouse - Defined
A Data Warehouse is that portion of an overall A Data Warehouse is that portion of an overall Architected Data Environment that serves as Architected Data Environment that serves as the single integrated source of data for the single integrated source of data for Informational Processing, and is:Informational Processing, and is:
Subject OrientedSubject Oriented
IntegratedIntegrated
Time VariantTime Variant
Non-VolatileNon-Volatile
Why a Data Warehouse?Why a Data Warehouse?
• Integrates enterprise business processesIntegrates enterprise business processes
• Organized and queried by subject areasOrganized and queried by subject areas
• concerned strictly with historical dataconcerned strictly with historical data
• data updated regularly – Right time not Real Timedata updated regularly – Right time not Real Time
• loaded data rarely changesloaded data rarely changes
• structured to meet information requirements of the structured to meet information requirements of the enterpriseenterprise
• Result - Users trust their informationResult - Users trust their information
Data Warehousing ConceptsData Warehousing Concepts
Data Data WarehouseWarehouse Data MartsData Marts
Sales
Marketing
Finance
OperationalSystems
SalesAccounting
FinanceHuman
Resources
External DataExternal Data
SpreadsheetsSpreadsheets
Corporate Performance ManagementCorporate Performance Management
• What happened?
• Why did it happen?
• What will happen in the future?
• What if we...?
What business managers want to know...
Oracle Business Intelligence Oracle Business Intelligence SolutionsSolutions
QueryQueryDrillDrill
Down,Down,PivotPivot
Modeling,Modeling,TimeTime
Series,Series,FinancialFinancial
What IfWhat If
CalculationsCalculationsDerivedDerived
DataData
Reports
StandardReports
Discoverer ExpressExpress
Oracle BI Client Products
BI Increasing Complexity
Oracle Business Intelligence Systems
What are Enterprise Portals?What are Enterprise Portals?
“Web Applications that provide a single point of entry for
corporations to identify and unlock structured and
unstructured information from many sources, both inside and
outside the organization, and to tap into the corporate knowledge
base in order to make better more informed decisions”
Enterprise PortalsEnterprise Portals What Problems do They Solve? What Problems do They Solve?
• Serve as a Corporate Dashboard
• Integrates Information Access under One Roof
• Organizes Information including unstructured content
• Provides Role-based Information Access
• Cross Referencing of Data Items with Like Items
• Collaborative Departmental Level Development
• Unifies disparate IT processes
Oracle Portal Provides Unified Access to Oracle Portal Provides Unified Access to Structured and Unstructured Structured and Unstructured
InformationInformation
SalesSalesPortalPortal
HR HR PortalPortal
ERPERP DataDataWarehouseWarehouse
InternetInternet
Unstructured DataUnstructured Data
Network and Operating SystemNetwork and Operating System
Oracle Portal and Oracle 9iOracle Portal and Oracle 9i
Role Based User InterfaceRole Based User Interface
Business Business IntelligenIntelligen
cecePortalPortal
ERPERPPortalPortal
Oracle 9Oracle 9iiAS architectureAS architecture
PortletContent
Oracle9iAS Portal Middle Tier
PageRequest
PageResponse
Web Web ProviderProvider
Portal Portal RepositoryRepository
Database Database ProviderProvider
Oracle9iAS Portal Database
Tier
PageMetadata
Browser Client
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_
oc4
jm
od
_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
PortletContent
CachedMetadata& Content
Portal Portal CacheCache
Oracle9Oracle9iiAS Portal Page GenerationAS Portal Page Generation
Portal Middle TierPortal Middle Tier
• Oracle9Oracle9iiAS installation acts as AS installation acts as the Portal middle tierthe Portal middle tier
• Portal directly leverages the Portal directly leverages the following Oracle9following Oracle9iiAS services:AS services:
– Oracle HTTP ServerOracle HTTP Server
– mod_plsqlmod_plsql
– mod_oc4jmod_oc4j
– Web CacheWeb Cache
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCache
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCachePortal Portal CacheCache
mod_plsqlmod_plsql
• Translates URL requests Translates URL requests into stored procedure callsinto stored procedure calls
• Gateway into Portal Gateway into Portal DatabaseDatabase–Access to Portal Repository, Access to Portal Repository,
Portal UI and Database Portal UI and Database ProvidersProviders
• Provides connection Provides connection pooling for efficient pooling for efficient session managementsession management
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCache
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCachePortal Portal CacheCache
mod_oc4jmod_oc4j
• Apache plug-in Apache plug-in
• Routes Servlet requests to Routes Servlet requests to Oracle9Oracle9iiAS Containers for AS Containers for J2EE (OC4J) Servlet engineJ2EE (OC4J) Servlet engine
• PerformancePerformance
• Supports latest J2EE Supports latest J2EE specificationsspecifications
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCache
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCachePortal Portal CacheCache
Oracle9Oracle9iiAS Web CacheAS Web Cache
• Memory-based cacheMemory-based cache
• Combines caching, Combines caching, compression, and assembly to compression, and assembly to accelerate both static and accelerate both static and dynamic contentdynamic content
• Also provides load-Also provides load-balancing, failover, and surge balancing, failover, and surge protection to improve protection to improve availability, reliabilityavailability, reliability
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCache
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
Ora
cle
HT
TP
Ser
ver
Ora
cle
HT
TP
Ser
ver
mo
d_o
c4j
mo
d_o
c4j
Par
alle
l P
aral
lel
Pag
eP
age
En
gin
eE
ng
ine
mo
d_p
lsq
lm
od
_pls
ql
mo
d_p
lsq
lm
od
_pls
ql
Portal Portal CacheCachePortal Portal CacheCache
Portal Development ApproachPortal Development Approach
• Secure Management SponsorSecure Management Sponsor• Scope the ProjectScope the Project
– Use client and Use client and departmental departmental questionnaires to define questionnaires to define goalsgoals
• Identify the Project TeamIdentify the Project Team• Identify Content ContributorsIdentify Content Contributors• Use user identified requirements Use user identified requirements
to define the Portal structureto define the Portal structure• Identify structured and Identify structured and
unstructured contentunstructured content
• Iteratively refine assumptions Iteratively refine assumptions through verification and through verification and validation with usersvalidation with users
• Perform Enterprise metadata Perform Enterprise metadata analysisanalysis
• Identify content and system Identify content and system standards (Branding)standards (Branding)
• Organization and NavigationOrganization and Navigation
• Ensure ongoing content Ensure ongoing content maintenancemaintenance
• Measure ROIMeasure ROI
Corporate SponsorCorporate Sponsor•Drives Project goalsDrives Project goals
Portal ArchitectPortal Architect•ManagesManages•FacilitatesFacilitates•Identifies BottlenecksIdentifies Bottlenecks•Establishes StandardsEstablishes Standards
Employee
EmployeeEmploEmploEXsdfe
EXsdfeEXsEXs
AbcdAbcd
Employee
Employee
EmploEmplo
EXsEXs
AbcdAbcd
Employee
Employee
EmploEmplo
Employee
Employee
Portal Development TeamPortal Development Team•Portal AdministratorPortal Administrator
•Application DevelopersApplication Developers
•Database AdministratorsDatabase Administrators
•Graphics DesignersGraphics Designers
Employee
EmployeeEmploEmploEXsdfe
EXsdfeEXsEXs
AbcdAbcd
Employee
Employee
EmploEmplo
EXsEXs
AbcdAbcd
Employee
Employee
EmploEmplo
Employee
Employee
Content ProvidersContent Providers•Content Manager(s)Content Manager(s)
•Content ContributorsContent Contributors
•Graphics DesignersGraphics Designers
•Quality Assurance SpecialistsQuality Assurance Specialists
Suggested BI Portal Project TeamSuggested BI Portal Project Team
What makes a BI/DW project What makes a BI/DW project Successful?Successful?
• Corporate sponsorship chainCorporate sponsorship chain
• Management of expectationsManagement of expectations
• Data qualityData quality
• Design issuesDesign issues
• User InterfaceUser Interface
• Scalability issuesScalability issues
• PerformancePerformance
• AdministrationAdministration
• Process alignmentProcess alignment
Scoping the ProjectScoping the Project
• Define project goals in a Mission StatementDefine project goals in a Mission Statement
• Define objectives of the siteDefine objectives of the site
• Identify short and long term goals with questionnairesIdentify short and long term goals with questionnaires
• Define ROI metricsDefine ROI metrics
• Use draft objectives to hone in on site requirementsUse draft objectives to hone in on site requirements
• Use a User and Data-centric approachUse a User and Data-centric approach
• Manage user expectations for the siteManage user expectations for the site
• h• h
4. Define hardware, software,4. Define hardware, software,And security requirementsAnd security requirements
1.1. Define Business Processes Define Business Processes and rolesand roles
2. Perform Enterprise 2. Perform Enterprise Information AssessmentInformation Assessment
3. Define Look, Feel and 3. Define Look, Feel and Branding conceptsBranding concepts
Requirements Definition ProcessRequirements Definition Process
Requirements Definition ProcessRequirements Definition Process
• Define roles and privileges by user typeDefine roles and privileges by user type
• Define user functions and business processesDefine user functions and business processes
• Perform enterprise information assessment (data architecture)Perform enterprise information assessment (data architecture)
• Define unstructured document and content standardsDefine unstructured document and content standards
• Define structured data and determine data qualityDefine structured data and determine data quality
• Organize information (categories and perspectives)Organize information (categories and perspectives)
• Define look, feel, and branding conceptsDefine look, feel, and branding concepts
• Define hardware capacityDefine hardware capacity
• Define software needsDefine software needs
• Define security requirements (SSL, firewall, user access)Define security requirements (SSL, firewall, user access)
Content Planning Form and Content Planning Form and Content Inventory FormContent Inventory Form
Define Corporate Data Define Corporate Data ArchitectureArchitecture
BI Portal DesignBI Portal Design
• Define site look and feelDefine site look and feel• Applications and contentApplications and content• Site organizationSite organization• Navigation methodsNavigation methods• Dimensional database design and sourcingDimensional database design and sourcing• Architecture and security designArchitecture and security design• LabelingLabeling• ThemesThemes• User InterfaceUser Interface• Develop prototypes iterativelyDevelop prototypes iteratively
Develop Dimensional Model Develop Dimensional Model from Enterprise Modelfrom Enterprise Model
Discoverer ComponentsDiscoverer Components
Discoverer Discoverer PlusPlus
Discoverer Discoverer ViewerViewer OracleOracle
NetNet
End User Layer
Discoverer Discoverer PortletsPortlets
HTTPHTTP
ReportsReports
ExportExport
Warehouse Builder
Discoverer Administrator
ExcelExcel
OEMOEM
Discoverer End User LayerDiscoverer End User Layer
User Sees DatabaseEnd User Layer
Client address
Total Revenue Forecast
cl_addr1||','||cl_addr2|','||cl_addr3||', '||cl_twn||', '||cl_zipcode
sum(nvl(fcast_qty*unit_price,0))
Hides the Complexity of the Underlying Database
Ease of Use
It’s All in the MetadataIt’s All in the Metadata
• EUL simplifies user access to databaseEUL simplifies user access to database
• Controls query environmentControls query environment
• Controls summary table aggregate awareness Controls summary table aggregate awareness
• Provides consistent view of dataProvides consistent view of data
• User access controlUser access control
• Object relationships grouped by business areaObject relationships grouped by business area
• Metadata shared with OWB/Designer Metadata shared with OWB/Designer repositoriesrepositories
Oracle Discoverer Design IssuesOracle Discoverer Design Issues
• Set up and group Business Areas by business functionSet up and group Business Areas by business function
• Refine relational structure - joins, calculated items, Refine relational structure - joins, calculated items, conditionsconditions
• Edit/format properties using item properties work sheetEdit/format properties using item properties work sheet
• Create date and Item hierarchiesCreate date and Item hierarchies
• Create Item ClassesCreate Item Classes
• Create date and item drillsCreate date and item drills
• Create Summary tablesCreate Summary tables
• Create complex folders lastCreate complex folders last
• Develop Discoverer Viewer workbooksDevelop Discoverer Viewer workbooks
• Develop multiple report looks/ multiple tabsDevelop multiple report looks/ multiple tabs
Oracle Portal and DiscovererOracle Portal and Discoverer
• Worksheet PortletWorksheet Portlet– CustomizableCustomizable
– Data and/or graphData and/or graph
– Scheduled and cachedScheduled and cached
– Calls ViewerCalls Viewer
• List of Workbooks List of Workbooks – CustomizableCustomizable
– ScheduledScheduled
Adding Discoverer PortletsAdding Discoverer Portlets
• Ensure Discoverer Services are runningEnsure Discoverer Services are running• Ensure OC4J_BI_Forms are runningEnsure OC4J_BI_Forms are running• Click on Discoverer link within OEMClick on Discoverer link within OEM
– Enable graphs in Discoverer Viewer / PortletEnable graphs in Discoverer Viewer / Portlet– Create a public connection using Create ConnectionCreate a public connection using Create Connection
• Create workbooks with multiple work sheetsCreate workbooks with multiple work sheets– Keep Portlet charts and reports simpleKeep Portlet charts and reports simple
• Register Discoverer within the Portal Repository using Register Discoverer within the Portal Repository using ‘Register a Portlet Provider’ on Portal Build tab‘Register a Portlet Provider’ on Portal Build tab
• Check to ensure Discoverer Portlet is running by checking Check to ensure Discoverer Portlet is running by checking http://<hostname.domain:7779>/discoverer/portletproviderhttp://<hostname.domain:7779>/discoverer/portletprovider
• Add Discoverer Portlet to a Portal PageAdd Discoverer Portlet to a Portal Page
Integrating Discoverer within PortalIntegrating Discoverer within Portal
• Edit your Portal Page GroupEdit your Portal Page Group
• Click on Add Portlets icon on Click on Add Portlets icon on the region you want to work the region you want to work withwith
• Within the Portlet Repository Within the Portlet Repository find the Discoverer Portlet find the Discoverer Portlet Repository and choose Repository and choose WorksheetWorksheet
• Click OK after Worksheet is Click OK after Worksheet is displayed as showndisplayed as shown
Adding a Discoverer PortletAdding a Discoverer Portlet
• You will see an error that says You will see an error that says “Error This Portlet has not “Error This Portlet has not been defined. The publisher been defined. The publisher must define the portlet by must define the portlet by clicking on Edit Defaults….”clicking on Edit Defaults….”
• Under Editing Views at the Under Editing Views at the top of the edited page, Click top of the edited page, Click Layout Layout
• Choose Edit Defaults next to Choose Edit Defaults next to the worksheet portletthe worksheet portlet
Discoverer Portlet WizardDiscoverer Portlet Wizard
• Choose the Publishers Choose the Publishers Connection for the workbook Connection for the workbook you wish to displayyou wish to display
• Click Next and choose the Click Next and choose the workbook for display from the workbook for display from the workbooks availableworkbooks available
– If the workbook is not listed If the workbook is not listed invoke Discoverer Plus and give invoke Discoverer Plus and give privileges to the publisherprivileges to the publisher
• Select a Worksheet for display Select a Worksheet for display if there are multiplesif there are multiples
Portlet Settings WizardPortlet Settings Wizard
• In the Portlet Settings In the Portlet Settings wizard, provide a Portlet wizard, provide a Portlet Title and choose the content Title and choose the content typetype
– Both crosstab/table and graphBoth crosstab/table and graph
– Crosstab/table onlyCrosstab/table only
– Graph only Graph only
• Note: It is normally better to Note: It is normally better to display just the report or the display just the report or the GraphGraph
• Set Refresh Options as Set Refresh Options as appropriate for data volatilityappropriate for data volatility
Integrated Discoverer PortletIntegrated Discoverer Portlet
Design Working PrototypeDesign Working Prototype
• Define ROI for the projectDefine ROI for the project
• Organize Portal for end usersOrganize Portal for end users
• Group content according to Business ProcessGroup content according to Business Process
• Populate dimensional modelPopulate dimensional model
• Organize information within the PortalOrganize information within the Portal
• Develop site navigation controlsDevelop site navigation controls
• Brand the Portal site consistentlyBrand the Portal site consistently
• Utilize application standardsUtilize application standards
• Plan remainder of the projectPlan remainder of the project
• Measure ROI after rolloutMeasure ROI after rollout
User Interface ConsiderationsUser Interface Considerations
• Use appropriate BI toolsUse appropriate BI tools• Use Portal Publish with Approval privilegeUse Portal Publish with Approval privilege• Use reports and charts liberally and drill down/acrossUse reports and charts liberally and drill down/across• Use HTML forms or Java where possible to avoid Oracle Use HTML forms or Java where possible to avoid Oracle
Forms and JinitiatorForms and Jinitiator• Use Alerts where appropriateUse Alerts where appropriate• Ensure role based security is enforcedEnsure role based security is enforced• Integrate Discoverer and Developer on Portal pagesIntegrate Discoverer and Developer on Portal pages• Integrate non-structured informationIntegrate non-structured information
Other Development Tools – Other Development Tools – Portal PDKPortal PDK
• Omni PortletOmni Portlet– component of Oracle9component of Oracle9iiAS Portal that helps page AS Portal that helps page
designers quickly publish data (Tabular, Chart, designers quickly publish data (Tabular, Chart, Form, List, News) from various different data Form, List, News) from various different data sources (CSV, xml, Web Services, JCA, SQL and sources (CSV, xml, Web Services, JCA, SQL and Web Page)Web Page)
• Web ClippingWeb Clipping– allows you to extract specific portion or "clipping" allows you to extract specific portion or "clipping"
(e.g., HTML table) of a Web page content and (e.g., HTML table) of a Web page content and publish it within Portal.publish it within Portal.
• Java applicationsJava applications– Various Java apps including Discussion Forums and Various Java apps including Discussion Forums and
integration appsintegration apps
Author Contact InformationAuthor Contact Information
• Steve VandivierSteve Vandivier– Http://www.Avanco.ComHttp://www.Avanco.Com
– [email protected]@avanco.Com
– Oracle 9ias portal handbookOracle 9ias portal handbook
– Osborne McGraw-hill, Osborne McGraw-hill,
Oracle press: ISBN 0-07-222249-2Oracle press: ISBN 0-07-222249-2