ca project and portfolio management - a data warehouse deep dive
TRANSCRIPT
CA Project & Portfolio Management –A Data Warehouse Deep Dive
Agile Management
Linda Wray
CA Technologies
Services Architect - GD
AMX01E
@CAPPM
#CAWorld
2 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of
warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only
Terms of this Presentation
3 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Abstract
Data Warehousing is used as the foundation of powerful Business Intelligence solutions. This lecture will facilitate the understanding of the CA PPM 14.2 data warehouse structure and features. You will gain an understanding how to leverage the tools provided as supporting documentation to develop powerful reporting outputs.
Linda Wray
CA Technologies
Software Architect –Global Delivery
4 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Agenda
DATA WAREHOUSING KEY CONCEPTS
OVERVIEW OF CA PPM 14.2 REPORTING ARCHITECTURE
CA PPM 14.2 DATA RELATED TOOLS
DATA WAREHOUSE CONFIGURATION
DATA WAREHOUSE CONTENT
CA PPM 14.2 DATA WAREHOUSE TROUBLESHOOTING
1
2
3
4
5
6
6 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehousing Key Concepts
Data Warehouse – subject-oriented, time-variant, collection of data stored to provide efficient reporting
ETL - Extract Transform & Load– Extract – refers pulling data content from a source system
– Transform – relates to the transformation or references made to the data allowing the content to be stored in a simplistic fashion
– Load – the population of the data into the data warehouse tables
Domain – Jaspersoft semantic layer – Semantic layer – the business representation of database content
Common Terminologies
7 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehousing Key Concepts
Source System– database which stores application data
– used as the source for data content by the data warehouse (CA PPM)
Database Link – named pointer to another database for one-way data selection
Stored Procedures – used to encapsulate a set of operations or queries to be executed against the database server
Common Terminologies
8 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehousing Key Concepts
Dimension – reference information tied to measurable events
Measure/Metric – values on which calculations are performed (Aggregations: sum, count, average, etc…)
Fact table- measures are stored and id fields to dimension tables captured for reference
Common Terminologies
9 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehousing Key Concepts
Star schema – one or more fact tables reference dimension tables
Primary Key – uniquely identifies records in a table– Examples: Investment ID, Resource ID, etc…
Foreign Key – field in a table that uniquely identifies records in another table. The primary key of another table.– Example: Investment ID in a fact table
Common Terminologies
11 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Overview of CA PPM ReportingData Architecture
CA PPMDatabase ETL Process
CA PPM Data
Warehouse
Jaspersoft Domains(Semantic Layer)
Reports
Embedded: Pentaho Data Integrator drives
ETL Load
Both Web Based Ad-Hoc Reporting and Full-
Client reports
Business Logic and Labels which allow Ad-Hoc Analysis without technical expertise
12 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Overview of CA PPM ReportingData Architecture
Key Data Warehouse Benefits– Data model easy to query
Use of Star Schema
Table and column naming conventions
– Output is returned faster into reports
Aggregation tables
– Option for a separate data warehouse database server minimizes impact on CA PPM application
Ability to query both DWH and CA PPM with database links
14 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationMandatory Settings
Data Warehouse Database Server– The database server which will house the data warehouse must be
configured per CA PPM documentation
Database Link– The database link to the CA PPM database must be configured to allow
ETL process to load content into the DWH data warehouse
15 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationMandatory Settings
Languages– Multiple languages are supported (English is mandatory)
– Access Configuration
Administration General Settings System Options Data Warehouse Options
16 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationMandatory Settings
Fiscal Calendar– Data Warehouse supports one Fiscal Calendar
– Multiple entities can be extracted into the Data Warehouse, but only one Fiscal Calendar can be selected
17 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationOptional Settings
Dynamic Domain Updates– Domains and data warehouse updated with custom objects
and attributes
18 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationOptional Settings
Time Slice Configuration– Ensure time slice configurations are set per documentation
40 time slices should be selected with data warehouse flag selected
– 1 Daily
– 13 each for Weekly
– Monthly
– Fiscal
25 new slices & 15 existing
19 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationMandatory Settings
Data Warehouse Jobs – Table Population– Load Data Warehouse
Responsible for Extracting Transform and Loading data
– Load Data Warehouse Access Rights
Addresses user security privileges in the Data Warehouse
20 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationMandatory Settings
Data Warehouse Jobs – Auto Synchronization Scheduling– Recommended execution nightly/daily
– Request for increased frequency
Based on ETL execution duration
Necessary business processes
21 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ConfigurationMandatory Settings
Data Warehouse Jobs – User Access– ‘Create and Update Jaspersoft Users’ job
Updates and creates access rights to ‘Advanced Reporting’ for CA PPM users
Data Warehouse content is available through OOTB domains and Ad-hoc Views
23 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ContentCategorized Subject Areas
Selected Prefix Standards– DWH_CFG – configuration tables
– DWH_CMN – neutral database objects used across multiple subject areas
– DWH_LKP – lookup database object
– DWH_META – meta data tables used to capture data warehouse structure
– DWH_ODF – customer specific database objects
24 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ContentCategorized Subject Areas
Available data content within data warehouse
Change Request Management Resources Summary Investment EV Data
Issue Management All Associated Lookups Investment - Products
WBS Structure Investment - Assets Time Entry
Exchange Rates Resource User Security Current Baseline Data
OBS Hierarchy Customer-Specific Attributes Investment - Projects
WIP Transactions Investment - Ideas Time Entry Notes
Financial Benefit Plans Risk Management PMO Accelerator
Portfolio (High Level) TSV Values Investment - Services
Facts by Weekly/Monthly/Fiscal Investment - Other Work Time Sheets
Financial Budget/Cost Plans Team Allocations DBLINK for Missing Data
Resource Assignments Summary Facts Investment User Security
Summary Facts Financial Budget/Cost Plans Time Sheet Notes
Investment - Applications Resource Assignments New Cost Slices - ETC/Allocations
25 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ContentStar Schema Concepts
Star Schema Example– Fact table is in the center
– Dimension tables surround the fact table
– Primary keys for dimension tables are foreign keys in fact
– ‘ETC…’ refers to additional columns
DWH_INV_TEAM_PERIOD_FACTS
FK1 TEAM_KEY
FK4 iNVESTMENT_KEY
FK2 RESOURCE_KEY
FK3 PERIOD_KEY
ALLOC_HOURS
ETC...
DWH_INV_TEAM
PK TEAM_KEY
ETC...
DWH_RES_RESOURCE
PK RESOURCE_KEY
ETC...
DWH_CMN_PERIOD
PK PERIOD_KEY
ETC...
DWH_INV_INVESTMENT
PK INVESTMENT_KEY
ETC...
26 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ContentCategorized Subject Areas
Selected CA PPM Star Schema Dimension Tables– DWH_RES_RESOURCE
Resource content such as: Resource Name, Email Address, Is Active, Resource Manager, etc…
– DWH_FIN_BENEFIT_PLAN
Financial benefit plan information: Plan Name, Description, Home Currency Code, Billing Currency Code, etc…
– DWH_CMN_PERIOD
Time period values: Period Type Key, Month Key, Month Start Date, Quarter Key, Quarter Start Date, etc…
27 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ContentCategorized Subject Areas
CA PPM Star Schema Fact Tables– DWH_INV_TEAM_PERIOD_FACTS
Data available at specific levels of granularity
Values roll up to time periods reflected in the DWH_CMN_PERIOD table
Detailed information can be drawn by joining the dimension tables
– DWH_INV_TEAM
– DWH_INV_INVESTMENT
– DWH_RES_RESOURCE
– DWH_CMN_PERIOD
28 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ContentCategorized Subject Areas
CA PPM Star Schema Fact Aggregation Tables– DWH_INV_TEAM_SUMMARY_FACTS
Data is summarized without ability to break down time periods
Totals are provided from the ‘%_SUMMARY_FACTS’ tables
Detailed information pulled from the dimension tables
– DWH_INV_TEAM
– DWH_INV_INVESTMENT
– DWH_RES_RESOURCE
29 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Data Warehouse ContentDWH Facts
Available fact data is based on configured data warehouse slices
The default slices can be modified to increase or decrease the available content
Default Measure ValuesMonthly 3 years back & 3 years forwardWeekly 1 year back & 1 year forwardDaily 1 year back & 1 year forwardFiscal 3 years back & 3 years forward
31 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
CA PPM 14.2 Data Warehouse Troubleshooting
Time slice configurations– Time slices with the same granularity require parallel configurations
– Incorrect configuration of slices will impact DWH
General Mishaps
Example Breakdown
Time Slice Granularity Note Sample
MonthlyAll monthly ‘Data warehouse’ time slices need the same date of
the month and same number of periods
MONTHLYRESOURCEALLOCCURVE – 1st of the Month & 13 periods
team::alloccost_curve::dwh_month – 1st of the Month & 13 periods
WeeklyAll weekly ‘Data Warehouse’ time slices need the same day of the work week defined in ‘Administration Project Management
Settings’
WEEKLYRESOURCEACTCURVE - Monday (First Day of Work Week)
baseline::current_team_usage::dwh_week - Monday (First Day of Work Week)
32 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
DWH_META_TABLES
Important Debugging Tables
Found in both PPM transactional database & PPM DWH data warehouse database
Contains meta data which provides details on the dynamic creation of the DWH data warehouse tables
Debugging Tables
CA PPM 14.2 Data Warehouse Troubleshooting
Found in both PPM transactional database & PPM DWH data warehouse database
Contains meta data which provides details on the dynamic creation of the DWH data warehouse columns
Found in PPM DWH data warehouse database
Includes information about the ETL load details
Includes start and end times of the ETL loads
DWH_META_COLUMNS DWH_CFG_AUDIT
33 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
CA PPM 14.2 Data Warehouse Troubleshooting
Unique Index Creation Error– Verify time zones on PPM and DWH servers
Time zones need to be modified if the count to the following query is greater than 0
– SELECT COUNT(1) FROM dwh_cmn_period WHERE dw_updated_date > (SELECT
dw_load_end_date FROM dwh_cfg_audit WHERE table_name =
'DWH_CMN_PERIOD')
Debugging Tables
34 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
CA PPM 14.2 Data Warehouse Troubleshooting
Identify tables with longer load times– Query the DWH_CFG_AUDIT meta data table
Check for table load times greater than 10 minutes
– Sample SQL Syntax:
SELECT table_name, ROUND(24*60*(dw_load_end_date - dw_load_start_date),2) FROM
dwh_cfg_audit WHERE 24*60*60*(dw_load_end_date - dw_load_start_date) > 10
Debugging Tables
35 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
CA PPM 14.2 Data Warehouse Troubleshooting
Unique Index Creation Error– Verify time zones on PPM and DWH servers
Time zones need to be modified if the count to the following query is greater than 0
– SELECT COUNT(1) FROM dwh_cmn_period WHERE dw_updated_date > (SELECT
dw_load_end_date FROM dwh_cfg_audit WHERE table_name =
'DWH_CMN_PERIOD')
Debugging Tables
37 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
CA PPM 14.2 Data Related Tools
Primary tools to assist with 14.2 Data warehouse content– Data Warehouse Database Schema
Packaged webpages focused on data warehouse features, capabilities, structure, object details, and helpful information
– Data Warehouse ERD Diagram
Diagram used to show relationships between tables
– Advanced Reporting Domain Field Descriptions
Provides mapping of Dimensions and measures to Data Warehouse tables
Locate and Access Data
39 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
AMT09SUsing CA Project & Portfolio Management (CA PPM)
to Align Projects with Strategy11/19/2015 at 12:15 pm
AMT10SGuiding Standardization Across the Enterprise at Disney
Parks and Resorts11/19/2015 at 3:00 pm
AMT19SPanel Discussion: Migrating to 14.2; New Advanced
Reporting
11/19/2015 at 4:30 pm
40 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
Must-See Demos
Simplify your Application PortfolioCA PPM
Theater – Agile Management
Identify the Right InvestmentsCA PPM
Theater – Agile Management
Align Resources to Meet DemandCA PPM
Theater – Agile Management
Business Transformation
CA PPM
Theater – Agile Management
41 © 2015 CA. ALL RIGHTS RESERVED.@CAPPM #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15