carve user manual - valency
TRANSCRIPT
Carve User Manual Project Definition Rating Index (PDRI)
& Construction Readiness Assessment (CRA)
(Ver 5.2)
Prepared by: Valency Inc.
Date: April 2021
151 Frobisher Drive, Unit B108
Waterloo, ON, N2V 2C9
Tel: (519) 883-7136
www.valencyinc.com
© Valency Inc. 2021 Carve User Manual (Version 5.2) 2
This page has been intentionally left blank.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 3
Table of Contents Introduction .................................................................................................................................................. 7
Revision History ............................................................................................................................................ 7
Carve Editions ............................................................................................................................................... 9
Navigation ..................................................................................................................................................... 9
Project Dashboard .................................................................................................................................... 9
Main menu .............................................................................................................................................. 10
User Profile ............................................................................................................................................. 10
Edition (footer) ........................................................................................................................................ 11
Admin Set-up .............................................................................................................................................. 11
Manage Portfolios ................................................................................................................................... 11
Create Portfolio ................................................................................................................................... 11
Assign users access to portfolio .......................................................................................................... 12
Edit Portfolio ....................................................................................................................................... 12
Delete a Portfolio ................................................................................................................................ 13
Manage Users ......................................................................................................................................... 13
User Roles ........................................................................................................................................... 13
Create User ......................................................................................................................................... 15
Edit User .............................................................................................................................................. 16
Access to Portfolios ............................................................................................................................. 16
Delete User ......................................................................................................................................... 17
Reset Password ................................................................................................................................... 17
Manage Templates ................................................................................................................................. 18
Overview ............................................................................................................................................. 18
Supported Templates .......................................................................................................................... 19
Migrating Templates to Newer Version .............................................................................................. 19
Activate/Inactivating Templates ......................................................................................................... 19
Rename Template ............................................................................................................................... 21
Print/Share Element Descriptions (Facilitation Package) as PDF ........................................................ 22
Export Assessment Data by Template ................................................................................................ 22
PDRI Templates ................................................................................................................................... 23
Construction Readiness Templates ..................................................................................................... 28
Manage Project Status (Lifecycle Stages) ............................................................................................... 34
© Valency Inc. 2021 Carve User Manual (Version 5.2) 4
Manage PDRI Score Range ...................................................................................................................... 35
Modifying PDRI Score Ranges and Associated Colours ....................................................................... 36
Default Colours and Ranges for PDRI Dashboard ............................................................................... 37
Manage CRA Score Range ....................................................................................................................... 39
Modifying Construction Readiness (CRA) Score Ranges and Associated Colours .............................. 40
Default Colours and Ranges for Construction Readiness ................................................................... 41
Project Management .................................................................................................................................. 42
Manage Projects ..................................................................................................................................... 42
Create a Project................................................................................................................................... 42
Searching for Projects ......................................................................................................................... 44
Viewing Project Details ....................................................................................................................... 46
Edit a Project ....................................................................................................................................... 46
Delete a Project ................................................................................................................................... 48
Viewing Assessments .......................................................................................................................... 49
Managing Action Items ........................................................................................................................... 59
Viewing Action Items .......................................................................................................................... 59
Creating Action Items .......................................................................................................................... 59
Edit an Action Item.............................................................................................................................. 62
Deleting Action Items .......................................................................................................................... 63
Reordering Action Items ..................................................................................................................... 63
Tracking the Status of Action Items .................................................................................................... 64
Exporting Action Items ........................................................................................................................ 65
Copying Action Items from Previous Assessment ............................................................................... 65
Facilitation – PDRI ....................................................................................................................................... 66
Preparing for a PDRI Session ................................................................................................................... 66
Locate or Create a Project ................................................................................................................... 66
Create an Assessment ......................................................................................................................... 66
Enter Session Details ........................................................................................................................... 67
Enter Attendees .................................................................................................................................. 68
Exclude Elements in the PDRI Assessment ......................................................................................... 69
Facilitating a PDRI Session ...................................................................................................................... 70
Conducting the Assessment Workshop .............................................................................................. 70
Section View ........................................................................................................................................ 70
© Valency Inc. 2021 Carve User Manual (Version 5.2) 5
Facilitation View .................................................................................................................................. 70
Post PDRI Workshop Review ................................................................................................................... 75
Low Definition Elements ..................................................................................................................... 75
Action Items ........................................................................................................................................ 75
Summary Report ................................................................................................................................. 75
Publish to Portfolio ............................................................................................................................. 76
Facilitation - Construction Readiness .......................................................................................................... 77
Assessment Methodology ....................................................................................................................... 77
Factors ................................................................................................................................................. 77
Categories ........................................................................................................................................... 77
Readiness Score / Readiness Benchmarks .......................................................................................... 78
The Process ......................................................................................................................................... 78
Preparing for a Construction Readiness Session .................................................................................... 78
Locate or Create a Project ................................................................................................................... 78
Create an Assessment ......................................................................................................................... 79
Enter Session Details ........................................................................................................................... 79
Enter Attendees .................................................................................................................................. 80
Facilitating a Construction Readiness Session ........................................................................................ 81
Conducting the Assessment Workshop .............................................................................................. 81
Assessment View ................................................................................................................................ 81
Category View ..................................................................................................................................... 82
Facilitation View .................................................................................................................................. 82
Post Construction Readiness Workshop Review .................................................................................... 86
Readiness Chart .................................................................................................................................. 86
Missing Factors ................................................................................................................................... 86
Action Items ........................................................................................................................................ 87
Best Practices ...................................................................................................................................... 87
Summary Report ................................................................................................................................. 87
Carve for Continuous Improvement ........................................................................................................... 88
Portfolio Analysis (PDRI) ......................................................................................................................... 88
Summary ............................................................................................................................................. 89
Project Distribution ............................................................................................................................. 90
Low Definition Elements (Low Scoring) .............................................................................................. 90
© Valency Inc. 2021 Carve User Manual (Version 5.2) 6
Support Functionality .............................................................................................................................. 92
Normalization Calculations ................................................................................................................. 92
How Portfolio Scores are Calculated and Benchmarked .................................................................... 93
Metrics .................................................................................................................................................... 94
Filters / Advanced Search ................................................................................................................... 94
Project Metrics .................................................................................................................................... 95
Add Metric .......................................................................................................................................... 95
© Valency Inc. 2021 Carve User Manual (Version 5.2) 7
Introduction Carve was designed to support facilitators who conduct PDRI and Construction Readiness Assessments
for their organizations. The Project Definition Rating Index (PDRI) is a methodology developed by the
Construction Industry Institute (CII) to assess the level of scope definition of capital projects during the
Front-End Planning process. The Construction Readiness Assessment (CRA) was developed to monitor
project health and prevent premature construction starts. This document will explain how Carve for
PDRI and CRA can be used to simplify facilitation, aggregate, and analyze portfolio data, and provide an
effective communication tool to share results with project stakeholders.
Revision History Version Release Date Revisions
3.2 July 2017
New functionality: - Score ranges and colours - Small industrial template - Using Edit to move project from one portfolio to another
Some other updates to user interface
3.3 Sept 2017
New functionality: - Advanced Search Criteria - Metrics dashboard for Admin users - Other minor fixes to user interface
3.4 March 2018 New functionality: - Exclude mechanism - PDRI for Manufacturing and Life Sciences template
4.2 October 2019 New Functionality: - Introduction of PDRI MATRS template
o Maturity and Accuracy - Element definition level descriptions - Action item export - Enhanced PDRI score graph - Carve for Construction Readiness
o Custom factors o Factor descriptions o Facilitation mode o Import/export of CRAs
4.3 December 2019 New Functionality: - Carve - General
o Administrator user export of assessment data by template
o Project dashboard display of project status - Carve for PDRI
o PDRI Summary Report - sort Low Scoring section by score or element order
- Carve for Construction Readiness o New template - Construction Readiness for Smaller
Projects o Auto-numbering of Factors & Categories
© Valency Inc. 2021 Carve User Manual (Version 5.2) 8
o Update to default Score Range Colours
5.0 March 2020 New Functionality - Carve Administration
o New role: Business User - Manage Templates
o Migration capability (PDRI Industrial templates to PDRI MATRS)
o Active/inactive template indicator - Project Dashboard
o Filter by Assessment Template
5.1 August 2020 Template Updates - Carve for Construction Readiness
o Formal rollout of configuration changes developed by Valency’s Construction Readiness User Group to mature the Construction Readiness templates
• Construction Readiness v2.0
• Construction Readiness – Smaller Projects v2.0
5.2 April 2021 New Functionality: - Carve – General
o Action item tracking - Carve for Construction Readiness
o Enhanced filtering “Unanswered” factors o Configure category-level target score and colour
© Valency Inc. 2021 Carve User Manual (Version 5.2) 9
Carve Editions Depending on Carve edition and user role, the user interface will be slightly different once logged into
Carve. The table below provides a general guideline on user accessibility to Carve features.
Refer to the User Roles section for more detail on the types of user access available.
Carve Feature Carve Edition User Role
Admin Facilitator Stakeholder
Projects Professional + + View only
Facilitator + + View only
Portfolios Professional + + +
Facilitator + - -
Metrics Professional view | edit - -
Facilitator view | edit - -
Admin Professional + - -
Facilitator + - - Table 1 - User access to Carve functionality based on Carve editions and user roles
Navigation Refer to user roles section to see which menu options will be available based on user role.
Project Dashboard The projects dashboard is the default screen displayed when all users log into Carve and lists all the
projects available to the user.
Every page displaying the Home icon will direct the user back to this page when clicked. In the
Project dashboard, every item highlighted in blue can be clicked on to drill down further. Every item
with a dropdown icon gives access to additional functionality.
To view a specific project, a user can simply click on the project name to begin drilling down to
assessment details.
Refer to Searching for Projects section to learn more about sorting and filtering the project view.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 10
Figure 1 – Project dashboard
Main menu Based on user’s role, they will see the following menu items:
• Projects – the main project dashboard
• Portfolios - to compare individual projects against the organization’s portfolio
• Metrics - includes key performance metrics (KPIs) commonly correlated with assessment scores
• Admin – administrators can manage portfolios, users, templates, project status and score ranges
Figure 2 – Main menu
User Profile In the top right corner, users can click the drop-down to view their profile and can change their
password.
Figure 3 – User drop-down
© Valency Inc. 2021 Carve User Manual (Version 5.2) 11
Edition (footer) At the bottom of all Carve screens, the user can view which edition their organization is subscribed to
(Facilitator edition or Professional Edition).
Figure 4 – Footer
Admin Set-up
Manage Portfolios Portfolios are managed by the Admin to group related projects and/or programs, by aggregating the
data it is possible to compare projects, identify potential areas for continuous improvement, and
conduct performance benchmarking. Each portfolio can only be associated with one PDRI template. This
ensures that all projects within the same portfolio are compared with alike projects. In Carve, portfolios
are set as a flat structure to avoid portfolios within portfolios.
Create Portfolio 1. From the Admin tab select Manage Portfolios
2. Click Create Portfolio button (top right-hand corner).
3. Enter the following:
a. portfolio name
b. portfolio manager (optional)
c. template type as shown below
Figure 5 – Create a new portfolio
4. Click Next.
NOTE: all projects within a portfolio must use the same template type (industrial, small industrial,
infrastructure, small infrastructure, manufacturing & life sciences or buildings).
5. If there are projects that have not yet been assigned to a portfolio click and drag the desired project
from the left Projects column to the Portfolio on the right.
6. Click Complete
© Valency Inc. 2021 Carve User Manual (Version 5.2) 12
Figure 6 – Add projects to a portfolio
7. Confirm portfolio creation:
a. Click Manage Portfolios
b. Verify the presence of the new portfolio
Assign users access to portfolio 1. Click in the Portfolio Users textbox and select the Carve users who should have access to this
portfolio. If the name is not listed go to Manage Users and confirm they are set up.
Note: users who are designated “Admin” status already have access to all portfolios by default and
therefore do not show up in the list.
Figure 7 – Add user access to the portfolio
2. To remove a user from a portfolio, click on the x to the left of the user
Edit Portfolio 1. From the Admin tab, select Manage Portfolios
2. Click on the portfolio to be edited
3. Fields available for editing include:
• Portfolio Name
• Portfolio Manager
• Portfolio Users
© Valency Inc. 2021 Carve User Manual (Version 5.2) 13
Delete a Portfolio Portfolios may be deleted if they do not have any projects assigned to them. To remove a project from a
portfolio, see Edit a Project section.
To delete a Portfolio:
1. Click on the Admin tab in the top menu
2. Identify the Portfolio for deletion, click the down arrow on the right and click Delete
3. A prompt will appear asking to confirm deletion, click ok to proceed
Figure 7 – Delete a portfolio
Manage Users Most organizations will see project teams evolve and will need to add or delete users over time. Users
can be created and deleted by Company Admin users at any time.
The Company Admin can create new stakeholders, facilitators, Company Admin or Business Admin.
Company Admins can also change a user’s role in Carve at any time to align with the user’s functional
needs.
User Roles Carve uses a role-based security model. Four user roles are supported in Carve:
• Stakeholder
• Facilitator
• Business Admin
• Company Admin
Each user is assigned a role based on the functional capabilities they require. The table below
summarizes some of the capabilities of each user.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 14
Feature Stakeholder Facilitator Business Admin
Company Admin
Project Dashboard ✓ ✓ ✓ ✓
View Assessment ✓ ✓ ✓ ✓
Print Assessment Report ✓ ✓ ✓ ✓
Portfolio Dashboard ✓ ✓ ✓ ✓
Change Password ✓ ✓ ✓ ✓
Import Project & Assessment ✓ ✓ ✓
Create Project & Assessment ✓ ✓ ✓
Prepare Assessment ✓ ✓ ✓
Share Assessment ✓ ✓ ✓
Change Project’s Portfolio ✓ ✓ ✓
Change Project Name ✓ ✓ ✓
Delete Assessment ✓ ✓ ✓
Delete Project ✓ ✓ ✓
Action Item Management ✓ ✓ ✓
Manage Portfolios ✓ ✓
Manage Users Read only ✓
Manage Templates ✓ ✓
Manage Project Status ✓ ✓
Manage Score Range ✓ ✓ Table 2 – Carve user roles
Stakeholder
Stakeholder is the most basic user role in Carve. These users may be direct members of the project,
executive managers, design or engineering consultants or anyone else who you want to be able to
access your PDRI / CRA results but not facilitate or manage assessment or assessment data. The
stakeholder role allows users to:
• view project and portfolio dashboards,
• view assessments,
• print assessments and reports.
A stakeholder cannot create, edit, prepare, share or delete projects, assessments or portfolios;
essentially this a view-only user role.
Facilitator
Facilitators are typically the power users of Carve. The facilitator or co-facilitator (scribe) will use Carve
to support facilitation of PDRI and CRA assessment with project teams. They will walk through the
assessment elements with the project stakeholders during the PDRI / CRA assessment. Low definition
items, element scores, gaps and action items will be noted in Carve as the session progresses. After the
session, the facilitator will use Carve to finalize the action items and write the executive summary for
the final report.
The facilitator role allows users to:
• create, edit and delete, projects, portfolios and PDRI / CRA assessments,
• import assessment data,
© Valency Inc. 2021 Carve User Manual (Version 5.2) 15
• and prepare and share final reports with the other user roles.
Business Admin
For clients with IT compliance requirements where managing users is a restricted function, we have introduced a role called "Business Admin".
The Business Admin has access to everything that the Company Admin role has "except" user administration. With the new Business Admin role, clients will be able to support the following division of responsibilities:
Administrative Tasks Company Admin Business Admin
Manage Portfolio Yes Yes
Manage Users Yes Read-only
Manage Templates Yes Yes
Manage Project Status Yes Yes
Manage Score Range Yes Yes
Table 3 – Carve Admin users
NOTE: The Company Admin was previously known as the “Admin” role. It has been renamed for clarity.
Company Admin
The Company Admin role has full capabilities in Carve, including the ability to manage the creation,
addition and removal of users.
• the creation of portfolios,
• activating and inactivating PDRI templates for the organization
• configuring of templates and element descriptions to meet specific business requirements
• Admin users are also provided access to the Metrics dashboard which includes key performance
metrics (KPIs) commonly correlated with assessment scores
Create User To create a new user,
1. From the Admin tab click Manage Users.
2. Click on Create User at the upper right.
3. Enter the user’s email address (their unique login for Carve).
4. Enter the first name and last name as it should appear in Carve.
5. Select the user role - Stakeholder, Facilitator Business Admin or Company Admin.
6. Assign portfolios – for Stakeholder and Facilitators, access must be granted to applicable portfolios
© Valency Inc. 2021 Carve User Manual (Version 5.2) 16
Figure 8 – Create new user
7. Click Save.
NOTE: Stakeholder and Facilitator users may not be able to access certain projects or assessments until
they have been assigned portfolio access. Admin users automatically have access to all the portfolios
within the organization, and therefore are not assigned portfolios.
Edit User 1. Click the Admin tab and then click Manage Users
2. Click on the user from the Users list
3. The editable fields can be changed as required
4. Changes are automatically saved
Access to Portfolios Providing portfolio(s) access to a new or existing user can be done in the Admin tab
1. Click the Admin tab and then click Manage Users.
2. Click on the user from the Manager Users list.
3. Click on the Portfolio entry field.
a. To add access: Using the down arrow, select and add each portfolio that this user has permission
to access.
b. To remove access: Click on the “X” to the left of the portfolio to revoke the user’s permission to
access the portfolio.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 17
Figure 9 – Adding or removing portfolio access
Delete User Deletion of an existing user from Carve can be done in the Admin tab (Figure 2.14):
1. Click the Admin tab and then click Manage Users.
2. Click on the user from the Manager Users list.
3. Click the Delete User button and select OK during the confirmation prompt.
Figure 10 – Deleting a user
Reset Password To reset a user’s password,
1. Click on the desired user from the Manager Users list.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 18
2. Click the “Reset Password” button at the bottom of the user page. An email containing the new
password will be sent directly to the user’s email address.
3. Reset Password: the user will need to reset their password themselves by following instructions
provided in the email.
NOTE: The admin can reset a user’s password, but the admin will never see the actual password
value – old or new.
Figure 11 – Reset user password
Manage Templates
Overview Industry validated PDRI templates are available for four industry sectors:
• Industrial projects: these could include power plants, chemical plants, oil & gas production, water
and/or waste treatment, and manufacturing. In 2015 CII released a version of PDRI specifically for
small industrial and plant projects. In 2019 CII released a new version of the full PDRI Industrial
template call PDRI MATRS (PDRI MATRS Industrial V5.0)
• Building projects such as offices, schools, medical facilities, institutional buildings, and research
facilities.
• Infrastructure projects generally involve linear construction with extensive public interface and
environmental impact. Examples could include railways, pipelines, transmission, and distribution.
In 2016 CII released a version of PDRI specifically for small infrastructure projects.
• Manufacturing and Life Sciences projects include a mix of both industrial and building scope.
Industrial facilities in the MLS sector include the manufacturing of pharmaceuticals, automobiles,
high-tech electronics, food, beverages, agriculture products, pulp and paper, and consumer
products.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 19
Supported Templates Carve currently supports the following CII templates:
Template Type Template Name Spreadsheet .xlsm Import Available
Industrial Projects PDRI Industrial V3.8 Industrial PDRI V4.0 PDRI MATRS Industrial V5.0
Yes Yes No
Infrastructure Projects PDRI Infrastructure V1.1 PDRI Infrastructure V4.0
Yes Yes
Building Projects PDRI Building V3.8 PDRI Building V4.0
Yes Yes
Small Industrial Projects PDRI Small Industrial Projects Yes
Small Infrastructure Projects
PDRI Small Infrastructure Projects No
Manufacturing and Life Sciences
PDRI for Manufacturing & Life Sciences
No
Construction Readiness Construction Readiness Construction Readiness – Smaller Projects* Construction Readiness v2.0* Construction Readiness – Smaller Projects v2.0*
No No No No
Table 4– Reset user password
*Configuration changes developed by Valency’s Construction Readiness User Group to mature the
Construction Readiness templates.
Organizations may use these templates, provided they have purchased the CII publication and
tool/template and have subscribed to the required Carve module(s) – PDRI, CRA (Construction
Readiness Assessment)
Migrating Templates to Newer Version Carve provides migration capability for legacy PDRI Industrial (3.8 or 4.0) assessments to PDRI MATRS
Industrial 5.0. The primary reason to migrate older assessments is to include them in portfolio analysis
alongside recent PDRI MATRS assessments. Please contact Valency Support and we will help you plan
your migration, including which projects to migrate. For clarity, the migrate step must be performed by
Valency Support.
Activate/Inactivating Templates Carve provides access to PDRI and CRA templates available from CII. The current and previous version of
each template can be used. However, it is recommended that organizations only activate applicable
templates and inactivate older template versions to minimize confusion and promote greater
consistency during PDRI and CRA sessions.
To activate or inactivate templates:
1. Click on the Admin tab from the top bar (shown in green below).
© Valency Inc. 2021 Carve User Manual (Version 5.2) 20
2. Select the Manage Templates tab to see the list of supported templates on the left.
3. Click on the down arrow on the right side of the template.
4. Click Activate or Inactivate.
Figure 12 – Inactivate a template
NOTE: Having a minimal list of available templates makes it easier for facilitators. Inactivating a template
removes it from the list visible to facilitators preventing possible errors or confusion by selecting the
incorrect template or template version.
Active/inactive template indicator.
Active templates will be identified with a blue dot (left hand side) and inactive templates with a grey dot.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 21
Figure 13 – Active/Inactive Template Indicator
Rename Template To edit Template Names to better fit an organization’s specific nomenclature:
1. Click on the Admin tab on the top bar (shown in green below)
2. Select the Manage Templates tab to see the list of supported templates
3. Identify the Template to edit and click the down-arrow on the right and select edit
Figure 14 – Edit template titles
4. Update the Custom Name and Custom Description field (or reset to revert to default values on the
left)
© Valency Inc. 2021 Carve User Manual (Version 5.2) 22
Figure 15 - Update the Custom Name and Custom Description field
5. Click Save
Reset Template Name to Default
1. Click Edit from the drop-down menu to the right of the selected template
2. Click the Reset button
Print/Share Element Descriptions (Facilitation Package) as PDF Prior to facilitating a PDRI or CRA session, it is valuable for attendees to read the element descriptions
associated with the PDRI / CRA template being used. In Carve, the Admin can create a PDF of the
complete Template which can then be distributed to the attendees.
To download the PDF of the PDRI or CRA Template element descriptions:
1. From the Admin tab click Manage Templates.
2. Identify the desired template and click the down arrow to the right.
3. Select Print to download a PDF copy of the element and element descriptions which can be distributed
as an email attachment or printed.
NOTE: Elements that were excluded in the template will be marked as Not Applicable and their
descriptions will not be shown in the PDF document.
Export Assessment Data by Template Company Admin users can export their assessments in .csv format on a template by template basis from
the Manage Templates tab.
Note: Templates must be enabled before exporting assessment data.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 23
Figure 16: Export Assessments Data
Export Assessments capability for Construction Readiness assessments.
An export (CSV file) for CRA assessment data has been added. This will be used in Valency’s PowerBI
Portfolio Dashboard for Construction Readiness (Beta). Any clients that would like to participate in beta
testing of the PowerBI Portfolio Dashboard should contact [email protected].
PDRI Templates
Edit Section Titles
It is possible to edit individual sections titles, short names or descriptions; however, this is not
recommended as it may cause confusion as the Section Titles are key reference points when comparing
with other organizations or CII published data and reports. If modifications are required:
1. Click on the Admin from the top bar (shown in green below)
2. Select the Manage Templates tab to see the list of supported templates
3. Click the Template containing the section to edit
4. Identify the section to edit and select the edit link on the right
© Valency Inc. 2021 Carve User Manual (Version 5.2) 24
Figure 17 – Edit section titles
5. Update the Custom Name, Custom Short Name, and Custom Description fields (or reset to revert to
default values on the left)
6. Click Save
Reset Section Title to Default
3. Click Edit from the drop-down menu to the right of the selected section
4. Click the Reset button
Edit Subsection Titles
Organizations will often change subsection titles and descriptions to suit internal or industry
terminology. To edit subsections titles and descriptions:
1. Click on the Admin from the top bar (shown in green below)
2. Select the Manage Templates tab to see the list of supported templates
3. Click the Template containing the subsection to edit
4. Click the section containing the subsection to edit
5. Identify the subsection to edit and select the edit button on the right
© Valency Inc. 2021 Carve User Manual (Version 5.2) 25
Figure 18 – Edit subsection titles
6. Update the Custom Name and Custom Description fields
7. Click Save (or reset to revert to default values on the left)
Reset Subsection Title to Default
5. Click Edit from the drop-down menu to the right of the selected subsection
6. Click the Reset button
Edit Element Descriptions (PDRI)
To edit the title and description of an individual element to accommodate an organization’s
nomenclature use the following steps:
1. Click on the Admin from the top bar (shown in green below)
2. Select the Manage Templates tab to see the list of supported templates
3. Click the Template containing the element to edit
4. Click the section containing the element to edit
5. Click the subsection containing the element to edit
6. Identify the element to edit and select the edit button on the right
© Valency Inc. 2021 Carve User Manual (Version 5.2) 26
Figure 19 – Edit element description
7. Update the Custom Name in the box at the top of the screen and/or type a custom description of the
element in the box provided. It should be noted the element will now only contain the text that is
included in the Custom Description box.
Figure 20 – Customize elements
8. Click Save (or reset to revert to default values on the left)
NOTE: A dark pencil indicates that an edit has been made to a specific item. A light grey pencil indicates
that an edit has been made further down the hierarchy and can be viewed by drilling down into the
template, section, subsection and element.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 27
Reset Element Description to Default
1. Click Edit from the drop-down menu to the right of the selected Element
2. Click the Reset button
Edit Definition Level Descriptions (PDRI MATRS Industrial 5.0)
Note: this is only applicable to the CII PDRI MATRS Industrial Template V5.0
To edit the definition level description of an individual element, use the following steps:
1. Follow steps 1 through 5 above for editing element descriptions
2. Click the element for which you would like to change the definition level
3. Select which definition level you would like to edit, clicking on the down-arrow button on the right
and selecting edit
4. Enter the custom description for the definition level
5. Click Save (or reset to revert to the default description)
Reset Definition Level Description to Default
7. Click Edit from the drop-down menu to the right of the selected Definition Level
8. Click the Reset button
Figure 21 - Edit definition level descriptions
Exclude Sections/Elements at Template/Organization Level (PDRI)
By excluding Sections or Elements at the Manage Templates Level, the change will apply to all
assessments created throughout your organization.
If you wish to exclude a category/factor for an individual assessment, please refer to Facilitating a PDRI
Session – Exclude Factors in the PDRI Assessment.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 28
The ability to exclude one or more components (element, category or section) for a template is only
available to organizations that have the “Exclude” feature enabled by Valency. Excluded components at
the template level will have affect all new projects created after the exclusion. Existing projects are not
affected by the template exclusion. However, facilitator users will have the ability to exclude project
elements on an assessment-by-assessment basis. Refer to Section 3.4.1 for more information on
excluding project elements for a specific assessment.
To exclude a component of a template, click on the down-arrow button on the right of the
section/subsection/element then select Exclude (Figure 3.12a). A black Exclude symbol will appear on
the component that is excluded, and grey Exclude symbol will appear on any upper level components
above it.
Figure 22 – Exclude a template component
Figure 23 – Exclude Symbol
To reverse the exclusion, click on the down-arrow button on the right of the excluded component and
select Include.
Construction Readiness Templates
Edit Category Name and Description (Construction Readiness)
Category Name and descriptions may be edited by an Admin user. To edit category name and
description use the following steps:
1. Go to the Admin tab, Manage Templates
2. Select the Construction Readiness Assessment, click on the word Assessment
3. Click drop-down arrow on the right of a category and select Edit
© Valency Inc. 2021 Carve User Manual (Version 5.2) 29
Figure 24 – Edit category descriptions
4. Enter the Custom Name and/or Custom Description
5. Click Save
Reset Category Name/Description to Default
1. Click Edit from the drop-down menu to the right of the selected Category
2. Click the Reset button
Edit Factor Descriptions (Construction Readiness)
Factor Name and descriptions may be edited by an Admin user. To edit factor name and description use
the following steps:
1. Go to the Admin tab, Manage Templates
2. Select the Construction Readiness Assessment, click on the word Assessment
3. Click drop-down arrow on the right of a factor and select Edit
© Valency Inc. 2021 Carve User Manual (Version 5.2) 30
Figure 25 – Edit factor name/descriptions
4. Enter the Custom Name and/or Custom Description
5. Click Save
Reset Factor Name/Description to Default
3. Click Edit from the drop-down menu to the right of the selected Category
4. Click the Reset button
Create Custom Factors (Construction Readiness)
Up to 20 custom factors may be created using the “Company Specific” category. Custom factors are
treated as “fundamental” factors, meaning they are not weighted and do not affect the overall
construction readiness core. However, comments may be captured, and action items assigned to custom
factors.
To access the “Company Specific” category, you must be an Admin user. To add custom factors or to edit
the Company Specific category use the following steps:
1. Go to the Admin tab, select Manage Templates
2. Select Construction Readiness Assessment, select Assessment
3. Select 16. Company Specific (to edit the category name or add a custom category description click the
drop-down arrow on the right-hand side of the category and select edit)
4. Click the drop-down arrow on the right-hand side of a factor and select edit to customize an
element/factor
a. Here you may customize the name and description for the factor
© Valency Inc. 2021 Carve User Manual (Version 5.2) 31
Figure 26 – customize factors
NOTE: Category 16, the “Company Specific” category is excluded from assessments by default. To
enable this category, click the drop-down arrow beside the category and select include. This must be
repeated for any factors the user wishes to include in their assessments.
Factors in the “Company Specific” category will only appear in assessments created after the category
and factors are enabled. Existing assessments and projects will not be affected by enabling this category.
Figure 27 – company specific category
Exclude Categories/Factors at Template Level (Construction Readiness)
By excluding Categories or Factors at the Manage Templates Level, the change will apply to all
assessments created throughout your organization.
To exclude a component of a template, click on the down-arrow button on the right of the
category/factor then select Exclude.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 32
Figure 28 – Exclude a factor on Construction Readiness template
Auto Re-numbering Feature
To simplify the construction readiness facilitation process, when a category or factor is excluded from
the template, the remaining categories and factors are automatically renumbered. Project stakeholders
will not be distracted by excluded content. This has been reflected in the:
• Construction Readiness template report (facilitation package)
• Conducting of assessments
• Construction Readiness Summary report
In the example below, the “Health/Safety/Security” category has been excluded, resulting in a re-
numbering of subsequent categories. Similarly, the second factor under 4. Execution has been excluded,
resulting in a re-numbering of the remaining factors in this category.
Figure 29 - Auto re-numbering of categories in Manage Templates
© Valency Inc. 2021 Carve User Manual (Version 5.2) 33
Category Weighting Summary
Admin users can download a Category Weighting Summary from the Manage Templates tab. The
Category Weighting Summary is a PDF report detailing the weighting impact of a company’s
customizations to the CRA templates. By comparing the company’s customized template against the
master template, the following data is highlighted:
• Categories excluded
• Number of remaining factors in a category
• Raw category weight
• Normalized category weight
• Change in weighting (master vs. customized category normalized weighting)
A view of the Category Weighting Summary is shown below.
Figure 30 - Category Weighting Summary – Construction Readiness template
Print the Category Weighting Summary
1. From the Admin Tab, click Manage Templates
2. To the right of the selected Construction Readiness template, select Print Weights Report
3. The PDF will download
© Valency Inc. 2021 Carve User Manual (Version 5.2) 34
Figure 31 – Print Category Weighting Summary for Construction Readiness Template
Manage Project Status (Lifecycle Stages) The Project Status is used to describe the current stage within the lifecycle of a project. In Carve, the
user is asked to identify the Project Status when creating an assessment (Session Details tab). The
assigned Project Status appears in Carve when reviewing the Project Assessment Summary and again as
part of the PDF Report.
The nomenclature used in Carve is based on CII practices. It is common in many organizations to use
slightly different terminology to reflect the project stages. To modify the wording of any of the nine
project phases to better suit your organisation:
1. From the Admin tab click Manage Project Status.
2. On the left-hand side, there is a list of all nine available project phases. To modify the wording click
on any one of the nine options listed.
3. Two new lines appear to the right (see figure below); on the top is the Default, on the bottom is the
Custom Name. Beside “Custom Name” type a description. Click SAVE.
4. The Custom Name will now appear on all projects, both existing and those generated in the future,
when that option is used.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 35
Figure 32 – Customize project status name
Manage PDRI Score Range The use of pictorial representations in Carve is intended to provide the user a quick indication of PDRI
results and how the current project compares with either industry standards or internal benchmarks.
The scores are represented with a coloured bar graph on the Project Dashboard (shown below). This
same representation follows through to the Assessment Summary, the Reports and the Portfolio
dashboard.
The project score, represented by the largest block in the centre, is compared to both the Industry
Standard, as defined by CII (the grey bar above the project score) and the portfolio average (a blue bar
shown below project score).
© Valency Inc. 2021 Carve User Manual (Version 5.2) 36
Figure 33 – Score ranges and colours
Administrators can modify the recommended ranges for any active PDRI Template and change the
colour of the ranges. This allows organizations to fully align score ranges to their internal standards and
procedures.
Modifying PDRI Score Ranges and Associated Colours It is possible to modify the colour representing the project score, the numerical range for that colour,
and the number of intervals included for each Stage Gate. The default in Carve compares the project
score to the CII Industry Standard for that particular stage gate.
By default, the project is coded green if the score is less than the high range of the Industry Standard for
that stage gate. The industry standard is defined by CII.
• The project is coded green if the score is within or less than the CII recommended range.
• The project is coded red if the score is greater than this value.
To modify the numerical ranges attributed to specific colours:
1. From the Admin Tab click on “Manage PDRI Score Range”
2. First choose the Template for which the colour and ranges will be modified. Select the Template from
the drop-down menu provided under “Template”.
3. To create a new range entry, click the button “Create range entry”, chose a Project Gate, the desired
score range and colour (as shown below).
4. To modify an existing range, click on the row you wish to modify and the editable row will appear at
the top of the screen (below the template selector).
NOTE: ensure you have ranges that cover all scores between “0” to “1000” inclusive. Changes to the
colours will apply to all projects past and future, for the template you have modified.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 37
Figure 34 – Change score ranges and colours
Default Colours and Ranges for PDRI Dashboard Carve starts with default colours attributed to ranges of scores for PDRI results. The default ranges and
colours are listed in the table below:
© Valency Inc. 2021 Carve User Manual (Version 5.2) 38
Gate Minimum Score Maximum Score Colour
Templates: Industrial, Building, Infrastructure
PDRI-1 0 800 Green
801 1000 Red
PDRI-2 0 600 Green
601 1000 Red
PDRI-2i 0 450 Green
451 1000 Red
PDRI-3 0 250 Green
251 1000 Red
Templates: Small Industrial, Small Infrastructure
PDRI Early 0 800 Green
801 1000 Red
PDRI Final 0 400 Green
401 1000 Red
Table 5 - PDRI default score ranges and associate colours
A screen capture of the Default values for the Industrial, Building and Infrastructure Templates is shown
below.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 39
Figure 35 – PDRI Manage score range colours
Manage CRA Score Range The use of pictorial representations in Carve is intended to provide the user a quick indication of PDRI
results and how the current project compares with either industry standards or internal benchmarks.
The scores are represented with a coloured bar on the Project Dashboard (shown below). This same
representation follows through to the Assessment Categories, Summary, and the Reports.
Figure 36 – Manage Score Range – Construction Readiness Project Dashboard
© Valency Inc. 2021 Carve User Manual (Version 5.2) 40
Modifying Construction Readiness (CRA) Score Ranges and Associated Colours It is possible to modify the default colour representing the project score and the numerical range for
that colour, and the number of intervals included. The default in Carve compares the project score to
the CII Industry Standard.
Admin users can also adjust the category-level target scores for the Construction Readiness Assessment.
They can be higher or lower than the overall scoring guidelines.
To modify the numerical ranges attributed to specific colours:
1. From the Admin Tab click on “Manage CRA Score Range”
2. First choose the Template for which the colour and ranges will be modified. Select the Template from
the drop-down menu provided under “Template”.
3. To create a new range entry, click the button “Create range entry”, chose a Category, the desired
score range and colour (as shown below).
4. To modify an existing range, click on the row you wish to modify and the editable row will appear at
the top of the screen (below the template selector).
Note: ensure you have ranges that cover all scores between “0%” to “100%” inclusive. Changes to the
colours will apply to all projects past and future, for the template you have modified.
Figure 37 – Modifying Construction Readiness category score ranges
© Valency Inc. 2021 Carve User Manual (Version 5.2) 41
The colour range and score indicators will reflect the defined score ranges, however; the changes made
do not affect the calculation of overall readiness (formulas are not changed).
Figure 38 – Category score colours on CRA assessment dashboard
Default Colours and Ranges for Construction Readiness The Construction Readiness Assessment templates have default score range colours to serve as a guide
to users. The default ranges and colours are listed in the table below:
Gate Minimum Score Maximum Score Colour
Templates: Construction Readiness, Construction Readiness – Smaller Projects
CRA 0 0 White
CRA 1 74999 Grey
CRA 75000 84999 Yellow
CRA 85000 100000 Green
Table 6 - CRA default score ranges and associate colours
A screen capture of the Default values for the Construction Readiness Templates is shown below.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 42
Figure 39 - Manage Score Range For CRA
NOTE: The white range (0-0) allows users to identify excluded categories, or categories where all factors
are listed as N/A.
Project Management
Manage Projects
Create a Project Prior to conducting an assessment, a unique project must exist in Carve (unless an assessment is being
imported).
Facilitators and Administrators can create new projects. Projects can be created from the Project
Dashboard by following these steps.
1. From the main Projects dashboard, click on “Create Project”
Figure 40 – Create a new project
2. Enter the project details:
© Valency Inc. 2021 Carve User Manual (Version 5.2) 43
Figure 41 – Create a new project setup window
• Project Name – required.
• Template type – required. Select the desired PDRI template from the drop-down menu. All
templates that are enabled for the organization will be displayed in the list.
If only a Construction Readiness Assessment is being conducted, you can leave the Template
Type at the default “PDRI – Industrial”.
• Portfolio – required. Select the desired portfolio from the drop-down menu. It is important to
choose the correct portfolio as this will be used to calculate internal PDRI and CRA benchmarks.
The following Parameters are all optional. These fields are available to the user to specifically define this
project and could also be used to search, sort and group similar projects for internal comparison of PDRI
and CRA scores. All the following information will appear on the Cover Page of the Assessment
Summary Report.
• Project ID
• Client name
• Client ID
• Project Type
• Project Location
3. Click the Save button
4. A new pop-up will appear to create an assessment
© Valency Inc. 2021 Carve User Manual (Version 5.2) 44
Figure 42 – Create a new assessment window opens once project is created
a. To create the assessment
• Select Assessment Type (PDRI or CRA)
• Select Template
• Select Project Gate
• Select Assessment Date
• Click Create
b. To bypass this step, click Cancel and the project will be created without an assessment
Searching for Projects For organizations with a significant number of projects and assessments, the ability to filter projects
using specific criteria allows organizations to gain important insights and analyze data efficiently. The
advanced criteria feature on the Project Dashboard addresses this requirement. In addition to filtering
projects by portfolio, users can use advanced criteria by clicking on Show Advanced Criteria, and then
click on “Add Condition” button. Available search criteria on the Projects dashboard include:
• Gate (drop-down list assigned based on template assigned to the portfolio, e.g. PDRI 1, 2, 2i, 3)
• Date range (previously displayed beside the portfolio drop-down)
• Project Status (defined by organization, e.g. feasibly, concept, detailed scope)
• Assessment Template
• Assessment Status (Posted, Shared, Created, Imported, Conflict)
• Project Manager
• Facilitator
• Client Name
• Client ID
• Project Name
• Project ID
• Project Type
• Project Location
© Valency Inc. 2021 Carve User Manual (Version 5.2) 45
Figure 43 - Advanced Search Criteria
Figure 44 - Adding a search condition
Users can add as many conditions as required. Each condition is evaluated as an “AND” statement. In
the example below, only projects from the “Building Projects” portfolio with a PDRI 3 assessment AND
client name containing “Waterloo” will be displayed.
Figure 45 – Adding multiple search conditions
The user can hide the advanced criteria fields by clicking on the “Hide Advanced Criteria” field. Once
hidden, a condensed description of the advanced criteria is displayed so the user is clear on the
advanced criteria that have been applied.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 46
Figure 46 – Condensed description of the advanced criteria
Viewing Project Details 1. From the Projects dashboard, locate the project.
• To view and edit existing assessments of the project, click on the project name to drill down to
the assessment list
Figure 47 – Assessment list
Edit a Project 1. From the Projects dashboard, locate the project.
2. To edit the project information, click on the down-arrow on the right
Figure 48 – Down arrow to edit project information
3. The Edit Project window will appear. After editing the project, click Save to save the changes.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 47
Figure 49 – Edit Project information
Edit the Portfolio Assigned to a Project
1. To assign a project to a different portfolio, follow the steps to edit a project.
2. In the Edit Project window, click the drop-down in the “Portfolio” field to select the portfolio.
3. Click Save
© Valency Inc. 2021 Carve User Manual (Version 5.2) 48
Figure 49 – Edit project, portfolio field
Delete a Project A project can be deleted by,
1. Locating the project to be deleted
2. Selecting Delete from the drop-down arrow to the right of the project
Figure 50 – Delete a project
3. A pop-up window will confirm. If there are any assessments associated with the project, they will be
deleted as well.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 49
Figure 51 – Delete project confirmation window
Viewing Assessments 1. To view and edit existing assessments for a project, click on the project name to drill down to the
assessment list
Figure 52 – Assessment list
2. From the list,
• click on the assessment name (PDRI assessments only) to access the Assessment Summary
dashboard
Figure 53 – Assessment Summary Dashboard
• click on Prepare link to edit the assessment information – it will direct user to the Assessment
Dashboard
© Valency Inc. 2021 Carve User Manual (Version 5.2) 50
Figure 54 – Assessment Dashboard
Assessment Metrics (PDRI)
Users can quickly view an assessment result by accessing the Assessment Summary Dashboard. This
dashboard includes the following tabs (tabs differ by assessment template):
• Assessment Summary: provide visual comparison of the project score to the portfolio and industry
average.
Figure 55 – Assessment Summary Dashboard
• Action items
• Attendees
• Low Definition Elements
• Section Summary
• Basis of Project Decision
• Basis of Design
• Execution Approach
NOTE: user cannot edit information on this dashboard. Any changes must be made from the Assessment
dashboard.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 51
Assessment Dashboard
Users can view and edit the assessment data from the Assessment Dashboard. Click on the project name
to drill down to the assessment list. Click Prepare to open the Assessment Dashboard.
Figure 56 – Viewing assessments from project dashboard
Each tab along the top provides access to the various sections of the assessment:
1. Session details
2. Attendees
3. Assessment (CRA)
4. Basis of Project Decision (PDRI)
5. Basis of Design (PDRI)
6. Execution Approach (PDRI)
7. Accuracy (PDRI MATRS Industrial 5.0)
8. Readiness Chart (CRA)
9. Missing Factors (CRA)
10. Low Definition (PDRI)
11. Action Items
12. Best Practices (CRA)
13. Summary
Edit an Assessment
1. To edit an existing assessments, click on the project name to drill down to the assessment list
Figure 57 – Assessment list
2. From the list, click on Prepare link to edit the assessment information.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 52
Figure 58 – Assessment Dashboard
Delete an Assessment
To delete an assessment,
1. Locate the project the assessment is associated with
2. Click on the project name to view the list of assessments
3. Click on the drop-down to the right of the assessment to be deleted
4. Click Delete
Figure 59 – Delete assessment from project dashboard
5. A pop-up window will appear asking to confirm
6. Click Delete
Figure 60 – Confirm window to delete assessment
Print an Assessment from Project Dashboard
1. Identify and click the Project for which a PDRI assessment is being prepared
2. Identify the assessment for which a PDF is to be created
3. Click the down arrow on the right of the assessment and click print
© Valency Inc. 2021 Carve User Manual (Version 5.2) 53
• If the assessment isn’t published, Carve will display a prompt asking if the assessment should be
published to the portfolio. Selecting Ok will publish the assessment and the PDF will download.
Selecting Cancel will not publish the assessment and the PDF will download.
Figure 61 - Print report of an assessment
• Users have the option to sort the Low Scoring section of the report by Score or by Element/Factor
Order (PDRI).
Figure 62 - Scoring order prompt
4. The downloaded file can be opened using a PDF viewer such as Adobe Reader or Internet Browser
NOTE: The PDF will indicate the project name, Client/Organization name, Project Manager, Facilitator
and Assessment Date automatically on the cover page and Project Name and Gate in the footer of each
page.
Print from Assessment Summary tab
Users can also download a PDF report within the assessment clicking the Print button in the Summary
tab.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 54
Figure 63 - Print report from Summary
The new PDF report contains project details (project gate/status, project manager and facilitator name,
assessment date), an executive summary, action items captured during the project assessment, and a
summary of gaps (PDRI) /missing factors (CRA).
Share an Assessment
To share an assessment with team members,
1. Locate the project the assessment is associate with and click on the project name to view the
assessments.
2. Click Share to the right of the assessment
Figure 64 – Share assessment from Project Dashboard
3. Select the user(s)
4. Enter a message
5. Click Share
© Valency Inc. 2021 Carve User Manual (Version 5.2) 55
Figure 65 – Share assessment window
Publish to Portfolio (Post)
Once an assessment is complete, or imported, it can be published to a portfolio. Publishing an
assessment to a portfolio allows for comparison between similar projects and can help generate an
internal baseline.
Note: all projects within a portfolio must use the same PDRI Template.
To publish an assessment to a portfolio:
1. Select Project from the top bar to arrive at the Project Dashboard 2. Identify the project containing the assessment to publish and click on the project name 3. To publish to the portfolio, click on the down arrow on the right opposite the Assessment (i.e. PDRI
1 or Early Review) and select Publish to Portfolio 4. If you wish to change the portfolio to which this project is affiliated, click the down arrow to the
right of the coloured bar graph and choose Edit. A dialogue box will appear and you will be able to choose the appropriate portfolio.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 56
Figure 66 – Publish an assessment to a portfolio
Exclude from Portfolio Analysis
PDRI assessments can be excluded from portfolio analysis by
1. Locating the project, the assessment is associated with and clicking on the project name to view the
assessments
2. Selecting “Exclude from portfolio analysis” from the drop-down menu to the right of the assessment
Figure 67 – Exclude assessment from portfolio analysis
Import Assessment
For organizations that use CII’s PDRI spreadsheet templates to facilitate PDRI and CRA assessments, the
completed spreadsheets may be imported into Carve*. This provides the organization with the ability to:
• Finalize the assessment and use Carve to communicate the results to Stakeholders (optional)
• Include PDRI assessment results in their portfolio analysis
• Carve has been designed to easily import this data seamlessly such that the user can immediately
integrate this data into either new or existing portfolios within Carve.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 57
Accepted formats include the CII spreadsheet format xlsm or assessment files that have been previously
exported from Carve in a .json file.
*Supported CII PDRI templates are listed in the Supported Templates section
NOTE: For CII PDRI templates that have been modified contact [email protected] for support for
a custom import to Carve.
Prior to import, the correct template must be active for the organization to ensure a successful import
of a PDRI assessment. Steps to activate a template can be found in the Activate/Inactivate Templates
section.
Steps to Import an Assessment
1. From the Project Dashboard screen, select Import assessment
Figure 68 – Import an assessment
2. Select the appropriate CII PDRI template using the radio buttons or Import Carve assessment file.
Figure 69 – Select a template and upload a file for importing
3. Click Select File.
4. Navigate to the location of the assessment being imported and select it.
5. Click Next.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 58
6. Select to import the assessment to a) an existing project or b) create a new Project using the
information from the imported assessment.
a. Click Select from available projects and use the dropdown to select which project the assessment
should be imported to.
b. Click Create a new project and the Project Name and Project ID will autofill from the import data
which can be renamed or given a new Project ID.
Figure 70 – Select template and import file
7. Select Complete Button.
8. Verify the Project has been imported to the correct project by reviewing the Project Dashboard to
ensure values have been mapped correctly.
9. To include the imported project in a portfolio, you must publish the imported file to the desired
portfolio.
Export Assessment
An individual assessment can be exported as a .json file.
1. Locate the project that the assessment is associated with and click the project name to view the
assessments.
2. Select Export from the drop-down menu to the right of the assessment
Figure 71 – Export assessment from project dashboard (.json file)
3. The .json file will immediately begin downloading
© Valency Inc. 2021 Carve User Manual (Version 5.2) 59
Managing Action Items Action items are often created during the facilitated PDRI or CRA session and can be added afterward
from within the Action Items tab. The following explains how to reorder the list of action items to best
reflect their respective priority, as well as how to add, modify or delete action items.
Viewing Action Items Action items are viewed from the Action Items tab within the assessment
1. Locate the project the assessment is associated with and click on the project name to view the
assessments
2. Click Prepare to open the assessment
3. Click on the Action Items tab
Figure 72 – Action Items tab in assessment
Creating Action Items Action items can be created from several areas of the assessment
From the Action Items tab
1. Click on Create Action Item (button)
Figure 73 – Create action item from Action Items tab
2. A window will open with the following editable fields
• Description
• Assigned to
• Target date
• Status (open, closed, cancelled)
• Category – what category does the action item pertain to (optional)
• Element (PDRI) / Factor (CRA) – what element or factor does the action item pertain to
(optional)
© Valency Inc. 2021 Carve User Manual (Version 5.2) 60
Figure 74 – Create Action Item window
3. Enter the detail and click ‘Save’
From the Low Definition tab (PDRI)
Figure 75 – Create Action Item from Low Definition tab
From the Missing Factors tab (CRA)
Figure 76 – Create Action item from Missing Factors tab
From the Assessment tabs (Element facilitation view)
1. Click on one of the PDRI sections
• Basis of Project Decision
• Basis of Design
• Execution Approach
• Accuracy (if applicable)
2. Click on the appropriate element to open facilitation view
3. Click on the Action items button
© Valency Inc. 2021 Carve User Manual (Version 5.2) 61
Figure 77 – Create Action Item from PDRI Element Facilitation window
From the Assessment tab (CRA)
Category level
Figure 78 – Create Action Item from CRA Assessment tab
© Valency Inc. 2021 Carve User Manual (Version 5.2) 62
Factor level (facilitation view)
Figure 79 – Create Action Item from CRA Factor Facilitation View
Edit an Action Item 1. Click on Projects at the top of the home menu to arrive at the Projects Dashboard
2. Identify and click the Project for which a PDRI or CRA assessment is being prepared
3. The selected project will expand to reveal an active assessments
4. Identify the assessment to review Action Items and click Prepare
5. Select the Action Items tab
6. Identify the action item requiring modification
7. Click the down arrow to the right of the action item and select edit
Figure 80 – Edit Action Item from Action Items tab
8. Update the necessary fields and click save.
9. Re-order the new action item if required
© Valency Inc. 2021 Carve User Manual (Version 5.2) 63
Deleting Action Items 10. Click on Projects at the top of the home menu to arrive at the Projects Dashboard
11. Identify and click the Project for which a PDRI or CRA assessment is being prepared
12. The selected project will expand to reveal an active assessments
13. Identify the assessment to review Action Items and click Prepare
14. Select the Action Items tab
15. Identify the action item requiring modification
16. Click the down arrow to the right of the action item and select Delete
Figure 81 – Delete Action Item from Action Items tab
Reordering Action Items Reordering the list of Action Items can position high-priority activities at the top which may help
prioritize activities. To reorder action items:
1. Click on Projects at the top of the home menu to arrive at the Projects Dashboard 2. Identify and click the Project for which an assessment is being prepared 3. The selected project will expand to reveal an active assessments 4. Identify the assessment to review Action Items and click Prepare 5. Select the Action Items tab. All action items created for the assessment will be listed 6. The order of action items can be changed by clicking on individual action items and dragging them
up or down.
Figure 82 – Reorder Action Items from Action Item tab
© Valency Inc. 2021 Carve User Manual (Version 5.2) 64
Tracking the Status of Action Items When creating or editing action items, the Status drop-down allows the user to set the status of the
item to:
• Open
• Closed
• Cancelled
Figure 83 – Capture status of Action Item (drop-down)
On the Action Items tab, users can filter action items by Status.
Figure 84 – Filter Action Items by Status on Action Items tab
The .csv export contains the “Status” and “Updated At” data. (See Exporting Action Items)
Figure 85 – Export of Action Items
© Valency Inc. 2021 Carve User Manual (Version 5.2) 65
The summary report will display Open Action Items.
Figure 86 – Summary report display of open action items
Exporting Action Items The list of action items can be exported for use in other project management software tools if required.
The export is a .csv file format.
To export the action items for an assessment,
1. Locate the project the assessment is associated with and click on the project name to view the
assessments
2. Click Prepare to open the assessment
3. Click on the Action Items tab
4. Click Export
Figure 87 – Exporting Action Items from Action Items tab
Note: the data that is visible is what will be exported. If the Status filter is set to Open than only Open
action items will be exported.
Copying Action Items from Previous Assessment Facilitators can now update the status of action items as well as copy action items from a previous
assessment to a new assessment (e.g. from PDRI-2 to a PDRI-3 assessment or from CRA conducted at
60% Design Complete to an assessment conducted at 90% Design Complete).
Note: PDRI action items can only be copied to a succeeding PDRI assessment within the same project,
you cannot transfer action items from a PDRI to a Construction Readiness assessment.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 66
When creating a new assessment, users will see the option to “Copy the action items from the last
PDRI/Construction Readiness assessment for this project”. By default, this will be checked on.
Figure 88 – Copying action items from previous assessment from Create Assessment window
By clicking Create, a new assessment is created with the Action Items tab populated with the previous
assessment’s action items.
From this view, the Project Manager can update the status of action items and reorder action items as
appropriate.
Facilitation – PDRI Carve’s facilitation steps are based on PDRI facilitation best practices from CII. Facilitators can either
• Complete the entire facilitation process using Carve
• Use CII’s PDRI spreadsheet templates to collect assessment data and import into Carve
Preparing for a PDRI Session It is recommended that the facilitator completed the following items prior to starting a facilitated PDRI
session:
1. Create a Project or Locate an Existing Project - make sure the project is ready in Carve.
2. Create a new assessment
3. Complete the Session Details and Attendees tabs on the Assessment dashboard
Locate or Create a Project Instructions for creating and locating a project can be found here:
• Creating a project
• Locating an existing project
Create an Assessment If a new project is being created, the user will be prompted to create the assessment at the same time.
See Creating a project section.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 67
If the project already exists,
1. Locate the project and click the project name
2. Click Create Assessment
Figure 89 – Create assessment from existing project
3. A new pop-up will appear to create an assessment
a. Select Assessment Type (PDRI or CRA)
b. Select Template
c. Select Project Gate
d. Select Assessment Date
Figure 89 – Create assessment set-up window
4. Click Create
Enter Session Details The default tab of the Assessment dashboard is the Session Details. In the Session Details tab, fill out
information for
• Project Gate. The project gate is automatically filled based on user’s selection during creation of
the assessment
• Project Status.
• Assessment Date is automatically filled based on user’s selection during creation of the
assessment.
• Facilitator
© Valency Inc. 2021 Carve User Manual (Version 5.2) 68
• Project Manager
Figure 90 – Session details
Enter Attendees Knowing who was in the PDRI session, and who was unable to attend, can provide insight into why a
project may have achieved a certain score, for example, if a key stakeholder or representative was not
able to attend the session, it may impact the overall score for their areas of expertise. It is best practice
to include in the Attendees list those who were not able to attend with “regrets”.
Add New Attendees
1. From the Attendees tab, click “Create Attendee” to start entering each participant. For each attendee, enter:
• Name (required)
• Organization – often front-end planning teams include team members from several organizations (e.g. owner, design contractor, consultant)
• Role – enter the attendee’s project role (not necessarily their job title at their organization)
• Contact
Figure 91 – Add an attendee
2. Click Save
Edit and Delete Attendees
If there are errors or modifications to an attendee’s information or if any an attendee needs to be
deleted:
Under at Attendees tab of an assessment that is being prepared, identify the attendee to be updated or deleted
• To edit, click the down arrow to the right of the attendee and select edit i. Update the Name, Organization, Role, Contact, and/or Email field and click save
© Valency Inc. 2021 Carve User Manual (Version 5.2) 69
• To delete, click the down arrow to the right of the attendee and select delete i. Select OK to confirm deletion of attendee
Exclude Elements in the PDRI Assessment The ability to exclude project components is only available to organizations that have the Exclude
feature enabled by Valency. In addition to the ability to exclude project components at the template
level, facilitators can exclude elements for a specific assessment.
The facilitator can exclude elements that are known to be not applicable prior to the PDRI session if they
want to streamline the facilitation process with the project team. Any elements that are explicitly
excluded are not presented while in facilitation mode. To exclude an element, click on the grey round
button in the Exclude column on the right of the element as shown in figure 4.7a, and click Ok on the
pop-up window (figure 4.7b). The element will be greyed out and the Exclude symbol will turn blue as
shown for element A.1 in the figure 4.7c.
Figure 92 – Exclude an element in an assessment
Figure 93 – Exclude an element in an assessment
Figure 94 – Exclude an element in an assessment
© Valency Inc. 2021 Carve User Manual (Version 5.2) 70
Facilitating a PDRI Session
Conducting the Assessment Workshop During facilitation of the PDRI there are three tasks that will be completed using Carve:
• Recording of comments during discussion of each element
• Recording of action items identified during discussion of each element or the project as a whole
• Scoring each element from 1-5 or 0 if the element is not applicable
Section View To begin, select either Basis of Project Decision, Basis of Design, or Execution Approach tab, of an assessment that is being prepared. Scoring will work the same way in all three sections. It is recommended to start with Basis of Project Decision followed by Basis of Design and then Execution Approach. Note: PDRI MATRS Industrial has a fourth tab called Accuracy.
Figure 95 – Assessment screen, facilitation tabs
Facilitation View Select the first element in the section by clicking the element’s hyperlinked name. (It is recommended to start with the first element). When clicking on the element name, the facilitation view will open.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 71
Figure 96 – Facilitation view
Capturing Comments
Record key comments captured from the project team’s discussion during the facilitated PDRI session
Figure 97 – Capturing comments
Capturing Action Items
1. Enter applicable action items by clicking the Action Items button
© Valency Inc. 2021 Carve User Manual (Version 5.2) 72
Figure 98 - Capturing Action Items
Filling the following details for each action item before clicking the check mark. a. Description of the Action Item; it is important the action items be clear, concise and articulate
the deliverable required b. Assigned to – Name of specific individual who will take responsibility for completing the action
item. c. Status – to start, this will be in the status Open but as the project progresses, the status can
be updated to Cancelled or Closed (see Managing Action Items) d. Due Date - Expected completion date of action item. Recommended to have a specific date
for completion if possible. e. Click the blue check mark to save the action item f. Select “back” to return to the element or repeat steps to add additional action items for this
element.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 73
Figure 99 – Creating an action item – action item window
Scoring Elements
The definition levels can be seen by hovering over each number
Figure 100 – Scoring element from facilitation view
Upon selection of a score for an element, the element scoring window will advance to the next active
element that in the section (unless it is the last element). Any element marked as excluded is
automatically skipped.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 74
When all elements in the section are complete, or to exit facilitation mode, click on the Done button. Move on to the next section until all three PDRI sections are completed.
If it is a PDRI MATRS Industrial 5.0 session, there is a fourth section called Accuracy that needs to be
completed.
Definition Level Descriptions (PDRI MATRS Industrial 5.0)
In the past, achieving consistency across PDRI facilitators in how PDRI elements were scored was
challenging. To improve consistency in scoring, this template includes definition level descriptions that
clearly state each level’s associated criteria. Within Carve, this has been implemented as a new feature
in the “facilitation mode” for PDRI assessments.
Figure 101 – Facilitation view – opening definition level descriptions on PDRI MATRS template
Another window will open allowing the facilitator to compare definition levels to assist the project team
with arriving at a consensus.
Figure 102 – Definition level descriptions window on PDRI MATRS template
Clicking the x in the top right corner will close the detailed descriptions window.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 75
Post PDRI Workshop Review
Low Definition Elements After completing the PDRI session, it is possible to immediately review the Low Definition elements
(elements which scored highest and thereby potentially posing the greatest risk to the project).
1. Select the Low Definition Tab 2. Under the Level dropdown, select the definition level appropriate for the PDRI Stage.
Figure 103 – Low Definition Elements tab
Note: Count display –shows the number of elements included in the low definition list based on the
filter criteria. Only the filtered elements displayed on this list will be included in the final report.
1. To read more about each element, click on the element hyperlink and a description will be displayed 2. Action Items can be created from this screen by clicking the Create Action Item button in the top right
corner 3. Review the final score with the project team show in the Summary Tab
Figure 104 – Review final score
Action Items Action items are often created during the facilitated PDRI session or can be added afterward from within
the action items tab. See Managing Action Items for details on how to create, edit, delete, track the
status and export Action Items.
Summary Report Preparing the executive summary for a PDRI session is a key task that the facilitator will complete after
the PDRI session. To create the Executive Summary:
1. From within the assessment, click the Summary tab
a. To get to the assessment
i. Click on Projects at the top of the home menu to arrive at the Projects Dashboard
ii. Identify and click the Project for which a PDRI assessment is being prepared
iii. The selected project will expand to reveal an active PDRI assessment
iv. Click Prepare to the right of the selected assessment
© Valency Inc. 2021 Carve User Manual (Version 5.2) 76
2. Select the Summary tab
3. Create or modify the executive summary by entering text in the main body of the page and use the
formatting tool bar as required for text formatting. The tool bar includes rich text word processing
tools providing facilitators the options of bulleted and numbered lists, indents, hyperlinks, and
headings.
Figure 105 – Create an executive summary
4. Click save button when the summary is complete or partially complete to ensure the system keeps a
copy of the entered information
Publish to Portfolio Once an assessment is complete, or imported, it can be published to a portfolio. Publishing an
assessment to a portfolio allows for comparison between similar projects and can help generate an
internal baseline. Note: all projects within a portfolio must use the same PDRI Template.
See Publish to Portfolio (Post) for more details.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 77
Facilitation - Construction Readiness
Assessment Methodology
Factors Each factor is assessed by a short statement to which the team will answer as (Yes), (No), or not
applicable (N/A) for the project. Each Readiness Factor is weighted based on importance and the
weights are used to calculate the overall Construction Readiness score.
Categories The factors are classified into 15 categories by which provides a comprehensive overview of all aspects
of the project before the start of construction. As such, the assessment of construction readiness is a
valuable project team alignment practice.
Categories are auto-numbered to reflect which categories are included by a user in a template. When
excluding a category, the others will remain in their original order, however their assigned number will
be adjusted to reflect exclusions made by the user. Factors belonging to the categories will also be auto-
numbered to reflect the category order. This auto-numbering is consistent across the platform, meaning
category numbers and ordering for the template will remain consistent in the assessment tab (including
facilitation mode), the readiness chart, the missing factors tab, the action items tab, the best practices
tab, and the summary tab (including the summary PDF report). (See section 5.6.3 for more detail)
The Construction Readiness Categories are:
• Project Team
• Engineering
• Planning
• Health/Safety/Security
• Execution
• Tools & Equipment
• Quality Management
• Change Management
• Contract Management
• Human Resource Management
• Stakeholders Management
• Risk Assessment & Management
• Procurement & Material Management
• Commissioning
• Project Control
• Company Specific (customizable)
© Valency Inc. 2021 Carve User Manual (Version 5.2) 78
Readiness Score / Readiness Benchmarks A project’s Construction Readiness Score is a single unified metric that is expressed as a
percentage. It sums up the effect of all readiness factors together. The construction Readiness Score
provides a standardized measure of construction readiness that can be used to track progress of a
project over time, or to monitor and compare readiness of projects in a portfolio of projects. A
Construction Readiness score of
- Less than 75% is a clear indicator of a project that is not ready for construction
- A score of 75 – 85% is considered borderline, and
- A score of greater than 85% represents a construction-Ready project.
The Process The construction readiness assessment is a straight-forward process:
- A well-organized meeting will contribute towards achieving buy-in on this process. Ensuring the
proper stakeholders attend and providing supporting reasons as to why this process will benefit
them specifically is helpful in promoting participation. Ensure the meeting room and all related
logistics are organized well in advance and provide assessment material to participants ahead of
the meeting.
- The next step is to conduct the construction readiness assessment typically with the assistance of
a neutral facilitator and co-facilitator (or scribe). The assessment will provide a construction
readiness score indicating if the project is Ready, borderline, or “Not-Ready” for construction.
Also, the assessment provides the data to clearly identify the categories for improvement that
need more attention to improve overall construction readiness.
- The third step that ultimately drives the improvement in construction readiness is for the team to
focus on the low scoring categories and take action to complete the activities or deliverables
required. Each category is linked to guidelines on CII best practices that can be used by the team
to help drive actions and improvements.
- If the project is not ready for construction, or borderline, after sufficient time to take action, the
team should re-assess construction readiness, focusing on the missing factors. Through this
iterative process, the team will ensure they are construction-ready and avoid a premature start
of construction.
Preparing for a Construction Readiness Session It is recommended that the facilitator completed the following items prior to starting a facilitated PDRI
session:
1. Create a Project or Locate an Existing Project - make sure the project is ready in Carve.
2. Create a new assessment
3. Complete the Session Details and Attendees tabs on the Assessment dashboard
Locate or Create a Project Instructions for creating and locating a project can be found here:
• Creating a project
• Locating an existing project
© Valency Inc. 2021 Carve User Manual (Version 5.2) 79
Create an Assessment If a new project is being created, the user will be prompted to create the assessment at the same time.
See Creating a project section.
If the project already exists,
1. Locate the project and click the project name
2. Click Create Assessment
Figure 106 – Create construction readiness assessment from existing project
3. A new pop-up will appear to create an assessment
a. Select Assessment Type (PDRI or CRA) – select CRA
b. Select Template
c. Select Project Gate
d. Select Assessment Date
Figure 107 – Create assessment window
4. Click Create
Enter Session Details The default tab of the Assessment dashboard is the Session Details. In the Session Details tab, fill out
information for
• Project Gate. The project gate is automatically filled based on user’s selection during
creation of the assessment
• Project Status.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 80
• Assessment Date is automatically filled based on user’s selection during creation of the
assessment.
• Facilitator
• Project Manager
Figure 108 – Enter CRA session details from assessment dashboard
Enter Attendees Knowing who was in the PDRI session, and who was unable to attend, can provide insight into why a
project may have achieved a certain score, for example, if a key stakeholder or representative was not
able to attend the session, it may impact the overall score for their areas of expertise. It is best practice
to include in the Attendees list those who were not able to attend with “regrets”.
Add New Attendees
3. From the Attendees tab, click “Create Attendee” to start entering each participant. For each attendee, enter:
• Name (required)
• Organization – often front-end planning teams include team members from several organizations (e.g. owner, design contractor, consultant)
• Role – enter the attendee’s project role (not necessarily their job title at their organization)
• Contact
Figure 109 – Add an attendee
4. Click Save
© Valency Inc. 2021 Carve User Manual (Version 5.2) 81
Edit and Delete Attendees
If there are errors or modifications to an attendee’s information or if any an attendee needs to be
deleted:
Under at Attendees tab of an assessment that is being prepared, identify the attendee to be updated or deleted
• To edit, click the down arrow to the right of the attendee and select edit i. Update the Name, Organization, Role, Contact, and/or Email field and click save
• To delete, click the down arrow to the right of the attendee and select delete i. Select OK to confirm deletion of attendee
Facilitating a Construction Readiness Session
Conducting the Assessment Workshop During facilitation of the PDRI there are three tasks that will be completed using Carve:
• Recording of comments during discussion of each factor
• Recording of action items identified during discussion of each factor or the project as a whole
• Scoring each factor Yes, No or Not Applicable (NA) if the factor is not applicable
Assessment View The Assessment summary view includes
1. The ability to filter by
• All factors
• Unanswered factors
• No or unanswered factors
2. A gauge that tracks the overall score as the team progresses through the assessment
3. A summary of the categories in a grid view outlining
• The category
• Factors answered within the category
• Target score for the category
• Previous score (if there is more than one assessment for this project)
• Current score
• Status (colour representation of the score based on target score settings)
© Valency Inc. 2021 Carve User Manual (Version 5.2) 82
Figure 110 – CRA Assessment dashboard
Category View When the facilitator clicks on a category, they will see a summary view of all of the factors within that
category including
1. The ability to filter the factors based on
• All factors
• Unanswered
• No or Unanswered
• Not applicable
2. Category score with corresponding colour indicator
3. Ability to create an action item
4. A grid view of
• The factor
• The factor score (Yes, No, NA)
• Comments
• Action items – a clickable link to view corresponding action items
Figure 111 – CRA Category view
Facilitation View By clicking on a factor, the facilitation view will open allowing the team to focus on one factor at a time.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 83
For factors that require more details or clarifications for consistent assessment, company-specific factor
descriptions may be added (see Manage Templates Section). Factor descriptions are displayed when
using the “facilitation mode” for a Construction Readiness Assessment.
Figure 112 – CRA facilitation view
Capturing Comments
Record key comments captured from the project team’s discussion during the facilitated CRA session
Figure 113 – CRA facilitation view, capture comments
© Valency Inc. 2021 Carve User Manual (Version 5.2) 84
Capturing Action Items
2. Enter applicable action items by clicking the Action Items button
Figure 114 – CRA facilitation view, enter action items
Filling the following details for each action item before clicking the check mark. a. Description of the Action Item; it is important the action items be clear, concise and
articulate the deliverable required b. Assigned to – Name of specific individual who will take responsibility for completing the
action item. c. Status – to start, this will be in the status Open but as the project progresses, the status
can be updated to Cancelled or Closed (see Managing Action Items) d. Due Date - Expected completion date of action item. Recommended to have a specific
date for completion if possible. e. Click the blue check mark to save the action item f. Select “back” to return to the element or repeat steps to add additional action items for
this element.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 85
Figure 115 – Creating an action item
Scoring Factors
Upon selection of an answer for a factor, the factor scoring window will advance to the next active
factor that in the category (unless it is the last factor). Any factor that has been excluded is
automatically skipped.
When all factors in the category are complete, or to exit facilitation mode, click on the Done button. Move on to the next category until all three CRA sections are completed.
Figure 116 – Scoring factor from facilitation view
© Valency Inc. 2021 Carve User Manual (Version 5.2) 86
Post Construction Readiness Workshop Review
Readiness Chart The Readiness Chart tab contains a chart depicting the assessment score (showing each category score).
Excluded categories will not be shown. The target score is outlined in green, while the current
assessment is outlined in blue.
Figure 117 – Readiness chart
Missing Factors The missing factors tab shows factors answered ‘No’. Users are able to filter which factors are shown by
using the drop-down menu at the top to select between four options: All Missing Factors, Fundamental
by Category, Readiness by Category, and Readiness by Importance. Users are also able to create Action
Items and add comments for Missing Factors in this tab.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 87
Figure 118 – Missing factors
Action Items Action items are often created during the facilitated PDRI session or can be added afterward from within
the action items tab. See Managing Action Items for details on how to create, edit, delete, track the
status and export Action Items.
Best Practices The Best Practices tab provides users with a list of relevant CII Knowledge Areas and Best Practices for
Low Scoring Categories to help improvement.
Summary Report The Summary Tab contains a section for users to provide an executive summary for this CRA session.
After completing an assessment, users can Print a PDF assessment report from this tab.
Figure 119 – Assessment summary
© Valency Inc. 2021 Carve User Manual (Version 5.2) 88
The Assessment Summary Report contains the following:
- Assessment Details
- Executive Summary
- Overall Readiness Score Graph
- Category Breakdown (including individual category scores and status compared to CII benchmark
targets)
- Missing Factors (broken down by type – fundamental and readiness) and applicable factor
comments
- Open Action Items
- Best Practices (relating to the missing factors of the user’s assessment)
Carve for Continuous Improvement
Portfolio Analysis (PDRI) Stakeholders are able to compare individual projects against the organization’s portfolio. To access the
portfolio, simply click on the portfolio tab at the top of the screen. There are three tabs within the
portfolio for a PDRI template:
• Summary shows the average PDRI scores by stage for the projects within the portfolio.
Stakeholders can drill down into individual projects for more insight.
• Portfolio Distribution shows how individual projects rank against the rest of the portfolio, as well
as the industy benchmarks. This tab allows stakeholder to easily identify project outliers and
quickly drill down to investigate why they are outliers.
• Low Definition Elements allows stakeholders to identify the top 5 or top 10 low definition items
to identify areas for potneital continuous improvement.
Figure 120 - Screenshot of the Portfolio Summary tab
NOTE: Portfolio Dashboard varies by template type.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 89
Summary For organizations with a significant number of PDRIs completed, the ability to analyze PDRI scores by
stage, using a flexible set of criteria is ideal. In addition to analyzing average PDRI scores by portfolio,
more in-depth root cause analysis can be done by evaluating average PDRI scores by:
• Portfolio
• Date range (e.g. before and after a major process change was introduced)
• Project Manager
• Facilitator
• Client Name
• Client ID
• Project Name
• Project ID
• Project Type
• Project Location
Figure 121 – Adding search condition in Summary tab
The format of the Summary page has changed so that the first filter criteria that must be selected is the
PDRI template. Once the PDRI template is selected, average PDRI scores by stage can be calculated for
all, one or multiple selected portfolios that use the same PDRI template.
The Advanced Criteria function follows the same rules as described for the Project Dashboard.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 90
Project Distribution Like the Summary page, the first filter criteria that must be selected is the PDRI template. Once selected,
the project distribution graph may be generated for one or more portfolios, as well as any of these
advanced criteria:
• Portfolio
• Date range (e.g. before and after a major process change was introduced)
• Status
• Project Manager
• Facilitator
• Client Name
• Client ID
• Project Name
• Project ID
• Project Type
• Project Location
Figure 122 – Adding search condition in Project Distribution tab
Low Definition Elements (Low Scoring) Like the Summary page, the first filter criteria that must be selected is the PDRI template. Once selected,
the low definition graph may be generated for one or more portfolios, as well as any of these advanced
criteria:
• Portfolio
• Date range (e.g. before and after a major process change was introduced)
• Section (e.g. one or more of Section I, II and III)
• Category (e.g. one or more categories from the full category list)
• Element (e.g. one or more elements from the full element list)
• Status
© Valency Inc. 2021 Carve User Manual (Version 5.2) 91
• Project Manager
• Facilitator
• Client Name
• Client ID
• Project Name
• Project ID
• Project Type
• Project Location
Figure 123 – Adding search condition in Low Definition Elements tab
An additional enhancement is the “All” option under Count. This can be used to generate:
• Average score of all elements in a template for a given criterion.
• Average score of all elements in a section or category, as shown in the example below for Section I.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 92
Figure 124 - Average score of all elements in a section I
Support Functionality The following sections explain the assumptions behind internal calculations that are done within Carve.
Normalization Calculations The assessment score generated from a PDRI session is used to communicate the level of scope
definition of any project. PDRI’s are scored out of 1000 and each element is given a score weighting.
During the PDRI research process, members of CII’s research team realized different elements within
PDRI represented different degrees of relative risk with respect to overall project success. Thus, it did
not make sense to give all elements equal weightings.
As part of the PDRI research initiative, PDRI elements were given different weightings based on
statistical analysis of data and extensive input from industry owners and contractors.
© Valency Inc. 2021 Carve User Manual (Version 5.2) 93
To compare PDRI projects, as is done in Carve, it is important all projects are scored out of 1000. This
may not be the case in some instances where one, or some elements, are not applicable to a particular
project. If an element is not applicable to a project it is assigned a score of “0” (rather than 1 to 5).
Normalization of total scores become important when you are excluding elements (definition level =
0). When elements are excluded, the maximum score becomes less than 1,000. Small projects present
the most challenge as several elements or entire categories may be excluded. In this case, the
maximum score can be significantly less than 1,000. When this occurs, Carve will normalize the total
score by removing the weighted value of the element from the total. For example, if an element has a
weighting of 32 but is given a definition level = 0, the PDRI total will be measured out of 968 instead of
1,000. Through this method, Carve will provide a normalized score by taking the raw value of the
remaining element scores and dividing by 968.
In instances where all elements are applicable and assigned a definition level between 1 and 5, the
normalized score and the raw score will be the same.
To view a completed assessment’s raw and normalized scores:
1. Click on Projects at the top of the home menu to arrive at the Projects Dashboard 2. Identify and click the Project for which a PDRI assessment score will be reviewed 3. The selected project will expand to reveal the active PDRI assessments 4. Identify the PDRI assessment for which the raw and normalized score will be reviewed and click
prepare on the right 5. Click on the Summary tab 6. In the top right two scores will be displayed. The top number is the normalized score which has
removed element weightings with a score of 0. The second number is the raw score. NOTE: The normalized score will always be greater than or equal to the raw score
How Portfolio Scores are Calculated and Benchmarked Portfolios are created in Carve to group projects for analysis. A portfolio is a grouping of projects using
the same PDRI template, and these can be assessed by PDRI stage (-1, -2, -2i and -3). Portfolios are
assigned by the Admin or Facilitator. A portfolio of projects can be used to compare projects within the
portfolio or compare against CII benchmarks.
To add a project’s assessment score to the portfolio average score it must be assigned to the correct
portfolio and “published” to the portfolio; these functionalities is available to the facilitator or an admin.
To publish a completed assessment to a portfolio
1. Click on Projects from the top menu bar 2. Identify the project containing the assessment to publish and click on the project name 3. Confirm the project is associated with the correct portfolio
a. If not, follow the instructions outline in Section 2.4.2 and 2.4 to learn more about updating the project’s portfolio
4. Identify the project assessment, click on the down arrow on the right and select publish to portfolio
To remove a Published Assessment from a Portfolio
© Valency Inc. 2021 Carve User Manual (Version 5.2) 94
1. Click on Projects from the top bar 2. Identify the project containing the assessment to publish and click on the project name 3. Identify the project assessment, click on the down arrow on the right and select exclude from
portfolio.
Figure 125 – Exclude an assessment from portfolio analysis
Metrics The Metrics tab provides the ability to capture key performance indicators related to overall project
success, such as
• Project Cost
• Schedule Duration
• Project Completion Date
• Change Order Value
• OSHA Recordable Incidents
• Contingency Amount
• Capacity Objectives
• Defects
This allows project teams to correlate their assessments scores with project performance metrics to
support continuous improvement efforts.
Filters / Advanced Search Users can use the advanced search and filter capability to locate the project in question
Figure 126 – Metrics tab, filtering projects
© Valency Inc. 2021 Carve User Manual (Version 5.2) 95
Project Metrics The main window displays a summarized list of projects with key metrics data
Figure 127 – Metrics tab, project list view
Clicking on the project name expands the project view to display any metrics associated with the project
Figure 128 – Metrics tab, viewing project metrics
Add Metric To add a metric,
Locate the project and click on the project name to expand the project details
© Valency Inc. 2021 Carve User Manual (Version 5.2) 96
Click Add Metric
Figure 129 – Add new metric
A new line will appear
1. Select a metric
2. Enter Planned Value
3. Enter Actual Value
4. Click Save
Figure 130 – Creating a metric