carve user manual - valency

96
Carve User Manual Project Definition Rating Index (PDRI) & Construction Readiness Assessment (CRA) (Ver 5.2) Prepared by: Valency Inc. Date: April 2021 151 Frobisher Drive, Unit B108 Waterloo, ON, N2V 2C9 Tel: (519) 883-7136 www.valencyinc.com

Upload: others

Post on 25-Dec-2021

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Carve User Manual - Valency

Carve User Manual Project Definition Rating Index (PDRI)

& Construction Readiness Assessment (CRA)

(Ver 5.2)

Prepared by: Valency Inc.

Date: April 2021

151 Frobisher Drive, Unit B108

Waterloo, ON, N2V 2C9

Tel: (519) 883-7136

www.valencyinc.com

Page 2: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 2

This page has been intentionally left blank.

Page 3: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 3

Table of Contents Introduction .................................................................................................................................................. 7

Revision History ............................................................................................................................................ 7

Carve Editions ............................................................................................................................................... 9

Navigation ..................................................................................................................................................... 9

Project Dashboard .................................................................................................................................... 9

Main menu .............................................................................................................................................. 10

User Profile ............................................................................................................................................. 10

Edition (footer) ........................................................................................................................................ 11

Admin Set-up .............................................................................................................................................. 11

Manage Portfolios ................................................................................................................................... 11

Create Portfolio ................................................................................................................................... 11

Assign users access to portfolio .......................................................................................................... 12

Edit Portfolio ....................................................................................................................................... 12

Delete a Portfolio ................................................................................................................................ 13

Manage Users ......................................................................................................................................... 13

User Roles ........................................................................................................................................... 13

Create User ......................................................................................................................................... 15

Edit User .............................................................................................................................................. 16

Access to Portfolios ............................................................................................................................. 16

Delete User ......................................................................................................................................... 17

Reset Password ................................................................................................................................... 17

Manage Templates ................................................................................................................................. 18

Overview ............................................................................................................................................. 18

Supported Templates .......................................................................................................................... 19

Migrating Templates to Newer Version .............................................................................................. 19

Activate/Inactivating Templates ......................................................................................................... 19

Rename Template ............................................................................................................................... 21

Print/Share Element Descriptions (Facilitation Package) as PDF ........................................................ 22

Export Assessment Data by Template ................................................................................................ 22

PDRI Templates ................................................................................................................................... 23

Construction Readiness Templates ..................................................................................................... 28

Manage Project Status (Lifecycle Stages) ............................................................................................... 34

Page 4: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 4

Manage PDRI Score Range ...................................................................................................................... 35

Modifying PDRI Score Ranges and Associated Colours ....................................................................... 36

Default Colours and Ranges for PDRI Dashboard ............................................................................... 37

Manage CRA Score Range ....................................................................................................................... 39

Modifying Construction Readiness (CRA) Score Ranges and Associated Colours .............................. 40

Default Colours and Ranges for Construction Readiness ................................................................... 41

Project Management .................................................................................................................................. 42

Manage Projects ..................................................................................................................................... 42

Create a Project................................................................................................................................... 42

Searching for Projects ......................................................................................................................... 44

Viewing Project Details ....................................................................................................................... 46

Edit a Project ....................................................................................................................................... 46

Delete a Project ................................................................................................................................... 48

Viewing Assessments .......................................................................................................................... 49

Managing Action Items ........................................................................................................................... 59

Viewing Action Items .......................................................................................................................... 59

Creating Action Items .......................................................................................................................... 59

Edit an Action Item.............................................................................................................................. 62

Deleting Action Items .......................................................................................................................... 63

Reordering Action Items ..................................................................................................................... 63

Tracking the Status of Action Items .................................................................................................... 64

Exporting Action Items ........................................................................................................................ 65

Copying Action Items from Previous Assessment ............................................................................... 65

Facilitation – PDRI ....................................................................................................................................... 66

Preparing for a PDRI Session ................................................................................................................... 66

Locate or Create a Project ................................................................................................................... 66

Create an Assessment ......................................................................................................................... 66

Enter Session Details ........................................................................................................................... 67

Enter Attendees .................................................................................................................................. 68

Exclude Elements in the PDRI Assessment ......................................................................................... 69

Facilitating a PDRI Session ...................................................................................................................... 70

Conducting the Assessment Workshop .............................................................................................. 70

Section View ........................................................................................................................................ 70

Page 5: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 5

Facilitation View .................................................................................................................................. 70

Post PDRI Workshop Review ................................................................................................................... 75

Low Definition Elements ..................................................................................................................... 75

Action Items ........................................................................................................................................ 75

Summary Report ................................................................................................................................. 75

Publish to Portfolio ............................................................................................................................. 76

Facilitation - Construction Readiness .......................................................................................................... 77

Assessment Methodology ....................................................................................................................... 77

Factors ................................................................................................................................................. 77

Categories ........................................................................................................................................... 77

Readiness Score / Readiness Benchmarks .......................................................................................... 78

The Process ......................................................................................................................................... 78

Preparing for a Construction Readiness Session .................................................................................... 78

Locate or Create a Project ................................................................................................................... 78

Create an Assessment ......................................................................................................................... 79

Enter Session Details ........................................................................................................................... 79

Enter Attendees .................................................................................................................................. 80

Facilitating a Construction Readiness Session ........................................................................................ 81

Conducting the Assessment Workshop .............................................................................................. 81

Assessment View ................................................................................................................................ 81

Category View ..................................................................................................................................... 82

Facilitation View .................................................................................................................................. 82

Post Construction Readiness Workshop Review .................................................................................... 86

Readiness Chart .................................................................................................................................. 86

Missing Factors ................................................................................................................................... 86

Action Items ........................................................................................................................................ 87

Best Practices ...................................................................................................................................... 87

Summary Report ................................................................................................................................. 87

Carve for Continuous Improvement ........................................................................................................... 88

Portfolio Analysis (PDRI) ......................................................................................................................... 88

Summary ............................................................................................................................................. 89

Project Distribution ............................................................................................................................. 90

Low Definition Elements (Low Scoring) .............................................................................................. 90

Page 6: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 6

Support Functionality .............................................................................................................................. 92

Normalization Calculations ................................................................................................................. 92

How Portfolio Scores are Calculated and Benchmarked .................................................................... 93

Metrics .................................................................................................................................................... 94

Filters / Advanced Search ................................................................................................................... 94

Project Metrics .................................................................................................................................... 95

Add Metric .......................................................................................................................................... 95

Page 7: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 7

Introduction Carve was designed to support facilitators who conduct PDRI and Construction Readiness Assessments

for their organizations. The Project Definition Rating Index (PDRI) is a methodology developed by the

Construction Industry Institute (CII) to assess the level of scope definition of capital projects during the

Front-End Planning process. The Construction Readiness Assessment (CRA) was developed to monitor

project health and prevent premature construction starts. This document will explain how Carve for

PDRI and CRA can be used to simplify facilitation, aggregate, and analyze portfolio data, and provide an

effective communication tool to share results with project stakeholders.

Revision History Version Release Date Revisions

3.2 July 2017

New functionality: - Score ranges and colours - Small industrial template - Using Edit to move project from one portfolio to another

Some other updates to user interface

3.3 Sept 2017

New functionality: - Advanced Search Criteria - Metrics dashboard for Admin users - Other minor fixes to user interface

3.4 March 2018 New functionality: - Exclude mechanism - PDRI for Manufacturing and Life Sciences template

4.2 October 2019 New Functionality: - Introduction of PDRI MATRS template

o Maturity and Accuracy - Element definition level descriptions - Action item export - Enhanced PDRI score graph - Carve for Construction Readiness

o Custom factors o Factor descriptions o Facilitation mode o Import/export of CRAs

4.3 December 2019 New Functionality: - Carve - General

o Administrator user export of assessment data by template

o Project dashboard display of project status - Carve for PDRI

o PDRI Summary Report - sort Low Scoring section by score or element order

- Carve for Construction Readiness o New template - Construction Readiness for Smaller

Projects o Auto-numbering of Factors & Categories

Page 8: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 8

o Update to default Score Range Colours

5.0 March 2020 New Functionality - Carve Administration

o New role: Business User - Manage Templates

o Migration capability (PDRI Industrial templates to PDRI MATRS)

o Active/inactive template indicator - Project Dashboard

o Filter by Assessment Template

5.1 August 2020 Template Updates - Carve for Construction Readiness

o Formal rollout of configuration changes developed by Valency’s Construction Readiness User Group to mature the Construction Readiness templates

• Construction Readiness v2.0

• Construction Readiness – Smaller Projects v2.0

5.2 April 2021 New Functionality: - Carve – General

o Action item tracking - Carve for Construction Readiness

o Enhanced filtering “Unanswered” factors o Configure category-level target score and colour

Page 9: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 9

Carve Editions Depending on Carve edition and user role, the user interface will be slightly different once logged into

Carve. The table below provides a general guideline on user accessibility to Carve features.

Refer to the User Roles section for more detail on the types of user access available.

Carve Feature Carve Edition User Role

Admin Facilitator Stakeholder

Projects Professional + + View only

Facilitator + + View only

Portfolios Professional + + +

Facilitator + - -

Metrics Professional view | edit - -

Facilitator view | edit - -

Admin Professional + - -

Facilitator + - - Table 1 - User access to Carve functionality based on Carve editions and user roles

Navigation Refer to user roles section to see which menu options will be available based on user role.

Project Dashboard The projects dashboard is the default screen displayed when all users log into Carve and lists all the

projects available to the user.

Every page displaying the Home icon will direct the user back to this page when clicked. In the

Project dashboard, every item highlighted in blue can be clicked on to drill down further. Every item

with a dropdown icon gives access to additional functionality.

To view a specific project, a user can simply click on the project name to begin drilling down to

assessment details.

Refer to Searching for Projects section to learn more about sorting and filtering the project view.

Page 10: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 10

Figure 1 – Project dashboard

Main menu Based on user’s role, they will see the following menu items:

• Projects – the main project dashboard

• Portfolios - to compare individual projects against the organization’s portfolio

• Metrics - includes key performance metrics (KPIs) commonly correlated with assessment scores

• Admin – administrators can manage portfolios, users, templates, project status and score ranges

Figure 2 – Main menu

User Profile In the top right corner, users can click the drop-down to view their profile and can change their

password.

Figure 3 – User drop-down

Page 11: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 11

Edition (footer) At the bottom of all Carve screens, the user can view which edition their organization is subscribed to

(Facilitator edition or Professional Edition).

Figure 4 – Footer

Admin Set-up

Manage Portfolios Portfolios are managed by the Admin to group related projects and/or programs, by aggregating the

data it is possible to compare projects, identify potential areas for continuous improvement, and

conduct performance benchmarking. Each portfolio can only be associated with one PDRI template. This

ensures that all projects within the same portfolio are compared with alike projects. In Carve, portfolios

are set as a flat structure to avoid portfolios within portfolios.

Create Portfolio 1. From the Admin tab select Manage Portfolios

2. Click Create Portfolio button (top right-hand corner).

3. Enter the following:

a. portfolio name

b. portfolio manager (optional)

c. template type as shown below

Figure 5 – Create a new portfolio

4. Click Next.

NOTE: all projects within a portfolio must use the same template type (industrial, small industrial,

infrastructure, small infrastructure, manufacturing & life sciences or buildings).

5. If there are projects that have not yet been assigned to a portfolio click and drag the desired project

from the left Projects column to the Portfolio on the right.

6. Click Complete

Page 12: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 12

Figure 6 – Add projects to a portfolio

7. Confirm portfolio creation:

a. Click Manage Portfolios

b. Verify the presence of the new portfolio

Assign users access to portfolio 1. Click in the Portfolio Users textbox and select the Carve users who should have access to this

portfolio. If the name is not listed go to Manage Users and confirm they are set up.

Note: users who are designated “Admin” status already have access to all portfolios by default and

therefore do not show up in the list.

Figure 7 – Add user access to the portfolio

2. To remove a user from a portfolio, click on the x to the left of the user

Edit Portfolio 1. From the Admin tab, select Manage Portfolios

2. Click on the portfolio to be edited

3. Fields available for editing include:

• Portfolio Name

• Portfolio Manager

• Portfolio Users

Page 13: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 13

Delete a Portfolio Portfolios may be deleted if they do not have any projects assigned to them. To remove a project from a

portfolio, see Edit a Project section.

To delete a Portfolio:

1. Click on the Admin tab in the top menu

2. Identify the Portfolio for deletion, click the down arrow on the right and click Delete

3. A prompt will appear asking to confirm deletion, click ok to proceed

Figure 7 – Delete a portfolio

Manage Users Most organizations will see project teams evolve and will need to add or delete users over time. Users

can be created and deleted by Company Admin users at any time.

The Company Admin can create new stakeholders, facilitators, Company Admin or Business Admin.

Company Admins can also change a user’s role in Carve at any time to align with the user’s functional

needs.

User Roles Carve uses a role-based security model. Four user roles are supported in Carve:

• Stakeholder

• Facilitator

• Business Admin

• Company Admin

Each user is assigned a role based on the functional capabilities they require. The table below

summarizes some of the capabilities of each user.

Page 14: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 14

Feature Stakeholder Facilitator Business Admin

Company Admin

Project Dashboard ✓ ✓ ✓ ✓

View Assessment ✓ ✓ ✓ ✓

Print Assessment Report ✓ ✓ ✓ ✓

Portfolio Dashboard ✓ ✓ ✓ ✓

Change Password ✓ ✓ ✓ ✓

Import Project & Assessment ✓ ✓ ✓

Create Project & Assessment ✓ ✓ ✓

Prepare Assessment ✓ ✓ ✓

Share Assessment ✓ ✓ ✓

Change Project’s Portfolio ✓ ✓ ✓

Change Project Name ✓ ✓ ✓

Delete Assessment ✓ ✓ ✓

Delete Project ✓ ✓ ✓

Action Item Management ✓ ✓ ✓

Manage Portfolios ✓ ✓

Manage Users Read only ✓

Manage Templates ✓ ✓

Manage Project Status ✓ ✓

Manage Score Range ✓ ✓ Table 2 – Carve user roles

Stakeholder

Stakeholder is the most basic user role in Carve. These users may be direct members of the project,

executive managers, design or engineering consultants or anyone else who you want to be able to

access your PDRI / CRA results but not facilitate or manage assessment or assessment data. The

stakeholder role allows users to:

• view project and portfolio dashboards,

• view assessments,

• print assessments and reports.

A stakeholder cannot create, edit, prepare, share or delete projects, assessments or portfolios;

essentially this a view-only user role.

Facilitator

Facilitators are typically the power users of Carve. The facilitator or co-facilitator (scribe) will use Carve

to support facilitation of PDRI and CRA assessment with project teams. They will walk through the

assessment elements with the project stakeholders during the PDRI / CRA assessment. Low definition

items, element scores, gaps and action items will be noted in Carve as the session progresses. After the

session, the facilitator will use Carve to finalize the action items and write the executive summary for

the final report.

The facilitator role allows users to:

• create, edit and delete, projects, portfolios and PDRI / CRA assessments,

• import assessment data,

Page 15: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 15

• and prepare and share final reports with the other user roles.

Business Admin

For clients with IT compliance requirements where managing users is a restricted function, we have introduced a role called "Business Admin".

The Business Admin has access to everything that the Company Admin role has "except" user administration. With the new Business Admin role, clients will be able to support the following division of responsibilities:

Administrative Tasks Company Admin Business Admin

Manage Portfolio Yes Yes

Manage Users Yes Read-only

Manage Templates Yes Yes

Manage Project Status Yes Yes

Manage Score Range Yes Yes

Table 3 – Carve Admin users

NOTE: The Company Admin was previously known as the “Admin” role. It has been renamed for clarity.

Company Admin

The Company Admin role has full capabilities in Carve, including the ability to manage the creation,

addition and removal of users.

• the creation of portfolios,

• activating and inactivating PDRI templates for the organization

• configuring of templates and element descriptions to meet specific business requirements

• Admin users are also provided access to the Metrics dashboard which includes key performance

metrics (KPIs) commonly correlated with assessment scores

Create User To create a new user,

1. From the Admin tab click Manage Users.

2. Click on Create User at the upper right.

3. Enter the user’s email address (their unique login for Carve).

4. Enter the first name and last name as it should appear in Carve.

5. Select the user role - Stakeholder, Facilitator Business Admin or Company Admin.

6. Assign portfolios – for Stakeholder and Facilitators, access must be granted to applicable portfolios

Page 16: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 16

Figure 8 – Create new user

7. Click Save.

NOTE: Stakeholder and Facilitator users may not be able to access certain projects or assessments until

they have been assigned portfolio access. Admin users automatically have access to all the portfolios

within the organization, and therefore are not assigned portfolios.

Edit User 1. Click the Admin tab and then click Manage Users

2. Click on the user from the Users list

3. The editable fields can be changed as required

4. Changes are automatically saved

Access to Portfolios Providing portfolio(s) access to a new or existing user can be done in the Admin tab

1. Click the Admin tab and then click Manage Users.

2. Click on the user from the Manager Users list.

3. Click on the Portfolio entry field.

a. To add access: Using the down arrow, select and add each portfolio that this user has permission

to access.

b. To remove access: Click on the “X” to the left of the portfolio to revoke the user’s permission to

access the portfolio.

Page 17: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 17

Figure 9 – Adding or removing portfolio access

Delete User Deletion of an existing user from Carve can be done in the Admin tab (Figure 2.14):

1. Click the Admin tab and then click Manage Users.

2. Click on the user from the Manager Users list.

3. Click the Delete User button and select OK during the confirmation prompt.

Figure 10 – Deleting a user

Reset Password To reset a user’s password,

1. Click on the desired user from the Manager Users list.

Page 18: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 18

2. Click the “Reset Password” button at the bottom of the user page. An email containing the new

password will be sent directly to the user’s email address.

3. Reset Password: the user will need to reset their password themselves by following instructions

provided in the email.

NOTE: The admin can reset a user’s password, but the admin will never see the actual password

value – old or new.

Figure 11 – Reset user password

Manage Templates

Overview Industry validated PDRI templates are available for four industry sectors:

• Industrial projects: these could include power plants, chemical plants, oil & gas production, water

and/or waste treatment, and manufacturing. In 2015 CII released a version of PDRI specifically for

small industrial and plant projects. In 2019 CII released a new version of the full PDRI Industrial

template call PDRI MATRS (PDRI MATRS Industrial V5.0)

• Building projects such as offices, schools, medical facilities, institutional buildings, and research

facilities.

• Infrastructure projects generally involve linear construction with extensive public interface and

environmental impact. Examples could include railways, pipelines, transmission, and distribution.

In 2016 CII released a version of PDRI specifically for small infrastructure projects.

• Manufacturing and Life Sciences projects include a mix of both industrial and building scope.

Industrial facilities in the MLS sector include the manufacturing of pharmaceuticals, automobiles,

high-tech electronics, food, beverages, agriculture products, pulp and paper, and consumer

products.

Page 19: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 19

Supported Templates Carve currently supports the following CII templates:

Template Type Template Name Spreadsheet .xlsm Import Available

Industrial Projects PDRI Industrial V3.8 Industrial PDRI V4.0 PDRI MATRS Industrial V5.0

Yes Yes No

Infrastructure Projects PDRI Infrastructure V1.1 PDRI Infrastructure V4.0

Yes Yes

Building Projects PDRI Building V3.8 PDRI Building V4.0

Yes Yes

Small Industrial Projects PDRI Small Industrial Projects Yes

Small Infrastructure Projects

PDRI Small Infrastructure Projects No

Manufacturing and Life Sciences

PDRI for Manufacturing & Life Sciences

No

Construction Readiness Construction Readiness Construction Readiness – Smaller Projects* Construction Readiness v2.0* Construction Readiness – Smaller Projects v2.0*

No No No No

Table 4– Reset user password

*Configuration changes developed by Valency’s Construction Readiness User Group to mature the

Construction Readiness templates.

Organizations may use these templates, provided they have purchased the CII publication and

tool/template and have subscribed to the required Carve module(s) – PDRI, CRA (Construction

Readiness Assessment)

Migrating Templates to Newer Version Carve provides migration capability for legacy PDRI Industrial (3.8 or 4.0) assessments to PDRI MATRS

Industrial 5.0. The primary reason to migrate older assessments is to include them in portfolio analysis

alongside recent PDRI MATRS assessments. Please contact Valency Support and we will help you plan

your migration, including which projects to migrate. For clarity, the migrate step must be performed by

Valency Support.

Activate/Inactivating Templates Carve provides access to PDRI and CRA templates available from CII. The current and previous version of

each template can be used. However, it is recommended that organizations only activate applicable

templates and inactivate older template versions to minimize confusion and promote greater

consistency during PDRI and CRA sessions.

To activate or inactivate templates:

1. Click on the Admin tab from the top bar (shown in green below).

Page 20: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 20

2. Select the Manage Templates tab to see the list of supported templates on the left.

3. Click on the down arrow on the right side of the template.

4. Click Activate or Inactivate.

Figure 12 – Inactivate a template

NOTE: Having a minimal list of available templates makes it easier for facilitators. Inactivating a template

removes it from the list visible to facilitators preventing possible errors or confusion by selecting the

incorrect template or template version.

Active/inactive template indicator.

Active templates will be identified with a blue dot (left hand side) and inactive templates with a grey dot.

Page 21: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 21

Figure 13 – Active/Inactive Template Indicator

Rename Template To edit Template Names to better fit an organization’s specific nomenclature:

1. Click on the Admin tab on the top bar (shown in green below)

2. Select the Manage Templates tab to see the list of supported templates

3. Identify the Template to edit and click the down-arrow on the right and select edit

Figure 14 – Edit template titles

4. Update the Custom Name and Custom Description field (or reset to revert to default values on the

left)

Page 22: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 22

Figure 15 - Update the Custom Name and Custom Description field

5. Click Save

Reset Template Name to Default

1. Click Edit from the drop-down menu to the right of the selected template

2. Click the Reset button

Print/Share Element Descriptions (Facilitation Package) as PDF Prior to facilitating a PDRI or CRA session, it is valuable for attendees to read the element descriptions

associated with the PDRI / CRA template being used. In Carve, the Admin can create a PDF of the

complete Template which can then be distributed to the attendees.

To download the PDF of the PDRI or CRA Template element descriptions:

1. From the Admin tab click Manage Templates.

2. Identify the desired template and click the down arrow to the right.

3. Select Print to download a PDF copy of the element and element descriptions which can be distributed

as an email attachment or printed.

NOTE: Elements that were excluded in the template will be marked as Not Applicable and their

descriptions will not be shown in the PDF document.

Export Assessment Data by Template Company Admin users can export their assessments in .csv format on a template by template basis from

the Manage Templates tab.

Note: Templates must be enabled before exporting assessment data.

Page 23: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 23

Figure 16: Export Assessments Data

Export Assessments capability for Construction Readiness assessments.

An export (CSV file) for CRA assessment data has been added. This will be used in Valency’s PowerBI

Portfolio Dashboard for Construction Readiness (Beta). Any clients that would like to participate in beta

testing of the PowerBI Portfolio Dashboard should contact [email protected].

PDRI Templates

Edit Section Titles

It is possible to edit individual sections titles, short names or descriptions; however, this is not

recommended as it may cause confusion as the Section Titles are key reference points when comparing

with other organizations or CII published data and reports. If modifications are required:

1. Click on the Admin from the top bar (shown in green below)

2. Select the Manage Templates tab to see the list of supported templates

3. Click the Template containing the section to edit

4. Identify the section to edit and select the edit link on the right

Page 24: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 24

Figure 17 – Edit section titles

5. Update the Custom Name, Custom Short Name, and Custom Description fields (or reset to revert to

default values on the left)

6. Click Save

Reset Section Title to Default

3. Click Edit from the drop-down menu to the right of the selected section

4. Click the Reset button

Edit Subsection Titles

Organizations will often change subsection titles and descriptions to suit internal or industry

terminology. To edit subsections titles and descriptions:

1. Click on the Admin from the top bar (shown in green below)

2. Select the Manage Templates tab to see the list of supported templates

3. Click the Template containing the subsection to edit

4. Click the section containing the subsection to edit

5. Identify the subsection to edit and select the edit button on the right

Page 25: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 25

Figure 18 – Edit subsection titles

6. Update the Custom Name and Custom Description fields

7. Click Save (or reset to revert to default values on the left)

Reset Subsection Title to Default

5. Click Edit from the drop-down menu to the right of the selected subsection

6. Click the Reset button

Edit Element Descriptions (PDRI)

To edit the title and description of an individual element to accommodate an organization’s

nomenclature use the following steps:

1. Click on the Admin from the top bar (shown in green below)

2. Select the Manage Templates tab to see the list of supported templates

3. Click the Template containing the element to edit

4. Click the section containing the element to edit

5. Click the subsection containing the element to edit

6. Identify the element to edit and select the edit button on the right

Page 26: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 26

Figure 19 – Edit element description

7. Update the Custom Name in the box at the top of the screen and/or type a custom description of the

element in the box provided. It should be noted the element will now only contain the text that is

included in the Custom Description box.

Figure 20 – Customize elements

8. Click Save (or reset to revert to default values on the left)

NOTE: A dark pencil indicates that an edit has been made to a specific item. A light grey pencil indicates

that an edit has been made further down the hierarchy and can be viewed by drilling down into the

template, section, subsection and element.

Page 27: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 27

Reset Element Description to Default

1. Click Edit from the drop-down menu to the right of the selected Element

2. Click the Reset button

Edit Definition Level Descriptions (PDRI MATRS Industrial 5.0)

Note: this is only applicable to the CII PDRI MATRS Industrial Template V5.0

To edit the definition level description of an individual element, use the following steps:

1. Follow steps 1 through 5 above for editing element descriptions

2. Click the element for which you would like to change the definition level

3. Select which definition level you would like to edit, clicking on the down-arrow button on the right

and selecting edit

4. Enter the custom description for the definition level

5. Click Save (or reset to revert to the default description)

Reset Definition Level Description to Default

7. Click Edit from the drop-down menu to the right of the selected Definition Level

8. Click the Reset button

Figure 21 - Edit definition level descriptions

Exclude Sections/Elements at Template/Organization Level (PDRI)

By excluding Sections or Elements at the Manage Templates Level, the change will apply to all

assessments created throughout your organization.

If you wish to exclude a category/factor for an individual assessment, please refer to Facilitating a PDRI

Session – Exclude Factors in the PDRI Assessment.

Page 28: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 28

The ability to exclude one or more components (element, category or section) for a template is only

available to organizations that have the “Exclude” feature enabled by Valency. Excluded components at

the template level will have affect all new projects created after the exclusion. Existing projects are not

affected by the template exclusion. However, facilitator users will have the ability to exclude project

elements on an assessment-by-assessment basis. Refer to Section 3.4.1 for more information on

excluding project elements for a specific assessment.

To exclude a component of a template, click on the down-arrow button on the right of the

section/subsection/element then select Exclude (Figure 3.12a). A black Exclude symbol will appear on

the component that is excluded, and grey Exclude symbol will appear on any upper level components

above it.

Figure 22 – Exclude a template component

Figure 23 – Exclude Symbol

To reverse the exclusion, click on the down-arrow button on the right of the excluded component and

select Include.

Construction Readiness Templates

Edit Category Name and Description (Construction Readiness)

Category Name and descriptions may be edited by an Admin user. To edit category name and

description use the following steps:

1. Go to the Admin tab, Manage Templates

2. Select the Construction Readiness Assessment, click on the word Assessment

3. Click drop-down arrow on the right of a category and select Edit

Page 29: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 29

Figure 24 – Edit category descriptions

4. Enter the Custom Name and/or Custom Description

5. Click Save

Reset Category Name/Description to Default

1. Click Edit from the drop-down menu to the right of the selected Category

2. Click the Reset button

Edit Factor Descriptions (Construction Readiness)

Factor Name and descriptions may be edited by an Admin user. To edit factor name and description use

the following steps:

1. Go to the Admin tab, Manage Templates

2. Select the Construction Readiness Assessment, click on the word Assessment

3. Click drop-down arrow on the right of a factor and select Edit

Page 30: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 30

Figure 25 – Edit factor name/descriptions

4. Enter the Custom Name and/or Custom Description

5. Click Save

Reset Factor Name/Description to Default

3. Click Edit from the drop-down menu to the right of the selected Category

4. Click the Reset button

Create Custom Factors (Construction Readiness)

Up to 20 custom factors may be created using the “Company Specific” category. Custom factors are

treated as “fundamental” factors, meaning they are not weighted and do not affect the overall

construction readiness core. However, comments may be captured, and action items assigned to custom

factors.

To access the “Company Specific” category, you must be an Admin user. To add custom factors or to edit

the Company Specific category use the following steps:

1. Go to the Admin tab, select Manage Templates

2. Select Construction Readiness Assessment, select Assessment

3. Select 16. Company Specific (to edit the category name or add a custom category description click the

drop-down arrow on the right-hand side of the category and select edit)

4. Click the drop-down arrow on the right-hand side of a factor and select edit to customize an

element/factor

a. Here you may customize the name and description for the factor

Page 31: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 31

Figure 26 – customize factors

NOTE: Category 16, the “Company Specific” category is excluded from assessments by default. To

enable this category, click the drop-down arrow beside the category and select include. This must be

repeated for any factors the user wishes to include in their assessments.

Factors in the “Company Specific” category will only appear in assessments created after the category

and factors are enabled. Existing assessments and projects will not be affected by enabling this category.

Figure 27 – company specific category

Exclude Categories/Factors at Template Level (Construction Readiness)

By excluding Categories or Factors at the Manage Templates Level, the change will apply to all

assessments created throughout your organization.

To exclude a component of a template, click on the down-arrow button on the right of the

category/factor then select Exclude.

Page 32: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 32

Figure 28 – Exclude a factor on Construction Readiness template

Auto Re-numbering Feature

To simplify the construction readiness facilitation process, when a category or factor is excluded from

the template, the remaining categories and factors are automatically renumbered. Project stakeholders

will not be distracted by excluded content. This has been reflected in the:

• Construction Readiness template report (facilitation package)

• Conducting of assessments

• Construction Readiness Summary report

In the example below, the “Health/Safety/Security” category has been excluded, resulting in a re-

numbering of subsequent categories. Similarly, the second factor under 4. Execution has been excluded,

resulting in a re-numbering of the remaining factors in this category.

Figure 29 - Auto re-numbering of categories in Manage Templates

Page 33: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 33

Category Weighting Summary

Admin users can download a Category Weighting Summary from the Manage Templates tab. The

Category Weighting Summary is a PDF report detailing the weighting impact of a company’s

customizations to the CRA templates. By comparing the company’s customized template against the

master template, the following data is highlighted:

• Categories excluded

• Number of remaining factors in a category

• Raw category weight

• Normalized category weight

• Change in weighting (master vs. customized category normalized weighting)

A view of the Category Weighting Summary is shown below.

Figure 30 - Category Weighting Summary – Construction Readiness template

Print the Category Weighting Summary

1. From the Admin Tab, click Manage Templates

2. To the right of the selected Construction Readiness template, select Print Weights Report

3. The PDF will download

Page 34: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 34

Figure 31 – Print Category Weighting Summary for Construction Readiness Template

Manage Project Status (Lifecycle Stages) The Project Status is used to describe the current stage within the lifecycle of a project. In Carve, the

user is asked to identify the Project Status when creating an assessment (Session Details tab). The

assigned Project Status appears in Carve when reviewing the Project Assessment Summary and again as

part of the PDF Report.

The nomenclature used in Carve is based on CII practices. It is common in many organizations to use

slightly different terminology to reflect the project stages. To modify the wording of any of the nine

project phases to better suit your organisation:

1. From the Admin tab click Manage Project Status.

2. On the left-hand side, there is a list of all nine available project phases. To modify the wording click

on any one of the nine options listed.

3. Two new lines appear to the right (see figure below); on the top is the Default, on the bottom is the

Custom Name. Beside “Custom Name” type a description. Click SAVE.

4. The Custom Name will now appear on all projects, both existing and those generated in the future,

when that option is used.

Page 35: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 35

Figure 32 – Customize project status name

Manage PDRI Score Range The use of pictorial representations in Carve is intended to provide the user a quick indication of PDRI

results and how the current project compares with either industry standards or internal benchmarks.

The scores are represented with a coloured bar graph on the Project Dashboard (shown below). This

same representation follows through to the Assessment Summary, the Reports and the Portfolio

dashboard.

The project score, represented by the largest block in the centre, is compared to both the Industry

Standard, as defined by CII (the grey bar above the project score) and the portfolio average (a blue bar

shown below project score).

Page 36: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 36

Figure 33 – Score ranges and colours

Administrators can modify the recommended ranges for any active PDRI Template and change the

colour of the ranges. This allows organizations to fully align score ranges to their internal standards and

procedures.

Modifying PDRI Score Ranges and Associated Colours It is possible to modify the colour representing the project score, the numerical range for that colour,

and the number of intervals included for each Stage Gate. The default in Carve compares the project

score to the CII Industry Standard for that particular stage gate.

By default, the project is coded green if the score is less than the high range of the Industry Standard for

that stage gate. The industry standard is defined by CII.

• The project is coded green if the score is within or less than the CII recommended range.

• The project is coded red if the score is greater than this value.

To modify the numerical ranges attributed to specific colours:

1. From the Admin Tab click on “Manage PDRI Score Range”

2. First choose the Template for which the colour and ranges will be modified. Select the Template from

the drop-down menu provided under “Template”.

3. To create a new range entry, click the button “Create range entry”, chose a Project Gate, the desired

score range and colour (as shown below).

4. To modify an existing range, click on the row you wish to modify and the editable row will appear at

the top of the screen (below the template selector).

NOTE: ensure you have ranges that cover all scores between “0” to “1000” inclusive. Changes to the

colours will apply to all projects past and future, for the template you have modified.

Page 37: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 37

Figure 34 – Change score ranges and colours

Default Colours and Ranges for PDRI Dashboard Carve starts with default colours attributed to ranges of scores for PDRI results. The default ranges and

colours are listed in the table below:

Page 38: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 38

Gate Minimum Score Maximum Score Colour

Templates: Industrial, Building, Infrastructure

PDRI-1 0 800 Green

801 1000 Red

PDRI-2 0 600 Green

601 1000 Red

PDRI-2i 0 450 Green

451 1000 Red

PDRI-3 0 250 Green

251 1000 Red

Templates: Small Industrial, Small Infrastructure

PDRI Early 0 800 Green

801 1000 Red

PDRI Final 0 400 Green

401 1000 Red

Table 5 - PDRI default score ranges and associate colours

A screen capture of the Default values for the Industrial, Building and Infrastructure Templates is shown

below.

Page 39: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 39

Figure 35 – PDRI Manage score range colours

Manage CRA Score Range The use of pictorial representations in Carve is intended to provide the user a quick indication of PDRI

results and how the current project compares with either industry standards or internal benchmarks.

The scores are represented with a coloured bar on the Project Dashboard (shown below). This same

representation follows through to the Assessment Categories, Summary, and the Reports.

Figure 36 – Manage Score Range – Construction Readiness Project Dashboard

Page 40: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 40

Modifying Construction Readiness (CRA) Score Ranges and Associated Colours It is possible to modify the default colour representing the project score and the numerical range for

that colour, and the number of intervals included. The default in Carve compares the project score to

the CII Industry Standard.

Admin users can also adjust the category-level target scores for the Construction Readiness Assessment.

They can be higher or lower than the overall scoring guidelines.

To modify the numerical ranges attributed to specific colours:

1. From the Admin Tab click on “Manage CRA Score Range”

2. First choose the Template for which the colour and ranges will be modified. Select the Template from

the drop-down menu provided under “Template”.

3. To create a new range entry, click the button “Create range entry”, chose a Category, the desired

score range and colour (as shown below).

4. To modify an existing range, click on the row you wish to modify and the editable row will appear at

the top of the screen (below the template selector).

Note: ensure you have ranges that cover all scores between “0%” to “100%” inclusive. Changes to the

colours will apply to all projects past and future, for the template you have modified.

Figure 37 – Modifying Construction Readiness category score ranges

Page 41: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 41

The colour range and score indicators will reflect the defined score ranges, however; the changes made

do not affect the calculation of overall readiness (formulas are not changed).

Figure 38 – Category score colours on CRA assessment dashboard

Default Colours and Ranges for Construction Readiness The Construction Readiness Assessment templates have default score range colours to serve as a guide

to users. The default ranges and colours are listed in the table below:

Gate Minimum Score Maximum Score Colour

Templates: Construction Readiness, Construction Readiness – Smaller Projects

CRA 0 0 White

CRA 1 74999 Grey

CRA 75000 84999 Yellow

CRA 85000 100000 Green

Table 6 - CRA default score ranges and associate colours

A screen capture of the Default values for the Construction Readiness Templates is shown below.

Page 42: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 42

Figure 39 - Manage Score Range For CRA

NOTE: The white range (0-0) allows users to identify excluded categories, or categories where all factors

are listed as N/A.

Project Management

Manage Projects

Create a Project Prior to conducting an assessment, a unique project must exist in Carve (unless an assessment is being

imported).

Facilitators and Administrators can create new projects. Projects can be created from the Project

Dashboard by following these steps.

1. From the main Projects dashboard, click on “Create Project”

Figure 40 – Create a new project

2. Enter the project details:

Page 43: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 43

Figure 41 – Create a new project setup window

• Project Name – required.

• Template type – required. Select the desired PDRI template from the drop-down menu. All

templates that are enabled for the organization will be displayed in the list.

If only a Construction Readiness Assessment is being conducted, you can leave the Template

Type at the default “PDRI – Industrial”.

• Portfolio – required. Select the desired portfolio from the drop-down menu. It is important to

choose the correct portfolio as this will be used to calculate internal PDRI and CRA benchmarks.

The following Parameters are all optional. These fields are available to the user to specifically define this

project and could also be used to search, sort and group similar projects for internal comparison of PDRI

and CRA scores. All the following information will appear on the Cover Page of the Assessment

Summary Report.

• Project ID

• Client name

• Client ID

• Project Type

• Project Location

3. Click the Save button

4. A new pop-up will appear to create an assessment

Page 44: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 44

Figure 42 – Create a new assessment window opens once project is created

a. To create the assessment

• Select Assessment Type (PDRI or CRA)

• Select Template

• Select Project Gate

• Select Assessment Date

• Click Create

b. To bypass this step, click Cancel and the project will be created without an assessment

Searching for Projects For organizations with a significant number of projects and assessments, the ability to filter projects

using specific criteria allows organizations to gain important insights and analyze data efficiently. The

advanced criteria feature on the Project Dashboard addresses this requirement. In addition to filtering

projects by portfolio, users can use advanced criteria by clicking on Show Advanced Criteria, and then

click on “Add Condition” button. Available search criteria on the Projects dashboard include:

• Gate (drop-down list assigned based on template assigned to the portfolio, e.g. PDRI 1, 2, 2i, 3)

• Date range (previously displayed beside the portfolio drop-down)

• Project Status (defined by organization, e.g. feasibly, concept, detailed scope)

• Assessment Template

• Assessment Status (Posted, Shared, Created, Imported, Conflict)

• Project Manager

• Facilitator

• Client Name

• Client ID

• Project Name

• Project ID

• Project Type

• Project Location

Page 45: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 45

Figure 43 - Advanced Search Criteria

Figure 44 - Adding a search condition

Users can add as many conditions as required. Each condition is evaluated as an “AND” statement. In

the example below, only projects from the “Building Projects” portfolio with a PDRI 3 assessment AND

client name containing “Waterloo” will be displayed.

Figure 45 – Adding multiple search conditions

The user can hide the advanced criteria fields by clicking on the “Hide Advanced Criteria” field. Once

hidden, a condensed description of the advanced criteria is displayed so the user is clear on the

advanced criteria that have been applied.

Page 46: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 46

Figure 46 – Condensed description of the advanced criteria

Viewing Project Details 1. From the Projects dashboard, locate the project.

• To view and edit existing assessments of the project, click on the project name to drill down to

the assessment list

Figure 47 – Assessment list

Edit a Project 1. From the Projects dashboard, locate the project.

2. To edit the project information, click on the down-arrow on the right

Figure 48 – Down arrow to edit project information

3. The Edit Project window will appear. After editing the project, click Save to save the changes.

Page 47: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 47

Figure 49 – Edit Project information

Edit the Portfolio Assigned to a Project

1. To assign a project to a different portfolio, follow the steps to edit a project.

2. In the Edit Project window, click the drop-down in the “Portfolio” field to select the portfolio.

3. Click Save

Page 48: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 48

Figure 49 – Edit project, portfolio field

Delete a Project A project can be deleted by,

1. Locating the project to be deleted

2. Selecting Delete from the drop-down arrow to the right of the project

Figure 50 – Delete a project

3. A pop-up window will confirm. If there are any assessments associated with the project, they will be

deleted as well.

Page 49: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 49

Figure 51 – Delete project confirmation window

Viewing Assessments 1. To view and edit existing assessments for a project, click on the project name to drill down to the

assessment list

Figure 52 – Assessment list

2. From the list,

• click on the assessment name (PDRI assessments only) to access the Assessment Summary

dashboard

Figure 53 – Assessment Summary Dashboard

• click on Prepare link to edit the assessment information – it will direct user to the Assessment

Dashboard

Page 50: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 50

Figure 54 – Assessment Dashboard

Assessment Metrics (PDRI)

Users can quickly view an assessment result by accessing the Assessment Summary Dashboard. This

dashboard includes the following tabs (tabs differ by assessment template):

• Assessment Summary: provide visual comparison of the project score to the portfolio and industry

average.

Figure 55 – Assessment Summary Dashboard

• Action items

• Attendees

• Low Definition Elements

• Section Summary

• Basis of Project Decision

• Basis of Design

• Execution Approach

NOTE: user cannot edit information on this dashboard. Any changes must be made from the Assessment

dashboard.

Page 51: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 51

Assessment Dashboard

Users can view and edit the assessment data from the Assessment Dashboard. Click on the project name

to drill down to the assessment list. Click Prepare to open the Assessment Dashboard.

Figure 56 – Viewing assessments from project dashboard

Each tab along the top provides access to the various sections of the assessment:

1. Session details

2. Attendees

3. Assessment (CRA)

4. Basis of Project Decision (PDRI)

5. Basis of Design (PDRI)

6. Execution Approach (PDRI)

7. Accuracy (PDRI MATRS Industrial 5.0)

8. Readiness Chart (CRA)

9. Missing Factors (CRA)

10. Low Definition (PDRI)

11. Action Items

12. Best Practices (CRA)

13. Summary

Edit an Assessment

1. To edit an existing assessments, click on the project name to drill down to the assessment list

Figure 57 – Assessment list

2. From the list, click on Prepare link to edit the assessment information.

Page 52: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 52

Figure 58 – Assessment Dashboard

Delete an Assessment

To delete an assessment,

1. Locate the project the assessment is associated with

2. Click on the project name to view the list of assessments

3. Click on the drop-down to the right of the assessment to be deleted

4. Click Delete

Figure 59 – Delete assessment from project dashboard

5. A pop-up window will appear asking to confirm

6. Click Delete

Figure 60 – Confirm window to delete assessment

Print an Assessment from Project Dashboard

1. Identify and click the Project for which a PDRI assessment is being prepared

2. Identify the assessment for which a PDF is to be created

3. Click the down arrow on the right of the assessment and click print

Page 53: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 53

• If the assessment isn’t published, Carve will display a prompt asking if the assessment should be

published to the portfolio. Selecting Ok will publish the assessment and the PDF will download.

Selecting Cancel will not publish the assessment and the PDF will download.

Figure 61 - Print report of an assessment

• Users have the option to sort the Low Scoring section of the report by Score or by Element/Factor

Order (PDRI).

Figure 62 - Scoring order prompt

4. The downloaded file can be opened using a PDF viewer such as Adobe Reader or Internet Browser

NOTE: The PDF will indicate the project name, Client/Organization name, Project Manager, Facilitator

and Assessment Date automatically on the cover page and Project Name and Gate in the footer of each

page.

Print from Assessment Summary tab

Users can also download a PDF report within the assessment clicking the Print button in the Summary

tab.

Page 54: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 54

Figure 63 - Print report from Summary

The new PDF report contains project details (project gate/status, project manager and facilitator name,

assessment date), an executive summary, action items captured during the project assessment, and a

summary of gaps (PDRI) /missing factors (CRA).

Share an Assessment

To share an assessment with team members,

1. Locate the project the assessment is associate with and click on the project name to view the

assessments.

2. Click Share to the right of the assessment

Figure 64 – Share assessment from Project Dashboard

3. Select the user(s)

4. Enter a message

5. Click Share

Page 55: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 55

Figure 65 – Share assessment window

Publish to Portfolio (Post)

Once an assessment is complete, or imported, it can be published to a portfolio. Publishing an

assessment to a portfolio allows for comparison between similar projects and can help generate an

internal baseline.

Note: all projects within a portfolio must use the same PDRI Template.

To publish an assessment to a portfolio:

1. Select Project from the top bar to arrive at the Project Dashboard 2. Identify the project containing the assessment to publish and click on the project name 3. To publish to the portfolio, click on the down arrow on the right opposite the Assessment (i.e. PDRI

1 or Early Review) and select Publish to Portfolio 4. If you wish to change the portfolio to which this project is affiliated, click the down arrow to the

right of the coloured bar graph and choose Edit. A dialogue box will appear and you will be able to choose the appropriate portfolio.

Page 56: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 56

Figure 66 – Publish an assessment to a portfolio

Exclude from Portfolio Analysis

PDRI assessments can be excluded from portfolio analysis by

1. Locating the project, the assessment is associated with and clicking on the project name to view the

assessments

2. Selecting “Exclude from portfolio analysis” from the drop-down menu to the right of the assessment

Figure 67 – Exclude assessment from portfolio analysis

Import Assessment

For organizations that use CII’s PDRI spreadsheet templates to facilitate PDRI and CRA assessments, the

completed spreadsheets may be imported into Carve*. This provides the organization with the ability to:

• Finalize the assessment and use Carve to communicate the results to Stakeholders (optional)

• Include PDRI assessment results in their portfolio analysis

• Carve has been designed to easily import this data seamlessly such that the user can immediately

integrate this data into either new or existing portfolios within Carve.

Page 57: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 57

Accepted formats include the CII spreadsheet format xlsm or assessment files that have been previously

exported from Carve in a .json file.

*Supported CII PDRI templates are listed in the Supported Templates section

NOTE: For CII PDRI templates that have been modified contact [email protected] for support for

a custom import to Carve.

Prior to import, the correct template must be active for the organization to ensure a successful import

of a PDRI assessment. Steps to activate a template can be found in the Activate/Inactivate Templates

section.

Steps to Import an Assessment

1. From the Project Dashboard screen, select Import assessment

Figure 68 – Import an assessment

2. Select the appropriate CII PDRI template using the radio buttons or Import Carve assessment file.

Figure 69 – Select a template and upload a file for importing

3. Click Select File.

4. Navigate to the location of the assessment being imported and select it.

5. Click Next.

Page 58: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 58

6. Select to import the assessment to a) an existing project or b) create a new Project using the

information from the imported assessment.

a. Click Select from available projects and use the dropdown to select which project the assessment

should be imported to.

b. Click Create a new project and the Project Name and Project ID will autofill from the import data

which can be renamed or given a new Project ID.

Figure 70 – Select template and import file

7. Select Complete Button.

8. Verify the Project has been imported to the correct project by reviewing the Project Dashboard to

ensure values have been mapped correctly.

9. To include the imported project in a portfolio, you must publish the imported file to the desired

portfolio.

Export Assessment

An individual assessment can be exported as a .json file.

1. Locate the project that the assessment is associated with and click the project name to view the

assessments.

2. Select Export from the drop-down menu to the right of the assessment

Figure 71 – Export assessment from project dashboard (.json file)

3. The .json file will immediately begin downloading

Page 59: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 59

Managing Action Items Action items are often created during the facilitated PDRI or CRA session and can be added afterward

from within the Action Items tab. The following explains how to reorder the list of action items to best

reflect their respective priority, as well as how to add, modify or delete action items.

Viewing Action Items Action items are viewed from the Action Items tab within the assessment

1. Locate the project the assessment is associated with and click on the project name to view the

assessments

2. Click Prepare to open the assessment

3. Click on the Action Items tab

Figure 72 – Action Items tab in assessment

Creating Action Items Action items can be created from several areas of the assessment

From the Action Items tab

1. Click on Create Action Item (button)

Figure 73 – Create action item from Action Items tab

2. A window will open with the following editable fields

• Description

• Assigned to

• Target date

• Status (open, closed, cancelled)

• Category – what category does the action item pertain to (optional)

• Element (PDRI) / Factor (CRA) – what element or factor does the action item pertain to

(optional)

Page 60: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 60

Figure 74 – Create Action Item window

3. Enter the detail and click ‘Save’

From the Low Definition tab (PDRI)

Figure 75 – Create Action Item from Low Definition tab

From the Missing Factors tab (CRA)

Figure 76 – Create Action item from Missing Factors tab

From the Assessment tabs (Element facilitation view)

1. Click on one of the PDRI sections

• Basis of Project Decision

• Basis of Design

• Execution Approach

• Accuracy (if applicable)

2. Click on the appropriate element to open facilitation view

3. Click on the Action items button

Page 61: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 61

Figure 77 – Create Action Item from PDRI Element Facilitation window

From the Assessment tab (CRA)

Category level

Figure 78 – Create Action Item from CRA Assessment tab

Page 62: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 62

Factor level (facilitation view)

Figure 79 – Create Action Item from CRA Factor Facilitation View

Edit an Action Item 1. Click on Projects at the top of the home menu to arrive at the Projects Dashboard

2. Identify and click the Project for which a PDRI or CRA assessment is being prepared

3. The selected project will expand to reveal an active assessments

4. Identify the assessment to review Action Items and click Prepare

5. Select the Action Items tab

6. Identify the action item requiring modification

7. Click the down arrow to the right of the action item and select edit

Figure 80 – Edit Action Item from Action Items tab

8. Update the necessary fields and click save.

9. Re-order the new action item if required

Page 63: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 63

Deleting Action Items 10. Click on Projects at the top of the home menu to arrive at the Projects Dashboard

11. Identify and click the Project for which a PDRI or CRA assessment is being prepared

12. The selected project will expand to reveal an active assessments

13. Identify the assessment to review Action Items and click Prepare

14. Select the Action Items tab

15. Identify the action item requiring modification

16. Click the down arrow to the right of the action item and select Delete

Figure 81 – Delete Action Item from Action Items tab

Reordering Action Items Reordering the list of Action Items can position high-priority activities at the top which may help

prioritize activities. To reorder action items:

1. Click on Projects at the top of the home menu to arrive at the Projects Dashboard 2. Identify and click the Project for which an assessment is being prepared 3. The selected project will expand to reveal an active assessments 4. Identify the assessment to review Action Items and click Prepare 5. Select the Action Items tab. All action items created for the assessment will be listed 6. The order of action items can be changed by clicking on individual action items and dragging them

up or down.

Figure 82 – Reorder Action Items from Action Item tab

Page 64: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 64

Tracking the Status of Action Items When creating or editing action items, the Status drop-down allows the user to set the status of the

item to:

• Open

• Closed

• Cancelled

Figure 83 – Capture status of Action Item (drop-down)

On the Action Items tab, users can filter action items by Status.

Figure 84 – Filter Action Items by Status on Action Items tab

The .csv export contains the “Status” and “Updated At” data. (See Exporting Action Items)

Figure 85 – Export of Action Items

Page 65: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 65

The summary report will display Open Action Items.

Figure 86 – Summary report display of open action items

Exporting Action Items The list of action items can be exported for use in other project management software tools if required.

The export is a .csv file format.

To export the action items for an assessment,

1. Locate the project the assessment is associated with and click on the project name to view the

assessments

2. Click Prepare to open the assessment

3. Click on the Action Items tab

4. Click Export

Figure 87 – Exporting Action Items from Action Items tab

Note: the data that is visible is what will be exported. If the Status filter is set to Open than only Open

action items will be exported.

Copying Action Items from Previous Assessment Facilitators can now update the status of action items as well as copy action items from a previous

assessment to a new assessment (e.g. from PDRI-2 to a PDRI-3 assessment or from CRA conducted at

60% Design Complete to an assessment conducted at 90% Design Complete).

Note: PDRI action items can only be copied to a succeeding PDRI assessment within the same project,

you cannot transfer action items from a PDRI to a Construction Readiness assessment.

Page 66: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 66

When creating a new assessment, users will see the option to “Copy the action items from the last

PDRI/Construction Readiness assessment for this project”. By default, this will be checked on.

Figure 88 – Copying action items from previous assessment from Create Assessment window

By clicking Create, a new assessment is created with the Action Items tab populated with the previous

assessment’s action items.

From this view, the Project Manager can update the status of action items and reorder action items as

appropriate.

Facilitation – PDRI Carve’s facilitation steps are based on PDRI facilitation best practices from CII. Facilitators can either

• Complete the entire facilitation process using Carve

• Use CII’s PDRI spreadsheet templates to collect assessment data and import into Carve

Preparing for a PDRI Session It is recommended that the facilitator completed the following items prior to starting a facilitated PDRI

session:

1. Create a Project or Locate an Existing Project - make sure the project is ready in Carve.

2. Create a new assessment

3. Complete the Session Details and Attendees tabs on the Assessment dashboard

Locate or Create a Project Instructions for creating and locating a project can be found here:

• Creating a project

• Locating an existing project

Create an Assessment If a new project is being created, the user will be prompted to create the assessment at the same time.

See Creating a project section.

Page 67: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 67

If the project already exists,

1. Locate the project and click the project name

2. Click Create Assessment

Figure 89 – Create assessment from existing project

3. A new pop-up will appear to create an assessment

a. Select Assessment Type (PDRI or CRA)

b. Select Template

c. Select Project Gate

d. Select Assessment Date

Figure 89 – Create assessment set-up window

4. Click Create

Enter Session Details The default tab of the Assessment dashboard is the Session Details. In the Session Details tab, fill out

information for

• Project Gate. The project gate is automatically filled based on user’s selection during creation of

the assessment

• Project Status.

• Assessment Date is automatically filled based on user’s selection during creation of the

assessment.

• Facilitator

Page 68: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 68

• Project Manager

Figure 90 – Session details

Enter Attendees Knowing who was in the PDRI session, and who was unable to attend, can provide insight into why a

project may have achieved a certain score, for example, if a key stakeholder or representative was not

able to attend the session, it may impact the overall score for their areas of expertise. It is best practice

to include in the Attendees list those who were not able to attend with “regrets”.

Add New Attendees

1. From the Attendees tab, click “Create Attendee” to start entering each participant. For each attendee, enter:

• Name (required)

• Organization – often front-end planning teams include team members from several organizations (e.g. owner, design contractor, consultant)

• Role – enter the attendee’s project role (not necessarily their job title at their organization)

• Contact

• Email

Figure 91 – Add an attendee

2. Click Save

Edit and Delete Attendees

If there are errors or modifications to an attendee’s information or if any an attendee needs to be

deleted:

Under at Attendees tab of an assessment that is being prepared, identify the attendee to be updated or deleted

• To edit, click the down arrow to the right of the attendee and select edit i. Update the Name, Organization, Role, Contact, and/or Email field and click save

Page 69: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 69

• To delete, click the down arrow to the right of the attendee and select delete i. Select OK to confirm deletion of attendee

Exclude Elements in the PDRI Assessment The ability to exclude project components is only available to organizations that have the Exclude

feature enabled by Valency. In addition to the ability to exclude project components at the template

level, facilitators can exclude elements for a specific assessment.

The facilitator can exclude elements that are known to be not applicable prior to the PDRI session if they

want to streamline the facilitation process with the project team. Any elements that are explicitly

excluded are not presented while in facilitation mode. To exclude an element, click on the grey round

button in the Exclude column on the right of the element as shown in figure 4.7a, and click Ok on the

pop-up window (figure 4.7b). The element will be greyed out and the Exclude symbol will turn blue as

shown for element A.1 in the figure 4.7c.

Figure 92 – Exclude an element in an assessment

Figure 93 – Exclude an element in an assessment

Figure 94 – Exclude an element in an assessment

Page 70: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 70

Facilitating a PDRI Session

Conducting the Assessment Workshop During facilitation of the PDRI there are three tasks that will be completed using Carve:

• Recording of comments during discussion of each element

• Recording of action items identified during discussion of each element or the project as a whole

• Scoring each element from 1-5 or 0 if the element is not applicable

Section View To begin, select either Basis of Project Decision, Basis of Design, or Execution Approach tab, of an assessment that is being prepared. Scoring will work the same way in all three sections. It is recommended to start with Basis of Project Decision followed by Basis of Design and then Execution Approach. Note: PDRI MATRS Industrial has a fourth tab called Accuracy.

Figure 95 – Assessment screen, facilitation tabs

Facilitation View Select the first element in the section by clicking the element’s hyperlinked name. (It is recommended to start with the first element). When clicking on the element name, the facilitation view will open.

Page 71: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 71

Figure 96 – Facilitation view

Capturing Comments

Record key comments captured from the project team’s discussion during the facilitated PDRI session

Figure 97 – Capturing comments

Capturing Action Items

1. Enter applicable action items by clicking the Action Items button

Page 72: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 72

Figure 98 - Capturing Action Items

Filling the following details for each action item before clicking the check mark. a. Description of the Action Item; it is important the action items be clear, concise and articulate

the deliverable required b. Assigned to – Name of specific individual who will take responsibility for completing the action

item. c. Status – to start, this will be in the status Open but as the project progresses, the status can

be updated to Cancelled or Closed (see Managing Action Items) d. Due Date - Expected completion date of action item. Recommended to have a specific date

for completion if possible. e. Click the blue check mark to save the action item f. Select “back” to return to the element or repeat steps to add additional action items for this

element.

Page 73: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 73

Figure 99 – Creating an action item – action item window

Scoring Elements

The definition levels can be seen by hovering over each number

Figure 100 – Scoring element from facilitation view

Upon selection of a score for an element, the element scoring window will advance to the next active

element that in the section (unless it is the last element). Any element marked as excluded is

automatically skipped.

Page 74: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 74

When all elements in the section are complete, or to exit facilitation mode, click on the Done button. Move on to the next section until all three PDRI sections are completed.

If it is a PDRI MATRS Industrial 5.0 session, there is a fourth section called Accuracy that needs to be

completed.

Definition Level Descriptions (PDRI MATRS Industrial 5.0)

In the past, achieving consistency across PDRI facilitators in how PDRI elements were scored was

challenging. To improve consistency in scoring, this template includes definition level descriptions that

clearly state each level’s associated criteria. Within Carve, this has been implemented as a new feature

in the “facilitation mode” for PDRI assessments.

Figure 101 – Facilitation view – opening definition level descriptions on PDRI MATRS template

Another window will open allowing the facilitator to compare definition levels to assist the project team

with arriving at a consensus.

Figure 102 – Definition level descriptions window on PDRI MATRS template

Clicking the x in the top right corner will close the detailed descriptions window.

Page 75: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 75

Post PDRI Workshop Review

Low Definition Elements After completing the PDRI session, it is possible to immediately review the Low Definition elements

(elements which scored highest and thereby potentially posing the greatest risk to the project).

1. Select the Low Definition Tab 2. Under the Level dropdown, select the definition level appropriate for the PDRI Stage.

Figure 103 – Low Definition Elements tab

Note: Count display –shows the number of elements included in the low definition list based on the

filter criteria. Only the filtered elements displayed on this list will be included in the final report.

1. To read more about each element, click on the element hyperlink and a description will be displayed 2. Action Items can be created from this screen by clicking the Create Action Item button in the top right

corner 3. Review the final score with the project team show in the Summary Tab

Figure 104 – Review final score

Action Items Action items are often created during the facilitated PDRI session or can be added afterward from within

the action items tab. See Managing Action Items for details on how to create, edit, delete, track the

status and export Action Items.

Summary Report Preparing the executive summary for a PDRI session is a key task that the facilitator will complete after

the PDRI session. To create the Executive Summary:

1. From within the assessment, click the Summary tab

a. To get to the assessment

i. Click on Projects at the top of the home menu to arrive at the Projects Dashboard

ii. Identify and click the Project for which a PDRI assessment is being prepared

iii. The selected project will expand to reveal an active PDRI assessment

iv. Click Prepare to the right of the selected assessment

Page 76: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 76

2. Select the Summary tab

3. Create or modify the executive summary by entering text in the main body of the page and use the

formatting tool bar as required for text formatting. The tool bar includes rich text word processing

tools providing facilitators the options of bulleted and numbered lists, indents, hyperlinks, and

headings.

Figure 105 – Create an executive summary

4. Click save button when the summary is complete or partially complete to ensure the system keeps a

copy of the entered information

Publish to Portfolio Once an assessment is complete, or imported, it can be published to a portfolio. Publishing an

assessment to a portfolio allows for comparison between similar projects and can help generate an

internal baseline. Note: all projects within a portfolio must use the same PDRI Template.

See Publish to Portfolio (Post) for more details.

Page 77: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 77

Facilitation - Construction Readiness

Assessment Methodology

Factors Each factor is assessed by a short statement to which the team will answer as (Yes), (No), or not

applicable (N/A) for the project. Each Readiness Factor is weighted based on importance and the

weights are used to calculate the overall Construction Readiness score.

Categories The factors are classified into 15 categories by which provides a comprehensive overview of all aspects

of the project before the start of construction. As such, the assessment of construction readiness is a

valuable project team alignment practice.

Categories are auto-numbered to reflect which categories are included by a user in a template. When

excluding a category, the others will remain in their original order, however their assigned number will

be adjusted to reflect exclusions made by the user. Factors belonging to the categories will also be auto-

numbered to reflect the category order. This auto-numbering is consistent across the platform, meaning

category numbers and ordering for the template will remain consistent in the assessment tab (including

facilitation mode), the readiness chart, the missing factors tab, the action items tab, the best practices

tab, and the summary tab (including the summary PDF report). (See section 5.6.3 for more detail)

The Construction Readiness Categories are:

• Project Team

• Engineering

• Planning

• Health/Safety/Security

• Execution

• Tools & Equipment

• Quality Management

• Change Management

• Contract Management

• Human Resource Management

• Stakeholders Management

• Risk Assessment & Management

• Procurement & Material Management

• Commissioning

• Project Control

• Company Specific (customizable)

Page 78: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 78

Readiness Score / Readiness Benchmarks A project’s Construction Readiness Score is a single unified metric that is expressed as a

percentage. It sums up the effect of all readiness factors together. The construction Readiness Score

provides a standardized measure of construction readiness that can be used to track progress of a

project over time, or to monitor and compare readiness of projects in a portfolio of projects. A

Construction Readiness score of

- Less than 75% is a clear indicator of a project that is not ready for construction

- A score of 75 – 85% is considered borderline, and

- A score of greater than 85% represents a construction-Ready project.

The Process The construction readiness assessment is a straight-forward process:

- A well-organized meeting will contribute towards achieving buy-in on this process. Ensuring the

proper stakeholders attend and providing supporting reasons as to why this process will benefit

them specifically is helpful in promoting participation. Ensure the meeting room and all related

logistics are organized well in advance and provide assessment material to participants ahead of

the meeting.

- The next step is to conduct the construction readiness assessment typically with the assistance of

a neutral facilitator and co-facilitator (or scribe). The assessment will provide a construction

readiness score indicating if the project is Ready, borderline, or “Not-Ready” for construction.

Also, the assessment provides the data to clearly identify the categories for improvement that

need more attention to improve overall construction readiness.

- The third step that ultimately drives the improvement in construction readiness is for the team to

focus on the low scoring categories and take action to complete the activities or deliverables

required. Each category is linked to guidelines on CII best practices that can be used by the team

to help drive actions and improvements.

- If the project is not ready for construction, or borderline, after sufficient time to take action, the

team should re-assess construction readiness, focusing on the missing factors. Through this

iterative process, the team will ensure they are construction-ready and avoid a premature start

of construction.

Preparing for a Construction Readiness Session It is recommended that the facilitator completed the following items prior to starting a facilitated PDRI

session:

1. Create a Project or Locate an Existing Project - make sure the project is ready in Carve.

2. Create a new assessment

3. Complete the Session Details and Attendees tabs on the Assessment dashboard

Locate or Create a Project Instructions for creating and locating a project can be found here:

• Creating a project

• Locating an existing project

Page 79: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 79

Create an Assessment If a new project is being created, the user will be prompted to create the assessment at the same time.

See Creating a project section.

If the project already exists,

1. Locate the project and click the project name

2. Click Create Assessment

Figure 106 – Create construction readiness assessment from existing project

3. A new pop-up will appear to create an assessment

a. Select Assessment Type (PDRI or CRA) – select CRA

b. Select Template

c. Select Project Gate

d. Select Assessment Date

Figure 107 – Create assessment window

4. Click Create

Enter Session Details The default tab of the Assessment dashboard is the Session Details. In the Session Details tab, fill out

information for

• Project Gate. The project gate is automatically filled based on user’s selection during

creation of the assessment

• Project Status.

Page 80: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 80

• Assessment Date is automatically filled based on user’s selection during creation of the

assessment.

• Facilitator

• Project Manager

Figure 108 – Enter CRA session details from assessment dashboard

Enter Attendees Knowing who was in the PDRI session, and who was unable to attend, can provide insight into why a

project may have achieved a certain score, for example, if a key stakeholder or representative was not

able to attend the session, it may impact the overall score for their areas of expertise. It is best practice

to include in the Attendees list those who were not able to attend with “regrets”.

Add New Attendees

3. From the Attendees tab, click “Create Attendee” to start entering each participant. For each attendee, enter:

• Name (required)

• Organization – often front-end planning teams include team members from several organizations (e.g. owner, design contractor, consultant)

• Role – enter the attendee’s project role (not necessarily their job title at their organization)

• Contact

• Email

Figure 109 – Add an attendee

4. Click Save

Page 81: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 81

Edit and Delete Attendees

If there are errors or modifications to an attendee’s information or if any an attendee needs to be

deleted:

Under at Attendees tab of an assessment that is being prepared, identify the attendee to be updated or deleted

• To edit, click the down arrow to the right of the attendee and select edit i. Update the Name, Organization, Role, Contact, and/or Email field and click save

• To delete, click the down arrow to the right of the attendee and select delete i. Select OK to confirm deletion of attendee

Facilitating a Construction Readiness Session

Conducting the Assessment Workshop During facilitation of the PDRI there are three tasks that will be completed using Carve:

• Recording of comments during discussion of each factor

• Recording of action items identified during discussion of each factor or the project as a whole

• Scoring each factor Yes, No or Not Applicable (NA) if the factor is not applicable

Assessment View The Assessment summary view includes

1. The ability to filter by

• All factors

• Unanswered factors

• No or unanswered factors

2. A gauge that tracks the overall score as the team progresses through the assessment

3. A summary of the categories in a grid view outlining

• The category

• Factors answered within the category

• Target score for the category

• Previous score (if there is more than one assessment for this project)

• Current score

• Status (colour representation of the score based on target score settings)

Page 82: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 82

Figure 110 – CRA Assessment dashboard

Category View When the facilitator clicks on a category, they will see a summary view of all of the factors within that

category including

1. The ability to filter the factors based on

• All factors

• Unanswered

• No or Unanswered

• Not applicable

2. Category score with corresponding colour indicator

3. Ability to create an action item

4. A grid view of

• The factor

• The factor score (Yes, No, NA)

• Comments

• Action items – a clickable link to view corresponding action items

Figure 111 – CRA Category view

Facilitation View By clicking on a factor, the facilitation view will open allowing the team to focus on one factor at a time.

Page 83: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 83

For factors that require more details or clarifications for consistent assessment, company-specific factor

descriptions may be added (see Manage Templates Section). Factor descriptions are displayed when

using the “facilitation mode” for a Construction Readiness Assessment.

Figure 112 – CRA facilitation view

Capturing Comments

Record key comments captured from the project team’s discussion during the facilitated CRA session

Figure 113 – CRA facilitation view, capture comments

Page 84: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 84

Capturing Action Items

2. Enter applicable action items by clicking the Action Items button

Figure 114 – CRA facilitation view, enter action items

Filling the following details for each action item before clicking the check mark. a. Description of the Action Item; it is important the action items be clear, concise and

articulate the deliverable required b. Assigned to – Name of specific individual who will take responsibility for completing the

action item. c. Status – to start, this will be in the status Open but as the project progresses, the status

can be updated to Cancelled or Closed (see Managing Action Items) d. Due Date - Expected completion date of action item. Recommended to have a specific

date for completion if possible. e. Click the blue check mark to save the action item f. Select “back” to return to the element or repeat steps to add additional action items for

this element.

Page 85: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 85

Figure 115 – Creating an action item

Scoring Factors

Upon selection of an answer for a factor, the factor scoring window will advance to the next active

factor that in the category (unless it is the last factor). Any factor that has been excluded is

automatically skipped.

When all factors in the category are complete, or to exit facilitation mode, click on the Done button. Move on to the next category until all three CRA sections are completed.

Figure 116 – Scoring factor from facilitation view

Page 86: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 86

Post Construction Readiness Workshop Review

Readiness Chart The Readiness Chart tab contains a chart depicting the assessment score (showing each category score).

Excluded categories will not be shown. The target score is outlined in green, while the current

assessment is outlined in blue.

Figure 117 – Readiness chart

Missing Factors The missing factors tab shows factors answered ‘No’. Users are able to filter which factors are shown by

using the drop-down menu at the top to select between four options: All Missing Factors, Fundamental

by Category, Readiness by Category, and Readiness by Importance. Users are also able to create Action

Items and add comments for Missing Factors in this tab.

Page 87: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 87

Figure 118 – Missing factors

Action Items Action items are often created during the facilitated PDRI session or can be added afterward from within

the action items tab. See Managing Action Items for details on how to create, edit, delete, track the

status and export Action Items.

Best Practices The Best Practices tab provides users with a list of relevant CII Knowledge Areas and Best Practices for

Low Scoring Categories to help improvement.

Summary Report The Summary Tab contains a section for users to provide an executive summary for this CRA session.

After completing an assessment, users can Print a PDF assessment report from this tab.

Figure 119 – Assessment summary

Page 88: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 88

The Assessment Summary Report contains the following:

- Assessment Details

- Executive Summary

- Overall Readiness Score Graph

- Category Breakdown (including individual category scores and status compared to CII benchmark

targets)

- Missing Factors (broken down by type – fundamental and readiness) and applicable factor

comments

- Open Action Items

- Best Practices (relating to the missing factors of the user’s assessment)

Carve for Continuous Improvement

Portfolio Analysis (PDRI) Stakeholders are able to compare individual projects against the organization’s portfolio. To access the

portfolio, simply click on the portfolio tab at the top of the screen. There are three tabs within the

portfolio for a PDRI template:

• Summary shows the average PDRI scores by stage for the projects within the portfolio.

Stakeholders can drill down into individual projects for more insight.

• Portfolio Distribution shows how individual projects rank against the rest of the portfolio, as well

as the industy benchmarks. This tab allows stakeholder to easily identify project outliers and

quickly drill down to investigate why they are outliers.

• Low Definition Elements allows stakeholders to identify the top 5 or top 10 low definition items

to identify areas for potneital continuous improvement.

Figure 120 - Screenshot of the Portfolio Summary tab

NOTE: Portfolio Dashboard varies by template type.

Page 89: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 89

Summary For organizations with a significant number of PDRIs completed, the ability to analyze PDRI scores by

stage, using a flexible set of criteria is ideal. In addition to analyzing average PDRI scores by portfolio,

more in-depth root cause analysis can be done by evaluating average PDRI scores by:

• Portfolio

• Date range (e.g. before and after a major process change was introduced)

• Project Manager

• Facilitator

• Client Name

• Client ID

• Project Name

• Project ID

• Project Type

• Project Location

Figure 121 – Adding search condition in Summary tab

The format of the Summary page has changed so that the first filter criteria that must be selected is the

PDRI template. Once the PDRI template is selected, average PDRI scores by stage can be calculated for

all, one or multiple selected portfolios that use the same PDRI template.

The Advanced Criteria function follows the same rules as described for the Project Dashboard.

Page 90: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 90

Project Distribution Like the Summary page, the first filter criteria that must be selected is the PDRI template. Once selected,

the project distribution graph may be generated for one or more portfolios, as well as any of these

advanced criteria:

• Portfolio

• Date range (e.g. before and after a major process change was introduced)

• Status

• Project Manager

• Facilitator

• Client Name

• Client ID

• Project Name

• Project ID

• Project Type

• Project Location

Figure 122 – Adding search condition in Project Distribution tab

Low Definition Elements (Low Scoring) Like the Summary page, the first filter criteria that must be selected is the PDRI template. Once selected,

the low definition graph may be generated for one or more portfolios, as well as any of these advanced

criteria:

• Portfolio

• Date range (e.g. before and after a major process change was introduced)

• Section (e.g. one or more of Section I, II and III)

• Category (e.g. one or more categories from the full category list)

• Element (e.g. one or more elements from the full element list)

• Status

Page 91: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 91

• Project Manager

• Facilitator

• Client Name

• Client ID

• Project Name

• Project ID

• Project Type

• Project Location

Figure 123 – Adding search condition in Low Definition Elements tab

An additional enhancement is the “All” option under Count. This can be used to generate:

• Average score of all elements in a template for a given criterion.

• Average score of all elements in a section or category, as shown in the example below for Section I.

Page 92: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 92

Figure 124 - Average score of all elements in a section I

Support Functionality The following sections explain the assumptions behind internal calculations that are done within Carve.

Normalization Calculations The assessment score generated from a PDRI session is used to communicate the level of scope

definition of any project. PDRI’s are scored out of 1000 and each element is given a score weighting.

During the PDRI research process, members of CII’s research team realized different elements within

PDRI represented different degrees of relative risk with respect to overall project success. Thus, it did

not make sense to give all elements equal weightings.

As part of the PDRI research initiative, PDRI elements were given different weightings based on

statistical analysis of data and extensive input from industry owners and contractors.

Page 93: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 93

To compare PDRI projects, as is done in Carve, it is important all projects are scored out of 1000. This

may not be the case in some instances where one, or some elements, are not applicable to a particular

project. If an element is not applicable to a project it is assigned a score of “0” (rather than 1 to 5).

Normalization of total scores become important when you are excluding elements (definition level =

0). When elements are excluded, the maximum score becomes less than 1,000. Small projects present

the most challenge as several elements or entire categories may be excluded. In this case, the

maximum score can be significantly less than 1,000. When this occurs, Carve will normalize the total

score by removing the weighted value of the element from the total. For example, if an element has a

weighting of 32 but is given a definition level = 0, the PDRI total will be measured out of 968 instead of

1,000. Through this method, Carve will provide a normalized score by taking the raw value of the

remaining element scores and dividing by 968.

In instances where all elements are applicable and assigned a definition level between 1 and 5, the

normalized score and the raw score will be the same.

To view a completed assessment’s raw and normalized scores:

1. Click on Projects at the top of the home menu to arrive at the Projects Dashboard 2. Identify and click the Project for which a PDRI assessment score will be reviewed 3. The selected project will expand to reveal the active PDRI assessments 4. Identify the PDRI assessment for which the raw and normalized score will be reviewed and click

prepare on the right 5. Click on the Summary tab 6. In the top right two scores will be displayed. The top number is the normalized score which has

removed element weightings with a score of 0. The second number is the raw score. NOTE: The normalized score will always be greater than or equal to the raw score

How Portfolio Scores are Calculated and Benchmarked Portfolios are created in Carve to group projects for analysis. A portfolio is a grouping of projects using

the same PDRI template, and these can be assessed by PDRI stage (-1, -2, -2i and -3). Portfolios are

assigned by the Admin or Facilitator. A portfolio of projects can be used to compare projects within the

portfolio or compare against CII benchmarks.

To add a project’s assessment score to the portfolio average score it must be assigned to the correct

portfolio and “published” to the portfolio; these functionalities is available to the facilitator or an admin.

To publish a completed assessment to a portfolio

1. Click on Projects from the top menu bar 2. Identify the project containing the assessment to publish and click on the project name 3. Confirm the project is associated with the correct portfolio

a. If not, follow the instructions outline in Section 2.4.2 and 2.4 to learn more about updating the project’s portfolio

4. Identify the project assessment, click on the down arrow on the right and select publish to portfolio

To remove a Published Assessment from a Portfolio

Page 94: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 94

1. Click on Projects from the top bar 2. Identify the project containing the assessment to publish and click on the project name 3. Identify the project assessment, click on the down arrow on the right and select exclude from

portfolio.

Figure 125 – Exclude an assessment from portfolio analysis

Metrics The Metrics tab provides the ability to capture key performance indicators related to overall project

success, such as

• Project Cost

• Schedule Duration

• Project Completion Date

• Change Order Value

• OSHA Recordable Incidents

• Contingency Amount

• Capacity Objectives

• Defects

This allows project teams to correlate their assessments scores with project performance metrics to

support continuous improvement efforts.

Filters / Advanced Search Users can use the advanced search and filter capability to locate the project in question

Figure 126 – Metrics tab, filtering projects

Page 95: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 95

Project Metrics The main window displays a summarized list of projects with key metrics data

Figure 127 – Metrics tab, project list view

Clicking on the project name expands the project view to display any metrics associated with the project

Figure 128 – Metrics tab, viewing project metrics

Add Metric To add a metric,

Locate the project and click on the project name to expand the project details

Page 96: Carve User Manual - Valency

© Valency Inc. 2021 Carve User Manual (Version 5.2) 96

Click Add Metric

Figure 129 – Add new metric

A new line will appear

1. Select a metric

2. Enter Planned Value

3. Enter Actual Value

4. Click Save

Figure 130 – Creating a metric