bim performance assessment - bim...

1 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016

BIM Performance Assessmenta n i n t r o d u c t i o n

presented by Bilal Succar | Emirates BIM User Group

hosted by the Canadian University of Dubai | Feb 15, 2016

bsuccar@bimexcellence.com

BIM Performance Assessment

Dr. Bilal SuccarDubai 2016

I. Introduction

II. Assessment Methods

c. how to Structure an Organisational Assessment

d. focus on the STAGED method

d1. understanding Capability Stages

d3. sample Template and Report

b. what is BIM Performance Assessment

e. focus on the CONTINUOUS method

e1. inventories of Competency Items and Model Uses

e2. sample Competency Assessment tools and charts

e3. sample Project Assessment based on Model Uses

III. Performance Improvement Lifecycle

IV. Summary and Good Bye

d2. understanding Maturity Levels

a. understanding BIM Wash

B u i l d i n g I n f o r m a t i o n M o d e l l i n g i s a s e t o f t e c h n o l o g i e s , p r o c e s s e s a n d p o l i c i e s e n a b l i n g

m u l t i p l e s t a k e h o l d e r s t o c o l l a b o r a t i v e l y d e s i g n , c o n s t r u c t a n d o p e r a t e a f a c i l i t y

l e t s ’ s ta r t w i t h a d e f i n i t i o n :

BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016

I. Introduction

Part I.a

understanding BIM Washand its levelshttp://bit.ly/BIMWash

0 . no BIM wash

1 . confusion

2 . inexperience

3 . exaggeration

4 . i l lus ion

d i f ferent l eve l s o f BI M Wa s h

LEVEL 1 confusion

LEVEL 2 inexperience

LEVEL 3 exaggeration

LEVEL 4 i l lusion

enough about

BIM Wash!

let’s focus on BIM performance

Part I.b

what is BIM performance?

and what are its benefits

BIM Performance is a generic term referring to a

large number of metrics . It covers the abilities and deliverables

expected from or realised by individuals, organisations, projects

and teams when using BIM tools and workflows

• Gain a clear picture of staff competency across the organisation or team

• Generate target competency profiles and identify competency gaps

• Identify training and professional development requirements

• Link training requirements to training material

• Match staff competency to roles and projects

• Clarify selection and recruitment criteria for new staff

the benefits of competency assessments

identifying the abilities of individuals (people):

• Establishing the organisation’s BIM adoption readiness

• Identifying which organisational systems are causing bottleneck and reducing productivity

• Discovering untapped potential that can be used on projects

• Identifying compliance gaps: standards that are not followed and protocols that need to be developed

the benefits of capability/maturity assessments

identifying the abilities of organisational systems allow:

Part I.c

how to structure an Organisational Assessment?

ORGANISATIONAL unit

TEAM of individuals

whole ENTERPRISE

the PROJECT itself

single INDIVIDUAL

the SUPPLY CHAIN

the whole MARKET

CAPABILITY MATURITY

CERTAINTY

COMPETENCY

READINESS

COMPATIBILITY COMPLIANCE

COMPETENCY COMPATIBILITY

MATURITY COMPLIANCECAPABILITY

MATURITY

RICHNESS VARIABILITY

whom/what to assess? what is being assessed?

ORGANISATIONAL unit

TEAM of individuals

whole ENTERPRISE

the PROJECT itself

single INDIVIDUAL

the SUPPLY CHAIN

the whole MARKET

CAPABILITY MATURITY

CERTAINTY

COMPETENCY

READINESS

COMPATIBILITY COMPLIANCE

COMPETENCY COMPATIBILITY

MATURITY COMPLIANCECAPABILITY

MATURITY

RICHNESS VARIABILITY

whom/what to assess? what is being assessed?

Assessment Pyramid (by Organisational Scale)

How to Structure the assessment:

Assessment Hierarchy (by Organisational Business Stream)

How to Structure the assessment:

conducted using static templates requires more elaborate tools

STAGED CONTINUOUS

assessments are conducted against a FIXED target:

either a performance or compliance milestone

assessments are conducted against a MOVING target: a

performance profile that continually evolves

there are two main ways for assessing performance

Part II.d

focus on the STAGED method

the STAGED method assesses against fixed targets – either:

STAGED

compliance milestones performance milestonese.g. UK’s BIM Level e.g. BIM Capability Stages

this session’s focus

the BIM performance milestones of organisations are composed of two complementary sets of metrics:

STAGED

BIM Capability Stages BIM Maturity Levelsnot to be confused with UK’s BIM Levels

Part II.d1

understanding BIM Capability Stages

What are BIM Capability Stages?

BIM Capabil ity Stages refer to the key performance milestones that can be achieved by organizations and teams as they

adopt BIM tools, workflows and protocols

p r e BIM

i n t e g r a t e d BIM

It is practically impossible to jump from pre-BIM (the status before BIM implementation) to full BIM capability in one step!

Frank Gehry

A number of intermediary stages separate ‘no BIM’ to ‘full BIM’.

object-based

modelling

network-based

integration

model-based

collaborationpre BIM post BIM

pre BIM

Frank Gehry

hand-drawing 2D cad

BIM StagesPre-BIM Status

Before the implementation of BIM, organizations are still dependent on manual and 2d CAD tools and processes.

Tools similar to AutoCAD® are prolifically used to generate scaled drawings and details.

(Succar, 2009)

no model interchanges

cad 2D and 3D from models

(Succar, 2009)

object-based

modelling

BIM Stage 1

These tools can generate five types of model based deliverables and are used to generate single-disciplinary models within either design, construction or operation –the three Project Lifecycle Phases.

BIM Stages

BIM capability is acquired through the successful implementation of an ‘object-based software tool’ similar to Revit®, Archicad® and Tekla®.

modelinterchanges

model-linking or federation

At Stage 2 players acquire the ability to collaborate with other disciplinary players. Collaboration occurs through an interchange (interoperable exchange) of models through ‘proprietary’ formats (e.g. RVT and NWD) and non-proprietary formats (e.g. IFC).

(Succar, 2009)

model-based

collaboration

BIM StagesBIM Stage 2

images: Autodesk

model-based

collaboration

At Stage 2 players acquire the ability to collaborate with other disciplinary players. Collaboration occurs through an interchange (interoperable exchange) of models through ‘proprietary’ formats (e.g. RVT and NWD) and non-proprietary formats (e.g. IFC).

However, at Stage 2, collaboration between different disciplines is file-based and one-to-one. This keeps stakeholders isolated in their silos with disjointed supply chain workflows.

network-based

integration

integrated models(not necessarily a single model)

At this capability stage, data-rich models are created, shared and maintained collaboratively across Project Lifecycle Phases. This integration can be achieved through ‘model servers’ (using proprietary, open or non-proprietary formats), Cloud Computing, or SaaS (Software as a Service).

BIM Stage 3 models are interdisciplinary models allowing complex analyses at early stages of virtual design and construction.

(Succar, 2009)

component and materials costs

integrated maintenance

systems

operations business logic

geographic information

systems (GIS)

services grid

building management

systems (BMS)

virtually integrated Design, Construction & Operation (viDCO)

BIM Stagespost BIM

BIM Stages videohttp://bit.ly/Video-Stages

15 mins | CC available

This model is also available inSpanish | French | Italian | …refer to BIMThinkSpace Ep13

BIM Capability Stages measure minimumability (availability).

to measure how good this capability is, another metric is applied.

Part II.d2

understanding BIM Maturity Levels

BIM Maturity is the gradual and continual improvement in qual ity, repeatabil ity and predictabil ity within avai lable BIM Capabil ity.

BIM Maturity is expressed as 5 Maturity Levels (or performance improvement milestones ) that organizations,

teams and whole markets aspire to.

BIM Maturity Index videohttp://bit.ly/Video-Maturity

9 mins | CC available

This model is also available inSpanish | French | Italian | …refer to BIMThinkSpace Ep13

combining BIM Readiness, BIM Capability, BIM Maturity into a single

Point of Adoption model

Point of Adoptionhttp://bit.ly/Video-PoA

16 mins video

Part II.d3

sample Template and Report

BIM Maturity Matrix (BIM3)

Download full English version: http://bit.ly/BIM3-English (PDF 578kb) Portuguese: http://bit.ly/BIM3-Portuguese (PDF 711kb)

single BUSINESS STREAM multiple STREAMSperformance results based on STAGED assessment

using top-level BIM Capability/Maturity setsaveraged BIM Performance across

business streams for the whole enterprise

BIM Maturity Charts

Part II.e

focus on the CONTINUOUS method

CONTINUOUSthe CONTINUOUS method assesses against evolving targets;

it follows three common sense steps:

the CONTINUOUS method assesses against evolving targets; it follows three common sense steps:

CONTINUOUS

Part II.e1

inventories of Competency Items and Model Uses

to establish targets and assess against them, the CONTINUOUS assessment method relies on the availability of:

CONTINUOUS

needed for assessing individuals, organisations and teams

needed for assessing projects and organisations

a Competency Items inventory a Model Uses inventorya large list of abilities a large list of expected project deliverables

a Model Uses inventory

13096 Facilitate model-based collaboration between a small team of structural engineers on a bridge project

13881 Maintain BIModels generated using standardized protocols

36721 Use models to conduct egress/ingress simulations

40056 Use models to monitor building performance and control its equipment

a Competency Items inventory

6010 Asset Maintenance6030 Asset Tracking6070 Space Management

CONTINUOUS

sample items sample items

refer to full inventory

4010 Accessibility Analysis4060 Constructability Analysis4070 Cost Estimation

7010 Building Automation7030 Performance Monitoring

these inventories are derived - using a published research framework – by analysing numerous international standards, protocols, job ads, and many other sources

CONTINUOUS

8 SETS

55 TOPICS

1000s of ITEMS

Component Development

Library Management

Standardization & Templates

Technical Training

System and Process Testing

Guides and Manuals

1000s of ITEMS

8 SETS

55 TOPICS

CollaborationFacilitation

Project ManagementTeam Management

Workflow Management

1000s of ITEMS

8 SETS

55 TOPICS

Leadership

Strategic Planning

Organizational Management

Business Development

Client Management

Partnership and Alliancing

1000s of ITEMS

8 SETS

55 TOPICS

Part II.e2

sample Competency Assessment tools and charts

BIMexcellence.com | β2 | Individual Discovery Module

sample inventory-driven online tool

the CONTINUOUS assessment method

Competency Indexf i ve levels

BIMexcellence.comβ2 | Organisational Discovery Module

another sample inventory-driven online tool

the CONTINUOUS assessment method

Competency Scores: single set of data with Average Score Curve

sample Competency Benchmarkthe CONTINUOUS assessment method

Competency Profile:the competencies of a single individual against the 55 topics

Collated Profile: the competencies of several individuals against the 55 topics

Competency Distr ibut ionF ILTERED BY LOCATION

B A S I C S K I L L S A D V A N C E D + E X P E R T

Competency Matrix Competency Web

sample Competency Chartsthe CONTINUOUS assessment method

distribution of competency topics against competency levels distribution of scores against competency topics

Candidate Scores compared to Target Profile100% denotes full al ignment

note: percentages are not absolute scores but reflect degree of alignment

with client’s pre-qualification requirements

sample Competency Comparison Tablethe CONTINUOUS assessment method

Part II.e3

sample Project Assessment based on Model Uses

refer to BIMThinkSpace Ep24

Model Uses as a Performance Metric

Clients/Employers can define their BIM project requirements by selecting Model Uses (expected outcomes from using BIM)

from the inventory

Wheel (A) represents all Model Uses selected by the client; each blue shape representing a single Model Use

Each Model Use can be prioritised and assigned their geometric/informationalrequirements as specific to each project

Requirements:

Wheel (B) provides a summary of the team’s competency for each Model Use selected by the client

Abilities

The project team can then be assessed against the selected Model Uses using a variety of metrics – example:

the 5-level Competency Index

Comparison:

requirementsa performance TARGET as defined by the client

abilities (capability/maturity)a team’ performance PROFILE as established through assessment

Also available in Italian

III. Performance Improvement Lifecyclebringing it all together though the

SIX repetitive phases that apply to both STAGED and CONTINUOUS assessment methods

Performance Improvement Wheel

define vision, assessment hierarchy, metrics and timelineperformed by all parties

SCOPE1

establish current abilitiesperformed by 2nd party

ASSESS

collate results, analyse findings and generate a detailed reportperformed by 2nd party

ANALYSE

identify gaps, generate targets and action plans

performed by all parties

implement, train,

standardise, purchase, develop, and track

by 1st or 3rd party

measure progress, test abilities, identify changes and achievements

performed by 2nd party

MEASURE 6

IV. Summary

I. Introduction

c. how to Structure an Organisational Assessment

d. focus on the STAGED method

d1. understanding Capability Stages

d3. sample Template and Report

b. what is BIM Performance Assessment

e. focus on the CONTINUOUS method

e1. inventories of Competency Items and Model Uses

e2. sample Competency Assessment tools and charts

e3. sample Project Assessment based on Model Uses

III. Performance Improvement Lifecycle

IV. Summary and Good Bye

d2. understanding Maturity Levels

a. understanding BIM Wash

THANK YOU

BIMexcellence.com online assessment platform

BIMThinkSpace.com knowledge-sharing blog

BIMDictionary.com 600+ terms and descriptions

BIMframework.info Research blog

bsuccar@bimexcellence.com

bim performance assessment - bim...

Documents

bim book 2016 - vinci construction grands...

succar v. ashcroft, 394 f.3d 8, 1st cir. (2005)

productivity benefits of bim - building...

the five components of bim performance measurement

bim performance assessment - changeagents.blogs.com ·...

bim + building performance analysis using revit 2014 … ·...

nibs conference 2013: bim quickscan benchmark of bim...

sustainable build ipd bim - green building congress€¦ ·...

green bim-based study on the green performance of

bim in bridge construction639692/fulltext… · ·...

bim performance...

, b. succar and n. dawood

bim software for land restitution, modeling and analysis•...

cadac bim congres 2015 autodesk bim 360 - cadac group · pdf...

bim and building performance optimization - bim …€¦ ·...

the five components of bim performance measurement...the...

the five components of bim performance...

empirical study of bim-based building life cycle: case of...

design process visualization system intergrating bim data...

bim-based building performance analysis: …...bim-based...