bim performance assessment - bim...

1 BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016

BIM Performance Assessmenta n i n t r o d u c t i o n

presented by Bilal Succar | Emirates BIM User Group

hosted by the Canadian University of Dubai | Feb 15, 2016

[email protected]

2

BIM Performance Assessment

Dr. Bilal SuccarDubai 2016

I. Introduction

II. Assessment Methods

c. how to Structure an Organisational Assessment

d. focus on the STAGED method

d1. understanding Capability Stages

d3. sample Template and Report

b. what is BIM Performance Assessment

e. focus on the CONTINUOUS method

e1. inventories of Competency Items and Model Uses

e2. sample Competency Assessment tools and charts

e3. sample Project Assessment based on Model Uses

III. Performance Improvement Lifecycle

IV. Summary and Good Bye

d2. understanding Maturity Levels

a. understanding BIM Wash

3

B u i l d i n g I n f o r m a t i o n M o d e l l i n g i s a s e t o f t e c h n o l o g i e s , p r o c e s s e s a n d p o l i c i e s e n a b l i n g

m u l t i p l e s t a k e h o l d e r s t o c o l l a b o r a t i v e l y d e s i g n , c o n s t r u c t a n d o p e r a t e a f a c i l i t y

l e t s ’ s ta r t w i t h a d e f i n i t i o n :

4

BIM Performance Assessment | Dr. Bilal Succar | Emirates BIM User Group | Dubai 2016

I. Introduction

5


Part I.a

understanding BIM Washand its levelshttp://bit.ly/BIMWash

http://bit.ly/BIMWash

6



0 . no BIM wash

1 . confusion

2 . inexperience

3 . exaggeration

4 . i l lus ion

d i f ferent l eve l s o f BI M Wa s h

7



LEVEL 1 confusion

8



LEVEL 2 inexperience

9

LEVEL 3 exaggeration

10



LEVEL 4 i l lusion

11

enough about

BIM Wash!

let’s focus on BIM performance

12


Part I.b

what is BIM performance?

and what are its benefits

13


BIM Performance is a generic term referring to a

large number of metrics . It covers the abilities and deliverables

expected from or realised by individuals, organisations, projects

and teams when using BIM tools and workflows

14



• Gain a clear picture of staff competency across the organisation or team

• Generate target competency profiles and identify competency gaps

• Identify training and professional development requirements

• Link training requirements to training material

• Match staff competency to roles and projects

• Clarify selection and recruitment criteria for new staff

the benefits of competency assessments

identifying the abilities of individuals (people):

15



• Establishing the organisation’s BIM adoption readiness

• Identifying which organisational systems are causing bottleneck and reducing productivity

• Discovering untapped potential that can be used on projects

• Identifying compliance gaps: standards that are not followed and protocols that need to be developed

the benefits of capability/maturity assessments

identifying the abilities of organisational systems allow:

16


Part I.c

how to structure an Organisational Assessment?

17



ORGANISATIONAL unit

TEAM of individuals

whole ENTERPRISE

the PROJECT itself

single INDIVIDUAL

the SUPPLY CHAIN

the whole MARKET

CAPABILITY MATURITY

CERTAINTY

COMPETENCY

READINESS

COMPATIBILITY COMPLIANCE

COMPETENCY COMPATIBILITY

MATURITY COMPLIANCECAPABILITY

MATURITY

RICHNESS VARIABILITY

whom/what to assess? what is being assessed?

18



ORGANISATIONAL unit

TEAM of individuals

whole ENTERPRISE

the PROJECT itself

single INDIVIDUAL

the SUPPLY CHAIN

the whole MARKET

CAPABILITY MATURITY

CERTAINTY

COMPETENCY

READINESS

COMPATIBILITY COMPLIANCE

COMPETENCY COMPATIBILITY

MATURITY COMPLIANCECAPABILITY

MATURITY

RICHNESS VARIABILITY

whom/what to assess? what is being assessed?

19


Assessment Pyramid (by Organisational Scale)

How to Structure the assessment:

20



Assessment Hierarchy (by Organisational Business Stream)

How to Structure the assessment:

21



22

conducted using static templates requires more elaborate tools

STAGED CONTINUOUS

assessments are conducted against a FIXED target:

either a performance or compliance milestone

assessments are conducted against a MOVING target: a

performance profile that continually evolves

there are two main ways for assessing performance

23


Part II.d

focus on the STAGED method

24



the STAGED method assesses against fixed targets – either:

STAGED

compliance milestones performance milestonese.g. UK’s BIM Level e.g. BIM Capability Stages

this session’s focus

25



the BIM performance milestones of organisations are composed of two complementary sets of metrics:

STAGED

BIM Capability Stages BIM Maturity Levelsnot to be confused with UK’s BIM Levels

26


Part II.d1

understanding BIM Capability Stages

27

What are BIM Capability Stages?

BIM Capabil ity Stages refer to the key performance milestones that can be achieved by organizations and teams as they

adopt BIM tools, workflows and protocols


p r e BIM

i n t e g r a t e d BIM

It is practically impossible to jump from pre-BIM (the status before BIM implementation) to full BIM capability in one step!

Frank Gehry

A number of intermediary stages separate ‘no BIM’ to ‘full BIM’.

29

1 2 3

object-based

modelling

network-based

integration

model-based

collaborationpre BIM post BIM

30



pre BIM

Frank Gehry

hand-drawing 2D cad

BIM StagesPre-BIM Status

Before the implementation of BIM, organizations are still dependent on manual and 2d CAD tools and processes.

Tools similar to AutoCAD® are prolifically used to generate scaled drawings and details.

(Succar, 2009)

31



no model interchanges

cad 2D and 3D from models

(Succar, 2009)

object-based

modelling

BIM Stage 1

These tools can generate five types of model based deliverables and are used to generate single-disciplinary models within either design, construction or operation –the three Project Lifecycle Phases.

BIM Stages

BIM capability is acquired through the successful implementation of an ‘object-based software tool’ similar to Revit®, Archicad® and Tekla®.

32



modelinterchanges

model-linking or federation

At Stage 2 players acquire the ability to collaborate with other disciplinary players. Collaboration occurs through an interchange (interoperable exchange) of models through ‘proprietary’ formats (e.g. RVT and NWD) and non-proprietary formats (e.g. IFC).

(Succar, 2009)

model-based

collaboration

BIM StagesBIM Stage 2

33



images: Autodesk

arc

hit

ect

eng

inee

r

ow

ner

cont

ract

or

model-based

collaboration

At Stage 2 players acquire the ability to collaborate with other disciplinary players. Collaboration occurs through an interchange (interoperable exchange) of models through ‘proprietary’ formats (e.g. RVT and NWD) and non-proprietary formats (e.g. IFC).

However, at Stage 2, collaboration between different disciplines is file-based and one-to-one. This keeps stakeholders isolated in their silos with disjointed supply chain workflows.


34



network-based

integration

integrated models(not necessarily a single model)

At this capability stage, data-rich models are created, shared and maintained collaboratively across Project Lifecycle Phases. This integration can be achieved through ‘model servers’ (using proprietary, open or non-proprietary formats), Cloud Computing, or SaaS (Software as a Service).

BIM Stage 3 models are interdisciplinary models allowing complex analyses at early stages of virtual design and construction.


(Succar, 2009)

35



component and materials costs

integrated maintenance

systems

operations business logic

geographic information

systems (GIS)

services grid

building management

systems (BMS)

virtually integrated Design, Construction & Operation (viDCO)

BIM Stagespost BIM

36

BIM Stages videohttp://bit.ly/Video-Stages

15 mins | CC available

This model is also available inSpanish | French | Italian | …refer to BIMThinkSpace Ep13

http://bit.ly/Video-Stages



http://www.bimthinkspace.com/2009/12/episode-13-the-bim-maturity-index.html

37


BIM Capability Stages measure minimumability (availability).

to measure how good this capability is, another metric is applied.

38


Part II.d2

understanding BIM Maturity Levels

39

BIM Maturity is the gradual and continual improvement in qual ity, repeatabil ity and predictabil ity within avai lable BIM Capabil ity.

BIM Maturity is expressed as 5 Maturity Levels (or performance improvement milestones ) that organizations,

teams and whole markets aspire to.

41

BIM Maturity Index videohttp://bit.ly/Video-Maturity

9 mins | CC available

This model is also available inSpanish | French | Italian | …refer to BIMThinkSpace Ep13

http://bit.ly/Video-Maturity



http://www.bimthinkspace.com/2009/12/episode-13-the-bim-maturity-index.html

42

combining BIM Readiness, BIM Capability, BIM Maturity into a single

Point of Adoption model

43



44



45



46



Point of Adoptionhttp://bit.ly/Video-PoA

16 mins video

http://bit.ly/Video-PoA



47



48



49



50



51



52



53



54




16 mins video




55




16 mins video




56


Part II.d3

sample Template and Report


BIM Maturity Matrix (BIM3)

Download full English version: http://bit.ly/BIM3-English (PDF 578kb) Portuguese: http://bit.ly/BIM3-Portuguese (PDF 711kb)

http://bit.ly/BIM3-English

http://bit.ly/BIM3-Portuguese


single BUSINESS STREAM multiple STREAMSperformance results based on STAGED assessment

using top-level BIM Capability/Maturity setsaveraged BIM Performance across

business streams for the whole enterprise

BIM Maturity Charts

59


Part II.e

focus on the CONTINUOUS method

60


CONTINUOUSthe CONTINUOUS method assesses against evolving targets;

it follows three common sense steps:

61


the CONTINUOUS method assesses against evolving targets; it follows three common sense steps:

CONTINUOUS

62


Part II.e1

inventories of Competency Items and Model Uses

63


to establish targets and assess against them, the CONTINUOUS assessment method relies on the availability of:

CONTINUOUS

needed for assessing individuals, organisations and teams

needed for assessing projects and organisations

a Competency Items inventory a Model Uses inventorya large list of abilities a large list of expected project deliverables

64


a Model Uses inventory

13096 Facilitate model-based collaboration between a small team of structural engineers on a bridge project

13881 Maintain BIModels generated using standardized protocols

36721 Use models to conduct egress/ingress simulations

40056 Use models to monitor building performance and control its equipment

a Competency Items inventory

6010 Asset Maintenance6030 Asset Tracking6070 Space Management

CONTINUOUS

sample items sample items

refer to full inventory

4010 Accessibility Analysis4060 Constructability Analysis4070 Cost Estimation

7010 Building Automation7030 Performance Monitoring

http://bimexcellence.com/dictionary/Asset-Maintenance

http://bimexcellence.com/dictionary/asset-tracking

http://bimexcellence.com/dictionary/space-management

http://bimexcellence.com/model-uses/

http://bimexcellence.com/dictionary/Accessibility-Analysis

http://bimexcellence.com/dictionary/Constructability-Analysis

http://bimexcellence.com/dictionary/Cost-Estimation

http://bimexcellence.com/dictionary/Building-Automation

http://bimexcellence.com/dictionary/performance-monitoring

65


these inventories are derived - using a published research framework – by analysing numerous international standards, protocols, job ads, and many other sources

CONTINUOUS

66



8 SETS

55 TOPICS

1000s of ITEMS

67



Component Development

Library Management

Standardization & Templates

Technical Training

System and Process Testing

Guides and Manuals

1000s of ITEMS

8 SETS

55 TOPICS

68



CollaborationFacilitation

Project ManagementTeam Management

Workflow Management

1000s of ITEMS

8 SETS

55 TOPICS

69



Leadership

Strategic Planning

Organizational Management

Business Development

Client Management

Partnership and Alliancing

1000s of ITEMS

8 SETS

55 TOPICS

70


Part II.e2

sample Competency Assessment tools and charts

71



BIMexcellence.com | β2 | Individual Discovery Module

sample inventory-driven online tool

the CONTINUOUS assessment method

72

Competency Indexf i ve levels

73



BIMexcellence.comβ2 | Organisational Discovery Module

another sample inventory-driven online tool

the CONTINUOUS assessment method

74



Competency Scores: single set of data with Average Score Curve

sample Competency Benchmarkthe CONTINUOUS assessment method

75



Competency Profile:the competencies of a single individual against the 55 topics

76



Collated Profile: the competencies of several individuals against the 55 topics

77

Competency Distr ibut ionF ILTERED BY LOCATION

B A S I C S K I L L S A D V A N C E D + E X P E R T


Competency Matrix Competency Web

sample Competency Chartsthe CONTINUOUS assessment method

distribution of competency topics against competency levels distribution of scores against competency topics


Candidate Scores compared to Target Profile100% denotes full al ignment

note: percentages are not absolute scores but reflect degree of alignment

with client’s pre-qualification requirements

sample Competency Comparison Tablethe CONTINUOUS assessment method

80


Part II.e3

sample Project Assessment based on Model Uses


refer to BIMThinkSpace Ep24

http://bit.ly/BIMepisode24http:/www.bimthinkspace.com/2009/12/episode-13-the-bim-maturity-index.html

84



Model Uses as a Performance Metric

Clients/Employers can define their BIM project requirements by selecting Model Uses (expected outcomes from using BIM)

from the inventory

Wheel (A) represents all Model Uses selected by the client; each blue shape representing a single Model Use

Each Model Use can be prioritised and assigned their geometric/informationalrequirements as specific to each project

Requirements:

85




Wheel (B) provides a summary of the team’s competency for each Model Use selected by the client

Abilities

The project team can then be assessed against the selected Model Uses using a variety of metrics – example:

the 5-level Competency Index


Comparison:

requirementsa performance TARGET as defined by the client


abilities (capability/maturity)a team’ performance PROFILE as established through assessment

VS

Also available in Italian

http://www.ibimi.it/lezione-24-3-comprendere-gli-usi-del-modello-applicazioni-pratiche/

87


III. Performance Improvement Lifecyclebringing it all together though the

SIX repetitive phases that apply to both STAGED and CONTINUOUS assessment methods

88



Performance Improvement Wheel

89



define vision, assessment hierarchy, metrics and timelineperformed by all parties

SCOPE1

90



establish current abilitiesperformed by 2nd party

ASSESS

2

91



collate results, analyse findings and generate a detailed reportperformed by 2nd party

ANALYSE

3

92



identify gaps, generate targets and action plans

performed by all parties

PLAN

4

93



implement, train,

standardise, purchase, develop, and track

by 1st or 3rd party

ACT

5

94



measure progress, test abilities, identify changes and achievements

performed by 2nd party

MEASURE 6

95


IV. Summary

96



I. Introduction


c. how to Structure an Organisational Assessment

d. focus on the STAGED method

d1. understanding Capability Stages

d3. sample Template and Report

b. what is BIM Performance Assessment

e. focus on the CONTINUOUS method

e1. inventories of Competency Items and Model Uses

e2. sample Competency Assessment tools and charts

e3. sample Project Assessment based on Model Uses

III. Performance Improvement Lifecycle

IV. Summary and Good Bye

d2. understanding Maturity Levels

a. understanding BIM Wash


THANK YOU

BIMexcellence.com online assessment platform

BIMThinkSpace.com knowledge-sharing blog

BIMDictionary.com 600+ terms and descriptions

BIMframework.info Research blog

[email protected]

http://bimexcellence.com/

http://www.bimthinkspace.com.au/

http://www.bimthinkspace.com.au/

http://www.bimframework.info/

bim performance assessment - bim...

Documents