cim survey results 2013 - ucaiugcimug.ucaiug.org/meetings/melbourne2014/presentations/day...interpss...

This presentation, including any supporting materials, is owned by Gartner, Inc. and/or its affiliates and is for the sole use of the intended Gartner audience or other authorized recipients. This presentation may contain information that is confidential, proprietary or otherwise legally protected, and it may not be further copied, distributed or publicly displayed without the express written permission of Gartner, Inc. or its affiliates.© 2010 Gartner, Inc. and/or its affiliates. All rights reserved.

CIM Survey Results 2013

218 respondents completed an online survey in August/September 2013 about their organizations use of CIM standards. To qualify, respondents had to be knowledgeable about their organizations use and planned use of CIM standards, and be in either an electric utilities company, a university/R&D organization or a technology provider, systems integrator or consultant to electric utilities clients.

Agenda

• Demographics• Utility Responses• Tech Firm Responses• CIMUG website feedback• 2010 v 2013 comparison

1

Demographics

2

Sample Structure – Organization Type

3

83

65

23

3116

Number of respondents

Electric UtilityTechnology ProviderSystems IntegratorConsultantUniversity/R&D

N=218

Base: All

Sample Structure – Regions

4

52%

32%

42%

36%

27%

43%

44%

17%

34%

23%

13%

28%

0% 20% 40% 60%

North America

Latin America

Western Europe

Central/Eastern Europe

Middle East/Africa

Asia/Pacific

Regions covered by organization

Regions served by respondent

N=218

Base: All

Which of the following geographic regions does your organization cover and which do you personally serve in your current role?

% of respondents

Utility Responses

5

Utilities - Type

6

34%

19%

28%

5%

1%

1%

12%

0% 20% 40%

State/Municipal/Public Utility

Distribution System Operator

Transmission Owner/Operator

Independent System Operator

Generation Plant Owner/Operator

Electricity Cooperative

Other

N=83

Base: All utilities companies

Which of the following best describes your utility organization?

% of respondents

Utilities – Number of Customers

7

4%

4%

22%

64%

4%

0% 20% 40% 60% 80%

Less than 50,000 customers

50,000 to 199,999 customers

200,000 to 799,999 customers

800,000 customers or more

Don't know

N=45

Base: All utilities companies that have end customers

Which of the following best describes the total number of customers your utility serves?

% of respondents

Utilities – CIM Involvement - 1

8

N=83For each of the following, please state whether your organization has...

% of respondents

28%

24%

12%

11%

20%

12%

23%

11%

17%

20%

23%

16%

14%

19%

18%

11%

10%

11%

7%

11%

14%

13%

10%

10%

29%

23%

34%

31%

36%

36%

30%

30%

0% 50% 100%

Exchanging power system models

Defining message payloads for system integration project

Basis of design for an enterprise data warehouse or operational data store

Basis for definition of enterprise semantic model for management of business objects/terms

Improving data sharing across the organization

Combining CIM with other reference models and standards

Support for ESB frameworks and web services integration

A model-driven application integration process

CIM in Operation CIM in development Funded plans for CIM Evaluation of CIM Standards


Utilities – CIM Involvement - 2

9


% of respondents

23%

16%

13%

10%

4%

16%

10%

8%

2%

6%

14%

13%

11%

13%

7%

12%

2%

7%

1%

2%

5%

8%

7%

5%

4%

5%

6%

10%

1%

2%

31%

24%

25%

27%

28%

31%

18%

25%

18%

18%

0% 20% 40% 60% 80%

Network/Grid Operation

Outage Management

Records and Asset Management

Operational Planning and Optimization

Maintenance and Construction

Network Planning and Analysis

Customer Support

Meter Reading and Demand Response

Generation Plant

Other Business Functions

CIM in Operation CIM in development Funded plans for CIM Evaluation of CIM Standards


Utilities – CIM Applications Affected

10


Mean number of applications affected

2.66

2.06

1.86

1.57

2.14

1.65

2.00

2.50

1.67

1.83

0.00 1.00 2.00 3.00


Outage Management





Customer Support


Generation Plant


Base: All utilities companies (excludes none/NA/DK)

Utilities – CIM Priorities

11

N=83Please rank in order of importance the top three business benefits sought from successful CIM implementations in your organization.

% of respondents

30%

30%

20%

11%

8%

27%

31%

22%

18%

22%

19%

29%

14%

7%

0% 50% 100%

Cost Reduction on Integration

SOA Deployment, Need for Semantic Consistency

Governance on Internal Interfaces (Company Internal Policy Decision)

Governance on External Interfaces (Regulatory or Market Requirement)

Other

1st2nd3rd


Utilities – Number of CIM Interfaces

12

10%

45%

14%

6%

5%

6%

14%

0% 20% 40% 60%

None

1 to 9 interfaces

10 to 19 interfaces

20 to 29 interfaces

30 to 49 interfaces

50 interfaces or more

Don't know

N=83


Please estimate the number of individual interfaces based on CIM in your organization?

% of respondents

Utilities – CIM Experience

13

N=83For the following people within your organization, how would you describe their typical expertise and experience with CIM?

% of respondents

4%

13%

5%

24%

13%

5%

10%

30%

24%

40%

39%

51%

52%

37%

55%

24%

34%

0% 50% 100%

C-Level Executives

Line of Business Management

Engineers/Technicians/Operations

IT Management

Enterprise/Application Architects

IT Analysts/Developers

Expert Novice Has Awareness


Utilities – Migrating to New CIM Versions

14

57%

13%

16%

14%

0% 20% 40% 60% 80%

We have not migrated to newer versions of CIM

We have migrated some interfaces to newer releases of

CIM

We have an ongoing process to stay current with CIM releases

Other

N=63

Base: All utilities companies with at least one CIM interface

Which of the following best describes how your organization migrates to progressive CIM versions?

% of respondents

Utilities – Model-driven App integration

15

55%

71%

37%

59%

41%

14%

0% 20% 40% 60% 80%

CIM tutorial material

CIM Users Groups website

Software vendor assistance

Consultant assistance

CIM Users Group conferences

Other

N=51

Base: All utilities companies evaluating, funding, developing or already operating model-driven application integration using CIM

Which of the following has your organization used to progress with model-driven application integration?

% of respondents

Multiple Responses

Allowed

Utilities – Vendor Tools

16

58%43%

16%11%

8%7%6%

5%1%1%1%

29%

0% 20% 40% 60% 80%

Sparx Enterprise ArchitectCIMTool

CIMSpy/CIMDeskCIMEA

IBM Rational RoseMD3i

CIMphonyCIMContextor

CIMvianjCleanCIM

InterPSS OpenCIMOther

N=83Which of the following vendor tools are currently used to implement CIM in your organization?

% of respondents

Multiple Responses

Allowed


Utilities – Use of Integrators/Consultants

17

52%31%

17%

% of respondents

YesNoDon't know

N=83


Did your organization use consultants or integrators to help it implement CIM?

Tech Firm Responses

18

Technology Firms – CIM Areas Supported

19

58%

42%

38%

34%

40%

43%

48%

31%

52%

57%

43%

39%

43%

48%

57%

43%

35%

26%

35%

35%

45%

32%

39%

26%

44%

31%

19%

25%

38%

31%

38%

38%

0% 20% 40% 60% 80%







Support for Enterprise Service Bus (ESB) frameworks


Technology Provider (N=65) Systems Integrator (N=23) Consultant (N=31) University/R&D (N=16)

N=135For each of the following, please state whether your organization is currently supporting utility clients with CIM.

% of respondents

Multiple Responses

Allowed

Base: All technology providers, systems integrators, consultants and universities.

Technology Firms – CIM Involvement - 1

20

N=135For each of the following, please state whether your organization currently supports or plans to support utility clients with CIM.

% of respondents

50%

39%

36%

34%

41%

40%

46%

33%

29%

43%

36%

39%

43%

39%

39%

41%

0% 50% 100%







Support for Enterprise Service Bus (ESB) frameworks


Currently Supports Plans to Support


Technology Firms – CIM Involvement - 2

21


% of respondents

30%

19%

12%

11%

4%

17%

10%

17%

3%

2%

13%

8%

12%

9%

7%

9%

4%

10%

4%

3%

21%

16%

14%

19%

10%

14%

11%

20%

11%

10%

20%

25%

23%

28%

24%

27%

19%

24%

22%

19%

0% 50% 100%


Outage Management





Customer Support


Generation Plant


CIM in Operation CIM available to clients CIM in development CIM planned


Technology Firms – ESB Frameworks - 1

22

For those functional areas where CIM is in operation, please indicate the number of utility clients where your CIM-based offering is operational.

N=135


4.823.57

4.214.394.52

4.795.11

4.634.05

4.28

0.00 2.00 4.00 6.00


Outage Management





Customer Support


Generation Plant


Mean number of clients operational (excludes None and DK)


23

Which type of interface is most commonly used, for the frameworks your organization supports?

% of respondents

35%

20%

15%

19%

7%

5%

11%

17%

21%

8%

7%

2%

7%

9%

4%

4%

16%

8%

9%

2%

3%

1%

1%

1%

1%

1%

2%

1%

3%

2%

0% 20% 40% 60%

IBM WebSphere

Microsoft BizTalk

Oracle BEA Systems AquaLogic Service Bus

Oracle Fusion (including WebLogic)

Progress Software SonicESB

Progress Software SonicMQ

Red Hat JBoss

SAP

Tibco

webMethods (Software AG)

Web services Java Other

N=135



24

Which of the following Enterprise Service Bus (ESB) frameworks does your organization support or plan to support with its CIM-based messaging?

% of respondents

11%

2%

4%

4%

1%

1%

6%

6%

13%

3%

7%

4%

2%

4%

2%

2%

4%

3%

5%

2%

8%

5%

6%

7%

1%

1%

1%

6%

4%

3%

16%

15%

13%

14%

8%

7%

17%

13%

12%

7%

0% 20% 40% 60%

IBM WebSphere

Microsoft BizTalk

Oracle BEA Systems AquaLogic Service Bus

Oracle Fusion (including WebLogic)

Progress Software SonicESB

Progress Software SonicMQ

Red Hat JBoss

SAP

Tibco

webMethods (Software AG)

CIM in Operation CIM available to clients CIM in development CIM planned

N=135


Technology Firms – CIM Interfaces

25

21%

37%

15%

6%

1%

7%

13%

0% 10% 20% 30% 40%

None

1 to 9 interfaces

10 to 19 interfaces

20 to 29 interfaces

30 to 49 interfaces

50 interfaces or more

Don't know

Please estimate the number of individual interfaces based on CIM that your organization has implemented for others, or which are supported with your products?

% of respondents

N=135


Compare to slide 9

Technology Firms – CIM Migration

26

N=89Which of the following best describes how your organization migrates to progressive CIM versions?

% of respondents

40%

43%

39%

50%

18%

29%

33%

25%

38%

21%

22%

25%

4%

7%

6%

0% 20% 40% 60% 80% 100%

Technology Provider (N=45)

Systems Integrator (N=24)

Consultant (N=18)

University/R&D (N=12)

We have an ongoing process to stay current with CIM releasesWe have migrated some interfaces to newer releases of CIMWe have not migrated to newer versions of CIMOther

Base: All technology providers, systems integrators consultants or universities that has implemented at least one CIM interface.

Technology Firms – Versions Supported

27

16%

12%

16%

29%

44%

48%

20%

0% 20% 40% 60%

V10 or earlier (March 2006 or prior)

V11 (October 2006)

V12 (May 2007)

V13 (June 2008)

V14 (April 2010)

V15 (October 2012)

Other (V16+)

Which versions of CIM does your organization support?

% of respondents

Multiple Responses

Allowed

N=135


Technology Firms – CIM Experts

28

How many CIM full-time equivalent "experts" are employed by your organization to support its utility clients?

% of respondents

19%

22%

19%

25%

48%

30%

52%

63%

22%

22%

7%

6%

3%

13%

3%

4%

10%

6%

9%

13%

6%

0% 20% 40% 60% 80% 100%

Technology Provider (N=65)

Systems Integrator (N=23)

Consultant (N=31)

University/R&D (N=16)

None 1 to 4 experts 5 to 9 experts10 to 19 experts 20 or more experts Don't know

N=135


Extending CIM to New Areas

29

36%

22%

69%

55%

49%

60%

43%

48%

83%

55%

45%

77%

63%

56%

88%

0% 50% 100%

Gas Networks

Water Networks

Electricity Generation (Thermal, Hydro, Nuclear)

Utility (N=85) Technology Provider (N=65) Systems Integrator (N=23)Consultant (N=31) University/R&D (N=16)

N=218For each of the following please state whether or not you personally would like CIM standards to be extended to these areas.

% of respondents

Multiple Responses

Allowed

Base: All

Harmonizing CIM with Other Standards

30

22%

78%

34%

29%

68%

46%

39%

61%

35%

16%

74%

39%

38%

94%

19%

0% 20% 40% 60% 80% 100%

COSEM

IEC 61850

Multispeak

Utility (N=85) Technology Provider (N=65) Systems Integrator (N=23)Consultant (N=31) University/R&D (N=16)

In your opinion, what other standards should be further harmonized with CIM?

% of respondents

Multiple Responses

Allowed

N=218

Base: All

CIMUG – Website Evaluation

31

CIMug Satisfaction - All

32

4.944.85

4.784.75

4.644.594.57

4.444.42

4.304.27

4.174.144.13

3.5 4 4.5 5 5.5

User login and account maintenanceMeeting sites

CIM documentsWorking group sites

Project sitesOverall site usability/navigation

Tutorial informationSite search

“What's new”Email/forums/messaging with other users

FAQsShared calendars

BlogsHelp desk

N=170How satisfied are you with the following aspects of the CIM Users Group website (www.cimug.org)? 78% of respondents were CIMug website users.

Mean (1=completely dissatisfied, 7=completely satisfied)

Base: All CIMug Users

CIMug Satisfaction - Utilities

33

5.134.944.92

4.694.68

4.584.58

4.414.394.37

4.334.30

4.253.94

3.5 4 4.5 5 5.5

User login and account maintenanceTutorial information

CIM documentsWorking group sites

Overall site usability/navigationProject sites

Meeting sites“What's new”

Site searchHelp desk

FAQsEmail/forums/messaging with other users

Blogs

N=65How satisfied are you with the following aspects of the CIM Users Group website (www.cimug.org)? 78% of utilities respondents were CIMug website users.


Base: All utilities using CIMug Website

Shared calendars

CIMug Satisfaction – Tech Providers

34

5.035.00

4.744.66

4.614.59

4.404.39

4.284.27

3.923.90

3.863.77

3.5 4 4.5 5 5.5

User login and account maintenanceMeeting sites

Working group sitesProject sites

Overall site usability/navigationCIM documents

“What's new”Site search

Tutorial informationEmail/forums/messaging with other CIM users

N=50How satisfied are you with the following aspects of the CIM Users Group website (www.cimug.org)? 77% of technology providers were CIMug website users.


Base: All technology providers using CIMug Website

Shared calendarsFAQsBlogsHelp desk

CIMug Satisfaction – Systems Integrators

35

4.804.77

4.624.31

4.274.254.24

4.174.14

4.084.004.00

3.913.67

3.5 4 4.5 5 5.5

Overall site usability/navigationEmail/forums/messaging

User login and account maintenanceHelp desk

Tutorial informationSite search

Shared calendarsWorking group sites

FAQsProject sites

CIM documentsMeeting sites

N=18How satisfied are you with the following aspects of the CIM Users Group website (www.cimug.org)? 78% of Systems Integrators were CIMug website users.


Base: All systems integrators using CIMug Website

“What’s new”Blogs

CIMug Satisfaction – Consultants

36

5.305.145.13

5.055.00

4.834.79

4.714.70

4.594.53

4.424.38

4.35

3.5 4 4.5 5 5.5

Meeting sitesWorking group sites

CIM documentsUser login and account maintenance

Project sites“What's new”

Shared calendarsFAQs

Site searchOverall site usability/navigation

Tutorial informationEmail/forums/messaging with other CIM users

Help deskBlogs

N=24How satisfied are you with the following aspects of the CIM Users Group website (www.cimug.org)? 77% of Consultants were CIMug website users.


Base: All consultants using CIMug Website

CIMug Satisfaction – Universities/R&D

37

5.004.89

4.864.80

4.704.62

4.504.45

4.424.25

4.224.20

4.174.11

3.5 4 4.5 5 5.5

Project sitesShared calendars

FAQsCIM documents

Site searchBlogs

Help deskOverall site usability/navigation

Tutorial informationUser login and account maintenance

Email/forums/messaging with other CIM usersWorking group sites

Meeting sites“What's new”

N=13How satisfied are you with the following aspects of the CIM Users Group website (www.cimug.org)? 81% of Universities/R&D were CIMug website users.


Base: All universities/R&D using CIMug Website

CIMug Priorities

38

5.75

5.68

5.51

5.50

5.43

5.36

5.26

4 5 6 7

Model management and version release processes

Education, networking and support for CIM users

Tools development and support

Interoperability testing and certification

Communication across CIMug, IEC 61850, IEC TC57 WGs, etc.

Research projects to extend CIM and coordinate with other standards

Utility CIM project stories

N=218How important are the following CIM Users Group strategic priorities to you personally in your role?

Mean (1=not at all important, 7=extremely important)

Base: All


2010 vs 2013

Utilities – CIM In Operation 2010 vs 2013

40

N=83

For each of the following, please state whether your organization has in operation...

% of respondents

20%

20%

4%

8%

8%

12%

8%

28%

24%

12%

11%

20%

12%

23%

11%

0% 10% 20% 30%









2010

2013


N=49

Utilities – CIM In Develop’t 2010 vs 2013

41

N=83

For each of the following, please state whether your organization has in development or operation.

% of respondents

33%

43%

16%

16%

22%

27%

20%

20%

45%

45%

35%

27%

35%

31%

41%

22%

0% 20% 40% 60%









2010

2013


N=49

Vendors – CIM In Operation 2010 vs 2013

42

N=135

For each of the following, please state whether your organization has in operation...

% of respondents

21%

10%

13%

5%

13%

11%

15%

1%

6%

30%

12%

11%

4%

17%

10%

17%

3%

2%

0% 20% 40%






Customer Support


Generation Plant


2010

2013

N=95

Base: All technology providers, systems integrators, consultants and universities (2013 only).

Vendors – CIM Available 2010 vs 2013

43

N=135

For each of the following, please state whether your organization has in available to clients or already in operation...

% of respondents

34%

25%

23%

16%

25%

19%

24%

7%

12%

44%

24%

20%

12%

26%

14%

27%

7%

5%

0% 20% 40% 60%






Customer Support


Generation Plant


2010

2013

N=95

Base: All technology providers, systems integrators, consultants and universities (2013 only).

Technology Firms – CIM Experts

44

How many CIM full-time equivalent "experts" are employed by your organization to support its utility clients?

Mean (based on mid-points of ranges)

4.10

6.08

7.73

4.36

6.04

5.34

0.00 2.00 4.00 6.00 8.00 10.00

Technology Provider

Systems Integrator

Consultant

2010

2013

Base: All technology providers, systems integrators and consultants

N=45

N=19

N=31

N=65

N=31

N=23


CIM Survey Results 2013

Project Manager: Michael Dornan, [email protected]

cim survey results 2013 - ucaiugcimug.ucaiug.org/meetings/melbourne2014/presentations/day...interpss...

Documents