global harmonization of datacenter energy efficiency metrics

All Rights Reserved, Copyright © GIPC 2012

Global Harmonization ofDatacenter Energy Efficiency Metrics

Takeshi Ueoro (NTT Data Corp.)

October, 2012

1All Rights Reserved, Copyright © GIPC 2012

１. The Need for Energy Efficiency Metrics

2. Efforts for Metrics Development in Japan

3. Harmonizing Global Metrics forData Center Energy Efficiency

Table of Contents


１. The Need for Energy Efficiency Metrics


1.1 Forecast of Energy Consumption by Data Centers (Global)

Source）Based on Green IT Promotion Council FY2009 Report

2005 2025 2050

7,186

29,810

3,1552,0061,425

9,192

32,965

Energy C

onsumption (100 m

illion Kw

h/year)

During technological revolution

Baseline


PUE Total data center power consumption

Power consumed by IT equipment（Power Usage Effectiveness）Existing metric ＝

However, ＰUE is a metric that measures the facility efficiency of the data center.

There is a need for a metric that can evaluate the data center itself!

PUE is already being utilized by many companies.

1.2 Existing Evaluation Metrics


2. Efforts for Metrics Development in Japan


2.1 Policies of Metrics Development

■A data center energy efficiency metric（1）Can easily compute the energy efficiency of a data center（2）Can make side-by-side comparisons between data centers （3）Can continue to make energy conservation condition

comparisons throughout the year

■Incorporate principal factors that improve data center energy efficiency

（1）Operation efficiency （2）IT equipment efficiency （3）Facility efficiency （4）Green energy utility


2.2 Concept of the New DPPE Metric

Data Center

Air-conditioners, power supply devices, power generators, lighting

ElectricityGasFuelCold water

Exhaust heat

Input energy Output

Photovoltaic energyWind energy

Energy

GREEN energy

Facility

ＩＴ

equipment

Servers, storage, network devices

WorkOperations, virtualization, power conserving operations

WorkInput energy (excl. renewable energy)

ＤＰＰＥ＝

ＤＰＰＥ

（Datacenter Performance Per Energy）This metric is the data center workload per CO2-emitting energy

Operation

Note) DC : Data Center


DPPE =

IT equipment work rate

IT equipment work capacity

DC energy

IT equipmentenergy

DC energy

DCenergy

IT equipmentenergy

DC Work

DC energy – Green energy

=

=

DC energy – Green energy

IT equipment work rate

IT equipment work Capacity

Greenenergy

－

① ② ③ ④

If data center workload (“DC Work”) is defined as IT equipment work rate × IT equipment work capacity, DPPE can be broken down to 4 factors below.

2.3 Breakdown of DPPE to 4 factors

2.5 Definition of DPPE and its 4 Sub-metrics


IT Equipment Utilization (ITEU)

IT Equipment Energy Efficiency(ITEE)

Power Usage Effectiveness

Green Energy Coefficient

(PUE)

(GEC)

Sub-metric Name Basic Definition Corresponding action

=• Effective operation of IT equipment

(IT equipment rated capacity)(Rated Energy Consumption of IT equipment)

=• Installation of energy efficient IT equipment

DC Total Energy Consumption

(Energy Consumption of IT Equipment) =• Energy saving in facility

=Green energy


• Use of GreenEnergy

DPPE＝ITEU×ITEE×（1／PUE）×（1／（1－GEC））

IT energy measured

IT energy max


IT Equipment Utilization (ITEU)

Measuring ITEU

RangeITEU＝0～1（MAX）

Total energy consumption of IT equipment [kWh]Total rated energy consumption of IT equipment [kWh]

ITEU =

2.8 Definition of ITEU

・Ratio of the total rated power of IT equipment written on their specification sheet to the actual measured power of IT equipment is used.

・The trend of the entire data center can be obtained although the ratio of the actual energy consumption to rated energy varies for each equipment.

・Though it is currently difficult for many data centers, it is desirable to measure it by monitoring servers, NW equipment and storage usage.


GIPC and JDCC compiled detailed PUE measurement guidelines and took measurements in Japan.

As the discussion over the definition of PUE is ongoing, these measurements were conducted by adding a definition of non-electric energy to the conventional PUE (site energy).

Consider all the energy related to the data centerMeasure the energy consumption of IT equipment at PDU output.When accumulated power (kWh) is not measurable, the effect of power

factor be considered.

2.9 Summary of PUE Measurement


(Energy Consumption of IT Equipment) PUE＝


ITEE: IT Equipment Energy Efficiency

Measuring ITEE・ITEE is given by dividing the IT equipment capacity by its energy consumption・How is IT equipment capacity calculated?Multiplication of the energy efficiency of the IT equipment (capacity/rated

power) by rated power・Sum of server capacity, storage capacity, network equipment capacity:

Adjusted by coefficients since the units differ for each capacity■Range

ITEE ＝

0 ～

∞

(server capacity) +

(storage capacity) +

(NW equipment capacity)

Total rated power [W] of IT equipment (servers, storage, NW equipment)ITEE =

= 7.72 [W / GTOPS]

= 0.0933 [W / Gbyte]

= 7.14 [W / Gbps]

2.10 Definition of ITEE

Server capacity

Energy consumption efficiency

Storage capacity


NW equipment capacity


13

2.11 Reference Computation of Capacity Used Through ITEEThe capacity of equipment used under ITEE engages the energy consumption efficiency outlined in Japan’s Law Regarding the Rationalization of Energy Use. Multiply the rated power by the reciprocal of energy consumption efficiency, and set the result as the substitute for capacity.

(Server capacity) +

(Storage capacity) + (ＮＷ

equipment capacity)ITEE =

Note: See http://www.eccj.or.jp/top_runner/index.html#eng for more detailed definitions of Energy Consumption Efficiency

(W1 + W2) / 2

Q

W1: Idle time Power consumption [W]W2: Power saving mode consumption [W]Q: Combined Theoretical Performance

(See next page for details of CTP)

Power consumption [W]

Storage capacity [GB]

WTransmission speed [Gbps]

W: Power Consumption at the Maximum Data Transmission Speed achieved [W]


Capacity = Rated power [W]

Energy Consumption Efficiency [W/MTOPS]


Energy Consumption Efficiency [W/GB]


Energy Consumption Efficiency [W/Gbps]

Total rated power of IT equipment [W]

http://www.eccj.or.jp/top_runner/index.html#eng


Measuring GEC

Green energy generated and consumed at data center [kWh]Data center’s total consumed energy [kWh]

GEC =

Green Energy Coefficient (GEC)

2.12 Definition of GEC

・Measure the energy generated on site using renewable energy

-Scope of green energy and how to treat energy generated on site/off site-How to treat green energy certificates

・To be defined in detail in the guideline

■Range

GEC ＝０～ 1（MAX）


2.6 Datacenter Energy Flow and Boundary of Metrics

Power Plant

Solar. Wind. etc

Local GreenPower

Grid PowerData Center Environment

Air conditioner.

Power Supply.

Lightings etc.

Hardware

ITEEPUE ITEUGEC

Data Center

Efficiency of Energy Procurement Efficiency of FacilityEfficiency ofHardware

Efficiency of Software and Operation

Software

and

Operation

IT Equipment

DPPE

Ｇａｓ, Ｆｕｅｌｓ

Ｏｔｈｅｒ

Ｅｎｅｒｇｙ


By the separate application of DPPE’s 4 sub metrics for each line of responsibilities, the entire effort for the Energy Efficiency of the Data Center could be divided into 4 different responsibilities.

Entire Data Center Efficiency must be doubled!

So, we need to double the DPPE number.

CIO

We need to make

ITEE 40% better

We need to make ITEU 20% better

We need to make

PUE 20% better

We need to make

GEC x 1.1

CIO CIO CIO CIO

Operations Purchasing Facility Dept. Facility Dept.

We could buy Equipments

with 40% improvements.

We could improve

operations by ……..

We could improve AC efficiency by

xx %

We could use xx KW

of PV

1. CIO determines total goal of DPPE

2. CIO decides goals of sub-metrics and tells them to managers

3. Managers determine plans to achieve each goal.

1.2 x 1.4 x 1.2 x 1.1=2.2 > 2

2.7 Useful use of the DPPE explained

＊ the mean value of ITEE in 2005 is assumed. ＊＊ the mean value of ITEE in 2010 (CAGR of 45 % is assumed.)

Assumed range of sub metrics for 2010

ITEU

ITEE

PUE

GEC

Worst Best

0.2 0.7

1.00* 6.41**

2.5 1.2

0 0.3

Estimated range of DPPE in 2010

0.08 5.34-

0.2×1.00×1/2.5×1/(1-0)

0.7×6.41×1/1.2×1/(1-0.3)

Worst Best


Estimated potential range of DPPE in 2010 is consistent with the observation.

2.13 The estimated range of DPPE and sub-metrics

2.14 Example of a Monitoring System Utilizing the DPPEA Japanese company is trying to develop a data center monitoring system based on the holistic approach.

Values of the metrics are shown in a spider chart.

ITEE

GEC

PUE

ITEU

DPPE

All Rights Reserved, Copyright © GIPC 2012 18

Note: This trial system currently shows instantaneous values.


データセンタ A B C D E F ベトナムシンガポール

ITEU 0.57 0.26 0.42 0.36 0.42 0.31 0.4 0.74

ITEE 2.14 1.08 0.48 3.68 1.32 1.41 0.84 3.59

PUE 1.89 1.42 1.76 2.12 1.82 1.71 1.77 2.2

GEC 0 0 0 0.004 0 0 0 0

DPPE 0.64 0.2 0.11 0.63 0.31 0.26 0.18 1.2

Measured values as of September 2010

2.14 Summary of DPPE Measurement

Data Center

Vietnam Singapore

20

３. Harmonizing Global Metrics forData Center Energy Efficiency


【Goal】Share global lessons and practices with an objective of arriving at a set of metrics, indices, and measurement protocols that can be formally endorsed or adopted by each participant organization to improve data center energy efficiency globally.

3.1 The “Global Harmonization” Task Force


A task force (composed of public and private sector representatives from Japan, US and Europe) was founded to discuss the global harmonization of data center energy efficiency metrics.

1st Workshop Continuous Discussion

• F2F workshop (twice a year)• Bi-weekly Tele-conference

Goal of Harmonization:• A set of metrics, indices and

measurement protocols to improve data center energy efficiency globally

Date and Venue:• March 26, 2009, Washington DCMembers• The Green Grid• U.S Department of Energy• U.S Environmental Protection Agency• European Commission Joint Research

Center （Data Centers Code of Conduct）• Japan’s Ministry of Economy Trade and

Industry• Japan’s Green IT Promotion Council

3.2 Progress of the Global Harmonization Task Force


TGG, U.S., EU and Japanese entities (both from private and public sectors) continuously held bi-annual “Face to Face” workshops and biweekly teleconferences.

2009 2010 2011 2012

F2F

Workshop

Tele-conference

1st

WS(March, Washington DC)

2nd

WS(Feb, San Jose)

3rd

WS(Oct, Milan)

4th

WS(Feb., Tokyo)

5th

WS(Oct, Washington DC)

6th

WS(Feb, Milan)

Introduction by Each Economy’s Participants

Definition of Desired Outcomes

Proposal of DPPE Metrics Calculation

PUE, GEC

Productivity Proxies

ITEE, ITEU (Introduction of the guideline and the trial measurement)

PUE Measurement,

DPPE Feedback (From TGG, EU, DOE, EPA)

Carbon metric

IT productivity metric including ITEE x ITEU

Carbon metric

Holistic Approach

Biweekly teleconference

Desired Outcome

PUEGEC, CUE, ERF

7th

WS(Oct, Tokyo)

2nd Workshop on Feb. 2010: Desired Outcomes


At Feb. 2010 Face to Face Workshop meeting, Desired Outcomes were agreed and defined to achieve the determination of Total Data Center Energy Efficiency.

Source: “Harmonizing Global Metrics for Data Center Energy Efficiency”(http://www.greenit-pc.jp/topics/release/pdf/dppe_j_20100416.pdf, http://www.greenit-pc.jp/topics/release/pdf/dppe_j_20110228.pdf)

Green Energy

Infra- structure

Ope- ration

Target

Hardware

4th Workshop on Feb 2011: PUE Measurement Protocol


At Feb. 2010 Face to Face Workshop meeting, the detailed measurement method of PUE was defined with a standardization in mind.

DesiredOutcomes

(1a)

(1b)

(2)

Holistic Framework

Metrics/Proxies Status

DefinitionCalculationMethodology

CalculationExample

Document/Agreement

PUE

Discussed

GEC/CUE/ERF etc. Discussed Discussed

DiscussedGIPC’sITEE & ITEU,TGG’ s Proxy #1 - #8

Discussed Discussed

Agreed Agreed Agreed Completed

-

Reached Agreements on PUE


“Measurement Guideline” of PUE, recommended Electrical Measurement points, and considerations for non-Standalone Data Center co-located within a large building complex site were discussed and agreed.

For Facility Energy usage determination, PUE was recommended.

IT Energy Measurement Points at PDU were strongly recommended.

Consideration for non-

Electrical Energy usage and measurements were thought.

Source: “Harmonizing Global Metrics for Data Center Energy Efficiency” (http://www.greenit-pc.jp/topics/release/pdf/dppe_j_20110228.pdf)

Reached Agreements on PUE


PUE＝Measurement of the total energy of the data center

the IT energy consumption

Type of energy

Weighting Factor*

Electricity 1.0Natural gas 0.35Fuel (oil) 0.35Fuel (other) 0.35Cold water 0.40Warm water 0.40Steam 0.40

Total energy is calculated by multiplying the weighting factor of each type of energy.

UPS PDUElectricity

1,100,000ｋＷｈ

Cold water

1,600,000ｋＷｈ

IT energy 1,000,000ｋＷｈ

Data Center

Cold water

1,600,000ｋＷｈ

Example of PUE computation in the case that cold water is used for air-conditioners.

PUE = (1,100,000*1+1,600,000*0.4) / (1,000,000*1)PUE = 1.58

6th Workshop on Feb. 2012: GEC/CUE/ERF


At Feb. 2012 Face to Face Workshop meeting, “GEC”, “CUE”, “ERF” and holistic framework were discussed.

DesiredOutcomes

(1a)

(1b)

(2)

Holistic Framework

Metrics/Proxies Status

DefinitionCalculationMethodology

CalculationExample

Document/Agreement

PUE

Agreed

GEC/CUE/ERF

Agreed Agreed

DiscussedGIPC’sITEE, ITEUTGG’s Proxy #4 - #6

Discussed Discussed

-

Agreed Completed

Agreed Agreed Agreed Completed

Completed

Metrics for Carbon Reductions


For the Desired Outcome 2 – “GEC”, “CUE” and “ERF” metrics were defined.

In order to promote and accredit the usage of Renewable Energy

GEC

Determine and performance measure the CO2 output from the Data Center

CUE

In order to promote the reuse/renew the wasted heat source from the Data Center.

ERF

Purpose

Ratio comparison of the Green Energy Source out of the Total Energy Consumption of a Data Center. Determined by the Green Energy Certificate ownership.

Ratio Comparison of the IT equipment Energy usages with a Data Center’s Total CO2 outputs.

Ratio between Total Data Center Energy Wastes vs. Reused/Renewed Wasted Energy by recovery.Unnecessary extended Waste Heat Output must be avoided. (PUE may go worsened)

Details

GEC CUE ERFBasic

Definition= = =Green energy consumed by the data center

Total energy consumed by the data center Reuse energy outside of the data center Total energy consumed by the data centerCEF x PUE

Where: CEF is the Carbon Dioxide Emission Factor (kgCO2eq/kWh) of the site.

Green EnergyCoefficient

Carbon Usage Effectiveness

Energy ReuseFactor

Reached Agreements on GEC


GEC＝Green energy consumed by the data center

total energy consumed by the data center

Regio n

Regional Authority / Issuer(s)

Link

E.U. Association of Issuing Bodies

Department of Energy and

Climate Change

http://www.aib- net.org/portal/page/portal/AIB_HOME/EECS/ Fact sheets（See Fact sheet 4）

http://www.decc.gov.uk/en/content/cms/meeti ng_energy/renewable_ener/renew_obs/eligibili ty/eligibility.aspx

Japan The Green Energy Certification Center

http://eneken.ieej.or.jp/greenpower/eng/index. htm

U.S.A U.S. EPA Green Power Partnership Green-e

http://www.epa.gov/greenpower

http://www.green-e.org/

Each country’s websites for information on green energy certificates.

Power Station Grid Powerdistribution

Utility meter

DC Purchased Green Energy Certificates for 20% of energy used.

100GWｈ

GEC＝20/100＝0.2

Certificate20GWh

Example: If 20GWh of renewable energy is purchased through green energy certificates or generated on site.

http://www.aib-net.org/portal/page/portal/AIB_HOME/EECS/Fact




http://www.decc.gov.uk/en/content/cms/meeting_energy/renewable_ener/renew_obs/eligibility/eligibility.aspx



http://eneken.ieej.or.jp/greenpower/eng/index.htm

http://eneken.ieej.or.jp/greenpower/eng/index.htm

http://www.epa.gov/greenpower

http://www.green-e.org/

Reached Agreements on CUE


CUE＝Total CO2 emissions caused by the total data center energy

Total IT equipment energy

（1）If electricity is the only energy source for the data center

CUE is calculated as CEF × PUE＊CUE value of each country/region is used.

CEF is the Carbon Emission Factor (kgCO2eq/kWh) of the site. PUE is the annual PUE for the data center.

（2）If energy source(s) other than electricity is used CO2 emissions are calculated for each type of energy.CUE＝CO2 emissions of a data center／Energy

consumed by IT equipment

・Excludes purchased green energy and carbon offsets.（Purchase rights are not allowed to be deducted for zero emission buildings)

Reached Agreements on ERF


ERF＝Reuse energy outside of the data center Total energy consumed by the data center

・Does not include reuse of waste energy generated within the data center. (It will be reflected in the PUE.)・ERF includes not only waste heat but also reuse of electricity and cold water.

Holistic Framework



7th Workshop on Oct. 2012: Outcome 1.a

・IT Productivity・Maturity Model for IT Productivity・DC Productivity Proxy Approach・Others

The taskforce discussed subjects Outcome(1) and (1.a), the final issues for the group to discuss, on Oct. 2 and 3.

Metric for Desired Outcome 1a (IT Productivity)


Current 9 Productivity Proxy proposals, including most recent “ITEE x ITEU” proxy, 4 Proxies are current finalists on the discussion at the Task Force.

# Type of Proxy (Proposal)

Evaluation

Accuracy Ease of Use

Both Points

1 Useful Work Self-Assessment and Reporting + - +

2 DCeP Subset by Productivity Link + - +

3 DCeP Subset by Sample Workload + - +

4 Bits Per Kilowatt-Hour + ++ +++

5 Weighted CPU Utilization –

SPECint_rate + + ++

6 Weighted CPU Utilization -

SPECpower + + ++

7 Compute Units Per Second Trend Curve - + +

8 Operations System Workload Efficiency - + +

9 IT Capacity x IT Utilization (ITEE x ITEU) + ++ +++

TGG

GIPC

Proposal


Conclusion

The global harmonization taskforce was initiated in 2009 and it has released many statements since then.It is currently continuing discussions seeking to reach an agreement by 2013.

We hope that the metrics and measurement standards to be established by the task force will be widely utilized and contribute to the improvement of energy efficiency in data centers throughout the world.


Thank you

http://www.greenit-pc.jp/activity/dppe/index.htmlGIPC- “Green IT Promotion Council” of Japan

Contact: Takeshi UeoroE-mail: [email protected]

global harmonization of datacenter energy efficiency metrics

Documents