performance evaluation and benchmarking using dea joe zhu department of management worcester...

24
Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 [email protected] www.deafrontier.com

Upload: andres-deveraux

Post on 14-Dec-2015

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Performance Evaluation and Benchmarking Using DEA

Joe ZhuDepartment of ManagementWorcester Polytechnic InstituteWorcester, MA [email protected]

Page 2: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

2

Outline

• What is DEA?• New Models/Uses

• Two-Stage Model• Context-dependent DEA• Benchmarking

• Books

Page 3: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 3

DEA & Banking

The Banking industry has been the subject of DEA analysis by researchers in various areas and probably is the most heavily studied business Branches Banks across countries

Bank Branch

InputsFTE in dollarsPremise/IT expensesOther Expenses

OutputsLoan BalancesDeposit BalancesSecurities BalancesGross Revenue

Bank Branch

InputsFTE in dollarsPremise/IT expensesOther Expenses

OutputsLoan BalancesDeposit BalancesSecurities BalancesGross Revenue

Source: Paradi et al. 2004

Page 4: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 4

DEA

Deals with multiple performance measures (inputs and outputs) in a single integrated model Includes any necessary measures related to the

characterization of banking performanceIdentifies a “base-line” for comparisons in

continuous improvement programProvides specific targets for improvement

(over time)

Page 5: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 5

- Regression can accommodateMultiple inputs oroutputs but not both

- Regression requires afunctional relationshipbetween in/outputs

- Regression provides onlyaverage relationshipsnot best practice

Why DEA?DEA Best-Practice Frontier

Input

Output

predicted average behavior

Page 6: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 6

Basic DEA Benchmarking Information

DEA gives Efficiency rating, or score, for each DMU Efficiency reference set: peer group Target for the inefficient DMU Information on how much inputs can be

decreased or outputs increased to make the unit efficient – improving productivity & performance

Page 7: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 7

DEA & Performance ImprovementDEA Best-Practice Frontier

Input

Output

Input reduction

D

Output augmentation

D

D

Page 8: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 8

Benefits

The establishment of the efficient frontier consisting of the best performing DMUs

A projection to the efficient frontier - a guide to “what to do” for the DMU managers

The identification of the peer group, a reasonable argument why it is a FAIR comparison

An indication of how important a particular DMU is as a role model

Page 9: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 9

How DEA works?

5 branches Three (B1, B2 & B3 are efficient – best practice frontier) B4 and B5 are inefficient Target for B4 is T1 (decrease inputs)

B4

B5

B1

B2

B3

T1

0

50

100

150

200

250

300

350

400

450

0 20 40 60

Teller Hours

Su

pp

ly D

oll

ars

Page 10: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 10

H4

H5

H1

H2

H3

T2

0

50

100

150

200

250

300

350

400

450

0 100 200 300 400 500

Sales

Ma

rke

t S

ha

re

5 branches Three (H1, H2 & H3 are efficient – best practice frontier) H4 and H5 are inefficient Target for B4 is T2 (increase outputs)

How DEA works?

Page 11: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu 11

More Information on DEA Web

www.deafrontier.com …

Books Cooper, W.W., Lawrence M. Seiford, and K. Tone. 2000. Data

Envelopment Analysis: A Comprehensive Reference Text with Models, Applications, References, and DEA-Solver Software. Kluwer Academic Publishers, Boston

Zhu, J. 2002. Quantitative Models for Performance Evaluation and Benchmarking: Data Envelopment Analysis with Spreadsheets. Kluwer Academic Publishers, Boston

… Softwares

DEA Excel Solver (DEAFrontier) …

Page 12: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

12

DEA & ITDEA & IT• Indirect impact of IT on productivity• Two Stage DEA Model• Chen, Y. and Zhu, J., Measuring information technology’s indirect

impact on firm performance, Information Technology & Management Journal, Vol. 5, Issue 1-2 (2004), 9-22.

Page 13: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe ZhuData Envelopment Analysis Joe Zhu 1313

What isWhat is Benchmarking?Benchmarking?

... a process of defining valid ... a process of defining valid measures of performance measures of performance comparison among peer units, comparison among peer units, using them to determine the using them to determine the relative positions of the peer relative positions of the peer units and, ultimately, units and, ultimately, establishing a standard of establishing a standard of excellence.excellence.

Page 14: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe ZhuData Envelopment Analysis Joe Zhu 1414

Acceptance System Decision Acceptance System Decision RuleRule

Trout Trout et al.et al. (1996, COR, Vol 23, 405-408) (1996, COR, Vol 23, 405-408)– acceptance/rejection of credit risksacceptance/rejection of credit risks

Seiford & Zhu (1998, COR, Vol. 25, 329-332)Seiford & Zhu (1998, COR, Vol. 25, 329-332)

Benchmarking

Page 15: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe ZhuData Envelopment Analysis Joe Zhu 1515

ApproachDEA Best-Practice Frontier/Benchmarks

Input

Output

new activities

Page 16: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe ZhuData Envelopment Analysis Joe Zhu 1616

Business Process Re-engineering

traditional best practice

performance

time

• Compare new bank branches to the traditional best-practice frontier.

Page 17: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe ZhuData Envelopment Analysis Joe Zhu 1717

Benchmarking results

Overall, new branches’ performance is improving

New branch best-practice

traditional branch best-practice

Cook, W.D., Seiford, L.M. and Zhu, Joe, Models for performance benchmarking: Measuring the effect of e-commerce activities on banking performance, OMEGA, Vol.32, Issue 4 (2004), 313-322.

Page 18: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

18

Context-dependent DEAContext-dependent DEA• Context-dependent

DEA• Consumer’s choice

is influenced by the context

• The performance of DMUs should also reflect “context”

Page 19: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

19

Journal of Marketing Journal of Marketing ResearchResearch

• Book Review– context-

dependent DEA (identifying possible moderating results) intriguing and, conceivably, breathtaking.

Page 20: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

20

Service ProductivityService Productivity

• D. Sherman and J. Zhu, D. Sherman and J. Zhu, Service Productivity Service Productivity Management: Improving Management: Improving Service Performance Using Service Performance Using Data Envelopment Analysis Data Envelopment Analysis (DEA) Springer, Boston, (DEA) Springer, Boston, 2006, ISBN 0-387-33211-1.2006, ISBN 0-387-33211-1.

Page 21: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

21

DEA HandbookDEA HandbookW.W. Cooper, L.M. Seiford and J. Zhu Handbook on Data Envelopment Analysis, Springer, Boston, 2004, ISBN 1-4020-7797-1

Page 22: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

22

Modeling Issues W.D. Cook and Joe

Zhu, Modeling Performance Measurement: Applications and Implementation Issues in DEA, Springer, Boston, 2005, ISBN 0-387-24137-X.

Page 23: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

23

DEA & FinanceDEA & Finance• Mutual funds• CTAs• Hedge Funds

G. Gregoriou and Joe Zhu, Evaluating Hegde Funds and CTA Performance:

Data Envelopment Analysis Approach, John Wiley & Sons, New York, 2005,

ISBN 0-471-68185-7 .

Page 24: Performance Evaluation and Benchmarking Using DEA Joe Zhu Department of Management Worcester Polytechnic Institute Worcester, MA 01609 jzhu@wpi.edu

Data Envelopment Analysis Joe Zhu

24