v konferencja ewaluacyjna warszawa, 23.10.2009

1

V Konferencja EwaluacyjnaV Konferencja EwaluacyjnaWarszawa, 23.10.2009Warszawa, 23.10.2009

Werner SchmidtWerner Schmidt OOperationsperations EvaluationEvaluation

The role of ex-post evaluation The role of ex-post evaluation an EIB perspectivan EIB perspectivee

The role of ex-post evaluation an EIB perspective

Werner Schmidt – Operations Evaluation

35th Evaluation Conference - Warsaw23/10/2009

Presentation outline

EIB STRUCTURE, OBJECTIVES & LENDING

EX-POST EVALUATION AND THE PROJECT CYCLE

EV Scope and objectives

Methodology and criteria

Impact on the Bank and future trends


The European Investment Bank (EIB)Long-term Finance Promoting European Objectives

European Union’s long-term lending bank set up in 1958 by the Treaty of Rome.

Shareholders: 27 EU Member States

Objectives within the Union:Cohesion and convergence

Small and medium-sized enterprises (SMEs)

Environmental sustainability

Knowledge Economy

Trans-European Networks (TENs)

Sustainable, competitive and secure energy

Objectives outside the Union – support EU policy


2008 Key Figures

European Union: EUR 51.5bnPartner countries: EUR 6.1bnTotal lending: EUR 57.6bn

Borrowings: EUR 59.5bn

Subscribed capital EUR 232.4bn(at 01/04/2009)

Lending target 2009 EUR 70 bn


EIB Lending 1958-2008


Loan signatures in the EU in 2008 (EUR m)


Ex-post evaluation at the EIB

EV Scope and objectives

Methodology and criteria

Impact on the Bank and future trends


The European Investment Bank (EIB)Ex-post Evaluation and the project cycle

EV is independent and carries out ex-post evaluations, focusing on how the Bank conducts its operations within the framework of EU policies ( the Treaty, Directives, Council decisions, mandates etc.) and the decisions of the EIB Governors.

The ultimate objective is to identify aspects, which could improve :

the accountability (EIB management),

transparency (stakeholders)

and operational performance (lessons learned) of the Bank’s activities in future projects.


Ex post evaluation feeding back into the project cycle

Lending Strategy

Identification

Selection AppraisalContract

negotiations

ImplementationMonitoring

Self-evaluation

IndependentEx-post

Evaluation

Time frame:

self evaluation, ex post, ongoing evaluation, mid term


Individual and/or thematic evaluations Strategy / mandate evaluations Mid-term reviews Joint donor evaluations Scope of activities

Type of evaluations and activities


OECD/DAC criteria ECG Standards Illustration of evaluation criteria used

Relevance (first pillar of value added) Project performance (second pillar) = Effectiveness,

Efficiency, Sustainability and environmental impact EIB contribution (third pillar) EIB management of the project cycle EIB’s Investment Profitability

Evaluation methodologies and results


Relevance

EffectivenessEfficiency

Sustainability

Environmental impact

MDB’s Investment Profitability

MDB’s contribution

MDB’s Work Quality

Selective use

Performance

of the

operation

oradditionality

Illustration of main criteria used


EU policies – EU objectives Country objectives

EIB strategies

Project objectives

Relevance


Second pillar of value added

1. Effectiveness2. Efficiency3. Sustainability4. Environmental and social impact

Project performance


How do we measure project results ?Effectiveness – work duration

1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Project 1 ex-anteex-post








Project 9 I ex-anteex-post

Project 9 II ex-anteex-post


ex-anteex-postExtension of works/expected completion

1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010









Project 9 I ex-anteex-post

Project 9 II ex-anteex-post


ex-anteex-postExtension of works/expected completion


How do we measure project results ?Efficiency - Economic Rate of Return (ERR)

-202468

101214161820

-2 0 2 4 6 8 10 12 14 16 18 20

ERR ex-ante (%)

ERR

ex-

post

(%)

11

3

2110

65

4

9


Contribution of the EIB

1. Financial contribution Financial terms Catalytic effects

2. Institutional and technical contribution Conditions Technical assistance Expertise: financial and/or technical

Project performance


Type of reporting Internal dissemination External dissemination :

Disclosure and confidentiality Annual reporting

Communication: EV website: intranet and internet

And use: Follow-up on recommendations

Reporting, Communication, Dissemination


Evaluation activity – impact on Bank operations

Revision/Update of EIB strategies in specific sectors

Improved dissemination of EIB expertise

Improved management of the project cycle:ensure strict handling of contractual clauses

ensure quality of PCR

respect of guidelines on environment


More on the Role of the EIBMore on joint evaluationsMore on learning/dissemination

Evaluation trends for the future


http://www.eib.org/evaluation

Further information under

v konferencja ewaluacyjna warszawa, 23.10.2009

Documents

ongoing evaluation

self evaluation

post evaluations

lending bank

eib ev scope

bnsubscribed capital

eib governors

eib perspectivethe role