María MuñozGeneral Directorate for Community Funds

Ministry of Economy and FinanceSPAIN

María MuñozGeneral Directorate for Community Funds

Ministry of Economy and FinanceSPAIN

1

STRATEGIC REPORTING AND THEMATIC EVALUATIONS

STRATEGIC REPORTING AND THEMATIC EVALUATIONS

DG REGIO EVALUATION NETWORK MEETINGBrussels, 2-3 April 2009

DG REGIO EVALUATION NETWORK MEETINGBrussels, 2-3 April 2009

2

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

Evaluation Plan 2007-2013 Evaluation Plan 2007-2013 Evaluation Plan 2007-2013 Evaluation Plan 2007-2013

Types of evaluations to be carried out in 2007-2013

Responsibilities of main actors

Indicators system

Management structure: Monitoring Committee

Financial and Human resources

Indicative timetable

3

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

SISTEMA DE SEGUIMIENTO ESTRATÉGICO SISTEMA DE SEGUIMIENTO ESTRATÉGICO Y EVALUACIÓN CONTINUAY EVALUACIÓN CONTINUA

SISTEMA DE SEGUIMIENTO ESTRATÉGICO SISTEMA DE SEGUIMIENTO ESTRATÉGICO Y EVALUACIÓN CONTINUAY EVALUACIÓN CONTINUA

STRATEGIC REPORTING AND ON GOING STRATEGIC REPORTING AND ON GOING EVALUATION SYSTEMEVALUATION SYSTEM

STRATEGIC REPORTING AND ON GOING STRATEGIC REPORTING AND ON GOING EVALUATION SYSTEMEVALUATION SYSTEM

NSRF: Strategic Reporting

i) 2009ii) 2012

Strategic Thematic Evaluations

i. Knowledge-based economyii. Environmentiii. Equal Opportunitiesiv. Immigration

Operational Evaluations

i. Regional OP’sii. Multi-regional OP’s

STRATEGIC REPORTING

Article 29Council Reg. 1083/2006

ON GOING EVALUATION

Article 47Council Reg. 1083/2006

Evaluation of Communication Plan

ST

RA

TE

GIC

RE

PO

RT

ING

AN

D

ON

GO

ING

EV

AL

UA

TIO

N

SY

ST

EM

EVALUATION OF INFORMATION AND

PUBLICITY MEASURES

Article 4 Commission Reg. 1828/2006

4

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S Needs / ProblemsNeeds / Problems Socio economic environment

ObjectivesObjectives InputsInputs OutputsOutputs

ImpactsImpacts

Outcomes/ResultsOutcomes/Results

RELEVANCEEFFICIENCY

EFFECTIVENESS

UTILITY/SUSTAINABILITY

PR

OG

RA

MM

EE

VA

LU

AT

ION

STRATEGIC REPORTING OF NSRF (III)STRATEGIC REPORTING OF NSRF (III)STRATEGIC REPORTING OF NSRF (III)STRATEGIC REPORTING OF NSRF (III)

5

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

EVALUATION GUIDESEVALUATION GUIDESEVALUATION GUIDESEVALUATION GUIDES

PurposePurpose

To define the activities to be carried out

To set up homogeneous methodologies

To identify the techniques and tools used in the evaluations

6

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

EVALUATION GUIDESEVALUATION GUIDESEVALUATION GUIDESEVALUATION GUIDES

NSRF: Strategic Reporting

i) 2009ii) 2012

STRATEGIC REPORTING

ON GOING EVALUATION

Strategic Thematic Evaluations

i. Knowledge-based economyii. Environmentiii. Equal Opportunitiesiv. Immigration

Operational Evaluations

i. Regional OP’sii. Multi-regional OP’s

Evaluation of Communication Plan

EVALUATION OF INFORMATION

AND PUBLICITY MEASURES

EVALUATION PLAN

Indicators System

7

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

2007-2013 EVALUATIONS. TIMETABLE2007-2013 EVALUATIONS. TIMETABLE2007-2013 EVALUATIONS. TIMETABLE2007-2013 EVALUATIONS. TIMETABLE

8

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

CHAPTER I: Methodology description

CHAPTER II: Context analysis

CHAPTER III: Analysis of Internal and External Coherence

CHAPTER IV: Analysis of complementarity

CHAPTER V: Results

CHAPTER VI: Horizontal principles

CHAPTER VII: Conclusions

STRATEGIC REPORTING OF NSRFSTRATEGIC REPORTING OF NSRFSTRATEGIC REPORTING OF NSRFSTRATEGIC REPORTING OF NSRF

Objective:

To analyze the relevance and validity of the strategy defined within the

NSRF defined in 2005 and its contribution to the achievement of the

Lisbon Goals

Content:

9

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

STRATEGIC REPORTING. NSRF 2009STRATEGIC REPORTING. NSRF 2009STRATEGIC REPORTING. NSRF 2009STRATEGIC REPORTING. NSRF 2009

10

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

STRATEGIC THEMATIC EVALUATIONS (I)STRATEGIC THEMATIC EVALUATIONS (I)STRATEGIC THEMATIC EVALUATIONS (I)STRATEGIC THEMATIC EVALUATIONS (I)

EVALUATION ON KNOWLEDGE BASED ECONOMYEVALUATION ON KNOWLEDGE BASED ECONOMY– Knowledge-based economy is at the center of the Lisbon

Strategy– This topic is present in all regional and multi-regional OPs.

Specially in the Technological Fund.– The Spanish Government is also fostering R&D and innovation

in order to leverage growth (25% annual increase in R&D budget in previous years)

– Spain still needs to catch up with EU leaders

EVALUATION ON EQUAL OPPORTUNITIESEVALUATION ON EQUAL OPPORTUNITIES– In order to ensure that equality between men and women and

the integration of the gender perspective is promoted during the various stages of implementation of the Funds.

– In co-ordination with the Women’s Institute.

11

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

STRATEGIC THEMATIC EVALUATIONS (II)STRATEGIC THEMATIC EVALUATIONS (II)STRATEGIC THEMATIC EVALUATIONS (II)STRATEGIC THEMATIC EVALUATIONS (II)

EVALUATION ON ENVIRONMENTEVALUATION ON ENVIRONMENT– In order to ensure that environmental protection and

sustainability are promoted during the various stages of implementation of the Funds.

– In co-ordination with the Ministry for the Environment

EVALUATION ON IMMIGRATIONEVALUATION ON IMMIGRATION– Immigration burst in Spain– It is urgent to manage this reality– Need to define policies addressed to immigrants and their

social inclusion.

12

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

STRATEGIC THEMATIC EVALUATIONS (III)STRATEGIC THEMATIC EVALUATIONS (III)STRATEGIC THEMATIC EVALUATIONS (III)STRATEGIC THEMATIC EVALUATIONS (III)

ContentContent

– CHAPTER I. Content of the evaluation. Description of methodology

– CHAPTER II. Context analysis

– CHAPTER III. Analysis of the relevance and validity of the strategy

– CHAPTER IV. Analysis of outcomes, results and impacts

– CHAPTER V. Analysis of the quality of execution and of the management system

– CHAPTER VI. Best practices

– CHAPTER VII. Conclusions

13

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

TOOLSTOOLSTOOLSTOOLS

Indicators systemIndicators system

Context indicatorsStrategic indicatorsEvaluation indicatorsOperational indicators

Early Warning indicators Documents analysisDocuments analysis

SurveysSurveys

InterviewsInterviews

Case studiesCase studies

Econometric techniquesEconometric techniques

14

GE

EN

RA

L D

IRE

CT

OR

AT

E F

OR

CO

MM

UN

ITY

FU

ND

S

THANK YOU !THANK YOU !

María MuñozMaría Muñoz

mjmunozm@sgpg.meh.esmjmunozm@sgpg.meh.es