announces notice of recruitement · 2019. 10. 25. · sos children’s villages bosnia &...

SOS CHILDREN’S VILLAGES BOSNIA & HERZEGOVINA

YOUTH EMPOWERMENT PROGRAMME IN SARAJEVO

ANNOUNCES NOTICE OF RECRUITEMENT

CONSULTANT / EXTERNAL ASSOCIATES (F/M) / 1 POSITION

DURATION: November – December 2019

PROJECT: YOUTH EMPOWERMENT AND EMPLOYMENT PROGRAM (YEEP) 2016-2019

SOS Children’s Villages Bosnia and Herzegovina (SOS BiH) seeks the services of a skilled evaluation consultant to

undertake an external evaluation of a 3-year project, funded by the German Federal Ministry for Economic Cooperation

and Development (BMZ) and Hermann-Gmeiner-Fonds Deutschland e.V. The overall aim of the project was to deliver a

continuous and sustained youth empowerment programme to help reduce the impact of youth unemployment on communities

and individuals in the region through youth employability. We support young people on their way to employment and

independence through a special focus on youth empowerment and to help them prepare for the labour market and increase

their employment prospects.

The Project - Promotion of professional and social integration of marginalized young people in Sarajevo through the

establishment of the "Youth Empowerment and Employment Program (YEEP)" started on 01 September, 2016 and will end on

31 December, 2019. This evaluation is intended to feed into project closure activities. Details regarding contents of proposals

and submission procedures are explained herein, Terms of Reference (ToR).

The evaluation will answer the following questions:

1) What are the changes the program has brought in the lives of the target group who participated in it, their families and their

communities?

2) How relevant, effective, efficient, sustainable and participatory are the programme interventions?

3) What lessons can be drawn from the project in order to be used for further continuation of the programme?

The evaluation should analyze the progress that the project has achieved in relation to the specific programme indicators, as

set out in the Impact Matrix of the project. All project material for the external evaluators are provided with access to data as

agreed in the contract signed.

The consultant qualifications should have:

Proven competency in monitoring and evaluation, including impact assessment or project evaluation.

A social science backgrounds.

Demonstrated a good knowledge of development work and partners in multiple sectors in Bosnia and Herzegovina, and

experience in international development is also highly desired.

A good knowledge of the country (Bosnia and Herzegovina) with focus on topics such as social protection and policies,

education, social inclusion, gender relations etc.

Proven experience and expertise in evaluating cross-cutting issues.

Proven experience in participatory processes and data collection methods.

Good facilitation and interpersonal skills.

Strong skills in coordinating teamwork.

Strong analytical and conceptual skills.

Excellent written and oral communication skills.

Ability to transfer complex concepts and ideas into practical and simple language.

Ideally experience in organising research processes with/for SOS Children’s Villages.

Ideally have experience and credibility in providing evaluating services to BMZ financed projects.

Proficiency in English language written and oral.

Excellent computer skills, including word processing, spreadsheet programs and data base management.

Re-announcement date: 25 October, 2019.

Submission of the technical and financial proposal.

The deadline for submitting the proposal is 04 November, 2019 at 16:00 hrs. (BiH time), with “YES Sarajevo

Evaluation” in the subject line.

Interested External Evaluator Service Provider’s should deliver, and/or email:

Curriculum Vitae (CV) of the expert/(s) that will be engaged in fulfilling the external evaluation service.

Letter of Interest (no more than one page).

Proposal (both technical and financial).

Any document that they have to proof their expertise on external evaluation, and/or an example piece of work from a

similar assignment.

Incomplete applications will not be considered.

Contacted will be only those candidates who are shortlisted.

Note: We do not commit to returning received applications.

Nepotpune prijave neće se razmatrati.

Kontaktirani će biti samo oni kandidati koji su ušli u uži izbor.

Napomena: Ne obavezujemo se vraćati pristigle prijave.

***

To: SOS Children's Villages Bosnia and Herzegovina

Semira Fraste, b.b. 71000 Sarajevo

Bosnia and Herzegovina

Or

E-mail: [email protected] and [email protected]

Subject line: YES Sarajevo Evaluation

mailto:[email protected]


A loving home for every child 1 | Terms of Reference | YES Sarajevo 2016-2019 | Bosnia and Herzegovina

Terms of Reference (TOR)

For

External Evaluation of the

Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the Youth Empowerment and Employment Program (YEEP)

(BMZ Project 3756)

SOS Kinderdorf International, Representative Office, Bosnia and Herzegovina SOS Children’s Villages Bosnia and Herzegovina

Re-announcement

Sarajevo, Bosnia and Herzegovina 25 October 2019


TABLE OF CONTENTS

Introduction|3

1 | Background and Rationale|3

2 | Purpose, Objectives and Use|4

3 | Scope of the Work|6

4 | Methodology|11

5 | Process of Evaluation|11

6 | Outputs and Deliverables|13

7 | Expert profile of the Evaluation Team|13

8 | Tentative Timetable|14

9 | Management of the Evaluation|15

10| Quantity Structure|17

11| Evaluation Report Structure|19

12| Selection Criteria|21

13| Mode of Payment|21

14| Submission of the Technical and Financial Proposal|22

ACRONYMS BMZ German Federal Ministry for Economic Cooperation and Development CVPD Children’s Villages Programme Director ES Employment Specialist F&CDD Fundraising and Communication Development Director FD Finance Director HGFD SOS Children’s Villages worldwide / Hermann-Gmeiner-Fund Germany e.V. IM Impact Matrix IO SOS International IOR SOS international Office Region NALCA National Alternative Care Adviser ND National Director NFSPA National Family Strengthening Programme Advisor NGO None Governmental Organisation NPDD National Programme Development Director NPFA National Public Funding Adviser OECD/DAC Organisation for Economic Cooperation and Development / Development Assistant Committee PM Project Manager SOS BIH SOS Children’s Villages Bosnia and Herzegovina TOR Terms of Reference VC Volunteer Coordinator VET Vocational Education Training YEEP/YES Youth Empowerment Employment Program/Youth Empowerment Service

INTRODUCTION These Terms of Reference (ToR) serve as a request for proposals from individual consultants or companies who are interested in conducting an impact evaluation of the project: Promotion of professional and social integration of marginalized young people in Sarajevo through the


establishment of the "Youth Empowerment and Employment Program (YEEP)", BMZ project, funded by the German Federal Ministry for Economic Cooperation and Development (BMZ) and Hermann-Gmeiner-Fonds Deutschland e.V. Details regarding contents of proposals and submission procedures are explained herein. SOS Children’s Villages Bosnia and Herzegovina (SOS BiH) was registered in 1994 as the national representative of SOS Children’s Villages International and is a non-political, non-governmental organization. The programmes include youth development, education, alternative long-term care and family strengthening. The SOS BIH program activities are organised and implemented by 177 highly skilled employees and are being carried out in the locations of Sarajevo, Mostar, Gorazde and Gracanica. SOS Children's Villages International and SOS BiH have been working together successfully since 1994 and the programme work is divided into the following areas: Family-friendly alternative long-term care - two children's villages, two youth facilities, two "semi-independent living" programmes; Foster families - support for 40 foster families; Prevention-six family strengthening programmes; Education: two kindergartens, two centres for early childhood development, four youth empowerment projects; De-institutionalisation: development of the law on foster families and related quality standards, training of foster families, capacity building of skilled workers; and Advocacy-Care Leavers Voices, Youth Advocacy Network and Strengthening the Rights of Children in Alternative Care. SOS BiH actively, participates in policy-making and advocates for the rights of children and young people who are at social risk - as stated in the UN guidelines for alternative long-term care. And work closely with decision-makers, government institutions, civil society organizations and social service providers, and attached great importance to the involvement of young people in decision-making processes.

1|Background and Rationale

The Project1 - Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)” implemented in City of Sarajevo with emphasis in the two municipalities Novi Grad and Ilidza East with 139,704 residents. In the project area there are two groups of marginalize young people who are faced with particular challenges: both young people from troubled families and young people from care systems (social service, foster parents) are faced with socio-economic exclusion. In Novi Grad, the youth unemployment rate is 47.6% and in East Ilidza at 54%. Approximately 50% of the target group has a secondary school certificate but due to the pressure of just trying to provide for a living, are unable to complete further qualifications. Most of the young people work in the informal sector or do seasonal work by offering themselves as day workers. They only have a small irregular income and are exposed to risky and insecure working conditions. 20% of households with young people have problems covering monthly living costs. In these households’ teenagers are often responsible for the family income. This means that almost every one in five households lives at risk of poverty. The marginalized groups described are struggling because of their family situation (marginalized family or no parental care) with social exclusion. Psychosocial consequences of socio-economic exclusion are stress, depression, and fear for the future, alcohol and drug abuse and low self-esteem and negative self-image. Apathy, passivity and hopelessness are widespread among marginalized youth. This reinforces the already existing burden of the still noticeable effects of the war and the strong inter-ethnic tensions. Furthermore, the local community and employers lack the responsibility, responsiveness and coordination mechanisms to tackle the important issues of marginalized youth integration and unemployment.

1 The Project, refer to Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)”, hereinafter YES Center.


All programmes of SOS Children’s Villages Bosnia and Herzegovina (SOS BiH) contributed to social inclusion of discriminated and marginalized young people. Therefore, this project is not a one-time action but bedded into a long-term and integrated Youth Empowerment Programme. The overall objective is to improve the livelihood and empowerment of 300 marginalized young people (15-29 year of age) in the City of Sarajevo, benefited from a quality information access in the Youth Empowerment and Employment Program (YEEP) Centre (hereinafter YES Center). More specifically to support youth in their ability to find employment/income by means of qualifications and trainings in the area of life-employability skills, job search skills/application, vocational training, employment and self-help/business start-ups. Further increased of its household income, contributed to their financial self-sustainability, and social inclusion. As a result, the role of the target group as responsible project stakeholder was strengthened. The established collaborative stakeholders network provided a platform for exchange of experience and knowledge, mutual support, confirmation and maintained the collaborative YEEP Stakeholders Network, were NGO Nautilus as strategic partner in this project were improved. Furthermore, the involved voluntary youth in the Information Center are important actors in the peer learning approach of the project that assures a long-term involvement and motivation of the target group. SOS BiH secured cooperation with public institutions, different chambers of commerce and the business sector. The evaluation should determine the extent of the implemented outcomes and sustainability of the project as well as the performance of SOS BiH in the process of the project implementation that will lead to recommendations for improvement of the approach and services for supporting marginalized youth reaching social and financial sustainability. In addition, the evaluation results can serve as bases for further joint initiatives and cooperation between SOS Children’s Villages worldwide / Hermann-Gmeiner-Fund Germany e.V. (HGFD) and SOS Children’s Villages Bosnia and Herzegovina as implementing partners. This evaluation at the end of the project should assess strengths and weaknesses of the project, its impact on the target group and potential improvements and/or new developments for further continuation of the project.

It should also support the pilot approach of this project and draw lessons learnt from the implementation that can be taken further to develop and implement similar projects in other municipalities in Bosnia and Herzegovina.

2|Purpose, Objectives and Use

The overall objective of this evaluation will be to assess the impact of the project. The specific objectives of the evaluation are:

To assess the effectiveness of the implemented Project: Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)" in the City of Sarajevo targeting two municipalities Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska). Especially the progress the project has made against the target indicators as found in the Impact Matrix (IM).

To evaluate the efficiency of the project in relation to beneficiaries, costs and timeframe of the project.

Assess the extent to which the project addressed the real needs of the target group (relevance).

To assess the sustainability of the project (institutional, social, financial, etc.).

To assess how the project contributed to the desired long-term change for the beneficiaries (impact).

To conclude finding and recommendations for further development of future interventions. More details about the specific objectives can be found under point No.3 Scope of work.


The desired results of the evaluation are:

To document the impact of the project with special emphasis on the impact the project has had on marginalized youth (including women).

To provide commentary on the overall project design, the intervention logic and an analysis of the strategy and methodology used in the project: Promotion of professional and social integration of marginalized young people in Sarajevo through the establishment of the "Youth Empowerment and Employment Program (YEEP)” in the City of Sarajevo (two municipalities Novi Grad-Federation of BiH and East Ilidza - Republika Srpska).

To critically examine the impact matrix and target indicators found in the original proposal and provide post-project figures along with a narrative explaining the reasons for under/over performance achievement.

To draw conclusions, make recommendations and state lessons learnt for future strategy and improvements in implementation of the project.

To provide commentary on the current political, social and cultural factors impacting the implementation of the project.

To document the communities’ attitude towards the project.

Key persons:

Marginalized youth participating in the project

Youth who are not participating but might be somehow affected by the project (e.g. from neighborhood)

Marginalized youth who left the project

Project team

SOS Children’s Villages BiH programme units’ staff/teams; especially those of Youth Empowerment and Family Strengthening Programme

Project partners, community members and associates, local partners and main stakeholders

Strategic and Programme Management on National Level

Key users of evaluations results:

Project level: Project team – Project Manager (PM), Employment Specialist (ES), Volunteer Coordinator (VC).

Management level: National Director (ND), National Programme Development Director (NPDD), Finance Director (FD), Fundraising and Communication Development Director (FR&CDD); National Public Funding Adviser (NPFA), National Alternative Care Adviser (NALCA), National Family Strengthening Programme Advisor (NFSPA), and Children’s Villages Programme Director, Sarajevo (CVPD).

Community level: Mayor in two municipalities Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska), Administrative Units authorities, Regional Labor Offices of BiH authorities, Public VET centres / Academe in BiH, Corporates and Civil Society Organisations.

Regional level: SOS international Office Region (IOR).

Global level: SOS international (IO), project donor and SOS Kinderdörfer weltweit. The evaluation findings should contribute to:

Strengthen the work with marginalized young people in reaching to improve the livelihood and empowerment to their financial self-sustainability, and social inclusion, socio-economical sustainability.

Strengthen the partnerships with community service providers, associates and duty bearers;


Improve organizational future programme work.

Understand more deeply how and why the project is effecting change.

Inform decision making authorities in local and national level for further strategic directions toward work with marginalized young people.

3| Scope of the Work

The geographical scope at which the evaluation will be conducted is on the territory of the City of Sarajevo with a special focus on the Municipality of Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska), where the YES Centre is located, through which the activities of the project are being implemented.

The scope of the evaluation will include all the aspects (activities, services) of the project implementation

as presented in the Project Proposal and Impact Matrix. The statistically significant sample of project

participants (random sample of project participants – marginalized youth from SOS care and two-targeted

local communities which are currently assisted by the project, as well as youth that have already left the

project, partners and project staff should take part in the evaluation in order to collect and analyse the

maximum available qualitative and quantitative data.

The plan is to invite all relevant partners and duty bearers to take part in the evaluation, without exclusion

of anyone. The evaluation segment of desk research will be done at the evaluator’s premises, but the

research (survey, focus groups, and interviews) will take place in YES Center, Sarajevo.

The expected period for conducting the evaluation is two months after the conclusion of an agreement for the implementation of the evaluation.

The evaluation questions should be revolved around the following evaluation criteria (OECD DAC): Relevance, Impact, Effectiveness, Efficiency, Sustainability and Project Management and Coordination. On the basis of the above evaluation criteria, instruments/questionnaires for the field mission should be prepared for stakeholders. Refer to Table 1.


Table 1: Defining the DAC Evaluation Criteria

Evaluation issue

Key guiding questions

Sources of information

Relevance Does the project address the situation of the specific target group?

To what extent is the project focused on the intended target group - i.e. youth and parents from vulnerable families and local specialists from relevant institutions/organisations?

What have been the specific criteria for the selection of the beneficiaries?

To what extent the youth and parents from vulnerable families and local specialists from relevant institutions/organisations have met the selection criteria?

To what extent, the project interventions respond to the needs and priorities of the project participants, including the needs of the communities that the project addresses?

To what extent project design addresses locally and nationally defined needs and priorities?

To what extent, the project adjustments that have been made so far, were relevant?

Documents: BMZ Project Proposal Annual SOS BiH and BMZ

project reports BMZ Project Participants

Database BMZ project Monitoring Tool Individual Folder and

individual development plan of project participants

People: Project participants, former

project participants Project staff

Effectiveness and Efficiency Has the project reached the intended results in an effective and efficient way?

To what extent are the objectives of the project being attained?

What is the percentage of the project fulfilment against the set indicators?

To what extent the project strategies, methodologies, tools and processes contributed to the achievement of the planned results?

Is the relation between input of resources and results achieved appropriate and justifiable?

What are the social benefits for youth/families/communities compared with resources spent for activities?

How do the costs of this project compare with the similar initiatives in the country?

Could the outcomes and results have been achieved at lower cost through applying a different approach?

Documents: Quarterly progress reports Annual BMZ project reports Individual Folder of project

participants Statistics Feedback letters of the project

participants Pre and post training evaluation

forms Partnership agreements


Building sustainable community-based responses

To what extent the project objectives and activities are in compliance of the needs of the target group?

Does the support system being built in the target communities effectively respond to the situation of youth and parents of vulnerable families?

To what extent has SOS Children’s Villages BiH contributed to the development of capacity of the public/private partners and main duty bearers to respond to the situation of the target group?

To what extent the community demonstrates interest to the project outcomes?

To what extent local authorities are involved and provide support to the project?

Building self-reliance of marginalized young people at risk

How many beneficiaries have participated in the project? Are all of them in need of the project services?

To what extend the beneficiaries are aware of the project and the services it provides? Do all targeted beneficiaries receive services by the project?

To what extent have beneficiaries been satisfied with the project interventions?

To what extend the amount, type and quality of the services correspond to the needs of the target group?

To what extent the quality of support had improved the lives of the beneficiaries? Are they satisfied with the services they received and its quality?

How many beneficiaries left the project since the beginning and became self-reliant? To what extend the results which they reached are sustainable and effective after they left the project?

What are the reasons for beneficiaries to fail in achieving self-reliance by the end of the evaluated period?

People: Marginalized young people and

state specialists who are participating or have participated in the project;

Partners (key implementation partner, public bodies and private partners)

Project staff Documents: BMZ Project Participants

Database Individual Development plans

(IPDs) SOS BiH Programme

Database Partner organisation - youth

led organisation – NGO Nautilus database


What approaches and strategies defined in case files/ beneficiaries’ plans have been the most effective and contributing in achieving self-reliance?

Is replication or removal of certain approaches required to increase efficiency?

Impact The systematic analysis of the changes in the lives of beneficiaries, communities and other stakeholders brought by the project.

What has been the impact in line with the planned results of the project, in terms of changes brought about in the situation of beneficiaries and communities?

What has been the impact beyond the planned results of the project, in terms of changes brought about in the situation of beneficiaries and communities? (positive and/or negative)

Documents: Matrix of Indicators as per BMZ-

Proposal Project progress reports Individual Folder of project

participants Feedback letters of the project

participants Pre and post training evaluation

forms People: Marginalized young people from

SOS Care, 2 local communities and local specialists from relevant institutions/organisations who are participating or have participated in the project

Partners (public bodies, government, key implementation partner)

Other stakeholders Project staff


Sustainability Measuring whether the benefits of an activity are likely to continue after donor funding has been withdrawn. Projects need to be environmentally as well as financially sustainable.

To what extend can activities, results and effects be expected to continue after project (BMZ/HGFD financing) has ended?

Has the capacity of the implementation partner been developed? If so, in what areas and how?

People: Marginalized young people and

youth from vulnerable families in 2 targeted areas and local specialists from relevant institutions/organisations who are participating or have participated in the project.

Partners (public bodies, government, key implementation partner)

Volunteers participated in the project

Project staff

Project management and coordination Does the project management and coordination ensure the quality implementation of the project.

To what extent does the project have appropriate management and coordination structures and organization of the process? Are these structures aimed at quality of the project implementation?

Who else from the local associates implementing partner was involved in the process of management and coordination and how it affects the quality implementation?

Documents: Project progress reports Partnership agreements

People: Project management team Partners (public bodies,

government, key implementation partner)

Project staff


4|Methodology

To be applied in the evaluation. The External Evaluation should be based on participatory approach involving and engaging a wide and diverse range of stakeholders. Stakeholders` participation is necessary for accountability, promoting ownership and sustainability, facilitating buy in, and further use of the evaluation recommendations. The participatory approach is very useful in engaging stakeholders and gaining their insights, experiences with the programs and the benefits obtained because of the programs. The evaluation implies inclusion of various 'rights holders' or young people leaving care, young people at social risk, parents at social risk, children from families at social risk that benefit from the project, as well as the 'duty bearers' or those responsible and accountable for providing services. This is necessary to assess whether benefits and contributions are fairly distributed by the interventions being evaluated. In general, evaluation methodology is concentrated on the objective, description and explanation of changes that have happened in beneficiaries’ lives due to their participation in the project. The evaluation approach should be also results’ oriented to provide evidence of both quantitative and qualitative achievements and the outputs and outcomes obtained by the project (or not). Both primary and secondary data should be used in the evaluation, and collected from a wide and diverse range of primary and secondary sources. Secondary information should be collected from documents provided to the evaluator. Primary information should be collected from the stakeholders of the project through semi-

structured interviews face-to face, and focus group discussions with beneficiaries and project staff members. The external evaluation work should be implemented according to Organizational Code of Conduct and Child Protection Policy.

5|Process of Evaluation

Description of the evaluation phases, the activities undertaken (chronologically) and relevant actors: Plan and design data collection methodology and process and agree on site visits to the project areas to meet project participants: 300 marginalized young people from SOS Care and two-targeted local communities and local specialists from relevant institutions/organisations and collect information in accordance with the requirements stipulated in the evaluation design.

The methodology of evaluation will include the following:

Document review including analysis on key reference documents listed in Terms of Reference

Case study of randomly selected beneficiaries’ files (present and those who exited the project

Interviews - structured and/or semi-structured; in person and/or by telephone with key informants listed in Terms of Reference

Focus groups with selected key informants – youth and parents of vulnerable families in the targeted areas and local specialists from relevant institutions/organisations, community members

Other methods relevant to evaluation objectives and scope


Data collection process includes:

Reviewing the project documentation and other sources of information at project level.

Identification of the major stakeholders who are associated with the project to be interviewed, such as the direct participants of the project (300 marginalized young people from SOS Care and local communities in the two-targeted areas and local specialists from relevant institutions/organisations), implementation partners, key local government representatives, and other service providers.

Selection of representative sample of communities or groups to be interviewed on the basis of agreed criteria.

Agreeing on the type of information to be collected.

Preparation of data collection tools including consultation with project staff on project/national/regional level.

Data collection with questionnaires and interviews with co-workers, beneficiaries, representatives of

partners, local authorities and community, focus groups and analysis of data. All data collected needs

to be disaggregated by sex.

Other to be defined by external evaluator.

Data analysis and elaboration of evaluation report: External evaluator will analyse collected data and will prepare an evaluation report that describes the main evaluator’s findings, recommendations and lessons learned. The final report should follow the structure and content as outlined in the terms of references. This stage includes:

Analysis of the data and elaboration of conclusions and recommendations

Preparation of a draft report

Present the findings to the respective staff on local/national and regional/ level to ensure triangulation

Finalise the report after inputs from various stakeholders

The main participants of the evaluation are:

Direct project beneficiaries: marginalized young people from SOS Care and 2 two municipalities

Novi Grad (Federation of BiH) and East Ilidza (Republika Srpska); local specialists from relevant institutions/organisations.

Project staff: Project Manager (PM), Employment Specialist (ES), Volunteer Coordinator (VC).

Programme staff on the National level: National Director (ND), National Programme Development Director (NPDD), Finance Director (FD), Fundraising and Communication Development Director (FR&CDD); National Public Funding Adviser (NPFA), National Alternative Care Adviser (NALCA), National Family Strengthening Programme Adviser (NFSPA), and Children’s Villages Programme Director, Sarajevo (CVPD).

Direct stakeholders: local government, private partners, business community, volunteers, etc.

6|Outputs and Deliverables External evaluator should prepare the following key deliverables:

Evaluation Design Contains the evaluation framework, detailed evaluation methodology, work plan and budget.

Developed Evaluation Tools


Draft Evaluation Report Draft report will be prepared in line with the proposed structure below and should be submitted to National Programme Management in National Office (NO), electronically via e-mail, in English not exceed 30 pages.

Final Evaluation Report

The findings of the external evaluation shall be presented in a written report following the proposed outline. Attachments – Templates of applied evaluation tools, questionnaires, main areas for focus groups and etc. The final evaluation report should be jargon free, clear and simply written. The main body of the report should not exceed 30 pages and should include an Executive summary, brief project background and recommendations. Technical information/annexes should be included in appendices only. Analysis of project achievements should always be backed up with relevant data, with reference to the data source. Recommendations should be specific and include relevant details for how they might be implemented. Final evaluation report should be submitted to National Director in English.

7|Expert profile of the Evaluation Team The Consultant must have:

Proven competency in monitoring and evaluation, including impact assessment or project evaluation.

A social science backgrounds.

Demonstrated a good knowledge of development work and partners in multiple sectors in Bosnia and Herzegovina, and experience in international development is also highly desired.

A good knowledge of the country (Bosnia and Herzegovina) with focus on topics such as social protection and policies, education, social inclusion, gender relations etc.

Proven experience and expertise in evaluating cross-cutting issues.

Proven experience in participatory processes and data collection methods.

Good facilitation and interpersonal skills.

Strong skills in coordinating teamwork.

Strong analytical and conceptual skills.

Excellent written and oral communication skills.

Ability to transfer complex concepts and ideas into practical and simple language.

Ideally experience in organising research processes with/for SOS Children’s Villages.

Ideally have experience and credibility in providing evaluating services to BMZ financed projects.

Proficiency in English language written and oral.

Excellent computer skills, including word processing, spreadsheet programs and data base management.

The Evaluation team should consist of the number of persons, which can be affordable in accordance with the approved evaluation budget. Roles and responsibilities in the team are distributed in accordance to the competence, level of expertise and requirements of the evaluation team. In order to be more time effective, the work with the documents, meetings with the project team, beneficiaries, partners and stakeholders can be done simultaneously and divided among evaluation team members. It is expected that the evaluation team will present concrete recommendations which are addressed to the specific stakeholders. Team leader of the evaluation team is responsible for:


Quality and timely fulfilment of the ToR with expected results of the evaluation

Overall evaluation design of the process

Elaborated evaluation plan indicating each step of the process

Effective distribution of the responsibilities among evaluation team members

Quality and timely implementation of the evaluation plan

Effective and quality data collection

Data compilation and analysing aimed at reaching goal of the evaluation

Preparation and submission of high quality and consistent evaluation report in due course External evaluator should not be biased and have any reason for conflict of interests. Evaluation team must respect participating communities’ culture, social norms, values and behaviour; and maintain appropriate relationships with participants to this evaluation.

8|Tentative Timetable

No.

No. of Weeks

Actions

Success Indicator

1. 1st week Hold 1st meeting with the client and defining of the contracted volume of work

The volume of work agreed and the contract is signed by both parties

Prepare the action plan for the evaluation process indicating the exact dates of visiting the location

Plan is prepared and approved by National Office (NO)

Analyse all available basic project documents (BMZ-proposal, reports, BMZ-guidelines, concepts, etc.)

Evaluation team received the documents in time

2.

2nd week

Develop set of tools (interviews, questionnaires, focus group scenarios etc.)

The set of tools is defined and approved by NO

2nd meeting with the client and discussion of the methodology and tools to be used during evaluation

Methodology and tools are defined and approved by NO

Prepare and submit to NO schedule of site visits mentioning all required documents to be prepared in the location

Schedule is approved by NO and received by the location. All required documents are prepared by the location

Develop and finalise the visit plan with the defined local stakeholders, project workers, stakeholders in the location, beneficiaries in the location

Visit plan is agreed, final visit plan (if needed) is received by the evaluators

3. 3rd week Make visit to the project location Evaluators are in the location

Hold meetings with all relevant parties as per the visit plan

Questionnaires are filled, focus groups and interviews are documented

Provide and analyse project documents in the location

Evaluators possess all required documents in the location


Analyse all data and prepare the draft report indicating the findings, recommendations, lessons learnt

Draft report is prepared and shared with NO

4. 4rt week 3rd meeting with the client and discussion of the preliminary results of the evaluation

Feedback from NO is received by the evaluators

Make the final draft report Final draft report is received

Provide feedback for the final draft report from NO and insert in the final draft

Feedback is received by evaluators and inserted in the final draft

Prepare and send final draft to NO Final draft received and approved by NO in the final draft and final draft received by NO

9|Management of the Evaluation Management involvement in the process is defined by the scope of responsibilities in the organisation. During the evaluation the responsibilities will be distributed as follow:

No.

Title/Position Responsibilities Comments

National Office of SOS Children’s Villages Bosnia and Herzegovina

1. National Director (ND)

• Approval of the volume of work for the evaluators • Signing of the contract with the evaluators • Approval of the final draft of the evaluation report • Approval of the payment, based on the contract terms

2.

National Programme Development Director (NPDD)

• Define the overall scope of work for the evaluation • Discuss the action plans and evaluation process with the

evaluators • Discuss methodology and set of tools with the evaluators • Receive and approve the evaluators action plans, visit

plans etc. • Finalise with the evaluators and with the project manager

the visit list and ensure the organization of the meetings as per the approved visit plan.

• Provide feedback to the 1st and the final draft evaluation report

• Monitor the whole process of evaluation • Approval of the TOR for evaluation • Approval of the final list of documents to be forwarded to

the evaluators • Providing feedback and approval of the methodology and

tools for evaluation • Approve schedule of the meetings


No.

Title/Position Responsibilities Comments

3. Project Manager (PM)

• Organises meetings with all relevant people as per the visit plan (SOS + external)

• Provides all relevant project documents and information (reports, statistics, etc.)

• In cooperation with NPDD organise meetings with the evaluators and NO workers

• Prepare draft of TOR • Discuss the action plans and evaluation process with the

evaluators • Discuss methodology and set of tools with the evaluators

4. Project staff

• Provides all relevant project documents and information (reports, statistics, etc.)

• Organise meetings with community members, programme participants for evaluation purpose

• Contribute during feedback giving process as per component led by each of them


10|Quantity Structure

Table 2, below showing the different activities and amount of 24 working days per evaluator:

NO. EVALUATION ACTIVITIES

DAYS OF THE MONTH

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

1. Hold 1st meeting with the client and defining of the contracted volume of work.

2. Prepare the action plan for the evaluation process indicating the exact dates of visiting the location.

3.

Finalise the list of the basic documents to be provided to the evaluation team. If translation is needed define the documents for translation.

4. Analise all available basic project documents (reports, guidelines, concepts etc.).

5. Develop set of tools (interviews, questionnaires, focus group scenarios etc.).

6. 2nd meeting with the client and discussion of the methodology and tools to be used during evaluation.

7. Prepare and submit to National Office (NO) schedule of travel to project location and required documents to be prepared.

8.

Develop and finalise the visit plan with the defined local stakeholders, project workers, stakeholders and beneficiaries in the location.


NO. EVALUATION ACTIVITIES

DAYS OF THE MONTH

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

9. Make visit to the project location.

10. Hold meetings with all relevant parties as per the visit plan.

11. Provide and analyse project documents in the location.

12. Analyse all data and prepare the draft report indicating the findings, recommendations, lessons learnt.

13. 3rd meeting with the client and discussion of the preliminary results of the evaluation.

14. Make the final draft report.

15. Provide feedback for the final draft report from NO and insert in the final draft.

16. Prepare and send final draft to NO.

The evaluation is expected to be undertaken in between November – December 2019. The final report is due on 31st of December 2019.


11|Evaluation Report Structure

The evaluation report has to be structured in the following way:

TABLE OF CONTENTS

Table of contents

Figures and tables

Acronyms SUMMARY

Background and project context

Findings and conclusions

Recommendations and lessons learned 1. INTRODUCTION

1.1. SCOPE OF EVALUATION • Brief project description

1.2. BACKGROUND AND RATIONALE

• Reason and justification for evaluation • Aim and purpose of evaluation • Key guiding questions

1.3. EVALUATION MISSION

• Time span and process of evaluation • Profile, composition and independence (none-bias) of evaluation team • Participation of partners and target group in evaluation • External factors influencing the evaluation process and respective consequences

2. METHODOLOGY

2.1. EVALUATION APPROACH AND METHODOLOGY • Methodology and instruments • Measures ensuring the protection of the stakeholders involved

2.2. CRITICAL ASSESSMENT

• Measures ensuring the protection of the stakeholders involved 3. CONDITIONS FOR EVALUATION

• Local context, problem statement, initial potentials of project and important changes throughout project period

• Presence and actions of other stakeholders • Risk factors for achieving project objectives


4. PERFORMANCE OF GERMAN AND IMPLEMENTING PARTNER

• Staff qualification • Changes at German and implementing partner organization

5. EFFECTIVENESS

5.1. RELEVANCE • Needs of the target group are addressed and the objectives of the donor (BMZ),

German and implementing partners are attained • Adequate developmental approach and conceptualization

5.2. EFFECTIVENESS

• Quality of project planning • Quality of system of indicators and objectives • Quality of project implementation • Motivation, ownership and legitimacy of implementing partner • Quality of project management • Achievability of project objectives • Other effects on output and impact level (incl. negative, if any)

5.3. EFFICIENCY

• Cost effectiveness of the project

5.4. DEVELOPMENTAL IMPACTS • Achievement of overall objective • Model-character, structural changes and broad effect • Other effects of overall, developmental impact (incl. negative, if any)

5.5. SUSTAINABILITY

• Viability and durability of positive impacts (once BMZ-funding has ceased); incl. developments in surrounding areas.

• Risks and potentials of sustainable impacts for the target group as well as on organisational level

6. CROSS-CUTTING ISSUES

• Cross-cutting topics of development cooperation • Contribution to organisational goals

7. CONCLUSIONS AND RECOMMENDATIONS

7.1. CONCLUSIONS

7.2. RECOMMENDATIONS

7.3. LESSONS LEARNED


ANNEXES • Terms of Reference • Composition and independence (none-bias) of evaluation team • Evaluation matrix • Evaluation plan and time diagram • List of stakeholders consulted • Bibliography/reference • Questionnaires/other data collection instruments • System of objectives and indicators

12|Selection Criteria

The following selection criteria will be taken into consideration by the tender committee in selecting the best proposal:

Method: The proposed method for evaluating the impact of the project is suitable.

Timetable/work plan: The timetable/work plan are realistic and meet the needs of the project.

Cost: The cost of the proposal given the availability of data, analysis, method, and other aspects of

the proposal are reasonable and feasible.

Experience: The level of training and experience of the consultants in undertaking impact evaluations and recommendations from organizations for which the consultant(s) have worked previously.

Proposals should include details on methodology, work plan, costs, expertise, experiences and Curriculum Vitae (CV) of the consultant(s).

13|Mode of Payment

The agreed consultancy fee will be paid in three phases (installments): 1st Phase: The consultant shall receive 25% of the total agreed amount upon signing the contract. 2nd Phase: The consultant shall receive 25% of the total agreed amount after the submission of the draft report, and after having received feedback from relevant stakeholders. This phase includes presentation of the draft report.

3rd Phase: The consultant shall receive the remaining 50% of the total payment after incorporating all of the feedbacks received from various stakeholders and the submission of the Final Report.


14|Submission of the Technical and Financial Proposal

Re-announcement date: 25 October, 2019.

The deadline for submitting the proposal is 04 November, 2019 at 16:00 hrs. (BiH time), with “YES Sarajevo Evaluation” in the subject line. Interested External Evaluator Service Provider’s should deliver, and/or email:

Curriculum Vitae (CV) of the expert/(s) that will be engaged in fulfilling the external evaluation service.

Letter of Interest (no more than one page).

Proposal (both technical and financial).

Any document that they have to proof their expertise on external evaluation, and/or an example piece of work from a similar assignment.

***

To: SOS Children's Villages Bosnia and Herzegovina

Semira Fraste, b.b. 71000 Sarajevo Bosnia and Herzegovina

Or E-mail: [email protected] and [email protected]

Subject line: YES Sarajevo Evaluation

