elto 2010 11-ipsos presentation_26 05 2011

Nobody’s Unpredictable

Evaluation of Long Term OutcomesRANE region / Czech Republic, Russia / Challenge Europe, Creative Cities

Presentation prepared for:

May 2011 Ipsos Sp. z o.o. ● ul. Taśmowa 7 02- 677 Warszawa ● tel.: + 48 22 448 77 00 © 2010 Ipsos All rights reserved

Setting the Scene – Overall Perception of the BC Projects

Challenge Europe Project (Czech Republic)

Beneficial Changes

British Council Areas for Improvement

Creative Cities Project (Russia)

Beneficial Changes

British Council Areas for Improvement

Further comments

Impact on the BC image

Agenda

3

© 2

010

Ipso

s

Aims of the study

AIMS OF THE STUDYAIMS OF THE STUDY

The research process seeks to measure three generic types of outcome:

for the individual: personal development for the workplace or wider society and economy:

organisational development for relationships with the UK: continuing or new engagement

with the UK in a professional, institutional or commercial capacity.

Provision of systematic qualitative evidence of the achievement of the outcomes of British Council’s work along with quantitative data for

corporate, regional and country scorecards results.

4

© 2

010

Ipso

s

Methodology and sample

Qualitative phone interview (duration approx. 30-40 minutes long)

The study was conducted in two countries:•Czech Republic, 7-18 February 2011

•Russia, 7-18 February 2011

Method

Location & Date

Differentiating eligibility criteria

Sample was drawn from the British Council most important audience database within each country

• leaders (T1s) • influencers (T2s)

Sample size: 90 interviews overall (45 interviews per country)

Sample

Czech Republic Russia

Programme focus

Challenge Europe Creative Cities

Audience(no. of interviews)

T1s(n=4)

T2s(n=41)

T1s(n=4)

T2s(n=41)

5

© 2

010

Ipso

s

Setting the scene

Overall perception of the BC projects

6

© 2

010

Ipso

s

Regardless of the project, THE BC ROLE WAS PERCEIVED AS VERY IMPORTANT FOR THE LOCAL DEVELOPMENT. Main assets were:

The BC know-how and experience in running various projects in an international context

The BC willingness to invest time and resource in order to help development of other countries

Taking part in the BC initiative was regarded as of high value, enriching especially personal development

It was highly appreciated to have an opportunity to observe and learn from the way such a renown organization operates

All participants expressed a desire that the BC continues its initiatives in their countries

Overall perception of the BC projects

7

© 2

010

Ipso

s

Evaluation of long term outcomes

Challenge Europe project

8

© 2

010

Ipso

s

Beneficial Changes to Personal Development

Challenge Europe

9

© 2

010

Ipso

s

Beneficial Changes to Personal Development (1/3)

T1

-ENHANCING ONE’S KNOWLEDGE

- GAINING FEEDBACK on one’s activities (e.g. lectures delivered)

T2

-Enhancing PRO-ECOLOGY APPROACH

- BROADENING HORIZONS

- PERSONAL ENRICHMENT

- Establishing NEW CONTACTS

- MEETING EXPERTS from various fields/specialties

Changes in perceptions, attitudes and opinions:

T1 respondents were less involved in the program (perceived themselves as

observers or patrons / sponsors)

10

© 2

010

Ipso

s


T1

- DISCOVERING ORGANIZATIONAL CULTURE (way of communication with project partners, organization of work, initiation of professional relations)

T2

-ECOLOGY AWARENESS: enhancing knowledge about the issue

- Improvement of COMMUNICATION SKILLS (personal and professional)

- Improvement of PROJECT MANAGEMENT SKILLS / ORGANIZATIONAL SKILLS

- Gaining SELF-CONFIDENCE and independence

- improving ENGLISH LANGUAGE SKILLS

Acquisition of knowledge and skills:

It is highly appreciated to get the opportunity to observe the way a renown organization operates,learn from those observations and test new skills in practice.

Perceived as major contribution usable then at work / in professional life – AN INVESTMENT FOR THE FUTURE

11

© 2

010

Ipso

s


Adding to personal development was usually perceived as the main benefit of the program.

Participation in the BC program was seen as A VALUABLE AND ENRICHING EXPERIENCE

N=45

Overall score

Opportunity to work with people, also with people you don’t know and you are to create something together. Sometimes it was a fight and it was quite painful nonetheless it’s a good experience for practice and it’s priceless. (T2)

12

© 2

010

Ipso

s

Beneficial Changes to Work / Organisation / Institution

Challenge Europe

13

© 2

010

Ipso

s

Beneficial Changes to Work / Organisation / Institution (1/3)

T2

- Establishing NEW PROFESSIONAL CONTACTS

- PUBLISHING activities

Behaviour changes such as advocacy, cascade training and sustained network participation in relevant areas

T2

-INSPIRATION drawn from the way projects were managed by the BC (e.g.: role and the way facilitator operates)

-USE OF SKILLS learned: negotiation, communication, facilitating meetings, brainstorming, project management

- MORE FOCUS ON TEAM WORK

Agenda setting such as decision making, raising profile of the area and re-aligning departments/work units

14

© 2

010

Ipso

s


T1

– BEING MORE OPEN to project partners’ opinions in the future (inspired by the BC organizational culture)

T2

- Better COORDINATION & COMMUNICATION with external co-operants

- Changing STYLE OF WORKING

- Enrichment of one’s EXPERTISE that may be beneficial for the organization

- DEVELOPING IDEAS inspired by CHE program, continuing them

Institutional or concrete change such as policy creation, development of new organisational structures and new practices embedded into organisation

15

© 2

010

Ipso

s


The benefits for the organization were in most cases INDIRECT – sourced from personal enrichment of the participants

For some (mostly students) it was a certain of investment for the future

N=45

Overall score

‘I do not see it as something I could apply immediately, but for sure it

enriched me a lot and this is something I could refer to in the future. (T2, PhD

student)

16

© 2

010

Ipso

s

Beneficial Changes to Connections with the UK

Challenge Europe

17

© 2

010

Ipso

s

5. Beneficial Changes to Connections with the UK (1/2)

T2

- enhancing AWARENESS of the BC ACTIVITIES / INTEREST in the BC ACTIVITIES in general

- enhanced INTEREST in the UK in general

- better overall UK PERCEPTION

- establishing NEW PROFESSIONAL RELATIONS with similar expert organizations in the UK

- TRAVELS to the UK within the program, meeting people there

- participation in conferences abroad (UK, Poland, Finland)

T1

The BC perceived as one of the liaisons, but not the initial one.Nevertheless, its role appreciated a lot.

UK in general considered a source of inspiration in ecology.

In most cases, relations with the UK were ALREADY ESTABLISHED PRIOR TO THE PROGRAM.

18

© 2

010

Ipso

s

Beneficial Changes to Connections with the UK (2/2)

Respondents usually not perceived their participation in the program as particularly beneficial for their connections with the UK.

The main benefit from this program was enhancement of awareness of the UK / BC involvement in environmental issues and general strengthening of the UK image as a country.

N=45

Overall score

‘My perception of the UK was positive earlier, but I did not realized how ecological

awareness is developed there. I think it could be an inspiration for us. (T2 PhD student)

19

© 2

010

Ipso

s

Areas for improvements

Challenge Europe

20

© 2

010

Ipso

s

British Council Areas for Improvement (1/3)

It seems that BC PROGRAM WAS MOST BENEFICIAL FOR PERSONAL DEVELOPMENT

Many respondents were treating participation in the BC programs as an investment of some kind that may be beneficial for them personally in the future.

Scores assigned to each of the areas of the interview

It seems worthy to suggest participants how a certain program might be beneficial for their organization.

2010-11 (N) Score Personal

Score Institutional

Score Connections with UK

45 78 62 57

Research scores (mean)

21

© 2

010

Ipso

s


MORE INTENSITY OF THE PROGRAM EXECUTION: – setting clear objectives of the project – adjust timing schedule accordingly (more time devoted to execution and the results’ summary

rather than to the preparatory phase)

MORE ASSISTANCE TO LOCAL CO-OPERATORS IN PR ACTIVITIES

CHANGING CONCEPT OF BUDGET DISTRIBUTION – less on participants comfort, more on program content

IMPROVING SELECTION CRITERIA FOR PROGRAM PARTICIPANTS so they could understand better nature of the program prior to entering it – better assessment if the program would be in line with one’s personal / organization needs

ENABLING CONTACT WITH PEOPLE FROM OTHER COUNTRIES participating in the program (exchange of expertise, networking)

WE RECOMMEND THE FOLLOWING IMPROVEMENTS ON THE PROGRAM:

22

© 2

010

Ipso

s


USING THE BC OVERALL CREDENTIAL TO PROMOTE NEW PROGRAMS / ACTIVITIES the BC as a brand evoking very positive associations – competence, expertise, credibility, etc.

PROVIDING MORE INFORMATION ABOUT OTHER BC ACTIVITIESit is still often perceived as an institution organizing English courses only

INITIATES ACTIVITIES ALSO ON A REGIONAL SCALE (not only in Prague)

FURTHERMORE WE SUGGEST THE FOLLOWING ACTIVITIES:

23

© 2

010

Ipso

s

Evaluation of long term outcomes

Creative Cities project

24

© 2

010

Ipso

s

Beneficial Changes to Personal Development

Creative Cities

25

© 2

010

Ipso

s


T1

Appreciated presence of EXPERTS FROM ABROAD.

T2

- CHANGE OF PERCEPTION of one’s surroundings

-BROADENING TOPIC perception

- Overall appreciation of the NEW EXPERIENCE – working in the international context

- MEETING PEOPLE from various backgrounds, establishing contacts in general

- Contact with INSPIRING SPEAKERS

- Gaining MOTIVATION to act, to become more involved in local issues

- Gaining SELF-CONFIDENCE

Changes in perceptions, attitudes and opinions:

26

© 2

010

Ipso

s


T1

Appreciated EXAMPLES of forms of governing a city elsewhere

T2

-Discovering TEAM WORK

- BROADENING HORIZONS: learning to look at the issue from different perspectives

- Experiencing new MODEL OF RUNNING PROJECTS, facilitating meetings

- Learning NEW METHODS (e.g. brainstorming, presenting problem as a game)

- Improving COMMUNICATION, PRESENTATION SKILLS

Acquisition of knowledge and skills:

27

© 2

010

Ipso

s


Participation was regarded as an interesting and generally enriching experience.

Nevertheless, it seems that they had problems with evaluating it (usually did it in vague, general terms).

For many way the program was handled was new and surprising (cross-field participants, unique program formula).

Most valued were personal contacts established during the program. N=45

Overall score

All new projects bring interesting information and assist in one’s development. (T2 private entrepreneur)

28

© 2

010

Ipso

s

Beneficial Changes to Work / Organisation / Institution

Creative Cities

29

© 2

010

Ipso

s


T2

-INSPIRATION for undertaking new activities and adjustment of projects started during the program to the local needs

- Establishing COOPERATION WITH LOCAL CITY BOARD

Behaviour changes such as advocacy, cascade training and sustained network participation in relevant areas

T1 / T2

- BROADENING PERCEPTION of the problem

- Discovering NEW WAYS of carrying some practices

Agenda setting such as decision making, raising profile of the area and re-aligning departments/work units

30

© 2

010

Ipso

s


T2

- Applying MANAGERIAL SKILLS

- IMPROVING SKILLS: •team work / team building•training•project management•organizational skills in general

Institutional or concrete change such as policy creation, development of new organisational structures and new practices embedded into organisation

31

© 2

010

Ipso

s


Respondents’ responses were often very general and it was difficult for them to give example of tangible skill or practice that has influenced their work / organization.

They considered participation in the program beneficial indirectly, through their personal enrichment.

N=45

Overall score

‘This event broadened my outlook and taught me new ways of dealing with some practices. (T1 head of Regional Development Fund)

33

© 2

010

Ipso

s


T1

-Establishing CONTACTS with some program participants

- FINDING PARTNERS acting in the similar field (arts and culture)

T2

- Establishing NEW CONTACTS

- EXCHANGING INFORMATION with experts met during the program

- EXPANDING KNOWLEDGE about the UK in general

New contacts, strengthening of existing contacts, business opportunities, joint collaboration projects and / or cultural cooperation both within or as a result of the BC activity

Quite often connections with the UK were set earlier, both personal and professional

NOTE: The nature of the established contacts was very often passive (sending e-mail from time to time, occasional

contact via Facebook).

34

© 2

010

Ipso

s


There was declared a strong wish to make contacts with the UK representatives (business, cultural events partners).

–UK treated as a source of inspiration, country with established know how in many fields.

(Since it did not happen, there was some deal of disappointment).

N=45

Overall score

36

© 2

010

Ipso

s


In general BC PROGRAM WAS SEEN NECESSARY AND INSPIRING.

But many respondents had problems with linking acquired skills with their personal or professional activities (to give more tangible examples of change or influence).


2010-11 (N) Score Personal

Score Institutional

Score Connections with UK

45 64 65 58

Research scores (mean)

37

© 2

010

Ipso

s



WE RECOMMEND THE FOLLOWING IMPROVEMENTS ON THE PROGRAM:

PROVIDING FEEDBACK ABOUT THE OUTCOMES OF THE PROGRAM: – Information about next steps of projects implementations

ADJUSTING PROGRAM SCOPE TO THE LOCAL NEEDS (in a way to make it MORE ADEQUATE)– Showing opportunities for real implementations (practical nature rather than only theoretical /

fantasy-like)

IMPROVING SELECTION CRITERIA FOR PROGRAM PARTICIPANTS so they could understand better nature of the program prior to entering it – better assessment if the program would be in line with one’s personal / organization needs

SETTING CLEAR OBJECTIVES of the program and particular activities so as participants are sure what is expected from them

ENABLING CONTACT WITH PEOPLE FROM OTHER COUNTRIES participating in the program (exchange of expertise, networking)

38

© 2

010

Ipso

s


FURTHERMORE WE RECOMMEND THE FOLLOWING ACTIVITIES:

MORE PUBLICITY / INFORMATION ON THE BC ACTIVITIES: – the BC as an institution was not considered widely known

DEVELOPING BC INVOLVEMENT IN SIMILAR PROGRAMS– also outside Moscow – operating more on a regional scale

40

© 2

010

Ipso

s

Impact on the BC image

Overall the British Council image was very positive in both countries.

The BC was associated with expertise and willingness to share it with others.

A common wish that the BC maintains level of its involvement in Central Europe area or even increases it.

– There is still plenty of room for the BC activities, especially in programs enhancing awareness of the contemporary environmental, social, cultural issues (ecology, immigration, multi-culturalism, etc.).

The BC is considered a facilitator of social activity - with the potential to activate local communities.

41

© 2

010

Ipso

s

Impact on the BC image (2/3)

Representing the UK as a country well

Professionalexpert

capableprestigious

Pro-active approach

Inspiring others through various programs

(cultural, social, etc.)Willing to cooperate

Enhancing positive UK image through investing money in other countries

development

Helpful, competent, motivated and polite staff

Open approach: listening to others, introducing

amendments to a program if necessary

The BC image built / fostered via Challenge Europe

(in CR)

42

© 2

010

Ipso

s

Impact on the BC image (3/3)

Perceived as a facilitator of change

Inspiring others through programs it offers

Enhancing positive UK image through

involvement in local issues

Professional, friendly, up-to-the-point staff

The BC image built / fostered via

Creative Cities (in RU)

Professionalexpert

capableprestigious (aspirational)

43

© 2

010

Ipso

s

To sum up:

How to improve both programs in the future ?

Making programs more beneficial for organizations Providing clear information about programs nature and potential outcomes to avoid

misunderstanding Encouraging networking between participants on the international level Providing feedback on the outcomes of the program

elto 2010 11-ipsos presentation_26 05 2011

Documents