professor teresa sordé, member of the impact-ev project research team and professor at the...
TRANSCRIPT
IMPACT-EV: Evaluating the impact and outcomes of EU
SSH research (FP7)Teresa Sordé
Autonomous University of Barcelona
Impact & the Humanities Queen’s University Belfast, 8th June 2015
The Commission eliminated the SSH in
the draft of Horizon 2020
Máire GEOGHEGAN-QUINN EU Commissioner for Research, Innovation and Science
The Academies' voices and the Parliament restored SSH, but at tenure track
All European Academies
SSH in Horizon 2020
1. Health, demographic change and wellbeing
2. Food security, sustainable agriculture and forestry, marine, maritime and inland water research, and the bioeconomy
3. Secure, clean and efficient energy4. Smart, green and integrated transport5. Climate action, environment, resource
efficiency and raw materials6. Inclusive, innovative and reflective
societies7. Secure & innovative societies
Thanks to the campaign initiated by SSH researchers, the European Parliament decided there had to be a specific Challenge on SSH
Seven broad challenges
http://europa.eu/rapid/press-release_MEMO-13-1085_ca.htm
Improvement of citizens’
living conditions
SOCIALIMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Policy implementati
on POLICY IMPACT
SCIENTIFICIMPACT
Science-basedEC
communication
NO Connectio
n
Policy makersdo not take EU
scientific research & EC
communications into account
Noimprovement of citizens' living
conditions
SOCIALIMPACT
Policy implementatio
n POLICY IMPACT
SSH with Social Impact
Support for SSH
SSH without Social Impact
Questioning the SSH
Noimprovement of citizens' living
conditions
SOCIALIMPACT
Federico Mayor Zaragoza (Director General UNESCO 1987-1999):I won’t go to another Conference where diagnoses on poverty are presented, because the best diagnosis is the autopsy but it comes too late. We need solutions based on evidences and we need them now.
Improvement of citizens’ living
conditions
SOCIALIMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Policy
implementation POLICY IMPACT
SCIENTIFICIMPACT
Science-basedEC
communication
NO Connection
Policy makersdo not take EU
scientific research & EC
communications into account
Noimprovement of citizens' living
conditions
SOCIALIMPACT
Policy implementation
POLICY IMPACT
SSH with Social ImpactSupport for SSH
SSH without Social ImpactQuestioning the SSH
Noimprovement of citizens' living
conditions
SOCIALIMPACT
Research Team
Director: Ramon Flecha (CREA – University of Barcelona, Spain)
Members:
MTAK KIK-TTO, Hungary (András Schubert, Editor of Scientometrics)
Trinity College Dublin, Ireland. (Paul Holm, the President of the European Consortium for Humanities Institutes and Centres (ECHIC)
DANS-KNAW, The Netherlands, Center for Organisational Research (CORe), Università della Svizzera Italiana, Switzerland, Institute for Economic Research on Firms and Growth (CERIS–CNR), Italy, Trinity Long Room Hub, Population and Social Policy Consultants (PSPC), Belgium, Health Economics Research Group (HERG), Brunel University, United Kingdom.
IMPACT-EV
The main objective of IMPACT-EV is to develop a permanent system of selection, monitoring and evaluation of the various
impacts of Social Sciences and the Humanities research. IMPACT-EV will not only develop indicators and standards for evaluating scientific impact of SSH research but especially, for evaluating their policy and
social impact.
Some of the research activities we are requested to conduct:
1.The criteria and quantification of the social impact (ex ante and ex-post) of projects from all scientific areas.
2.To explain the evaluators how to use these criteria
3.The ex-post evaluation of all SSH projects of the FP7 (2007-2013) and last call FP6 (2006).
4.The creation of an open repository on research social impact.
Evaluating the impact and outcomes of European SSH research
EC contribution: 2.271.709 €
Strategies for inclusion and social cohesion in Europe from Education
EC contribution: 3.361.503 €
The creation of new occupational patterns for cultural minorities
EC contribution: 650.128 €
Solidarity in European societies: Empowerment, social justice and
citizenship EC contribution: 2.495.608 €
1. Solar Energy
2. Coronary Heart disease
3. Planes
4. Alzheimer
5. Electric car6. Micro-chip
7. Alpha mannosidosis disease
8. Architecture
9. Clinical partnership
10. INCLUD-ED (SSH)
http://europa.eu/rapid/press-release_MEMO-11-520_es.htm?locale=fr
a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
112 indexed articles
Authorships: 54 female researchers24 male researchers
Among them: 27 senior35 junior
16 PhD Students
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact
Transference
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
We have transference when policy makers, NGOs, schools or citizens use our research results to plan and carry out their interventions
28th of April, 2005 - Resolution of the situation of the Romani People in the European Union:
The Council, the Commission, the member states and the candidate countries are asked to:
Consider the recognition of the Romani People as a European minority (European Parliament, P6_TA-PROV(2005)0151)
9th of March, 2011- Resolution on the EU strategy on Roma inclusion (European Parliament, 2010/2276(INI))
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
Distinguish:a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact
Social Impact
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
Problem with transference: many policy makers and citizens say that when they use researchers evidence they get worse social results
We have social impact when transference achieves better social results
Social impact are the evidence based improvements experienced by individuals
and societies, according to societal objectives, resulting form the transference
of excellent research.
1MONTSERRAT SCHOOL (Terrassa- Spain)
•Area and families from de lowest SES percentile (mostly North African families from Morocco).
•High unemployment and poverty rates.
• Learning Community since 2001/2002.
Interactive Groups
- Diverse people (volunteers, family members,...) come into the classrooms.
- Pupils are organized in heterogeneous groups
- Each volunteer facilitates the interactions among the children in each group
- The teacher manages the classroom
3CEIP LA PAZ (Albacete- Spain)
Learning community since 2006-2007
• In 2006, it was the poorest and most excluded neighborhoods in Spain
• Teachers could not go into the school. The police tried to help them and could not go either
Teachers ask for protection to enter the school
La Milagrosa neighbourhood
“Las seiscientas”
The police did not dare to enter the barrio
Social Indicator (EU2020 targets)
Social Impact Indicator from research outcomes
70% of the population between 20-65, employed
Number of new jobs in areas with high rates of unemployment
Source: Cooperativa Miguel Fenollera. (2013). Resultados de 2012 para la esperanza, en tiempos de crisis. Available at: http://www.coopmfenollera.com/2013/02/08/resultados-de-2012-para-la-esperanza-en-tiempos-de-crisis/
- 13 new jobs (10 permanent and 3 temporary contracts) in the coop.- 317 new jobs in the field of agriculture- 6 contracts to manage the labor training of employers.- 4 contracts in the management of the cooperative.
Creation of “La Milagrosa cooperative” in a neighborhood in extreme poverty (Albacete, Spain. 2011)
-non-profit
-Launched by the IMPACT-EV consortium (European Commission).http://www.ub.edu/sior/index.php
It is an open source repository to store evidence of social impact.
Any researcher or research group around the world can freely upload evidence of their research social impact.
Any institution or citizen can freely see the evidences of the studies, researchers and research groups with social impact
factor through accessing to SIOR website.
SOCIAL IMPACT OPEN REPOSITORYhttp://www.ub.edu/sior/sior.php [email protected]
In order to create a account, researchers and research institutions have to register with their ORCID ID or with their email address
Description of Research ProjectPrincipal Investigator &Research TeamSocial TargetsSocial Impact of the Project
SOCIAL IMPACT CRITERIA
1) Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
2) Percentage of improvement achieved in relation to the starting situation.
3) Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one
4) Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and
5) Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time
SIOR takes those targets already defined by citizens through their democratically
elected representatives as a reference to define what is considered social impact.
Font: http://ec.europa.eu/archives/commission_2010-2014/president/news/documents/pdf/20100303_1_en.pdf
• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
• Percentage of improvement achieved in relation to the departing situation.
Score Criteria
10 30% of improvement
9 20-29% of improvement
8 10-19% of improvement
7 Some improvement
SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
• Percentage of improvement achieved in relation to the starting situation.
• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one
• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies
• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time
SOCIAL IMPACT CRITERIA
• In this repository only the researchers and studies that have had social impact appear.
• Even if their value is 1 it means a good result, because many others do not even achieve enough social impact to be in this repository.
SOCIAL IMPACT CRITERIA
Before publishing the project, the SIOR team revises all the information uploaded (peer review), and if everything is correct, the project is published.
• Creation of employment
Museum of Human Evolution (created in 2010): •500.000 visitors •More than 1130 new jobs•Economic impact: 53 million €
Atapuerca has contributed to improve the knowledge about our own history, by discovering an hominid (Homo Antecessor), which is possibly the first human being in the European continent. Contribution to understanding humanity.
• SIOR is an ongoing process directed by academics and counting with the support of the technical team.
• SIOR is already transforming the scientific community:– Researchers who do not know whether their work has
achieved social impact, start to consider it and seek for evidences (even in finished projects)
– Researchers whose work does not have achieved social impact, start to consider it.
Allow researchers and research institutions make clear contributions to science, to the societies and to their own work
Increase the visibility of this research worldwide Addressing the concern about social impact across the research
community
We cannot change the past, but we can change the present and the future, and SIOR, among many other initiatives, is
already contributing to do so.
Thank [email protected]
@SIORepository@impact-ev
Mexico:6 schools as Learning Communities implementing SEAs3 schools participating in training on LC and implementing SEAs
Peru:7 schools as Learning Communities implementing SEAs9 schools participating in training on LC and implementing SEAs
Colombia:8 schools as Learning Communities implementing SEAs
Guatemala:3 schools participating in training on LC
Argentina:7 schools participating in training on LC in February 2015
Chile:2 school participating in training on LC in February-March 2015
• Located in Andarai (Rio de Janeiro)
• Part of the pilot of LC in Brazil
• Learning community since
2013
GEC EPITACIO PESSOA (Rio de Janeiro)
My big dream, which is the motto of Learning Communities, is to have the
community, parents, society within the school helping in the educational
process of these students.School principal, Rio de Janeiro
If I have doubts, I call the teacher, and so I am also learning, I'm remembering my school days… I learn as much they do.School employee and volunteer, Rio de Janeiro
Brazil
Learning Communities in PERU
Since 2013…
1,258 children and adolescents participating in LC
5 schools started family education activities.
10 rural schools implementing DLG.
800 teachers have known LC
65 teachers have received training on LC and SEAs
Over 150 parents and family members have participated as volunteers in the implementation of SEAs
63 family members of Piura have participated in DLG
94 Teachers have participated in Dialogic Pedagogic Gatherings
Before I didn’t have such confidence, but now I can tell my classmates what I feel, what I think, my view of the text, in
which it is helping me ... I perform better, I can participate in class, I
haven’t the fear that I had before. Student participating in DLG, Cusco
Like any parent, you want your child to succeed, to learn more, you try to teach that everything can be solved ... parents have to put their bit to make this better for them.Father, Volunteer, Lima
Peru
Mexico
It is an excellent program, I wish it will be implemented not only in this county, in this school, but nationally.Teacher, Nuevo Leon
It's very nice, children teach each other to share, to listen to different
opinions, to respect, one as a mother realizes that.
Mother, Nuevo Leon
Percentage of pupil enrolments that are regular absentees MORNING AFTERNOON Mean
Academic year 2011/2012
40% 53,45% 46,72%
Successful Educational Actions
Academic year 2012/2013
10% 19,35% 14,67%
Academic year 2013/2014
5,37% 6,79% 6,08%
Academic year 2014/2015
1,26% 0,63% 0,94%
School Absenteeism and educational success
Academic year 2011-2012
Academic year 2012-2013
21,05% 80%Transformation into a Learning Community
Outcomes in Pre-school (5 years old) (% achievement reading and writing)
MEDITERRANI SCHOOL (Tarragona- Spain)
Academic year 2011-2012
Academic year 2012-2013
30% 60%
Transformation into a Learning Community
MEDITERRANI SCHOOL (Tarragona- Spain)
Year 5: % Educational achievement
In 2012-2013 family and community participation increases- 22 family members engaged in 6 training activities held in the school
Source: Cooperativa Miguel Fenollera. (2013). Resultados de 2012 para la esperanza, en tiempos de crisis. Available at: http://www.coopmfenollera.com/2013/02/08/resultados-de-2012-para-la-esperanza-en-tiempos-de-crisis/
- 13 new jobs (10 permanent and 3 temporary contracts) in the coop.- 317 new jobs in the field of agriculture- 6 contracts to manage the labor training of employers.- 4 contracts in the management of the cooperative.
Creation of “La Milagrosa cooperative” in a neighborhood in extreme poverty (Albacete, Spain. 2011)
Distinguish:a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
Social Impact
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
SCIENTIFICIMPACT
ERA
Science-basedEC
communication
Science-basedEC
communication
Policy makers look for
science-based policies
Improvement of citizens’ living
conditions
SOCIALIMPACT
Policy implementation
POLITICAL IMPACT
Problem with transference: many policy makers and citizens argue that sometimes when they use the evidences provided by researchers, they get worse social results.
We have social impact when transference serves to achieve better social results.
Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations.
Social impact are the evidence based improvements experienced by individuals and societies, according to societal objectives, resulting form the transference of excellent research.
Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations