SIOR: recognition of the social impact of research through
open access resources
IMPACT-EVEvaluating the impact and
outcomes of European SSH research (2014-2017)
Research Team
Director: CREA – University of Barcelona, Spain,
Members:
MTAK KIK-TTO, Hungary (András Schubert, Editor of Scientometrics)
Trinity College Dublin, Ireland. (Paul Holm, the President of the European Consortium for Humanities Institutes and Centres (ECHIC)
DANS-KNAW, The Netherlands, Center for Organisational Research (CORe), Università della Svizzera Italiana, Switzerland, Institute for Economic Research on Firms and Growth (CERIS–CNR), Italy, Trinity Long Room Hub, Population and Social Policy Consultants (PSPC), Belgium, Health Economics Research Group (HERG), Brunel University, United Kingdom.
IMPACT-EV
Some of the research activities the European Commission are requesting us to conduct:
1. The criteria and quantification of the social impact (ex ante and ex-post) of projects from all scientific areas.
2. To explain the evaluators how to use these criteria
3. The ex-post evaluation of all SSH projects of the PF7 (2007-2013) and last call FP6 (2006).
4. The creation of an open repository on research social impact.
Some of the research activities the European Commission are requesting us to conduct:
1. The criteria and quantification of the social impact (ex ante and ex-post) of projects from all scientific areas.
2. To explain the evaluators how to use these criteria
3. The ex-post evaluation of all SSH projects of the PF7 (2007-2013) and last call FP6 (2006).
4.The creation of an open repository on research social impact:SIOR
Social Impact- Researchers are not used to think about their
work as generating social impact… - Not a tradition of gathering evidences of our
research social impact- Social Impact occurs beyond the research
projects lifespan- Problems of attribution- How to measure social impact
…
“It is a bad idea to keep repacking one's
bags for a trip that one never takes”
Talcott Parsons
Olin Wright, E. Class Counts: comparative studies in class analysis(Cambridge University Press, 1997), p.15.
Here during these two days at the #ORCIDCASRAI15, we are all starting the trip…
What is SIOR?
SIOR is a non-profit initiative launched by the IMPACT-EV
consortium (European Commission).
http://www.ub.edu/sior/index.php
SIOR is an open source repository to store evidence of social impact.
Any researcher or research group around the world can freely upload evidence of their research social impact
through registering to SIOR with an ORCID id.
Any institution or citizen around the world can freely see the evidences of the studies, researchers and research groups with social impact factor through registering to SIOR with an
ORCID id.http://www.ub.edu/sior/index.php
SOCIAL IMPACT OPEN REPOSITORYhttp://www.ub.edu/sior/sior.php [email protected]
Why ?
To respond to the open demand of measurable parameters of social improvements generated by scientific projects, promoting a necessary alternative to the stagnation of scientific results and enabling real social impact.
What is contributing to?
Enhance SSH research with social impactAllow researchers and research institutions make clear contributions to science, to the societies and to their own work (linked to ORCID)Increase the visibility of this research worldwideWidening the concern about social impact across the esearch community
How does SIOR work?
SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
• Percentage of improvement achieved in relation to the starting situation.
• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one
• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time
SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
• Percentage of improvement achieved in relation to the starting situation.
• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one
• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time
SIOR takes those targets already defined by citizens through their democratically
elected representatives as a reference to define what is considered social impact.
Font: http://ec.europa.eu/archives/commission_2010-2014/president/news/documents/pdf/20100303_1_en.pdf
SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
• Percentage of improvement achieved in relation to the starting situation.
• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one
• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time
SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
• Percentage of improvement achieved in relation to the starting situation.
• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one
• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time
Score Criteria
10 30% of improvement
9 20-29% of improvement
8 10-19% of improvement
7 Some improvement
SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets
• Percentage of improvement achieved in relation to the starting situation.
• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one
• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time
SOCIAL IMPACT CRITERIA
• In this repository only the researchers and studies that have had social impact appear.
• Even if their value is 1 it means a good result, because many others do not even achieve enough social impact to be in this repository.
Example: This situation is similar to journal rankings ; for instance , to be in the 4th quartile in JCR means to have a scientific impact that most journals do not reach.
Examples
27
SOCIAL IMPACT OPEN REPOSITORYhttp://www.ub.edu/sior/sior.php [email protected]
SOCIAL IMPACT PROJECTS
INCLUSIVE CITIES PROJECTHarvard Kennedy School
Reducing urban poverty from the organizational capacities of the working poor
Restoring Fukushima
University of Tokyo
Strict control of
agricultural
products after
nuclear disaster.
Decontamination
with agricultural
procedures.
Social impact: Increase in school performance (performance rates)
Connection to UN Millennium Goals, EU2020 target or other similar official social targets
Europe 2020 Target on Education: Reducing the rates of early school leaving below 10%
Has achieved more than 30% of improvement
- La Paz Primary School (highly deprived area): Increase of a 68% in the % of students who pass the official exam on reading skills (from 17% to 85% in 5 years , 2001-2006).
- Primary school with Roma population: Increase of a 58,95% in the percentage of students who achieve read and write skills in pre-primary education (5 years old) in 2012-2013.
Transferability: at least implemented in 2 different contexts
- 172 Schools in Latin America (Argentina, Brazil, Chile, Colombia, México, Perú)
- 6 schools in UK (Cambridge, Norwich)
Social impact published on scientific journals with recognized impact (at least 1 article), governmental or non-governmental official bodies
- Scientific papers: Flecha, R., & Soler. M. (2013). Turning difficulties into possibilities: engaging Roma families and students in school through dialogic learning. Cambridge Journal of Education, 3(44), 451.465.
Sustainability of the impact throughout time
Increase in educational attainment continues in above mentioned schools
Total score: 10
Social impact: Creation of employment in locations of extreme poverty
Connection to UN Millennium Goals, EU2020 target or other similar official social targets
Europe 2020 Target on Employment: 75% of the 20-64 year-olds to be employed
Has achieved more than 30% of improvement
- One of the poorest neighborhoods in southern Europe: 39% of employment increase (586 new jobs , Miquel Fenollera Cooperative)
Transferability: at least implemented in 2 different contexts
- Catalan neighbourhood. Social initiative launched in 2013 consisting on a sewing women group.
- Primary school: school volunteers have been employed by the city council
Social impact published on scientific journals with recognized impact (at least 1 article), governmental or non-governmental official bodies
- Scientific articles . Burgués, A., Martin, S. & Santa Cruz, I. (2013). La relación entre cooperativas transformadoras y desigualdades sociales en los territorios . Scripta Nova, 427(XVII).
- Reports from City council services
Sustainability of the impact throughout time
Employment in the cooperative is sustained
Total score: 10
Before publishing the project, the SIOR team revises all the information uploaded (peer review), and if everything is correct, the project is published.
To End…
• SIOR is an ongoing process, directed by academics and counting with the support of the technical team.
• SIOR working with the funding and evaluation agencies to have access to this information (ex ante, ex post)
• SIOR is already transforming the scientific community:– Researchers who do not know whether their work has
achieved social impact, start to consider it and seek for evidences (even in finished projects)
– Researchers whose work does not have achieved social impact, start to consider so.
We cannot change the past, but we can change the present and the future, and SIOR, among other
initiatives, is already contributing to do so.
Social impact are the evidence based improvements experienced by individuals and societies (according to societal objectives), resulting from the transference of excellent research.
Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations.
Social impact are the evidence based improvements experienced by individuals and societies, according to societal objectives, resulting form the transference of excellent research.
Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations