Impact after REF: Issues and Opportunities

Chris HewsonSchool of Environment, Education and Development / School of Social Sciences

University of Manchester

Overview

• Models & Definitions (REF, ESRC, etc.)

• Lessons from REF

• Embedding Impact

• Supporting Impact

• Questions

Impact Model: Payback

The logic model of the Payback FrameworkHanney et al (2004)

Impact Model: SIAMPI

Social Impact Assessment Methods through Productive Interactions (EU-FP7 2010)

Impact Model: RCUK

Pathways to Impact: RCUK (2009-)

Impact Definition: ESRC

• Academic impact is the demonstrable contribution that excellent social and economic research makes to scientific advances, across and within disciplines, including significant advances in understanding, method, theory and application.

• Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organisations and nations.

Impact Definition: ESRC

• Instrumental: influencing the development of policy, practice or service provision, shaping legislation, altering behaviour

• Conceptual: contributing to the understanding of policy issues, reframing debates

• Capacity building: through technical and personal skill development.

Impact Model: REF

Why the REF Impact Case Studies are so difficult to write(especially in the social sciences and humanities)

Dunleavy (2012)

Impact Model: REF

Dunleavy (2012)

Impact Definition: REF (Panel C)

• “The main panel acknowledges that impact within its remit may take many forms and occur in a wide range of spheres. These may include (but are not restricted to): creativity, culture and society; the economy, commerce or organisations; the environment; health and welfare; practitioners and professional services; public policy, law and services.”

• “The categories used to define spheres of impact… inevitably overlap and should not be taken as restrictive. Case studies may describe impacts which have affected more than one sphere.”

Impact Definition: REF (Panel D)

Rules: REF

• Counterfactual? “‘Underpinned by’ means that the research made a distinct and material contribution to the impact taking place, such that the impact would not have occurred or would have been significantly reduced without the contribution of that research.”

• Disinterment? “Each case study must explain how (through what means) the research led to or contributed to the impact, and include appropriate sources of information external to the HEI to corroborate these claims.”

Evidence: REF (Panels C & D)

56 Indicators?

Holbrook, Barr & Brown (2013)

REF: 6 Lessons

1. Dissemination/pathways alone are not impact

2. Difficult to tie impact to specific research

3. Some impacts are direct, others mediated

4. Impact is flexible – based on reach and

significance, alongside a clear evidence trail

5. New models of social engagement and

measurement may be required

6. Corroboration is the glue, not the icing

Embedding Impact

1. Mapping relationships with stakeholders• Reviewing traditional models of dissemination

• Charting subsidiary impacts through ongoing dialogue

2. Balancing reach and significance• Critiquing the relationship between research quality and

impact

3. Assessing support requirements• Discipline specificity

• Assistance with bids

• Capturing data

Supporting Impact

1. DA Level

2. School Level

3. Faculty Level

4. University Level

Contact

Chris Hewson

chris.hewson@manchester.ac.uk

Twitter: c_d_hewson