assessing for impact from research · assessing for impact from research steven hill head of...
TRANSCRIPT
Assessingforimpactfromresearch
StevenHillHeadofResearchPolicy
Researchfish StrategyofImpact16November2017
FollowusonTwitterat@HEFCE
@stevenhill
Measurement,assessmentandevaluationofresearchimpactisanincreasingareaofactivitywithinuniversities.
Thishaslargelybeendrivenbyexternallyimposedsummativeassessmentprocesses.
Thereareopportunitiestousetheevidencethatisbeingcollectedfordifferentpurposes:tounderstandtheprocessesofresearch,knowledgeexchangeandimpactinnearreal-timeandusethatinsighttomakeadjustmentstomaximiseimpact.
Toachievethisweneedtofocusonimprovingreal-timeevidencecapture,data-linkingandinteroperability.Closeddatasetsareapotentialbarriertothis.
Whyassessresearchimpact?
Advocacy Accountability
Analysis Allocation
MorganJonesMandGrantJ(2013)Makingthegrade:methodologiesforassessingandevidencingresearchimpact.Deanetal.(Eds)(2013)7EssaysonImpact.DESCRIBEProjectReportforJisc.UniversityofExeter.https://www.exeter.ac.uk/media/universityofexeter/research/ourresearchexcellence/describeproject/pdfs/2013_06_04_7_Essays_on_Impact_FINAL.pdf
Advocacy Accountability
Analysis Allocation
0.0
20.0
40.0
60.0
80.0
100.0
120.0
140.0
160.0
EnglishUniversitiesinreceiptofQR
2014-15totalQRfunding(£M)
Advocacy Accountability
Analysis Allocation
0.0
20.0
40.0
60.0
80.0
100.0
120.0
140.0
160.0
EnglishUniversitiesinreceiptofQR
2014-15totalQRfunding(£M)
Advocacy Accountability
Analysis Allocation
Advocacy Accountability
Analysis Allocation
Inputs
Research,knowledgeexchangeandimpactprocesses Academicimpacts
Societalimpacts
PeopleInfrastructureKnowledgeMoney
Evidence
Evaluation
ImpactCaseStudyOutcomesdatabase
Inputs
Research,knowledgeexchangeandimpactprocesses Academicimpacts
Societalimpacts
PeopleInfrastructureKnowledgeMoney
Evidence
Evaluation
Nearreal-timefeedback
Whyassessresearchimpact?
Advocacy Accountability
Analysis Allocation
Adjustment
MorganJonesMandGrantJ(2013)Makingthegrade:methodologiesforassessingandevidencingresearchimpact.Deanetal.(Eds)(2013)7EssaysonImpact.DESCRIBEProjectReportforJisc.UniversityofExeter.https://www.exeter.ac.uk/media/universityofexeter/research/ourresearchexcellence/describeproject/pdfs/2013_06_04_7_Essays_on_Impact_FINAL.pdf
Impactassessmentforadjustmentneeds…
• Nearreal-timedatacollectionandanalysis
https://theodi.org/blog/where-are-the-uks-most-active-tech-innovation-cities
http://www.picklejarcommunications.com/wp-content/uploads/2017/11/Full-map-with-labels.pdf
Impactassessmentforadjustmentneeds…
• Nearreal-timedatacollectionandanalysis
• Betterlinkingofdatasources
Inputs
Research,knowledgeexchangeandimpactprocesses Academicimpacts
Societalimpacts
PeopleInfrastructureKnowledgeMoney
Evidence
Evaluation
ImpactCaseStudyOutcomesdatabase
Healthandlifesciences
Physicalsciencesandengineering
SocialSciences
Artsandhumanities 2206linksbetweenfundedresearch
projectsandimpactcasestudies
Impactassessmentforadjustmentneeds…
• Nearreal-timedatacollectionandanalysis
• Betterlinkingofdatasources
• Inter-operabilityandopendata
Measurement,assessmentandevaluationofresearchimpactisanincreasingareaofactivitywithinuniversities.
Thishaslargelybeendrivenbyexternallyimposedsummativeassessmentprocesses.
Thereareopportunitiestousetheevidencethatisbeingcollectedfordifferentpurposes:tounderstandtheprocessesofresearch,knowledgeexchangeandimpactinnearreal-timeandusethatinsighttomakeadjustmentstomaximiseimpact.
Toachievethisweneedtofocusonimprovingreal-timeevidencecapture,data-linkingandinteroperability.Closeddatasetsareapotentialbarriertothis.