cris extensions to cerif for research outcomes and impact (mice) richard gartner centre for...
TRANSCRIPT
CRIS extensions to CERIF for research outcomes and impact (MICE)
Richard GartnerCentre for e-ResearchKing’s College London
“ a structured and systematic methodology for encoding information on the impact of research activities”
http://mice.cerch.kcl.ac.uk/
A follow-up to Readiness for REF (R4R)
Survey of existing literature to draw up basic taxonomy of impact indicators and measures
http://mice.cerch.kcl.ac.uk/
impact indicators: broader, essentially semantic, concepts which indicate that some impact has been achieved:- 'improved patient care', 'improved public services' and 'improved public awareness'
impact measures: measurable factors which provide evidence for whether an impact has occurred:- ''audience figures', 'increased revenue' and 'website hits'.
http://mice.cerch.kcl.ac.uk/
Plus: REF Impact PilotsENQUIRE Project Final ReportImpact case studies at KCLPURE activities model
http://mice.cerch.kcl.ac.uk/
Link table
cfImpactIndicatorIdcfImpactMeasureId
cfCountIintegercfValueFloatingPoint
cfValueJudgmentalNumericcfCountIintegerChange
cfValueFloatingPointChangecfValueJudgmentalNumericChange
CfValueJudgmentalTextcfStartDatecfEndDate
Impact indicator table
cfImpactIndicatorId
Impact indicator language tablecfImpactIndicatorId
cfText
Impact measure table
cfImpactMeasureId
Impact measurelanguage tablecfImpactMeasureId
cfText
OrgUnitProjectPersonPubl.etc.
Link tables
cfOrgUnitId etc.cfImpactMeasureId
cfClassIdcfClassSchemeId
cfStartDatecfEndDate
cfOrgUnitId etc.cfImpactIndicatorId
cfClassIdcfClassSchemeId
cfStartDatecfEndDate
Link table
cfImpactIndicatorIdcfImpactMeasureId
cfCountIintegercfValueFloatingPoint
cfValueJudgmentalNumericcfCountIintegerChange
cfValueFloatingPointChangecfValueJudgmentalNumericChange
CfValueJudgmentalTextcfStartDatecfEndDate
Impact indicator table
cfImpactIndicatorId
Impact indicator language tablecfImpactIndicatorId
cfText
Impact measure table
cfImpactMeasureId
Impact measurelanguage tablecfImpactMeasureId
cfText
<CERIF release="2008-1.0" date="2009-07-21" sourceDatabase="sample_data"> <cfResPubl_ImpactMeasure> <cfResPublId>92838</cfResPublId> <cfImpactMeasureId>mice-im-0001</cfImpactMeasureId> <cfClassId>impact-creation</cfClassId> <cfClassSchemeId>impact-roles</cfClassSchemeId> <cfStartDate>2000-04-06T00:00:00-00:00</cfStartDate> <cfEndDate>2001-04-04T00:00:00-00:00</cfEndDate> </cfResPubl_ImpactMeasure></CERIF>
OrgUnitProjectPersonPubl.etc.
Link tables
Link tables
cfOrgUnitId etc.cfImpactMeasureId
cfClassIdcfClassSchemeId
cfStartDatecfEndDate
cfOrgUnitId etc.cfImpactIndicatorId
cfClassIdcfClassSchemeId
cfStartDatecfEndDate
Link tables
cfOrgUnitId etc.cfImpactMeasureId
cfClassIdcfClassSchemeId
cfStartDatecfEndDate
cfOrgUnitId etc.cfImpactIndicatorId
cfClassIdcfClassSchemeId
cfStartDatecfEndDate OrgUnit
ProjectPersonPubl.etc.
Link table
cfImpactIndicatorIdcfImpactMeasureId
cfCountIintegercfValueFloatingPoint
cfValueJudgmentalNumericcfCountIintegerChange
cfValueFloatingPointChangecfValueJudgmentalNumericChange
CfValueJudgmentalTextcfStartDatecfEndDate
Impact indicator table
cfImpactIndicatorId
Impact indicator language tablecfImpactIndicatorId
cfText
Impact measure table
cfImpactMeasureId
Impact measurelanguage tablecfImpactMeasureId
cfText
Evaluation
St. Andrews and Atira mapped taxonomy to PURE data model
Conclusions
CRIS systems need to be extended with a new content type: Outcome, which can be related to related to e.g. Research Outputs; Journals; Conferences and Esteems
Outcomes need timestamps as they change all the time
A strong need for a standardisation process in the area before these measures should be implemented in a larger scale in a CRIS system
Evaluation
Goldsmiths studies
Goldsmiths
Based on discussions with the Research Office and in-depth analysis of 10 Goldsmiths Impact Case studies, mainly in humanities but also psychology, anthropology and sociology
Quantitative measures
number of research outputs such as articles, books, performancesnumber of media appearances and reviews number of citations numbers relating to audience or readership percentage change in behaviour, condition etc. grant value.
Impact indicators of most relevance
cultural enrichmentsocial inclusion and cohesion enriched appreciation of culture media attention improved public awareness collaboration with cultural bodies.
Recommendations
Less emphasis on quantitative measures
Numbers need contextual information
Possibly call measures 'evidence'
Evaluation
Goldsmiths studies
Survey of 19 institutions in UK
36% collect data of type recorded in MICE impact measures:-50% Textually-expressed measures of impact category15% Percentage and numeric factors
ConcernsAppropriateness of using numbers to measure impactLocal collection of the data in a standard formatMore information and guidance in relation to measuring impact
@KingsCeRch
Centre for e-Research (CeRch) at King's College London
http://mice.cerch.kcl.ac.uk/wp-uploads/2011/05/ImpactUnderCERIF.doc
http://mice.cerch.kcl.ac.uk/