international standards setting · research assessment exercise held every 7 years –tied to qr...
TRANSCRIPT
![Page 1: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/1.jpg)
INTERNATIONAL STANDARDS SETTING : RESEARCH
INFORMATION
PRESENTATION TO OECD NESTI BUREAU ADVISORY GROUP MEETING
11TH SEPTEMBER 2017
Anna Clements,Assistant Director Library Services (Digital Research), University of St Andrews, UK
Executive for Strategy, euroCRIS Board
Chair, CASRAI-UK
Member, Snowball Metrics Steering Committee
orcid.org/0000-0003-2895-1310 @annakclements
Some slides courtesy Ed Simons, President euroCRIS and David Baker, Executive Director, CASRAI
![Page 2: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/2.jpg)
AGENDA
1. Why standards needed in research information management
2. CASRAI
3. euroCRIS & CERIF
4. Opportunities & Challenges – general and UK
![Page 3: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/3.jpg)
THE PROBLEM
Put simply, HEIs (and the researchers they represent) need to provide an increasing
complexity and amount of information about their research inputs, process and outcomes
to their funders
Funders and governments need this information to drive innovation, accelerate knowledge
transfer and justify investment
HEIs are measured by national and global rankings which make use of metrics and methods
which can lack transparency and legitimacy
![Page 4: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/4.jpg)
INTEROPERABILITY OF RESEARCH INFORMATION IS ESSENTIAL
• To reduce burden and so improve information quality and availability; “enter once: reuse
many”
• To allow comparisons of "apples to apples"
• For transparency and legitimacy
![Page 5: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/5.jpg)
THE THREE PILLARS OF INTEROPERABILITY
1. Agreed definitions of what is being exchanged
2. Persistent Identifiers for disambiguation for people, organisations, projects, outputs
3. Common exchange format to simplify implementation and avoid vendor lock-in
ALL SHOULD BE OPENLY AVAILABLE, SUPPLIER-AGNOSTIC AND HAVE A TRANSPARENT
SUSTAINABLE INCLUSIVE GOVERNANCE MODEL
![Page 6: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/6.jpg)
THE THREE PILLARS OF INTEROPERABILITY
1. Agreed definitions of what is being exchanged
2. Persistent Identifiers for disambiguation for people, organisations, projects, outputs
3. Common exchange format to simplify implementation and avoid vendor lock-in
ALL SHOULD BE OPENLY AVAILABLE, SUPPLIER-AGNOSTIC AND HAVE A TRANSPARENT
SUSTAINABLE INCLUSIVE GOVERNANCE MODEL
![Page 7: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/7.jpg)
CASRAI : HOW IT WORKS
• Non profit membership organisation : HEIs, research funders, non profit association partners,
solution-provider partners
• Canadian, UK and EU Chapters : Chapter Steering Committee Chair reports to CASRAI
Board
• https://casrai.org/about & https://forum.casrai.org/
• Annual work cycles:
• Open Call -> Working Groups -> Open Review -> Dictionary (may require >1 cycle)
http://casrai.org/opencall17
https://forum.casrai.org/t/2017-standards-open-review-now-closed/378
![Page 8: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/8.jpg)
CASRAI : STANDARDS IN ACTION
• Academic CV – full and abridged versions [templates/controlled vocabularies]
• http://dictionary.casrai.org/CV_-_Full_Academic ORCID, ScienCV, Canada, Portugal; EU
planning updates
• Contributor Terms [classification]
• http://dictionary.casrai.org/Contributor_Roles know as CRediT
PloS http://blogs.plos.org/plos/2016/07/author-credit-plos-and-credit-update/, Aries Systems,
NISO, more publishers in progress
• Peer Review [templates/controlled vocabularies]
• https://members.orcid.org/api/workflow/peer-review ORCID, many Publishers unofficially
![Page 9: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/9.jpg)
CASRAI : WORK IN PROGRESS
• IRIDIUM – research data glossary [CA-led]
• IMPACT – template/controlled vocabularies [UK-led]
• OPEN ACCESS – glossary [UK-led]
• CAREER LEVELS – classification [UK-led includes HESA]
• NOTICE OF AWARD – template/controlled vocabularies [UK-led]
• RESEARCH CLASSIFICATION – classification [EU-led]
• RESEARCH DATA MANAGEMENT PLAN – template/s, controlled vocabularies [CA-led]
Keep up to date and get involved at https://forum.casrai.org/
![Page 10: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/10.jpg)
EUROCRIS & CERIF : OVERVIEW
• euroCRIS is a non profit membership organisation : HEIs & other research organisations,
research funders, non profit association partners, solution-provider partners
• With over 240 institutional and personal members in 45 countries (mainly Europe, but also
North and South America, ANZ, Japan and Middle East)
• euroCRIS looks after CERIF – the Common European Research Information Format (CERIF);
an open standard data model for storing and exchanging research information
• Work done by Task Groups and Strategic Partnerships
• Next event : Strategic Membership Meeting, Bratislava, November 20-21
http://www.eurocris.org/activities/membership-meetings/bratislava-strategic-membership-
meeting-november-2017
![Page 11: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/11.jpg)
CERIF
CRIS: MultifunctionalInformationResources
![Page 12: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/12.jpg)
CRIS: MultifunctionalInformationResources
FUNCTIONALITY OF CRIS
![Page 13: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/13.jpg)
CRIS: MultifunctionalInformationResources
FUNCTIONALITY OF CRIS
![Page 14: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/14.jpg)
ADOPTION OF CRIS (OR RIM) SYSTEMS
• National Systems, include
• Norway, Netherlands, Portugal, Sweden, Slovakia, Czech Republic, Slovenia
• Research Organisations, include
• UK > 50% (and > 90% in terms of research publications) – mainly commercial Pure, Symplectic
Elements or Converis
• Italy > 60 use dSpace-CRIS based IRIS system from CINECA
• NL recently moved to commercial systems, mainly Pure; Denmark all use Pure
• Increasingly US, ANZ organisations are adopting RIM/CRIS
• UPCOMING International survey organised by OCLC and euroCRIS on RIM adoption
![Page 15: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/15.jpg)
CERIF COMPLIANCE
• Some systems are fully compliant e.g. PTCRIS in Portugal and SK CRIS in Slovakia, others
have implemented CERIF-XML for interoperating between systems e.g. Pure, dSpace-CRIS
• euroCRIS strategic partners e.g. OpenAire and ORCID are implementing CERIF
• Jisc (in UK) are CERIFying their Research Data Shared Service
• Netherlands P-O-P project exchange national funders NWO/KNAW & HEIs using CERIF-
XML
• Germany is mapping their Research Core Dataset to CERIF
• Snowball Metrics working with both CASRAI and euroCRIS
![Page 16: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/16.jpg)
OPPORTUNITIES/CHALLENGES
• Standards/interoperability seen as a ‘technical or IT problem’ not a business problem
• Need leadership from the right senior managers – they need to know cost of not doing this
• Hits individual HEIs and their researchers hardest BUT it is a sector-wide problem
• Need governments to understand total cost of lack of interoperability across entire sector
rather than separate siloed stakeholder ‘solutions’
• Membership-based non profit organisations are expertise-rich BUT cash/time poor
• Vendors & Funders are key – need to implement according to Science Europe Principles
• ORCID is a fine example of this working - it has been/is being resourced
![Page 17: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/17.jpg)
OPPORTUNITIES/CHALLENGES - UK
• Researchfish : commercial company
Annual collection of research outputs and outcomes from RCUK & Health Charity funded resesrch; no
open standards (yet!) but question set is freely available and is an ongoing and successful interoperability
pilot and working group involving HEIs and funders.
• HESA : sector-owned
Annual collections of student, staff, financial, business interaction, dest. leavers, estates data; research
information includes research income, research students, knowledge engagement and transfer activities.
• REF : public funding bodies (HEFCE, SFC, HEFCW & DELNI)
Research assessment exercise held every 7 years – tied to QR money (£1.6 billion) and reputation via
league tables; VERY important to HEIs. Data on researchers, publications/outputs, impact & environment
• High-level Research Information Management Co-ordination Group with members from JISC,
RCUK/UKRI, HEFCE, ARMA, HESA, WELLCOME – open standards key element CASRAI, euroCRIS/CERIF,
ORCID
![Page 18: International standards setting · Research assessment exercise held every 7 years –tied to QR money (£1.6 billion) and reputation via league tables; VERY important to HEIs. Data](https://reader034.vdocument.in/reader034/viewer/2022050201/5f54836b2a3f3c7dbb3dadfd/html5/thumbnails/18.jpg)
THANK YOU
PRESENTATION TO OECD NESTI BUREAU ADVISORY GROUP MEETING
11TH SEPTEMBER 2017
Anna Clements,Assistant Director Library Services (Digital Research), University of St Andrews, UK
Executive for Strategy, euroCRIS Board
Chair, CASRAI-UK
Member, Snowball Metrics Steering Committee
orcid.org/0000-0003-2895-1310 @annakclements
Some slides courtesy Ed Simons, President euroCRIS and David Baker, Executive Director, CASRAI