supporting evaluation with unique and persistent identifiers
DESCRIPTION
Presentation at AAAS, Feb 16, 2014. https://aaas.confex.com/aaas/2014/webprogram/Session7211.htmlTRANSCRIPT
orcid.org Contact Info: p. +1-301-922-9062 a. 10411 Motor City Drive, Suite 750, Bethesda, MD 20817 USA
Supporting Evaluation with Unique and Persistent Identifiers for Researchers 16 February 2014 AAAS Annual Meeting, Chicago Rebecca Bryant, PhD
Director of Community, ORCID [email protected]
@ORCID_ORG http://orcid.org/0000-0002-2753-3881
The research community has lacked the ability to link researchers and scholars with their professional activities.
What is the problem?
• Discoverability within and across databases • Acknowledgement and citation of contributions • Author, grantee, and faculty record management • Research reporting and impact assessment
15 February 2014 orcid.org 2
Why so difficult? Relying on author names is inadequate for identification
15 February 2014 orcid.org 3
Common Names
“Estimates by China's Ministry of Public Security suggest that more than 1.1 billion people — around 85% of China's population — share just 129 surnames. Problems with abbreviations, ordering of given names and surnames and inconsistent journal practices heighten the confusion.” http://www.nature.com/news/2008/080213/full/451766a.html
15 February 2014 orcid.org 4
Multiple Names
• J. Å. S. Sørensen
• J. Aa. S. Sørensen
• J. Å. S. Sorensen
• J. Aa. S. Sorensen
• J. Å. S. Soerensen
• J. Aa. S. Soerensen
• Jens Å. S. Sørensen
• Jens Aa. S. Sørensen
• Jens Å. S. Sorensen
• Jens Aa. S. Sorensen
• Jens Å. S. Soerensen
• Jens Aa. S. Soerensen
• J. Åge S. Sørensen
• J. Aage S. Sørensen
• J. Åge S. Sorensen
• J. Aage S. Sorensen
• J. Åge S. Soerensen
• J. Aage S. Soerensen
• Jens Åge S. Sørensen
• Jens Aage S. Sørensen
• Jens Åge S. Sorensen
• Jens Aage S. Sorensen
• Jens Åge S. Soerensen
• Jens Aage S. Soerensen
An illustrative example: Jens Åge Smærup Sørensen
• J. Åge Smærup Sørensen
• J. Aage Smaerup Sørensen
• J. Åge Smarup Sorensen
• J. Aage Smarup Sorensen
• J. Åge Smaerup Soerensen
• J. Aage Smaerup Soerensen
• Jens Åge Smærup Sørensen
• Jens Aage Smaerup Sørensen
• Jens Åge Smarup Sorensen
• Jens Aage Smarup Sorensen
• Jens Åge Smærup Soerensen
• Jens Aage Smaerup Soerensen
And on and on it goes …
Name Changes
15 February 2014 orcid.org 6
Why so difficult? Contributions are also complex—more than journal articles
15 February 2014 orcid.org 7
idea People
Team Collaborations
Trainees
Affiliations Employer
Professional Associations
Funding Grants
Contracts Seed Funding
Coop Agreements
Publications Journal Articles Books Patents Legal Briefs Algorithms Software Code
Datasets Physical Objects Electronic Files Protein Structures Genetic Sequences
Impacts Policy Legal Health Environment Education Product Development Spin Off Workforce
Service Activities Peer Review
Working Groups Leadership Positions
Training and Mentoring
Many different research outputs
15 February 2014 orcid.org 8
Multiple Disciplines
15 February 2014 9
Narcolepsy Hibernation Stanford Univ. 1988-1991
Circadian Rhythms
Glutamate Receptors Stanford Univ. 1997-2006
Postdoc Policy AAAS
2001-2003
Calcium Sparks Neuron-Glial Signals Potassium Channels
NIH 1997-2002 Science Workforce
Women in Science Interdisciplinary Research
NAS 2003-2007
Research Policy Evaluation Metrics
Infrastructure Discovery Logic
2007-2012
? ? ? ? One person or many
Understanding Impact
v How can we reliably connect researchers to their contributions?
v Can we expand our view of what is considered a contribution?
v How do we track research activities across careers? Databases? Organizations?
v How can we measure the impact of our training program? Funding program? Department? Project?
15 February 2014 orcid.org 10
v Funders v Universities &
research organizations
v Publishers v Professional
societies v Researchers
We all have questions:
Identifiers for Researchers Effective evaluation requires:
v Unique and persistent person-identifier that can be used throughout one’s research career, across professional activities, affiliations, nations and languages
v IDs that are integrated in standard workflows, embedded in works metadata, independent of platform, and can be linked with other IDs
v Data exchange standards, accessible data, and links to source docs
15 February 2014 orcid.org 11
v ORCID provides a non-proprietary registry of persistent unique identifiers for researchers
v ORCID iDs are embedded in research systems and ORCID provides an API that enables the interoperable exchange of information between systems
v ORCID code is open source and we support community efforts to develop tools and services
v ORCID links research information across systems through persistent identifiers
ORCID
15 February 2014 orcid.org 12
v ORCID record data marked public by researchers is published annually
15 February 2014 orcid.org 13
Interoperability
ORCID works collaboratively with the research community to ensure use and adoption of research
information exchange standards
14
Other identifiers
Funders
Universities
Professional associations
Repositories
Publishers
ORCID is a hub
120 members and growing
15
Publishing* AIP$Publishing,$AIRITI,$Aries,$Atlas,$Cactus,$Copernicus,$EBSCO,$Elsevier,$EDP$Sciences,$eJournal$Press,$eLife,$Epistemio,$Flooved,$Hindawi,$InfraFM$Academic$Publishing,$Jnl$Bone$and$Joint$Surgery,$Karger,$Landes$Bioscience,$National$Academy$of$Sciences,$Nature,$Oxford$University$Press,$Peerage$of$Science,$PLOS,$Rockefeller$University$Press,$RNAi,$ScienceOpen,$Springer,$Taylor$&$Francis,$Wiley,$Wolters$Kluwer$
Associations* American$Astronomical$Soc,$American$Chemical$Soc,$ACSESS,$AAAS,$American$Geophysical$Union,$American$Mathematical$Soc,$American$Psychological$Assn,$American$Physical$Soc,$American$Soc$Microbiology,$American$Soc$Civil$Engineers,$Assn$Computing$Machinery,$Electrochemical$Society,$IEEE,$IOP,$Modern$Language$Assn,$OSA,$Royal$Soc$Chemistry,$Soc$Neuroscience$
Funders* Autism$Speaks,$US$Department$of$Energy,$US$Food$and$Drug$Administration,$Fundação$para$a$Ciência$e$a$Tecnologia,$Japan$Science$and$Technology$Agency,$Qatar$National$Research$Foundation,$US$National$Institutes$of$Health,$UK$National$Institute$of$Health$Research,$Wellcome$Trust$
Universities*and*Research*Organizations*
Boston$Univ,$CalTech,$Cambridge$Univ,$Chalmers$Univ$Technology,$Charles$Darwin$Univ,$Chinese$Academy$of$Sciences$Library,$CERN,$Cornell$Univ,$EMBL$(EBI),$FHCRC,$Glasgow$Univ,$Harvard$Univ,$IFPRI,$KACST,$KISTI,$Consorcio$Madroño,$Forschungszentrum$Jülich,$KTH$Royal$Inst$Tech,$$MIT,$MSKCC,$National$Institute$of$Informatics,$National$Taiwan$Univ$College$of$Medicine,$National$Taiwan$Normal$Univ,$NYU$Langone$Medical$Center,$Oxford$University,$Penn$State,$Purdue$Univ,$Riga$Technical$Univ,$SUNYFStonybrook,$Texas$A&M$Univ,$Univ$Bern,$Univ.$Cadiz,$Univ$Carlos$III$de$Madrid,$Univ$Oviedo,$Univ$Zaragoza,$Univ$College$London,$Univ$Colorado,$Univ$Hong$Kong,$Univ$Kansas,$Univ$Manchester,$Univ$Michigan,$Univ$Missouri,$Univ$Politécnica$Madrid,$Univ.$Waikato,$Univ$Washington$
Repositories*and*Profile*Systems*
Altmetric,$Association$of$Users$of$Ukranian$Research$and$Academic$Network,$Australian$National$Data$Service,$AVEDAS,$British$Library,$Copyright$Clearance$Center,$CrossRef,$DataCite,$Dryad,$F1000$Research,$Faculty$of$1000,$figshare,$Impact$Story,$Knode,$M2Community,$OCLC,$PubMed$Europe$(EBI),$Symplectic,$Thomson$Reuters,$Überresearch$$
!
Publishers
Associations
Funders
Universities and Research Orgs
Repositories and Profile Systems
Americas 50%
AsiaPac 13%
EMEA 37%
Registrations growing steadily
15 February 2014 orcid.org 16
-‐
50,000
100,000
150,000
200,000
250,000
300,000
350,000
400,000
450,000
500,000
Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
Member Creator
Website
Trusted party
ORCID has issued over 525,000 identifiers since our launch in October 2012
Broad international usage
• 36 countries >10,000 unique visitors
• 84 countries >1,000 unique visitors
• Registry supports multiple character sets
• Content in Spanish, French, English, and Chinese (adding Portuguese, Korean, Japanese, and Russian in 2014)
15 February 2014 17 orcid.org
Country Visits % USA 370082 15.5% China 230908 9.7%
Portugal 155445 6.5% UK 127906 5.4% India 126960 5.3% Spain 104542 4.4% Italy 88814 3.7% Brazil 84693 3.6%
Germany 83155 3.5% Japan 75587 3.2%
Australia 63133 2.6% France 61973 2.6% Canada 50670 2.1% Iran 44592 1.9% Russia 44061 1.8%
South Korea 42598 1.8% Turkey 36496 1.5% Sweden 33458 1.4%
Netherlands 31583 1.3% Malaysia 31516 1.3% Taiwan 30983 1.3% Egypt 27373 1.1% Poland 22350 0.9%
Switzerland 22043 0.9% Mexico 21973 0.9% Vietnam 16820 0.7% Belgium 16011 0.7%
Saudi Arabia 15875 0.7% Greece 15302 0.6% Denmark 13152 0.6%
18
“Where possible, it is also recommended that contributors be uniquely identifiable, and data uniquely attributable, through identifiers which are persistent, non-proprietary, open and interoperable (e.g. through leveraging existing sustainable initiatives such as ORCID for contributor identifiers and DataCite for data identifiers).” --European Commission Grantee Guidelines http://ec.europa.eu/research/participants/data/ref/h2020/grants_manual/hi/oa_pilot/h2020-hi-oa-pilot-guide_en.pdf
http://biomedicalresearchworkforce.nih.gov/tracking-system.htm#d
Funding policy
“Greater precision and transparency of the research outputs linked to a particular funder or grant is vital to help us better understand the impact of our funding.” Liz Allen, Head of Evaluation, Wellcome Trust http://orcid.org/0000-0002-9298-3168
http://www.jisc.ac.uk/whatwedo/programmes/di_researchmanagement/researchinformation/orcid.aspx
http://openaccess.blogg.kb.se/2013/01/30/slutrapport-fran-projekt-forfattarindentifikatorer/
National adoption
15 February 2014 orcid.org 19
bit.l
y/1a
bIO
yG
Who is Integrating and How?
20
• Research Funders • Professional Associations • Publishers • Universities and Research Orgs • Repositories, CRIS, Metrics Sites
For a list of organizations and integrations see http://orcid.org/organizations/integrators
Grant applications: NIH SciENcv
15 February 2014 orcid.org 21
Link ScienCV record to ORCID using OAuth
Import iD from ORCID record
Grant applications v The US Department of Energy has integrated ORCID iDs into
their E-Link and Announcement Notices.
v The Australian NHMRC has integrated ORCID identifiers into their RGMS grant application system.
v The Wellcome Trust has integrated ORCID iDs into its eGrants application system.
http://www.nhmrc.gov.au/media/newsletters/research-tracker/2013/nhmrc-research-tracker-28-june-2013
https://www.osti.gov/elink/aboutorcid.jsp
15 February 2014 orcid.org 22
“AGU is implementing ORCIDs in our member records, editorial databases, and papers. Having the ability to uniquely identify scientists helps the society, editors, authors, and members in many ways, from improving efficiency to providing services and support.” Brooks Hanson, Director of Publications, American Geophysical Union http://orcid.org/0000-0001-6230-7145
15 February 2014 orcid.org 23
Professional associations
Publishing
15 February 2014 orcid.org 24
How are Universities
Engaging?
25
For more on university integrators see http://orcid.org/organizations/researchorganizations
• Encouraging ORCID adoption by faculty, researchers, and grad students
• Record creation • Embedding in repositories, theses and
dissertations • Tying to university identifiers/directory
information • Incorporating in researcher information/
CRIS systems
“We want to use ORCIDs to simplify the life of Oxford’s researchers for working with institutional systems and publishers’ systems by re-using already available information for publication data management and reporting. The motto is: Input once – re-use often.” Wolfram Horstmann, Associate Director, Bodleian Libraries, University of Oxford http://orcid.org/0000-0001-8673-6104
15 February 2014 orcid.org 26
Career Life Cycle
15 February 2014 orcid.org 27
http://guides.library.tamu.edu/content.php?pid=553864&sid=4564757
Third party tools: Metrics
http://impactstory.org
Use your ORCID iD to obtain usage metrics for your
public works
15 February 2014 orcid.org 28
What’s next?
• Grants & account delegation (Q1) • Triple the registry to 1.5 million users in 2014 • Build membership & support adoption: support
national memberships, reduce barriers to using authentication, document use cases
• Support adoption: Increase international reach: more languages, ambassadors, & community partners
29
Need more information?
• Find out more at http://orcid.org • More on membership at http://orcid.org/about/membership • Learn about tools to embed ORCID iDs at http://
support.orcid.org/knowledgebase/ • Subscribe to our blog at http://orcid.org/about/news and follow
@ORCID_Org on Twitter • Attend an Outreach Meeting, http://orcid.org/about/events
• May 21-22, Chicago • November 5, Tokyo
30 15 February 2014 orcid.org
Thank you!
orcid.org Contact Info: p. +1-301-922-9062 a. 10411 Motor City Drive, Suite 750, Bethesda, MD 20817 USA
Supporting Evaluation with Unique and Persistent Identifiers for Researchers 16 February 2014 AAAS Annual Meeting, Chicago Rebecca Bryant, PhD
Director of Community, ORCID [email protected]
@ORCID_ORG http://orcid.org/0000-0002-2753-3881