bibliometrics for portfolio analysis - dpcpsi · nih library | what are bibliometrics?...
TRANSCRIPT
NIH Library | http://nihlibrary.nih.gov
Bibliometrics for
Portfolio Analysis
Chris Belter, Informationist, NIH Library
NIH Library | http://nihlibrary.nih.gov
• About bibliometrics
• Types of questions
– Collaboration
– Research topics
– Citation Impact
• Data sources and tools
Agenda
NIH Library | http://nihlibrary.nih.gov
About Bibliometrics
NIH Library | http://nihlibrary.nih.gov
What are Bibliometrics?
Bibliometrics are quantitative methods of studying scientific
research using publications as a proxy for research
Bibliometrics
Impact &
Evaluation
NIH Library | http://nihlibrary.nih.gov
Pros
Handles large data sets
Produces reproducible
results
Impact according to a large
sample
Cons
Requires expertise to
generate and interpret
Only measures publications
Limited measure of impact
Bibliometrics: Pros and Cons
NIH Library | http://nihlibrary.nih.gov
Types of Questions:
Collaboration
NIH Library | http://nihlibrary.nih.gov
Individual Co-Authorship
NIH Library | http://nihlibrary.nih.gov
Institutional Co-Authorship
NIH Library | http://nihlibrary.nih.gov
Institute Funding
NIH Library | http://nihlibrary.nih.gov
Types of Questions:
Research Topics
NIH Library | http://nihlibrary.nih.gov
Paper Topics
NIH Library | http://nihlibrary.nih.gov
Topic Evolution
NIH Library | http://nihlibrary.nih.gov
Landscape Analysis
NIH Library | http://nihlibrary.nih.gov
Types of Questions:
Citation Impact
NIH Library | http://nihlibrary.nih.gov
Citation-Based Indicators
Citations indicate the value, or usefulness, of one paper to the authors of another
Measuring the total citations received by a paper indicates its usefulness to other authors
Measuring citations to a set of papers (by a laboratory, grant portfolio, institute, etc.) indicates the set’s usefulness to science
NIH Library | http://nihlibrary.nih.gov
The Impact Factor
0
100
200
300
400
500
0-9 20-29 40-49 60-69 80-89 >99
Art
icle
s in
20
12
-20
13
Number of Citations in 2014
Articles Published in Cell (2014 IF: 32.242)
Below the Impact Factor: 854 (74%)
Near the Impact Factor: 108 (9%)
Above the Impact Factor: 203 (17%)
NIH Library | http://nihlibrary.nih.gov
Age and Discipline
0
20
40
60
80
100
120
2014 2013 2012 2011 2010 2009 2008 2007 2006 2005
To
p 1
0%
Cita
tio
n B
ase
line
Year of Publication
Biology & Biochemistry
Clinical Medicine
Molec Biol & Genetics
Neuroscience
Social Sciences
NIH Library | http://nihlibrary.nih.gov
Obtain citation distribution for similar articles
Assign percentile to article based on its citation count
Repeat for all articles in the
analysis
Aggregate percentiles
Percentile Ranking
NIH Library | http://nihlibrary.nih.gov
Rank Distribution
Top 1%6%
Top 10%21%
Top 20%16%Top 50%
28%
Below 50%29%
1,629
Articles
NIH Library | http://nihlibrary.nih.gov
Rankings by Discipline
0% 20% 40% 60% 80% 100%
Social Sciences
Biology & Biochem
Multidisciplinary Sci
Clinical Medicine
Molec Biol & Genetics
Top1% Top10% Top20% Top50% Bel50%
NIH Library | http://nihlibrary.nih.gov
Data Sources and Tools
NIH Library | http://nihlibrary.nih.gov
Data Sources
• QVR, RePORTER, PubMed, Web of Science, Scopus, etc.
Publication Data
• PubMed, Web of Science, Essential Science Indicators, Scopus, etc.
Analysis Data
NIH Library | http://nihlibrary.nih.gov
• Google Refine and GephiData cleaning
• Science of Science (Sci2) ToolNetwork analysis
• GephiNetwork
visualization
• Sci2 and VantagePoint (and R)Text mining
Analysis Tools