bibliometrics for portfolio analysis - dpcpsi · nih library | what are bibliometrics?...

24
NIH Library | http://nihlibrary.nih.gov Bibliometrics for Portfolio Analysis Chris Belter, Informationist, NIH Library [email protected]

Upload: others

Post on 23-Jul-2020

6 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Bibliometrics for

Portfolio Analysis

Chris Belter, Informationist, NIH Library

[email protected]

Page 2: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

• About bibliometrics

• Types of questions

– Collaboration

– Research topics

– Citation Impact

• Data sources and tools

Agenda

Page 3: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

About Bibliometrics

Page 4: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

What are Bibliometrics?

Bibliometrics are quantitative methods of studying scientific

research using publications as a proxy for research

Bibliometrics

Impact &

Evaluation

Page 5: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Pros

Handles large data sets

Produces reproducible

results

Impact according to a large

sample

Cons

Requires expertise to

generate and interpret

Only measures publications

Limited measure of impact

Bibliometrics: Pros and Cons

Page 6: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Types of Questions:

Collaboration

Page 7: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Individual Co-Authorship

Page 8: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Institutional Co-Authorship

Page 9: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Institute Funding

Page 10: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Types of Questions:

Research Topics

Page 11: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Paper Topics

Page 12: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Topic Evolution

Page 13: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Landscape Analysis

Page 14: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Types of Questions:

Citation Impact

Page 15: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Citation-Based Indicators

Citations indicate the value, or usefulness, of one paper to the authors of another

Measuring the total citations received by a paper indicates its usefulness to other authors

Measuring citations to a set of papers (by a laboratory, grant portfolio, institute, etc.) indicates the set’s usefulness to science

Page 16: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

The Impact Factor

0

100

200

300

400

500

0-9 20-29 40-49 60-69 80-89 >99

Art

icle

s in

20

12

-20

13

Number of Citations in 2014

Articles Published in Cell (2014 IF: 32.242)

Below the Impact Factor: 854 (74%)

Near the Impact Factor: 108 (9%)

Above the Impact Factor: 203 (17%)

Page 17: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Age and Discipline

0

20

40

60

80

100

120

2014 2013 2012 2011 2010 2009 2008 2007 2006 2005

To

p 1

0%

Cita

tio

n B

ase

line

Year of Publication

Biology & Biochemistry

Clinical Medicine

Molec Biol & Genetics

Neuroscience

Social Sciences

Page 18: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Obtain citation distribution for similar articles

Assign percentile to article based on its citation count

Repeat for all articles in the

analysis

Aggregate percentiles

Percentile Ranking

Page 19: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Rank Distribution

Top 1%6%

Top 10%21%

Top 20%16%Top 50%

28%

Below 50%29%

1,629

Articles

Page 20: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Rankings by Discipline

0% 20% 40% 60% 80% 100%

Social Sciences

Biology & Biochem

Multidisciplinary Sci

Clinical Medicine

Molec Biol & Genetics

Top1% Top10% Top20% Top50% Bel50%

Page 21: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Data Sources and Tools

Page 22: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Data Sources

• QVR, RePORTER, PubMed, Web of Science, Scopus, etc.

Publication Data

• PubMed, Web of Science, Essential Science Indicators, Scopus, etc.

Analysis Data

Page 23: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

• Google Refine and GephiData cleaning

• Science of Science (Sci2) ToolNetwork analysis

• GephiNetwork

visualization

• Sci2 and VantagePoint (and R)Text mining

Analysis Tools

Page 24: Bibliometrics for Portfolio Analysis - DPCPSI · NIH Library | What are Bibliometrics? Bibliometrics are quantitative methods of studying scientific research using publications as

NIH Library | http://nihlibrary.nih.gov

Chris Belter

[email protected]

301.451.5861

Questions?