aaup 2014: altmetrics and social media (m. buschman)

AAUPJune 23, 2014Mike Buschman, Co-Founder Plum Analyticsmike@plumanalytics.com@PlumAnalytics

Impact Metrics and the Research Environment

Current State of Scholarly Measure

2

Citations are lagging indicators

• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1

Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.

3

4

Legacy Metrics• Journal Impact Factor

• Journal-based measures only

• Citation Counts• Designed in the

1960’s• Lagging indicator

Plum Analytics Confidential

Researchers have Moved Online

5

Scholarly Data Exhaust

6

7

8

Metrics Categories

Usage

Social Media CitationsMentions

Captures

Our Approach to Altmetrics includes all 5 categories

•Citations•Usage•Captures•Mentions•Social Media

9

Altmetrics (narrowly defined)

Changing the focus on metrics

COUNTER how much your university uses the collection

Article-level metrics and

PlumX

how much the world uses your

research10

Metrics = Feedback Loops

11

Citations are lagging indicators

• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1

12Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.

Research output is more than articles…

Measure all of it

Beyond the Journal Article• Articles• Blog posts• Book chapters• Books• Cases• Clinical Trials• Conference Papers• Data Sets• Figures• Grants• Interviews 13

• Letters• Media• Patents• Posters• Presentations• Reports• Source Code• Theses /

Dissertations• Videos• Web Pages

How does this help me?

•New data to compete for grant dollars

•Showcase full breadth of impact

•New benchmarks

Performing Research

•ROI of research

•New data to make funding decisions

Funding Research

•Add value to IRs and online journals

•Recruit / retain “best” authors

Publishing Research 14

Citations are lagging indicators

• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1

15Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.

Competition for Grant $is Increasing

16

NIH: The Competition for Research $

http://report.nih.gov/NIHDatabook/Charts/Default.aspx?showm=Y&chartId=20&catId=2

Outstanding Excellent Very Good Good Fair Poor

Almost AlwaysFunded

Almost NeverFunded

Who Gets Funded?

17

Num

ber o

f Pro

posa

ls

“Gray Zone”Typically Funded

Adapted from:http://nuweb.neu.edu/nhe/insideview%20NSF.pdf

18

“Given how tight budgets are around the world, governments are rightfully demanding effectiveness in the programs they pay for.

To address these demands, we need better measurement tools to determine which approaches work and which do not.”

Bill GatesGates Foundation Annual Letter 2013

Tracking Grants ROI

19

Tracking the output associated with a grant

20

21

Sample of Metrics Sources• Amazon• Bit.ly• CrossRef• Delicious• Dryad• dSpace• ePrints• Facebook• Figshare• Github

22

• Google+• Medwave• Mendeley• Microsoft

Academic Search• PLOS• PubMed• Reddit• Research Blogging• Scopus

• SlideShare• SourceForge• Stack Overflow• Twitter• USPTO• Vimeo• Wikipedia• Worldcat• YouTube

Book Metrics

23

Turning big data into information for researchers

• Monitor promotional efforts for research

• Discover other researchers

• Where in the world are people interacting with my work?

• Where should I publish next time?• How are my co-authors performing?

24

Metrics provide a Feedback Loop

25

Thanks!

Mike Buschmanmike@plumanalytics.com

@mikebuschman