aaup 2014: altmetrics and social media (m. buschman)
TRANSCRIPT
AAUPJune 23, 2014Mike Buschman, Co-Founder Plum [email protected]@PlumAnalytics
Impact Metrics and the Research Environment
Current State of Scholarly Measure
2
Citations are lagging indicators
• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1
Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.
3
4
Legacy Metrics• Journal Impact Factor
• Journal-based measures only
• Citation Counts• Designed in the
1960’s• Lagging indicator
Plum Analytics Confidential
Researchers have Moved Online
5
Scholarly Data Exhaust
6
8
Metrics Categories
Usage
Social Media CitationsMentions
Captures
Our Approach to Altmetrics includes all 5 categories
•Citations•Usage•Captures•Mentions•Social Media
9
Altmetrics (narrowly defined)
Changing the focus on metrics
COUNTER how much your university uses the collection
Article-level metrics and
PlumX
how much the world uses your
research10
Metrics = Feedback Loops
11
Citations are lagging indicators
• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1
12Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.
Research output is more than articles…
Measure all of it
Beyond the Journal Article• Articles• Blog posts• Book chapters• Books• Cases• Clinical Trials• Conference Papers• Data Sets• Figures• Grants• Interviews 13
• Letters• Media• Patents• Posters• Presentations• Reports• Source Code• Theses /
Dissertations• Videos• Web Pages
How does this help me?
•New data to compete for grant dollars
•Showcase full breadth of impact
•New benchmarks
Performing Research
•ROI of research
•New data to make funding decisions
Funding Research
•Add value to IRs and online journals
•Recruit / retain “best” authors
Publishing Research 14
Citations are lagging indicators
• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1
15Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.
Competition for Grant $is Increasing
16
NIH: The Competition for Research $
http://report.nih.gov/NIHDatabook/Charts/Default.aspx?showm=Y&chartId=20&catId=2
Outstanding Excellent Very Good Good Fair Poor
Almost AlwaysFunded
Almost NeverFunded
Who Gets Funded?
17
Num
ber o
f Pro
posa
ls
“Gray Zone”Typically Funded
Adapted from:http://nuweb.neu.edu/nhe/insideview%20NSF.pdf
18
“Given how tight budgets are around the world, governments are rightfully demanding effectiveness in the programs they pay for.
To address these demands, we need better measurement tools to determine which approaches work and which do not.”
Bill GatesGates Foundation Annual Letter 2013
Tracking Grants ROI
19
Tracking the output associated with a grant
20
21
Sample of Metrics Sources• Amazon• Bit.ly• CrossRef• Delicious• Dryad• dSpace• ePrints• Facebook• Figshare• Github
22
• Google+• Medwave• Mendeley• Microsoft
Academic Search• PLOS• PubMed• Reddit• Research Blogging• Scopus
• SlideShare• SourceForge• Stack Overflow• Twitter• USPTO• Vimeo• Wikipedia• Worldcat• YouTube
Book Metrics
23
Turning big data into information for researchers
• Monitor promotional efforts for research
• Discover other researchers
• Where in the world are people interacting with my work?
• Where should I publish next time?• How are my co-authors performing?
24
