altmetrics in practice - wssf -- montreal - oct 14, 2013
DESCRIPTION
World Social Science Forum presentation by Mike BuschmanTRANSCRIPT
1
?
Altmetrics in PracticeWorld Social Science Forum
Montréal – Oct 14, 2013
Mike [email protected]
@mikebuschman@plumanalytics
Plum Analytics Confidential 2
Current State of Scholarly Measure
Well-known Problems with Citation Analysis
• Self-citations• Citations added because of pressure by editors• Negative citations• Only about 30% of influences are cited*• “Informal” influence isn’t measured through citations• Secondary sources– Review articles “take” citations away from reviewed articles
• Matthew effect – the rich get richer
* MacRoberts and MacRoberts, 2010
3
4
Legacy Metrics
• Journal Impact Factor– Journal-based
measures only
• Citation Counts– Designed in the
1960’s– Lagging indicator
Plum Analytics Confidential
Scholarly Data Exhaust
6
7
PlumX provides access to the full impact spectrum
Our Approach to Altmetrics
•Captures•Mentions•Social Media•Citations•Usage
8
Altmetrics
Different Categories of Impact• Usage• Downloads, views, book holdings, ILL, document
delivery• Captures• Favorites, bookmarks, saves, readers, groups, watchers
• Mentions• Blog posts, news stories, Wikipedia articles,
comments, reviews• Social Media• Tweets, Google +1s, likes, shares, ratings
• Citations• Scopus, PubMed Citations, Microsoft Academic Search,
patents
9
Citations are lagging indicators
• Scopus = 2• Web of Science = 0• Google Scholar = 8• PubMed = 1
Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.
10
Metrics for Every Copy
11
• 59 Bitly clicks through PLOS• 21 Bitly clicks through DOI link• 92 Delicious bookmarks to PLOS• 2 Delicious bookmarks to PubMed
Plum
Ana
lytic
s Co
nfide
ntial
How can I use these metrics?• New data to compete for grant dollars• Showcase full breadth of impact• New benchmarks
Performing Research
• ROI of research• New data to make funding decisionsFunding
Research
• Uncover hidden data• Add value to IRs and online journals• Recruit / retain “best” authors
Publishing Research 12
Tracks 20+ Types of Artifacts• Articles• Blog posts• Book chapters• Books• Cases• Clinical Trials• Conference Papers• Data Sets• Figures• Grants• Interviews 13
• Letters• Media• Patents• Posters• Presentations• Reports• Source Code• Theses /
Dissertations• Videos• Web Pages
Largest List of Metrics Sources• Amazon• Bit.ly• CrossRef• Delicious• Dryad• dSpace• ePrints• Facebook• Figshare• Github
14
• Google+• Medwave• Mendeley• Microsoft
Academic Search• PLOS• PubMed• Reddit• Research Blogging• Scopus
• SlideShare• SourceForge• Stack Overflow• Twitter• USPTO• Vimeo• Wikipedia• Worldcat• YouTube
PlumX / Smithsonian
15
16
Artifact / Article Level Metrics
Book metrics
17
Research Output Summarized
Clear, visual summaries of each researcher’s or group’s output
18
19
PlumX Author Dashboard
Tabular ViewSortable, table-view of full output.
Exportable to spreadsheets or integrated into other applications.
20
21
Author / Group Visualization
Search: Measuring Present Impact Changes the Game
22
Embed Metrics Everywhere
23
24
25
Some active Projects• University of Pittsburgh
– Rolling out to full university– Metrics for 35 journals
• Cambridge Centre for Health Services– Weekly monitor of impact
of promoting their research
• Royal Society of Chemistry– Pilot to incorporate
researcher-level widget into RSC author profile site
• OHSU– Medical taxonomy + metrics
• VIVO– Apps and tools working group
• University of Alberta– Comparing top business
school researchers
• Anonymous institution– Testing impact of open access
vs. published versions in their repository
Plum Analytics Confidential 26
Groupings & Author Widgets too
27
28
Learn more:
http://www.plumanalytics.comhttps://plu.mx
@plumanalytics@mikebuschman
28Mike Buschman