altmetrics for team science

Click here to load reader

Post on 16-Jul-2015



Health & Medicine

0 download

Embed Size (px)



IUPUI OFFICE OF ACADEMIC AFFAIRSAltmetrics Team Science & Collaborative Translational Science


Heather Coates, Assistant Librarian, University LibraryWillie Miller, Assistant Librarian, University Library

Welcome to Altmetrics for Team Science and Collaborative Translational Science. This is Heather Coates, Digital Scholarship & Data Management Librarian, University Library and I will be presenting the webinar with my librarian colleague, Willie Miller. This program is hosted by the IUPUI Office of Academic Affairs in collaboration with IUPUI Reference Librarians to assist candidates in the preparation of effective promotion and/or tenure dossiers. Todays webinar will focus on resources and strategies to help faculty develop evidence to demonstrate impact and outcomes in team science and collaborative translational research. It is important to note that candidates engaged in team sciences or collaborative work must clearly articulate their role and contributions to collaborative scholarship as well as demonstrate the significance and impact of their work in their dossier. For more information about the Promotion and/or Tenure process and to view the guidelines, please visit the Academic Affairs website As we begin the webinar, please know that you can submit questions to be answered during the program and you will be able to download program materials as well. In addition, program materials will be provided to registrants post-program via e-mail.1Citation MetricsWillie MillerAssistant Librarian, Liaison to the Schools of Informatics, Journalism, University Librarian

AltmetricsHeather CoatesDigital Scholarship & Data Management Librarian, Liaison to the Richard M. Fairbanks School of Public Health, University Library

Traditional MetricsTeam Science & Collaborative Translational ResearchMarch 5, 2015Willie Miller, MLS Informatics and Journalism Librarian4Traditional Metrics: LevelsArticle-level: citation countsJournal-level: impact factorAuthor-level: h-indexSources of DataWeb of ScienceJournal Citation Reports (JCR)ScopusGoogle Scholar CitationWeb of scienceFor author-level, article-level, and journal level metrics (JCR)

ScopusFor author-level, article-level, and institution-level metrics

Google Scholar CitationsFor author-level and article-level metrics

Citation Metrics: TrackingMarch 5, 2015

10Citation Metrics: TrackingTeam outputs# of team publicationsJournals for team publicationsHigh profile citation sources seminal article, leading researcher in the field, cited in a new policy, etc.Personal outputsContribution toward key publications or other outputsClearly identify ouputs created as part of a team versus individual or smaller group work

March 5, 2015Citation Metrics: PresentationMarch 5, 20155 Top-ranked JournalsJournalNo. of PublicationsJournal Impact Factor (2013)5-yr Impact FactorThe Lancet Neurology321.82324.075American Journal of Psychiatry313.55915.062Brain310.22610.846Neurology118.3038.375Biological Psychiatry59.47210.34712Presentation: ExamplesMarch 5, 2015Team H-index ValuesAuthorH-IndexTeam RankIra Shoulson541Elizabeth H. Aylward532*Jane S. Paulsen453Julie C. Stout424Douglas R. Langbehn335Kevin M. Duff25613AltmetricsTeam Science & Collaborative Translational ResearchMarch 5, 2015Heather Coates, MLS, MSDigital Scholarship & Data Management Librarian14Evaluating ImpactTeam Science & Collaborative Translational ResearchMarch 5, 2015March 5, 2015 March 5, 2015ImpactIndicatorsResearch Output & ActivitiesBiological materials, collaborations, data, databases, repositories, techniques & procedures, grey literature, invention disclosures, mobile apps, patents, trainees, etc. Advancement of KnowledgeBooks/chapters (inclusion in bibliographies, library ownership, textbook use), change in understanding (paradigm shift, lead to new approach), citations (first & second generation citations, countries and institutions represented), conference themes, new centers/institutesClinical Implementation (or TRIP)Biological materials, study cited in clinical decision aid, clinical/practice guidelines, diagnostic application, instruments, quality measure guidelines (govt or NPO), reporting requirementsLegislation & PolicyCommittee participation, study cited in guidelines, study cited in policy, study cited in enactment of standardsEconomic BenefitFindings cited in reduced costs for delivery of healthcare services, findings result in enhancement of existing resources and expertise, license agreements for use of IP, spinoff or startup companyCommunity BenefitPublic awareness of risk factors, patient decision materials, cited in public/private insurance benefit planAltmetricsTeam Science & Collaborative Translational ResearchMarch 5, 2015Traditional measures of impactProxy for expert evaluationTypically citation-basedLevels of evidenceJournal-levelArticle-levelScholar-levelHow can you use these in your dossier?What is the value of these metrics?

March 5, 2015Altmetrics typically measure impact of individual products19Citation-based MetricsMarch 5, 2015

Journal Level MetricsOutput/Article Level MetricsAuthor Level Metrics20AltmetricsMarch 5, 2015Web MetricsSocial Media MetricsViewUse

ShareRecommendDiscussConcepts: Viewed, Saved, Discussed, Recommended, Cited

21Altmetric ManifestoNo one can read everything. We rely on filters to make sense of the scholarly literature, but the narrow, traditional filters are being swamped. However, the growth of new, online scholarly tools allows us to make new filters; these altmetrics reflect the broad, rapid impact of scholarship in this burgeoning ecosystem. We call for more tools and research based on altmetricsMarch 5, 201522AltmetricsSupplement traditional metricsScope extends beyond the formal published scholarly record (journals & books)Timeframe: immediate to short-term impactSources: focus is on social media/engagementDOES capture qualitative data (ex: blog snippets, tweet content)March 5, 201523Types of scholarly outputsArticlesBooks & chaptersConference presentations, panels, etc.Blogs & blog postsGrey literature, conference materials, white papers, unpublished reportsLearning objects, instructional content, assessment tools, online courses, innovative use of technology, syllabi, etc.Impact on diverse populations or communities; impact on the community through media, changes in policy, law, or programsMarch 5, 201524Altmetric SourcesPublishers (e.g., PLoS, PubMed, etc.)Aggregation servicesImpact Story: Analytics: Subject repositoriesPubMedCentral (PMC)arXivSSRNInstitutional repositoriesIUPUI ScholarWorks: IUPUI DataWorks:

March 5, 201525Aggregator SourcesNews mediaSocial media platformsBlogsTwitterReference managers (e.g., Mendeley)other online conversations captured include YouTube, Wikipedia, Reddit, F1000, Q&A, Policy DocsNOT server-side views & download data

March 5, 2015March 5, 2015

27March 5, 2015

March 5, 2015

29March 5, 2015

March 5, 2015March 5, 2015

ImpactStory: ExampleMarch 5, 2015

33Plum Analytics ExampleMarch 5, 2015

34March 5, 2015The problem is not a lack of data, but how to evaluate and make sense of it.Using AltmetricsWhat is your case? What statements do you need to support?

Identify prioritiesChoose tools/platformsGatherSelectStoreVisualize

March 5, 201536Gathering DataGather manuallyFreeTime-consumingMessy & redundantTailored to your scholarship & argumentInclude unusual or field-specific sources Use an aggregator Minimal cost (individual)Less time-consumingGeneric, broad presentationHeavy emphasis on major social media channelsMarch 5, 201537Gathering Data: Altmetric.itInstall Bookmarklet the icon to your browser bookmarks toolbar

Get altmetrics for your outputsGo to URL for your article/blog post/column/code/etcClick on the shortcutGather data from the donut in a spreadsheet

Note: reliant on unique identifiers like DOI, handles, arXiv ID, SSRN ID, PMC ID, etc. but NOT limited to articles

March 5, 2015Use for databases or publishers who dont have altmetrics integrated into their platform (e.g., Web of Science)38Gathering Data: ScopusRegister for an ORCID (unique author ID)Sign up for a Scopus accountLink your ORCID to your Scopus accountMaintain an accurate list of articles associated with your profileGather data for each article (track in a spreadsheet)

March 5, 201539Manual Tracking: ExampleMarch 5, 2015

NOTE: The usage, views, and mentions data are fabricated for this example.40Presentation: ExamplesMarch 5, 2015Top 5 ArticlesTitleYearCitationsUsageViewsMentionsApathy is not depression1998351194742080*A new model for prediction of the age of onset and penetrance for Huntington's disease based on CAG length2004303269157122Generalized cognitive deficits in schizophrenia: A study of first- episode patients1999303165833090*Venezuelan kindreds reveal that genetic and environmental factors modulate Huntington's disease age of onset2004288214743480*Detection of Huntington's disease decades before diagnosis: The Predict-HD study20082345819123819*Product of the Huntington Study GroupNOTE: The usage, views, and mentions data are fabricated for this example.Insert sample tables for team science work & individual work (similar to Paul Mullins example)41Presentation: ExamplesMarch 5, 2015Top 5 Non-Article OutputsTitleImpactEvidenceHuntington Study Group websiteCommunityReceives more than 2,000 uni