research impact 2013 jan
TRANSCRIPT
IMPACT FACTORS
Part 3Scholarly Communication Workshops
CONTACT INFORMATION•UTSC | Sarah Forbes | [email protected]•Gerstein Science Information Centre | Gail Nichol | [email protected] or Allison Bell | [email protected]•UTM | Pam King | [email protected]
How to Assess Your Research Impact
Learning Outcomes:• Finding impact factors for journals
– JIF, Eigenfactor, SNIP, SJR
• How to find citations to your own work– Science citation lookup– Social science citation lookup
• How to quantify your research impact– H index
• AltMetrics
• Major controversies surrounding the value of citation searching
• Tips to increase the visibility of your research
How to Assess Your Research Impact
3 Citation Searching Tools
Adapted from Sigma Xi International Newsletter, volume 3, number 11/12 November/December 2004, with additions
Web of Science Scopus Google Scholar
Access Commercial Commercial Free
# of titles >10,000 >23,600 ?
Customized searches?
Yes Yes Not yet
Contains citation content back to
1945 (some back to 1900)
1996 ?
Notable features Contains older material, journal articles and proceedings
Wide international coverage, 100% of Medline content, proceedings included, patents and theses
Includes books, conferences, records from Open WorldCat Project, anything on Open Web
What can I say about the journals I publish in?
Journal Citation Reports• Journal Impact Factor
• Top journals in a field
• Eigenfactor
Scopus journal analyzer
Journal Impact Factor (JIF)
• A measure of the citations to a journal– (NOT individual articles or authors)
• One indicator of a journal’s importance
• Calculated annually by Thomson Scientific
• Published in Journal Citation Reports – (now an online database)
Journal Impact Factor
Calculated based on a two-year period – e.g. 2009
A = the number of times articles published in 2007-2008 were cited in indexed journals during 2009
B = the number of "citable items" (usually articles, reviews, proceedings or notes; not editorials and letters-to-the-editor) published in 2007-2008
2009 impact factor = A/B
(note that the 2009 impact factor was actually published in the 2010 Journal Citation Reports)
To access the Journal Citation Reports:
•Start at: http://gerstein.library.utoronto.ca/
•Click on Journal Citation Reports
There are two editions: Science and Social Sciences
A group of journals can be viewed by : Subject Category, Publisher or Country
Depending on your discipline you may need to look at both databases.
In the Science version there is a category called EDUCATION SCIENTIFIC DISCIPLINES – 27 titles
Choose one or more categories to see the journals in that area.
Choose type of data to sort by.
Social Sciences version for Education….
What do the IF numbers tell us?A single number without context is hard to interpret. Review of Educational Research has an IF of 3.326 (BUT for example in the subject of psychology the Annual Review of Psychology has an IF of 22.750).More meaningful? RER is the number one ranked journal in the area of Education and Educational Research OR 1st of 139 journals.
Click here to change the data sorted by and then sort again.
Data sorted by Impact Factor (2-year IF) – note how sorting by 5-year IF or by Eigfenfactor may change the order of journals
Click here to change the data sorted by and then sort again.
Eigenfactor Metrics
• Like the IF, essentially a ratio of number of citations to total number of articles and is a measure of a journal compared to other journals.
• Eigenfactor Score• Article Influence Score• “better rank the importance of scientific
journals or papers by viewing them in the context of the full citation network.”
Eigenfactor Score
• Articles from past 5 years
• How many times cited in the JCR year
• Consider which journals have cited –highly-cited journals have more influence
• Journal self-citations are removed
Article Influence Score
• Roughly analogous to the JIF
• Mean AIS is 1.00
• A score greater than 1.00 means that each article in the journal has above-average influence
• Metrics Eigenfactor Project was conducted by Carl Bergstrom and his laboratory at University of Washington
Scopus Journal Analytics
• Select up to 10 journals
• Graphical display
• See how journals are performing relative to each other
• More info: http://www.info.sciverse.com/scopus/scopus-in-detail/tools/journalanalyzer
SNIP
• Source-Normalized Impact per Paper
• Measures contextual citation impact by weighting citations based on the total number of citations in a subject field.
• The impact of a single citation is given higher value in subject areas where citations are less likely, and vice versa.
SJR (SCImago Journal Rank)
• SJR is a measure of scientific influence of scholarly journals that accounts for both the number of citations received by a journal and the importance or prestige of the journals where such citations come from.
• http://www.journalmetrics.com/sjr.php
• http://www.scimagojr.com/
The top ten journals ordered by number of articles on the topic of a Scopus search: buddhis*
Enter the titles of the top journals (up to 10) in the Journal Analyzer. E.g. Japanese Journal of Religious Studies, Religion, Journal of Indian Philosophy, Asian Philosophy, and Journal of the American Academy of Religion.
SCImago Journal Rank (SJR) , is a measure of the scientific prestige of scholarly sources: value of weighted citations per document.
E.g. same 5 journals
How to quantify your research impact
• H index – Both Web of Science and Scopus will calculate
an H index based on content in their database– Only looking at citations in journals
• Other sources– Google Scholar will also retrieve citations in
online sources like theses, government publications, white papers, course reading lists, books included in Google Books.
h index
• Developed by J.E. Hirsch
• Designed to “improve upon” simpler measures such as total number of citations or publications
• "A scientist has index h if h of his/her Np papers have at least h citations each, and the other (Np-h) papers have no more than h citations each."
i.e. A scholar with an index of h has published h papers, each of which has been cited by others at least h times.
Finding Who Cites You
Scopus
SCOPUS
• Best for the Sciences but now has some Social Sciences and Humanities coverage– Life Sciences >4,300 titles– Health Sciences >6,800 titles (all of Medline)– Physical Sciences >7,200 titles– Social Sciences & Humanities >5,300 titles
• References for items published 1996+• Journals, conference proceedings, trade
publications & book series
From main library portal at http://www.library.utoronto.caclick on Popular Databases and choose Scopus from list
Last name: vicente, Initial or first name: k
For broadest results, leave Affiliation blank and all Subjects checked.
Author Search
Click on the hyperlinked name for a details page about that author.
Note: A link to a details page is only shown for authors with more than one document in Scopus. Documents with insufficient data may not be matched, this can lead to more than one entry in the results list for the same author.
To see if there are any potential author matches
Select one or more authors and click View grouped with author.
Note spelling of names:Kim is spelled K i r nVicente is spelled Vincente
If you are the author you can ask Scopus to merge the records.
Now we can see the numbers for the main author entry and also for the added authors.
h index = 19
Remember that this graph and the h index of 19 only reflect citations in journals or conference proceedings. And in Scopus only citations from 1996 to the present are used.
A search in Google Scholar shows that his book, The human factor, has been cited at least 214 times.
If you have a common name, you may need to search for the title of each article you have written, one at a time.
ORCID=Open Researcher and Contributor ID
More info about Scopus and ORCID collaboration: http://www.info.sciverse.com/scopus/scopus-in-detail/orcid
link to your other identifiers (such as Scopus or ResearcherID or LinkedIn).
Researcher ID is associated with Web of Science.
Finding Who Cites You
Web of Science
From main library portal at http://www.library.utoronto.caclick on Popular Databases and choose Web of Science from list
AUTHOR SEARCH
Use this for:•citation analysis •h-index auto-generation•Author publishes under >1 name
Option to limit by topical area (or not)
107 articles found.
Who cites them?
Click “Create Citation Report”
107 articles by Vicente cited 1675 times in WOS…..
What’s indexed in WOS?
• List of journals here:– http://science.thomsonreuters.com/mjl/
• Conferences 1990+– List of conference proceedings here:
• http://thomsonreuters.com/products_services/science/science_products/a-z/conf_proceedings_citation_index
….. Next up: Scopus
Google Scholar
My Citations: author needs to setup a profile and add their own publicationsMetrics: h-index of a publication. GS displays the h5-index (i.e. 5 years)Alerts: create an alert on any querySettings: this is where you will be able to set your Library Links
How do the numbers comparefor Geoffrey Hinton?
Web of Science
Scopus Google Scholar
# of docs 203 146 337
Times cited 9,930 9,138 60,231
H-index 37 23 84
Journal Metrics on GS
How do the numbers compare?
5 year Impact Factor Eigenfactor Google Scholar
Cancer J of Clinicians Nature Nature
NEJM PNAS NEJM
Rev of Modern Physics Science Science
Annual Rev of Immunol Physical Review Letters The Lancet
Nat Rev Mol Cell Bio J Am Chem Soc Cell
Chem Rev Phys Rev B PNAS
Nat Rev Cancer J Biol Chem J of Clinical Oncology
Nat Materials Appl Phys Letters Nature Genetics
Nature NEJM JAMA
Physiological Reviews Cell Physical Review Letters
Google Scholar provides journal metrics for Humanities publications.
Google Scholar Facts
• Estimated 40% journals, 34% conferences, rest is “other”
• > coverage of non-English citations, international coverage compared to other databases
• Many unique citations in GS
• Expect duplication within GS search results
Qualitative Measure of Impact
• Intended to balance quantitative approaches• Becker Model (Bernard Becker Medical Library,
Washington University School of Medicine)– https://becker.wustl.edu/impact-assessment– Biomedical, but many measures can be applied
• Patent applications; licensing; cited in curricula; material transfer agreements generated by a study; requests for reprints; citations in a major review article; hits on research study’s web site; results factored into standards…
AltMetrics
• No one can read everything
• Rely on filters
• Traditional filters: peer review, citation counting and JIF
• Are there others worth looking at?
Article-level metrics
• PLOS ONE - >2000 articles/month
• Metrics as a discovery tool – a filter for you to find what interests you
• Data-driven stories about the post-pub reception of an article
• More info at: http://article-level-metrics.plos.org/
Scroll down to see different metrics.
The Citation Debate
General Debate
• No one source is comprehensive
• Only some formats are searchable
• Publication dates can affect results
• Citation counts provide a limited indication of impact
Journal Impact Factor (JIF) Debate
• JIFs vary across disciplines– Variants in time-to-publication
• Review journals have higher JIFs– Fewer articles per journal, cited more often
• JIF calculations are easily skewed– Heavy editorial/letter/opinion content; high/low
percentage of review articles
• Open-access journals = higher JIFs
H-Index (H-i) Debate
• H-i does not consider the context of citations– Fundamental to the argument, or just a passing ref?
• Two scientists, same h=30– A has 20 papers cited more than 1000 times– B has none
• H-i can only be compared fairly within a discipline, not between disciplines
• H-i likes a long publishing career– Greater chances for higher number of citations to
same articles
Increase Your Research Visibility
1. Do NOT automatically relinquish publishing rights– SPARC Canadian authors addendum: preserve certain
rights for your use– http://www.carl-abrc.ca/projects/author/author-e.html – Find publisher archiving and publishing policies at
SHERPA http://www.sherpa.ac.uk
2. Publish in open access journals• Find O/A journals at SHERPA
3. Self-archive your articles• https://tspace.library.utoronto.ca/• Find more archives at OpenDOAR:
http://www.opendoar.org/
Increase Your Research Visibility
• Strategies for enhancing the impact of research: https://becker.wustl.edu/impact-assessment/strategies– Use the same name variation– Standardized affiliation, no abbreviations– And many other suggestions about
dissemination and keeping track of your research….
