usage factor vs. impact factor: a case study with
Post on 21-Oct-2014
1.681 views
DESCRIPTION
TRANSCRIPT
![Page 1: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/1.jpg)
Usage Factor vs. Impact Factor: A case study withBioOne Journals
Jason Price, PhD Head of Collections and Acquisitions, Claremont University Consortium
eJournal Package Analyst, Statewide Calif. Electronic Library Consortium
![Page 2: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/2.jpg)
Researcher opinion on usefulness metric: Downloads as good (or better) than citations
CIBER: New journal publishing models: an international survey of senior researchers; Ian Rowlands and Dave Nicholas, 2005
![Page 3: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/3.jpg)
Researcher opinion on usefulness metric: Downloads better than citations
CIBER: New journal publishing models: an international survey of senior researchers; Ian Rowlands and Dave Nicholas, 2005
![Page 4: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/4.jpg)
Downloads per researcher have increased more rapidly
than articles per researcher
Source: Elsevier Customer Research, Scopus
![Page 5: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/5.jpg)
Usage Factor - Background
• Idea: Leverage COUNTER statistics to create a universal usage-based metric of relative journal quality
• Information gathering process: – Oct 2006: In-depth interviews
• ~10 @ authors, librarians & publishers– March 2007: Web survey
• 150 librarians; 1500 Authors– June 2007: Final Report: Stage 1 (Shepherd)
• http://www.uksg.org/usagefactors/final
![Page 6: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/6.jpg)
Usage Factor Formula
Usage Factor =
Total usage over period ‘x’ of articles published during period ‘y’÷
Total articles published during period ‘y’
![Page 7: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/7.jpg)
Usage Factor - Advantages
• Can be applied to all online journals• Measures practitioner & student use • Easily calculated by publishers• Additional pre-purchase journal eval. metric• Not discipline dependent?• Data availability: more rapid? less
proprietary?
![Page 8: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/8.jpg)
Usage factor - Concerns
• More potential for abuse• Difficult to agree on length of publication
period to assess • Many publishers unwilling to provide usage
data to 3rd parties – will require audit process• Many journals published on multiple
platforms, making download # harder to count
![Page 9: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/9.jpg)
Usage Factor Pilot Study – Bioone Journals
Title-level Data (n = 134)• Impact Factor (n = 94)• Total Times Cited in ISI (2007)• 2008 Global Downloads*
* of abstracts & articles from the BioOne Platform- adjusted for automated indexing hits
• # of articles in Bioone (≈ Publication period)• 2008 Claremont and Oberlin Group
downloads
![Page 10: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/10.jpg)
Questions
1. How do impact and usage factor relate to total citations & downloads?
2. (How) Do impact and usage factor rankings differ?
3. How does usage factor compare:1. between ISI-ranked & unranked? 2. Between .1 and .2 ?
4. Does usage factor differ from local usage?[How could usage factor be used to promote or
select Bioone journals?]
![Page 11: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/11.jpg)
Strong?
Impact Factor Usage Factor
2007ISI
CitationsStrong? Weak?
2008 Global
DownloadsWeak? Strong?
2007
![Page 12: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/12.jpg)
Impact and usage factor ranks are not related
![Page 13: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/13.jpg)
0
10
20
30
40
50
60
70
80
90
100
(low
er)-
->RA
NK-
->(h
ighe
r)
(lower)-->RANK-->(higher)
IF_rankUF_rank_(ISIJs)
num art?
Higher impact journals with lower usage factor
![Page 14: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/14.jpg)
Higher usage journals with lower impact factor
0
10
20
30
40
50
60
70
80
90
100
(low
er)-
->RA
NK-
->(h
ighe
r)
(lower)-->RANK-->(higher)
IF_rankUF_rank_(ISIJs)
num art?
![Page 15: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/15.jpg)
0
20
40
60
80
100
120
140
(low
er)-
->RA
NK-
->(h
ighe
r)
(lower)-->RANK-->(higher)
IF_rankUF_rank(All)num art?
UF_rank(All)--not ISI rated
![Page 16: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/16.jpg)
Bioone Profile
Count of Coll.Coll. ISI Ranked? Total
1Yes 72No 14
1 Total 862Yes 23No 25
2 Total 48Grand Total 134
![Page 17: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/17.jpg)
Largely overlapping usage factor distributions
![Page 18: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/18.jpg)
Local usage unrelated to usage factor
![Page 19: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/19.jpg)
Back to Survey Data: Librarian results: new journals
Ranking without Usage Factor Ranking with Usage Factor
1. Feedback from library users 1. Feedback from library users
2. Price 2. Usage Factor
3. Reputation/status of publisher 3.Price
4. Impact Factor 4. Impact Factor
5. Reputation/status of publisher
![Page 20: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/20.jpg)
Survey Data: Librarian results: existing journals
Ranking without Usage Factor
Ranking with Usage Factor
1. Feedback from library users 1. Feedback from library users
2. Usage 2. Usage
3. Price 3. Usage Factor
4. Cost per Download 4. Price
5. Impact Factor 5. Cost per Download
6. Reputation/status of publisher
6. Impact Factor
7. Reputation/status of Publisher
“I would view Usage Factor as an aid for collection rather than cancellation decisions. Usage per se is a more suitable tool for us when considering cancellation.”
![Page 21: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/21.jpg)
Usage Factor - Stage 2
• Project Steering Group established – 6 publishers – 1 aggregator – 1 hosting service
• Usage logs converted to uniform standard report format for analysis by expert third party
• RFP for third party selection process
![Page 22: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/22.jpg)
Stage 2 – Deliverables A report (early 2009) which will:
Outline the various metrics assessed
Recommend which of them prove consistent and robust enough to be adopted for scaled up onward monitoring
Suggest any ways in which data providers might amend the way they capture, structure, label, and maintain their data which would make the measurement of Usage Factors easier and more reliable.
Propose ways to audit Usage Factor for accuracy
![Page 23: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/23.jpg)
Summary: Usage Factor Implications
• Can break down the ISI ‘divide’• More favorable evaluation of
practitioner/student used journals• Can be used to show value of less well known
journals (particularly Bioone.2)• Could be used to identify candidates for
expansion• What others?
![Page 24: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/24.jpg)
Comments
• Doesn’t address journals w/ narrow coverage / small audience
• Basic vs. Applied Science journals might be differentially affected
• Usage factor might correlate better with Impact factor if a dif’t publishing period was examined
• Need a better estimate of downloads from all platforms to verify results
![Page 25: Usage Factor vs. Impact Factor: A case study with](https://reader033.vdocument.in/reader033/viewer/2022061106/54463522afaf9f59178b45ac/html5/thumbnails/25.jpg)
Sources/FMI
• Usage Factor Website• http://www.uksg.org/usagefactors
• Rowland & Nicholas. 2005 CIBER: New journal publishing models: an international survey of senior researchers• http://www.ucl.ac.uk/ciber/pa_stm_final_report.pdf
• McDonald. 2008. Usage Factor: Final Rpt. & Next Steps• http://www.nfais.org/Usage08McDonald.ppt
----------------------• Peter Shepherd AKA Tom Angus Novel Let Them Eat Cake
A hilarious comedy caricature of the excesses of the publishing industry‘whose characters are 2nd to none in their wild & offbeat excentricity’Read more & Order http://tinyurl.com/tomangus