elsevier's innovations in peer review athenes · 2016. 1. 8. · elsevier reviewer recognition...
TRANSCRIPT
![Page 1: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/1.jpg)
Elsevier’s
Innovations in Peer
ReviewReview
Dr. Bahar Mehmani
![Page 2: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/2.jpg)
Three Main DirectionThree Main Direction
Recognition: Reviewer Recognition Platform(All Elsevier Journals)
Transparency: Publishing peer review reports (selective Subjects)
Collaboration: Cross Review(Cell Press)
![Page 3: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/3.jpg)
Recognition
08/01/2016 3
Recognition
![Page 4: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/4.jpg)
Elsevier Reviewer Recognition Platform
Objective:
Collect and publicly display
reviewer activities, introduce
statuses, and provide perks
related to important
contribution of reviewerscontribution of reviewers
Current status:
• +1000 journals across all disciplines, +470,000 Reviewer Profile page
Advisors:
Prof. Dr. Lutz Prechelt
Dr. Simon Gosling
![Page 5: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/5.jpg)
My Elsevier Reviews Profile
You are a Recognized Reviewer!
>> Access My Elsevier Reviews Profile
We recognize the important contribution all reviewers make to Elsevier's journals. Based on your contribution, we have awarded you Recognized Reviewer Status.
My Latest Review
General and Comparative Endocrinology
September 2014
My Elsevier Reviews Profile
You are a Recognized Reviewer!
>> Access My Elsevier Reviews Profile
We recognize the important contribution all reviewers make to Elsevier's journals. Based on your contribution, we have awarded you Recognized Reviewer Status.
My Latest Review
General and Comparative Endocrinology
September 2014
Emails are
sent to
reviewers
08/01/2016 5
You are awarded this status as you have completed at least one manuscript review in the last two years for General and Comparative Endocrinology.
My Elsevier Reviews Profile BETA is a personalized page where you can:
• Track your reviewer status
• Claim reviewer discounts
• Collect your certificate
• Share your reviewer record.
Data Protection Notice
You are awarded this status as you have completed at least one manuscript review in the last two years for General and Comparative Endocrinology.
My Elsevier Reviews Profile BETA is a personalized page where you can:
• Track your reviewer status
• Claim reviewer discounts
• Collect your certificate
• Share your reviewer record.
Data Protection Notice
reviewers
after review
with link to
personal
profile page
![Page 6: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/6.jpg)
Volunteering for Review
08/01/2016 6
![Page 7: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/7.jpg)
Volunteer for Review via Review Profiles
08/01/2016 7
![Page 8: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/8.jpg)
08/01/2016 8
![Page 9: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/9.jpg)
Volunteering for Review via Journal Homepage
08/01/2016 9
![Page 10: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/10.jpg)
Nominated by Editor
08/01/2016 10
![Page 11: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/11.jpg)
08/01/2016 11
![Page 12: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/12.jpg)
08/01/2016 12
![Page 13: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/13.jpg)
Create your Public ProfileAnd
Claim your Reviews for
08/01/2016 13
AndClaim your Reviews for
Non-Elsevier Titles
![Page 14: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/14.jpg)
08/01/2016 14
Example: Link
![Page 15: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/15.jpg)
Transparency
08/01/2016 15
Transparency
![Page 16: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/16.jpg)
Review Reports as Articles on Science Direct
Objectives:
• Allow reviewers to receive
credit for their important
contribution
• Contribute to greater
transparency transparency
Current status:
• 5 journals since Nov. 2014
• Interlinked reviews with
separate DOIs on SD
• ORCiD listed
![Page 17: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/17.jpg)
Reviewer Feedback: Accepted Review Invite
08/01/2016 17
Review Invite
![Page 18: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/18.jpg)
• 95% said publishing review reports didn’t influence their recommendation.• 76% said the fact their reports will be publicly available didn’t change their
wording. 45% gave us consent to reveal their names.
Accepted Review Invite
08/01/2016 18
• 45% gave us consent to reveal their names.• 36% of those who preferred to stay anonymous said they will reveal their
names next time they review of the journal.• 98% said they will accept further review invites for the journal.
![Page 19: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/19.jpg)
Reviewer Feedback: Declined Review Invite
08/01/2016 19
Declined Review Invite
![Page 20: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/20.jpg)
![Page 21: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/21.jpg)
Article Usage in Science Direct
08/01/2016 21
Direct
![Page 22: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/22.jpg)
400
600
800
1.000
1.200Pe
er Re
view
Repo
rt Us
age
Feb-15
Apr-15
Jun-15
08/01/2016 22
0
200
400
Agricultural and Forest
Meteorology
Annals of Medicine and
Surgery
Engineering Fracture
Mechanics
International Journal of Surgery
Journal of Hydrology: Regional Studies
Peer
Revie
w Re
port
Usag
e
Jun-15
![Page 23: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/23.jpg)
0.60
0.80
1.00Ra
tio Pe
er Re
view
Repo
rt Us
age/A
rticle
Usag
eEngineering Fracture Mechanics
08/01/2016 23
0.00
0.20
0.40
feb-15 mar-15 apr-15 mag-15 giu-15 lug-15 ago-15
Ratio
Peer
Revie
w Us
age/A
rticle
![Page 24: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/24.jpg)
• Depends on the community’s attitude.• Spin off: Number of Peer Review reports received on Science
Direct as of 2016.
Peer Review Reports as Articles
08/01/2016 24
Direct as of 2016.• Most reviewers list their published peer review reports on their ORCiD
records under “peer review” section.• More journals will be taken on board as of 2016.
![Page 25: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/25.jpg)
Collaboration
08/01/2016 25
Collaboration
![Page 26: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/26.jpg)
• Most reviewers want to see other referee reports and be informed about the final decision.
• In case of conflicting recommendations, editors need more clarification.
Cross Review
08/01/2016 26
clarification.o Editor Invites all reviewers to a private forum where
� Reviewers can read and comment on each others reports� Answer editor’s question� Get informed about editors decision
![Page 27: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/27.jpg)
• 94% of reviewers liked the discussion and would be willing to participate in the future
• 94% of reviewers liked the discussion and would be willing to participate in the future
Initial Results for Cell Press
08/01/2016 27
• All authors felt that cross-review made it clearer how to revise their paper
• All editors found the forum useful particularly when reviewers disagreed
• All authors felt that cross-review made it clearer how to revise their paper
• All editors found the forum useful particularly when reviewers disagreed
![Page 28: Elsevier's innovations in peer review Athenes · 2016. 1. 8. · Elsevier Reviewer Recognition Platform Objective: Collect and publicly display reviewer activities, introduce statuses,](https://reader036.vdocument.in/reader036/viewer/2022071517/613a7c9f0051793c8c011219/html5/thumbnails/28.jpg)
Thank You!Thank You!