2014 crossref annual meeting peer review panel: do it once, do it well – questioning submission...
TRANSCRIPT
![Page 1: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/1.jpg)
Peerage of Science
Janne-Tuomas Seppänen, PhD
#crossref14
@JanneSeppanen, @peeragescience
![Page 2: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/2.jpg)
"Provide ships or sails adapted to the heavenly breezes, and there will be some who will brave even that void."
@JanneSeppanen, @peeragescience
![Page 3: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/3.jpg)
Andrzej Mirecki
@JanneSeppanen, @peeragescience
![Page 4: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/4.jpg)
@JanneSeppanen, @peeragescience
![Page 5: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/5.jpg)
@JanneSeppanen, @peeragescience
![Page 6: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/6.jpg)
@JanneSeppanen, @peeragescience
![Page 7: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/7.jpg)
@JanneSeppanen, @peeragescience
![Page 8: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/8.jpg)
Peer Review!
@JanneSeppanen, @peeragescience
![Page 9: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/9.jpg)
Peer Review!
@JanneSeppanen, @peeragescience
Exclusive submission
![Page 10: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/10.jpg)
Peer Review!
@JanneSeppanen, @peeragescience
Exclusive submission
Exclusive nomination of peers
![Page 11: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/11.jpg)
Peer Review!
@JanneSeppanen, @peeragescience
Exclusive submission
Exclusive nomination of peers
Exclusive use of reviews
S T A P
S T E M
F A I L
![Page 12: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/12.jpg)
Richard HortonEditor of Lancet
“peer review is biased, unjust,
unaccountable, incomplete, easily
fixed, often insulting, usually ignorant,
occasionally foolish, and frequently
wrong”
Richard Smith
ex-Editor of BMJ
“A woeful tale of the uselessness of
peer review”
“Peer review: a flawed process at the
heart of science and journals”
@JanneSeppanen, @peeragescience
![Page 13: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/13.jpg)
WHY?
- Peer reviewers feel they are doing housework?
- Appointed authority (editor) nominates just two
or three judges
- What is the consequence of failing as peer
reviewer?
- What is the consequence of excelling as peer
reviewer?
@JanneSeppanen, @peeragescience
![Page 14: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/14.jpg)
Peerage of Science
@JanneSeppanen, @peeragescience
Give authors some ownership
Give reviewers some ownership
Let everybody (incl. Editor) choice on anonymity
Judge the peer reviewers, maker it matter to them!
Allow concurrent consideration across journals, or…
at least share the peer reviews
![Page 15: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/15.jpg)
Old Henry’s Peerage of Science
Method comparison - duration
unpredictable, long
@JanneSeppanen, @peeragescience
![Page 16: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/16.jpg)
Peerage of ScienceAuthor decides,
enforced
Method comparison - duration
@JanneSeppanen, @peeragescience
![Page 17: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/17.jpg)
20 days...... 2.5 peer reviews
Peerage of ScienceAuthor decides,
enforced
Method comparison - duration
@JanneSeppanen, @peeragescience
![Page 18: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/18.jpg)
Old Henry’s Peerage of Science
Method comparison – who reviews
Editor solicitsreviews
@JanneSeppanen, @peeragescience
![Page 19: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/19.jpg)
Peerage of Science
Editor may solicitreviews
Method comparison – who reviews
@JanneSeppanen, @peeragescience
![Page 20: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/20.jpg)
Peerage of Science
Editor may solicitreviews + Peers can
engage freely
Method comparison – who reviews
@JanneSeppanen, @peeragescience
![Page 21: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/21.jpg)
Old Henry’s Peerage of Science
Method comparison – quality control
Editor knowsreviewers
@JanneSeppanen, @peeragescience
![Page 22: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/22.jpg)
Peerage of ScienceEditor knowsreviewers
Alfred R. Wallace ([email protected])
Method comparison – who reviews
@JanneSeppanen, @peeragescience
![Page 23: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/23.jpg)
Alfred R. Wallace ([email protected])
Peerage of Science
+ peer reviews arepeer-reviewed
Editor knowsreviewers
Method comparison – who reviews
@JanneSeppanen, @peeragescience
![Page 24: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/24.jpg)
Old Henry’s Peerage of Science
Method comparison – submissions
sequential
@JanneSeppanen, @peeragescience
![Page 25: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/25.jpg)
Peerage of Science
first concurrent, thensequential
@JanneSeppanen, @peeragescience
![Page 26: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/26.jpg)
Peerage of Science
first concurrent, thensequential
@JanneSeppanen, @peeragescience
![Page 27: 2014 CrossRef Annual Meeting Peer Review Panel: Do it once, do it well – questioning submission and peer review traditions](https://reader033.vdocument.in/reader033/viewer/2022060204/559f568c1a28abf0078b46e8/html5/thumbnails/27.jpg)
Thank you!
Janne-Tuomas Seppänen, PhD
#crossref14
@JanneSeppanen, @peeragescience