rutgers

42
The Good, the Bad, and the Ugly: What Retractions Tell Us About Scientific Transparency Beta Phi Mu, Omicron Chapter Rutgers October 15, 2014 Ivan Oransky Co-founder, Retraction Watch http://retractionwatch.com @ivanoransky

Upload: ivan-oransky

Post on 20-Jun-2015

777 views

Category:

Science


7 download

DESCRIPTION

The Good, the Bad, and the Ugly: What Retractions Tell Us About Scientific Transparency

TRANSCRIPT

Page 1: Rutgers

The Good, the Bad, and the Ugly: What Retractions Tell Us About

Scientific Transparency

Beta Phi Mu, Omicron ChapterRutgers

October 15, 2014

Ivan OranskyCo-founder, Retraction Watch

http://retractionwatch.com@ivanoransky

Page 2: Rutgers

Is This Science Today?

Page 3: Rutgers

Retractions on the Rise

http://pmretract.heroku.com/byyear

Page 4: Rutgers

Most Retractions Due to Misconduct

PNAS online October 1, 2012

Page 5: Rutgers

Publisher Error

Page 6: Rutgers

Duplication

Page 7: Rutgers

Plagiarism

Page 8: Rutgers

Legal Reasons

Page 9: Rutgers

Lack of IRB Approval

Page 10: Rutgers

Authorship Issues

Page 11: Rutgers

Fraud: Image Manipulation

Page 12: Rutgers

Fraud: Faked Data

Page 13: Rutgers

Not Reproducible

Page 14: Rutgers
Page 15: Rutgers

How Long Do Retractions Take?

Page 16: Rutgers

How Long Do Retractions Take?

Page 17: Rutgers

What Happens to Retracted Papers’ Citations?

-Assn of College & Research Libraries 2011

Page 18: Rutgers

What Happens to Retracted Papers’ Citations?

Budd et al, 1999: • Retracted articles received more than 2,000 post-

retraction citations; less than 8% of citations acknowledged the retraction

• Preliminary study of the present data shows that continued citation remains a problem

• Of 391 citations analyzed, only 6% acknowledge the retraction

Page 19: Rutgers

What Happens to Retracted Papers’ Citations?

Page 20: Rutgers

What Happens to Retracted Papers’ Citations?

“…annual citations of an article drop by 65% following retraction, controlling for article age and calendar year. In the years prior to retraction, there is no such decline, implying that retractions are unanticipated by the scientific community.”

Page 21: Rutgers

Do Journals Get the Word Out?

Page 22: Rutgers

Do Journals Get the Word Out?

“Journals often fail to alert the naïve reader; 31.8% of retracted papers were not noted as retracted in any way.”

Page 23: Rutgers

Do Journals Get the Word Out?

How the Naïve Reader is Alerted to Retractions

Where retraction noted Retracted papers, n (%)

Watermark on pdf 305 (41.1)

Journal website 248 (33.4)

Not noted anywhere 236 (31.8)

Note appended to pdf 128 (17.3)

pdf deleted from website 98 (13.2)

Page 24: Rutgers
Page 25: Rutgers

The Euphemisms

“unattributed overlap”

Page 26: Rutgers

The Euphemisms

“unattributed overlap”an “approach”

Page 27: Rutgers

The Euphemisms

“unattributed overlap”an “approach”“a duplicate of a paper that has already been

published”…by other authors

Page 28: Rutgers

The Euphemisms

“unattributed overlap”an “approach”“a duplicate of a paper that has already been

published”…by other authors“significant originality issue”

Page 29: Rutgers

The Euphemisms

“unattributed overlap”an “approach”“a duplicate of a paper that has already been

published”…by other authors“significant originality issue”“Some sentences…are directly taken from other

papers, which could be viewed as a form of plagiarism”

Page 30: Rutgers

The Rise of Post-Publication Peer Review

Page 31: Rutgers

The Rise of Post-Publication Peer Review

-Cell 2013; 153: 1228-1238

Page 32: Rutgers

hESCs in Cell

Page 33: Rutgers

“It does however have several examples of image reuse which might be of interest to PubPeer members and readers.”

hESCs in Cell

Page 34: Rutgers

hESCs in Cell

Page 35: Rutgers

hESCs in Cell

Page 36: Rutgers

hESCs in Cell

A number of comments about these errors in articles and blogs have drawn connections to the speed of the peer review process for this paper.  Given the broad interest, importance, anticipated scrutiny of the claims of the paper and the preeminence of the reviewers, we have no reason to doubt the thoroughness or rigor of the review process.

Page 37: Rutgers

hESCs in Cell

The comparatively rapid turnaround for this paper can be attributed to the fact that the reviewers graciously agreed to prioritize attention to reviewing this paper in a timely way. It is a misrepresentation to equate slow peer review with thoroughness or rigor or to use timely peer review as a justification for sloppiness in manuscript preparation.

Page 38: Rutgers

Journals Are Listening

Page 39: Rutgers

Journals Are Listening

Page 40: Rutgers

Journals Are Listening

Page 41: Rutgers

Doing The Right Thing Pays

Page 42: Rutgers

Contact Info

[email protected]

http://retractionwatch.com

@ivanoransky

Thanks to Nancy Lapid, Reuters Health