![Page 1: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/1.jpg)
Practical implementation of research data policies:Solutions using Dataverse
Mercè Crosas, Institute for Quantitative Social Science, Harvard Universitymercecrosas.com @mercecrosas
SSP 39th Annual Meeting, Boston, June 1, 2017
![Page 2: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/2.jpg)
Data Policies and Incentives for Data Sharing
![Page 3: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/3.jpg)
The scientific community is establishing best practices for data publishing and replication
![Page 4: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/4.jpg)
Data policies adoption vary across disciplines
Gen
etic
s
Biom
edic
al
Com
puta
tiona
l Sc
ienc
e
Econ
omic
s
Ecol
ogy
“weak”= recommend“strong” = require
Castro, Crosas, Garnett, Sheridan, Altman, 2017, Journal of Scholarly Publishing, Forthcoming
![Page 5: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/5.jpg)
Authors comply with strong data policies
0
10
20
30
40
50
60
70
80
90
100
Percentage of articles with available replication material
Data Sharing in Top Political Science Journals (Key 2016)*
Mandatory Replication Material
or Verification
Replication Material
Expected
No Requirement
Key, 2016, Political Science & Politics; via: Sebastian Karcher
Recently, 27 political science journals adopted the Journals Editors’ Transparency Statement
![Page 6: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/6.jpg)
Journal guidelines encourage open data practices
NHST = null hypothesis significance testing; CI = confidence intervals; MA = meta-analysis; CI_interp = confidence intervals interpretation; ES_interp = effect size interpretation; Data_excl = exclusion criteria reported; Material = additional materials availability; Prereg = preregistered study.
In Psychology Science:• use of confidence
intervals grows from 28% in 2013 to 70% in 2015
• availability to open data, grows from 3% to 39%
Giofrè D, Cumming G, Fresc L, Boedker I, Tressoldi P (2017) The influence of journal submission guidelines on authors' reporting of statistics and use of open research practices. PLOS ONE 12(4): e0175583. https://doi.org/10.1371/journal.pone.0175583
![Page 7: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/7.jpg)
Useful recommendations in “data citation roadmap for publishers”
• Recommendations for publishers to support data policies, through pre-submission, submission, production, and publication phase.
• Preference: Add data citation in Reference list
Results from BioCaddie Data Citation Implementation Pilot and Force11 Joint Declaration of Data Citation Principles
![Page 8: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/8.jpg)
Who are the data authors? Who gets credit?
Bierer, Crosas, Pierce, 2017, Data Authorship as an Incentive to Data Sharing, The New England Journal of Medicine, DOI: 10.1056/NEJMsb1616595
![Page 9: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/9.jpg)
Solutions with Dataverse
![Page 10: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/10.jpg)
Dataverse repositories are used around the world to publish research data(dataverse.org)
Harvard Dataverseis a public data repository open to any journal and data author to deposit their data(dataverse.harvard.edu)
![Page 11: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/11.jpg)
Dataverse supports multiple options for data submission from Journals
• Recommend Harvard Dataverse as one of the data repositories your journal supports
• Create a journal dataverse, and manage data submissions associated with your journal (there are ~160 journal dataverses in Harvard Dateverse repository)
• Integrate your journal system with Dataverse using the data deposit API
![Page 12: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/12.jpg)
Dataverse also provides options for data review
• Grant access to data reviewers in your journal dataverse
• Allow anonymous data review using a private URL for each dataset
• Set up extensive data and replication review with a third party (ODUM Institute at UNC)
![Page 13: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/13.jpg)
From JournalArticle
To Data
Example: AJPS journal dataverse
![Page 14: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/14.jpg)
For AJPS: Replication review becomes part of the submission workflow
+ +
0 Resubmits
1 Resubmit
2 Resubmits
3 Resubmits
4 Resubmits
0 10 20 30 40
3
17
31
37
8
Total: 95 completed verifications
via Thu-Mai Lewis Christian, Data Archives, ODUM Institute
![Page 15: Practical implementation of research data policies: Solutions … · 2017-12-11 · Practical implementation of research data policies: Solutions using Dataverse Mercè Crosas, Institute](https://reader033.vdocument.in/reader033/viewer/2022052800/5f0f90307e708231d444c831/html5/thumbnails/15.jpg)
Thanks!
Mercè Crosas, Institute for Quantitative Social Science, Harvard Universitymercecrosas.com @mercecrosas
• At least, recommend• If you can, require• If you dare, review and replicate