a guide to reproducible neuroimaging analyses...@kirstie_j doi: showing your working: a guide to...

58
@kirstie_j https://GitHub.com/KirstieJane/ReproducibleResearch doi: https://dx.doi.org/10.6084/m9.figshare.4244996 Showing your working: A guide to reproducible neuroimaging analyses

Upload: others

Post on 31-Dec-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Showing your working:A guide to reproducible neuroimaging analyses

Page 2: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

• Postdoc in Brain Mapping Unit,

Department of Psychiatry,

University of Cambridge

• 2016/17 Mozilla Fellow for Science

Page 3: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Reproduciblevs Replicable

Page 4: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Data

Same Different

Co

de Sa

me

Diffe

rent

Page 5: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Data

Same Different

Co

de Sa

me

ReproducibleD

iffe

rent

Page 6: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Data

Same Different

Co

de Sa

me

Reproducible ReplicableD

iffe

rent

Page 7: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Data

Same Different

Co

de Sa

me

Reproducible ReplicableD

iffe

rent

Robust

Page 8: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Data

Same Different

Co

de Sa

me

Reproducible ReplicableD

iffe

rent

Robust Generalisable

Page 9: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Barriers to reproducible research

Page 10: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Barriers to reproducible research

Held to higher

standards than

others

Is not considered

for promotion

Takes timeSupport

additional users

Requires

additional skills

Publication bias

towards novel findings

Plead the 5th

Page 11: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Barriers to reproducible research

Held to higher

standards than

others

Is not considered

for promotion

Takes timeSupport

additional users

Requires

additional skillsPlead the 5th

Publication bias

towards novel findings

Page 12: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Barriers to reproducible research

Held to higher

standards than

others

Is not considered

for promotion

Takes timeSupport

additional users

Requires

additional skillsPlead the 5th

Publication bias

towards novel findings

Page 13: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Barriers to reproducible research

Held to higher

standards than

others

Is not considered

for promotion

Takes timeSupport

additional users

Requires

additional skillsPlead the 5th

Publication bias

towards novel findings

Page 14: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Barriers to reproducible research

Held to higher

standards than

others

Is not considered

for promotion

Takes timeSupport

additional users

Requires

additional skillsPlead the 5th

Publication bias

towards novel findings

Page 15: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Barriers to reproducible research

Held to higher

standards than

others

Is not considered

for promotion

Takes timeSupport

additional users

Requires

additional skillsPlead the 5th

Publication bias

towards novel findings

Page 16: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Start small

Page 17: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Protocols.io

Page 18: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Page 19: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Page 20: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Coding your analyses

Page 21: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Comments areyour friend!

Page 22: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Page 23: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Aim for 40% comments in your

code

Page 24: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Share your comments with the original

author

Page 25: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

(which is almost always going to be

YOU!)

Page 26: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Python vs R(vs Matlab vs STATA etc…)

Page 27: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

R Studio

https://www.rstudio.com

Page 28: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Page 29: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Shiny gallery

Page 30: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Anaconda

Page 31: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Matplotlib& Seaborn

http://matplotlib.org

http://stanford.edu/~mwaskom/software/seaborn

Page 32: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Matplotlib& Seaborn

Matplotlib gallery

Click each

example to see

source code

Page 33: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

http://matplotlib.org/examples/statistics/errorbar_demo_features.html

Page 34: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Matplotlib& Seaborn

Seaborn gallery

Page 35: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Jupyter Notebook

http://jupyter.org

Page 36: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

https://losc.ligo.org/s/events/GW150914/GW150914_tutorial.html

Page 37: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

DOI: 10.1073/pnas.1608282113

Page 38: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Page 39: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Asking for help:StackOverflow & MWEs

http://stackoverflow.com

Page 40: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Git vs GitHub

Page 41: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

www.stemmrolemodels.comwww.github.com/KirstieJane/STEMMRoleModels

Page 42: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

http://www.slideshare.net/nishanbose/introduction-to-github-55872492/7

Page 43: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

http://www.slideshare.net/nishanbose/introduction-to-github-55872492/7

Page 44: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

http://www.slideshare.net/nishanbose/introduction-to-github-55872492/7

Page 45: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

http://www.slideshare.net/nishanbose/introduction-to-github-55872492/7

Page 46: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

http://www.slideshare.net/nishanbose/introduction-to-github-55872492/7

Page 47: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

http://www.slideshare.net/nishanbose/introduction-to-github-55872492/7

Page 48: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

www.GitHub.com/KirstieJane/

ReproducibleResearch

Page 49: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Some jargon bustingMerge

ForkMarkdown

RepositoryClone

Issues

Pull requestVersion control

Commit

Release

Branch

Page 50: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Submit your first pull request!

Inspired by: https://yourfirstpr.github.io

Page 51: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Submit your first pull request!

Inspired by: https://yourfirstpr.github.io

Page 52: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Create a glossary

Page 53: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Create a glossary

Page 54: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Share resources

Page 55: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Page 56: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible
Page 57: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Communityhttps://www.mozillascience.org

http://data-carpentry.org

http://software-carpentry.org

https://www.coursera.org/specializations/jhu-data-science

https://www.coursera.org/learn/python/home/info

Page 58: A guide to reproducible neuroimaging analyses...@kirstie_j  doi:  Showing your working: A guide to reproducible

@kirstie_jhttps://GitHub.com/KirstieJane/ReproducibleResearch

doi: https://dx.doi.org/10.6084/m9.figshare.4244996

Thank you!KirstieJane/ReproducibleResearch

@kirstie_j

doi: 10.6084/m9.figshare.4244996