![Page 1: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/1.jpg)
Reusable Science:How not to slip from the shoulders of giantsChris GorgolewskiMax Planck Research Group: Neuroanatomy & Connectivity
![Page 2: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/2.jpg)
Anatomy of a giant
I. Example studies
II. Probabilistic ROIs
III.Sharing statistical maps
IV.Data papers
![Page 3: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/3.jpg)
Anatomy of a giant
I. Example studies
II. Probabilistic ROIs
III.Sharing statistical maps
IV.Data papers
![Page 4: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/4.jpg)
Study I
Medial and Lateral Networks in Anterior Prefrontal Cortex Support Metacognitive Ability for Memory
and Perception
Benjamin Baird, Jonathan Smallwood, Krzysztof J. Gorgolewski, and Daniel S. Margulies
Journal of Neuroscience (in press)
![Page 5: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/5.jpg)
Meta-cognition
• Are we equally good in judging our performance of memory or perception tasks?
• Is metacognition related to medial or lateral prefrontal cortex? Does it depend on modality?
![Page 6: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/6.jpg)
Measuring metacognition
![Page 7: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/7.jpg)
Metacognition of memory and perception are distinct systems
![Page 8: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/8.jpg)
Sources of seed points
Gilbert et al. 2006, Functional specialization within rostral prefrontal cortex (area 10): a meta-analysis. Journal of cognitive neuroscience
![Page 9: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/9.jpg)
Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010). Relating introspective accuracy to individual differences in brain structure. Science (New York, N.Y.), 329(5998), 1541–3.
Sources of seed points
![Page 10: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/10.jpg)
Meta-cognition of MemoryMeta-cognition of Perception
Baird, Smallwood et al. (in press) JON
vs.
![Page 11: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/11.jpg)
Double dissociation of metacognitive abilities
![Page 12: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/12.jpg)
Study II
The Default Modes of Reading: Modulation of posterior cingulate and medial prefrontal cortex connectivity
associated with subjective and objective differences in reading experience
Jonathan Smallwood, Krzysztof J. Gorgolewski, Johannes Golchert, Florence J.M. Ruby, Haakon G. Engen, Benjamin
Baird, Melaina Vinski, Jonathan Schooler, Daniel S. Margulies
Frontiers in Neuroscience (in press)
![Page 13: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/13.jpg)
Reading comprehension
• What is the relation between task focus and reading comprehension?
• What role does Default Mode Network play in reading comprehension and task focus?
![Page 14: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/14.jpg)
Task focus is inversely correlated with reading comprehension
![Page 15: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/15.jpg)
Smallwood, et al., Frontiers in Human Neuroscience
Reading by DefaultSeed locations
Andrews-hanna, J. R., Reidler, J. S., Sepulcre, J., Poulin, R., Buckner, R. L., & Temp, P. (2010). Functional-anatomic fractionation of the brain’s default network. Neuron, 65(4), 550–62.
![Page 16: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/16.jpg)
Smallwood, et al., Frontiers in Human Neuroscience
Reading by Default
![Page 17: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/17.jpg)
Reading by Default
Smallwood, et al., Frontiers in Human Neuroscience
![Page 18: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/18.jpg)
Why mind-wandering may disrupt reading
![Page 19: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/19.jpg)
Study III
A correspondence between the brain's intrinsic functional
architecture and the content and form of self-generated thoughts
Krzysztof J. Gorgolewski, Dan Lurie, Sebastian Urchs, Judy A. Kipping, R. Cameron Craddock, Michael P.
Milham, Daniel S. Margulies, and Jonathan Smallwood
PLoS One (submitted)
![Page 20: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/20.jpg)
Mind wandering
• What is the content and form of thoughts in mind wandering?
• How does it relate to various aspects of intrinsic BOLD activity?
![Page 21: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/21.jpg)
Questions about the content
![Page 22: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/22.jpg)
Questions about the form
![Page 23: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/23.jpg)
Future vs. Past = Words vs. Images
![Page 24: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/24.jpg)
Resting state measures
Fractional Amplitude of Low Frequency Fluctuations
Regional Homogeneity
Degree Centrality
Group average
![Page 25: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/25.jpg)
Not only Default Mode Network
![Page 26: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/26.jpg)
Not only Default Mode Network
![Page 27: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/27.jpg)
What these studies have in common?
![Page 28: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/28.jpg)
Anatomy of a giant
I. Example studies
II. Probabilistic ROIs
III.Sharing statistical maps
IV.Data papers
![Page 29: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/29.jpg)
Signal to Noise ratio
![Page 30: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/30.jpg)
Looking in the wrong places
![Page 31: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/31.jpg)
Lower SNR = we miss more stuff
![Page 32: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/32.jpg)
Lower SNR = higher FDR threshold
![Page 33: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/33.jpg)
![Page 34: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/34.jpg)
How to improve power?
• stronger effects?• fewer null/noise samples -> ROI
![Page 35: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/35.jpg)
What is wrong with ROI analysis?
![Page 36: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/36.jpg)
What is wrong with ROI analysis?
![Page 37: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/37.jpg)
Binary nature of masks
![Page 38: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/38.jpg)
Fifty shades of grey
A probabilistic view on the ROI analysis
A probabilistic approach to ROI analysisGorgolewski et al. PRNI 2013
Fifty Shades of Grey, Matter
![Page 39: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/39.jpg)
![Page 40: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/40.jpg)
![Page 41: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/41.jpg)
![Page 42: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/42.jpg)
![Page 43: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/43.jpg)
![Page 44: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/44.jpg)
![Page 45: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/45.jpg)
![Page 46: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/46.jpg)
![Page 47: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/47.jpg)
![Page 48: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/48.jpg)
Extensions and disclaimers
• Kernel density estimation• Markov Random Field reguralization• Posterior maps cannot be used in
meta analysis – circularity!• Prior maps are integral part of the
analysis and need to be included in publications
![Page 49: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/49.jpg)
![Page 50: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/50.jpg)
![Page 51: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/51.jpg)
![Page 52: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/52.jpg)
Anatomy of a giant
I. Example studies
II. Probabilistic ROIs
III.Sharing statistical maps
IV.Data papers
![Page 53: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/53.jpg)
Just coordinates?
• Databases such as Neurosynth or BrainMap rely on peak coordinates reported in papers (only strong effects)
![Page 54: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/54.jpg)
Are we throwing money away?
![Page 55: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/55.jpg)
![Page 56: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/56.jpg)
Data sharing?
![Page 57: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/57.jpg)
![Page 58: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/58.jpg)
Data sharing?
• Ok, ok so we should share data.• We all know it’s good.• But almost no one does it.– You have to prepare data– You risk that your mistakes will be
found!
![Page 59: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/59.jpg)
“I swear I’ve heard it before”
• In the past there were many attempts to propagate data sharing– For example fMRI DC:
• Failed because of technical issues• …and the amount of time it took to prepare data
for submission (a week, a very frustrating week)
• fMRI DC was however too ambitious for its time:– They wanted to collect raw data and all
metadata required to reproduce the analysis
Van Horn & Gazzaniga (2013). Why share data? Lessons learned from the fMRIDC. NeuroImage
![Page 60: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/60.jpg)
Baby steps
• Everything is a question of cost and benefit– If we keep the cost low even small
benefit (or just conviction that data sharing is GOOD) will suffice
![Page 61: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/61.jpg)
NeuroVault.org simple data sharing
• Minimize the cost!• We just want your statistical maps
with minimum description (DOI)– If you want you can put more metadata,
but you don’t have to
• We streamline login process (external services such as Google, Facebook)
![Page 62: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/62.jpg)
Benefits?
• In return authors get interactive web based visualization of their statistical maps– Something they can embed on their lab
website
• We are keeping both cost and benefit low…–…but we also plan to work with journal
editors to popularize the idea
![Page 63: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/63.jpg)
![Page 64: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/64.jpg)
![Page 65: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/65.jpg)
?
Share your stat maps!
Make science more reproducible
![Page 66: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/66.jpg)
NeuroVault.org
![Page 67: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/67.jpg)
Anatomy of a giant
I. Example studies
II. Probabilistic ROIs
III.Sharing statistical maps
IV.Data papers
![Page 68: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/68.jpg)
Motivation
• Share your stat maps!
vs.
institutions scientists
![Page 69: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/69.jpg)
Quality control
• Share your stat maps!
Complex datasets require elaborate descriptions
![Page 70: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/70.jpg)
Solution – data papers
• Authors get recognizable credit for their work.– Even smaller contributors such as RAs
can be included.
• Acquisition methods are described in detail.
• Quality of metadata is being controlled by peer review.
![Page 71: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/71.jpg)
![Page 72: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/72.jpg)
• Neuroinformatics (Springer)• Frontiers in Human Brain Methods
• GigaScience (BGI, BioMed Central)• Scientific Data (Nature Publising
Group, coming soon)
(Frontiers Media)(Nature Publishing Group)
Where to publish data papers?
![Page 73: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/73.jpg)
![Page 74: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/74.jpg)
![Page 75: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/75.jpg)
Read more
• Probabilistic ROISGorgolewski et al. PRNI, 2013
• NeuroVault.orgGorgolewski et al. OHBM, 2013
• Data papersGorgolewski et al. Frontiers in Brain Imaging Methods, 2012
![Page 76: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/76.jpg)
Acknowledgements(my personal giants)
Pierre-Louie BazinHaakon EngenSatrajit Ghosh
Russell A. PoldrackJean-Baptiste Poline
Yannick SchwarzTal Yarkoni
Michael MilhamDaniel Margulies
Benjamin Baird
Jonathan SmallwoodJohannes GolchertFlorence J.M. RubyMelaina VinskiJonathan SchoolerDan LurieSebastian UrchsJudy A. KippingR. Cameron CraddockMPI CBS Resting state group
![Page 77: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/77.jpg)
THANK YOU!
![Page 78: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/78.jpg)
Details
![Page 79: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/79.jpg)
Details
![Page 80: Reusable Science: How not to slip from the shoulders of giants](https://reader036.vdocument.in/reader036/viewer/2022062709/558df1a01a28ab31438b45ca/html5/thumbnails/80.jpg)
Details