saving science - open up or perish
DESCRIPTION
Science is not an exclusive realm limited to people in white lab coats with Ph.D.s, but rather a way of thinking applied to everything from advanced computational simulations on nuclear material to brewing an award-winning beer. However, current scientific practices are undermining the very progress and innovation they were designed to stimulate, bringing us to the brink of a crisis. The lack of openness, access to data and methods, and opaque review processes have created a system that threatens the very foundation of scientific reasoning. However, there are many people and organizations working to prevent the collapse of the pillars science. The champions of the Open Science movement are passionately working to change the course of science and steer it back to its roots of reproducibility. In the process, the movement is also driving a new democratization of science that enables a much broader participation in scientific work and puts within the reach of the normal citizen the possibility of reproducing experiments and taking part in the scientific process. Science will fuel the future, if only we are all open to it. http://tedxalbany.org/talks/2013/marcus-hanwellTRANSCRIPT
![Page 1: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/1.jpg)
Saving Science Open Up or Perish
Dr. Marcus D. Hanwell
TEDxAlbany November 14, 2013
![Page 2: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/2.jpg)
![Page 3: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/3.jpg)
“Standing on the Shoulders of
Giants”
![Page 4: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/4.jpg)
Nullius in verba Motto of the Royal Society, founded in 1660
“Take nobody’s word for it”
![Page 5: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/5.jpg)
Trust, but verify
![Page 6: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/6.jpg)
Trust, but verify
![Page 7: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/7.jpg)
Trust, but verify
![Page 8: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/8.jpg)
Trust, but verify
![Page 9: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/9.jpg)
“Piled Higher and Deeper” by Jorge Cham www.phdcomics.com
![Page 10: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/10.jpg)
Reproducibility
![Page 11: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/11.jpg)
CC-BY-SA 3.0 http://en.wikipedia.org/wiki/File:Kempelen_chess1.jpg
![Page 12: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/12.jpg)
Showing What’s Inside the Box! • Need everything to reproduce results
o Raw data collected § How it was collected, conditions, versions
o Steps to run calculations/analysis § Often source code
o Analyzed results
SHOW YOUR WORK!
![Page 13: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/13.jpg)
“Publishing Research Without Data is Simply
Advertising, Not Science”
Graham Steel, http://blog.okfn.org/2013/09/03/publishing-research-without-data-is-simply-advertising-not-science/
![Page 14: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/14.jpg)
Reproducibility!
![Page 15: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/15.jpg)
“Is the evidence for austerity based on an Excel spreadsheet error?”
Washington Post, April 2013 http://www.washingtonpost.com/blogs/wonkblog/wp/2013/04/16/is-the-best-evidence-for-austerity-based-on-an-excel-spreadsheet-error/
![Page 16: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/16.jpg)
What is Open??? • What does open mean, how open is open?
o Everyone has the same access o No commercial, no derivatives is NOT OPEN
• Certain basic rights are granted to ALL o Share o Modify o Use
![Page 17: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/17.jpg)
Only 6 out of 53 “landmark” cancer studies could be
reproduced
http://www.nature.com/nature/journal/v483/n7391/full/483531a.html
![Page 18: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/18.jpg)
Reproducibility Initiative Receives $1.3M Grant to
Validate 50 Landmark Cancer Studies
http://blog.scienceexchange.com/2013/10/reproducibility-initiative-receives-1-3m-grant-to-validate-50-landmark-cancer-studies/
![Page 19: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/19.jpg)
An Analogy: Making Beer • I make great home brew!
o Using 5 gallon bioreactors to make “sweet nectar”
• I discovered a technique to make it better! o I sing to my beer each evening as it ferments! o My assertion is:
§ It energizes the yeast, and makes sweeter beer... o I have graphs showing 9/10 people prefer it o Even did chemical analysis showing less esters!
![Page 20: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/20.jpg)
CC-BY-SA, http://en.wikipedia.org/wiki/File:Brewing-textless.png
![Page 21: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/21.jpg)
Do I Really Need to Share More? • The beer I sang to was next to my stool
o It was in a colder part of my basement § I didn’t want to sit for hours in the hot part!
o Yeast produce more esters when they are too hot § They needed to be in a control group § It didn’t matter if it got a little hotter over there
• Do I want to sell beer, or do science? REPRODUCIBILITY!
![Page 22: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/22.jpg)
![Page 23: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/23.jpg)
CC-BY-SA: http://en.wikipedia.org/wiki/File:PiratesVsTemp%28en%29.svg
![Page 24: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/24.jpg)
Correlation does not equal causation
![Page 25: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/25.jpg)
![Page 26: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/26.jpg)
GTO = ce!!r2
"i = cµi"µµ
"
# r( ) = Pµ!"µ"!!
"µ
"
![Page 27: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/27.jpg)
GTO = ce!!r2
"i = cµi"µµ
"
# r( ) = Pµ!"µ"!!
"µ
"
Data
Equations
Source Code
![Page 28: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/28.jpg)
![Page 29: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/29.jpg)
Always Pushing the Boundaries • Science is about learning new things • Understanding the universe • Communicating that understanding • Adding to the sum of human knowledge • It is not about
o “selling ideas” or “promoting your work”
![Page 30: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/30.jpg)
Show your work all
![Page 31: Saving Science - Open Up or Perish](https://reader033.vdocument.in/reader033/viewer/2022060202/559b9c431a28ab0d448b4602/html5/thumbnails/31.jpg)
Let’s make science open again!