(spot309) inspiring innovation in the cloud @ nasa/jpl and beyond

76
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Images Courtesy of NASA/JPL-Caltech/Cornell October 2015 SPOT309 Inspiring Innovation in the Cloud @ NASA/JPL and Beyond Khawaja Shams NoSQL Engineering, AWS Tom Soderstrom IT CTO, JPL Rob Witoff Director, Coinbase

Upload: amazon-web-services

Post on 13-Apr-2017

2.156 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Images Courtesy of NASA/JPL-Caltech/Cornell

October 2015

SPOT309

Inspiring Innovation in the Cloud@ NASA/JPL and Beyond

Khawaja ShamsNoSQL Engineering, AWS

Tom Soderstrom IT CTO, JPL

Rob Witoff Director, Coinbase

Page 2: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

1936 Suicide Squad and the first rocket test x

Page 3: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

1943 JPL officially established

Page 4: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 5: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 6: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

We were in the IAAS business long before Amazon

Page 7: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

The Deep Space Network

Page 8: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Goldstone, USA Madrid, Spain Canberra, Australia

Page 9: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 10: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 11: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 12: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Amazon SWF

Decider

Data Processing Tasks

File Transfer Tasks

Decision Tasks

Data Processing Workers

EC2 EC2 EC2 EC2 S3

JPL Data Center

Decider

File Transfer Workers

Data Processing

Workers

Polyphony

AWS

Page 13: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Public Outreach

http://bit.ly/marsCaseStudy

Page 14: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 15: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Large Image Tiling

Page 16: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 17: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Deep Zoom Images: http://bit.ly/marsDeepZoom

Page 18: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 19: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 20: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

http://json.jpl.nasa.gov

Page 21: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 22: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

]

Page 23: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 24: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 25: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 26: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 27: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 28: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Live Demo: http://bit.ly/marsDemo

Step by Step tutorial: http://bit.ly/marsTutorial

Page 29: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

App: Mars Images

@DrMarkPowell

http://bit.ly/marsApp

Page 30: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 31: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 32: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 33: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 34: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 35: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 36: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Mars 2020

Page 37: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 38: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

And Beyond.

Page 39: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Pioneer IV

Mariner IV

Mariner 69

Mariner 10

Voyager

Galileo

Opt

ical

C

omm

unic

atio

ns

Kepler Cassini

Equ

ival

ent D

ata

Rat

e fro

m J

upite

r

1012

10-6 1960 1990 2010

Data Rates

1960 1970 1980 1990 2000 2010 2020

Giga

Mega

Kilo

1

Milli

Micro

*normalized from Jovian Distance

Page 40: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 41: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Power of Cloud Computing

Page 42: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Differences in Carbon Dioxide

Orbiting Carbon Observatory-2 (OCO-2) satellite

Page 43: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

RADAR as an instrument

Page 44: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Christ Church Earthquake New Zealand February, 2011

Page 45: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

from radar data acquired 3 days after earthquake

zone map released 4 months after earthquake

Page 46: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

SWOT Surface Water Ocean Topography

NISAR NASA-ISRO Synthetic Aperture Radar

Power of Cloud Computing

Page 47: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Lessons Learned for Scientific Computing

Page 48: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

1. Our Data Travels Too Much

Lessons Learned for Scientific Computing

Page 49: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 50: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 51: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

2. There are great algorithms & software to be shared

Lessons Learned for Scientific Computing

Page 52: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

The New Scientific Method to Collaborate

images

videos

files

binaries

snapshots

EC2

Amazon Elastic MapReduce

Amazon S3EC2 Machine Images

Page 53: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

3. Everyone wants more infrastructure

Lessons Learned for Scientific Computing

Page 54: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

“my cluster is not big enough...”- every scientist

Page 55: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

“buying a bigger cluster is too expensive...”

- every IT department

Page 56: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

“my queue wait time is too long...”- every scientist

Page 57: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

“that’s the only way I can run efficiently...”- every IT department

Page 58: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 59: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 60: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 61: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

?

Page 62: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 63: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

a top-500 supercomputer

ready in 100 seconds

for less than $100 per hour

Jet Propulsion LaboratoryCalifornia Institute of Technology

Page 64: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

This journey was not easy …

Page 65: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Our Recipe for Cloud Computing

Explore, Secure, Procure

Impact

Page 66: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 67: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 68: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 69: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 70: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 71: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 72: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 73: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

JPL Open House

Oct 10th & 11th

4800 Oak Grove Dr Pasadena, CA

Page 74: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond
Page 75: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Remember to complete your evaluations!

@ksshams

Page 76: (SPOT309) Inspiring Innovation in the Cloud @ NASA/JPL and Beyond

Thank you!

@ksshams@robwitoff