© 2013 ADAPTIVE COMPUTING, INC. 1

Creating a Better Infrastructure to Manage Big Data

SC’13 Exhibitor Forum Software for HPC III

Trev Harmon

Principal Solution Strategist Adaptive Computing

21 Nov 2013 4:00-4:30pm

Exascale ??

© 2013 ADAPTIVE COMPUTING, INC. 5 © 2013 ADAPTIVE COMPUTING, INC.

2013 2010 1990 1995 2005 2000 1980 1985 1970 1975 1960 1965

Let’s Turn Back the Clock

Denver, Colorado

© 2013 ADAPTIVE COMPUTING, INC. 6 © 2013 ADAPTIVE COMPUTING, INC.

Douglas Parkhill’s Vision

7

Cloud  ?  not  exactly  

© 2013 ADAPTIVE COMPUTING, INC. 9 © 2013 ADAPTIVE COMPUTING, INC.

An Over-simplification

HPC

Big Data

Cloud

Visualiza-tion

Technical Computing

Scientific Computing

Computing

© 2013 ADAPTIVE COMPUTING, INC. 10 © 2013 ADAPTIVE COMPUTING, INC.

Multiple Fields Multiple Users

© 2013 ADAPTIVE COMPUTING, INC. 11 © 2013 ADAPTIVE COMPUTING, INC.

Computing Workflows

HPC Visualiza-tion

© 2013 ADAPTIVE COMPUTING, INC. 12 © 2013 ADAPTIVE COMPUTING, INC.

Computing Workflows

HPC Visualiza-tion

Big Data Cloud Scientific Computing

© 2013 ADAPTIVE COMPUTING, INC. 13 © 2013 ADAPTIVE COMPUTING, INC.

Really, we’re optimizing…

Job Needs

Available Resources

© 2013 ADAPTIVE COMPUTING, INC. 14 © 2013 ADAPTIVE COMPUTING, INC. 14

Topology and Company

Topology-Awareness Data-Locality Awareness Hardware Preferences

© 2013 ADAPTIVE COMPUTING, INC. 15 © 2013 ADAPTIVE COMPUTING, INC.

Another Merger

HPC Visualiza-tion

Big Data Cloud Scientific Computing

HPC Cloud

© 2013 ADAPTIVE COMPUTING, INC. 16 © 2013 ADAPTIVE COMPUTING, INC.

Defining HPC Cloud

Cloud-based HPC ? Cloud-bursting ?

VM-encapsulated Jobs ?

It depends…

well all of them, really.

© 2013 ADAPTIVE COMPUTING, INC. 17 © 2013 ADAPTIVE COMPUTING, INC.

The Future of Computing Is Founded on HPC

Principles and Concepts.

© 2013 ADAPTIVE COMPUTING, INC. 18 © 2013 ADAPTIVE COMPUTING, INC.

Douglas Parkhill’s Vision

© 2013 ADAPTIVE COMPUTING, INC. 19 © 2013 ADAPTIVE COMPUTING, INC.

Join the Journey

© 2013 ADAPTIVE COMPUTING, INC. 20

© 2013 ADAPTIVE COMPUTING, INC. 21 © 2013 ADAPTIVE COMPUTING, INC.

▪  Denver Photo: http://www.flickr.com/photos/dagpeak/

▪  Douglas Parkhill Photo: http://www.spectralumni.ca/CommExpress_pdf/cemay84e.pdf

▪  Topology Map: US Geological Survey, US Department of the Interior/USGS

Attribution & Citation