ther's still plenty of room at the bottom!

19
There’s STILL plenty of room at the bottom! Andreas Olofsson 1

Upload: andreas-olofsson

Post on 18-Aug-2015

60 views

Category:

Technology


4 download

TRANSCRIPT

Page 1: Ther's STILL plenty of room at the bottom!

There’s STILL plenty of room at the bottom!

Andreas Olofsson

1

Page 2: Ther's STILL plenty of room at the bottom!

Richard Feynman’s Lecture (1959)

2Copyright Adapteva

“There's Plenty of Room at the Bottom”An Invitation to Enter a New Field of Physics

“Why cannot we write the entire 24 volumes of the Encyclopedia  Britannica on the head of a pin?”

“The principles of physics, as far as I can see, do not speak against the possibility of maneuvering things atom by atom.”

“I don't know how to do this on a small scale in a practical way, but I do know that computing machines are very large; they fill rooms. Why can't we make them very small, make them of little wires, little elements – and by little, I mean little. For instance, the wires should be 10 or 100 atoms in diameter, and the circuits should be a few thousand angstroms across.”

Other Concepts:• Rearranging atoms, Micro‐

machines, Chemical synthesis, Micro‐antenna arrays

Page 3: Ther's STILL plenty of room at the bottom!

Why the question is still relevant!

3

0

1

10

100

1,000

10,000

100,000

1,000,000

10,000,000

100,000,000

1990 1995 2000 2005 2010 2015 2020 2025 2030

System ProcessingNeedsLegacy ProcessingEfficiency

“The Efficiency Gap”Von NeumannSaturation

Copyright Adapteva

Page 4: Ther's STILL plenty of room at the bottom!

Need for Efficient Processing is Universal

4

Page 5: Ther's STILL plenty of room at the bottom!

Adapteva Company Introduction

5

Company History:• Founded in 2008 by processor design team from Analog Devices• [Coprocessor / manycore / DSP / multicore / accelerator / cpu] company• Shipping 16-core 65nm product since May 2011• Sampling 64-core 28nm product since July 2012• Launched Parallella open computing platform in October 2012

Notable Achievements:• 4 chips on < $2.5M in raised capital• 50 GFLOPS/W demonstrated at chip level• 28nm 64-core product only 10mm2

• Architecture scales to 1024 CPUs on-chip• ~$2M in revenue so far (~break-even)• ~5,000 customersCopyright Adapteva

Page 6: Ther's STILL plenty of room at the bottom!

Our Vision: True Heterogeneous Computing

6Copyright Adapteva

SYSTEM‐ON‐CHIP

BIGCPU

FPGA

BIGCPU

BIGCPU

BIGCPU

1000 small Epiphany RISC CPUs/DSPs

GPU

Page 7: Ther's STILL plenty of room at the bottom!

HPC COMPARISON DATA

7Copyright Adapteva

Technology FPGA DSP GPU CPU Manycore

Process 28nm 40nm 28nm 32nm 28nm

Programming VHDL C++/Asmbly CUDA C/C++ C/C++

Area (mm^2) 590 108 294 216 10

Chip Power (W) 40 22 135 130 2

CPUs n/a 8 16 4 64

Max GFLOPS 1500 160 3000 115 102

GHz * Cores n/a 12 16 14.4 51.2

L1 Memory 6MB 512KB 2.5MB 256KB 2MB

Peak performance means very little No magic bullet!Efficiency is 

everything

Page 8: Ther's STILL plenty of room at the bottom!

Epiphany: Massive Task‐Parallelism

8Copyright Adapteva

Coprocessor to ARM/Intel CPU 25mW per core C/C++ programmable

Page 9: Ther's STILL plenty of room at the bottom!

Programming Models

9Copyright Adapteva

MODEL#1TASK QUEUE MODEL

• Great for up to 2GFLOPS• Supports standard C/C++• “Cloud on a chip”

MODEL #2DATA PARALLEL MODEL

• openCL programmable• Easy integration of C/C++• openMP roadmap

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

X86/ARM/FPGA Host

Task1

Task3Task4

Task2

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

MINICPU

X86/ARM/FPGA HostTask1

Page 10: Ther's STILL plenty of room at the bottom!

The Future is Open HW Platforms!

10Copyright Adapteva

OPEN

DeveloperCommunities

CLOSED

Solutions CompanyResources

Partners

Y2000 Model Y2012 Model

Appliances Users that “touch” company technology

PlatformCompany

Page 11: Ther's STILL plenty of room at the bottom!

Parallella Open Computing

11Copyright Adapteva

Rj45

USB

GPIO

GPIO

ZYNQ(ARM)CPU

E64

1GB SDRAM

uSD

HDMI

USB

• Open (and ”free”):• Documentation• Board design files• Drivers• Software Tools

• Accessible (NO NDAs!)• $100 entry point• ~4000 devs signed up in 4 weeks

IO IO

Page 12: Ther's STILL plenty of room at the bottom!

Mind Boggling Progress

12Copyright Adapteva

100 GFLOPS100 KW$10M

(1992)Connection Machine 5

100 GFLOPS5 W (20k X)$200 (50k X)

(2012/2013)Parallella Board

Rj45

USB

GPIO

GPIO

ZYNQ(ARM)CPU

E64

1GB SDRAM

uSD

HDMI

USB

Page 13: Ther's STILL plenty of room at the bottom!

Smartphone:  So much room…

13Copyright Adapteva

62 cm3 0.00003 cm3>1M X Volume Reduction

2XCPU

A5X‐die~13mm

FPU~0.15mm

ARMA9

~2mm

A5X Chip~16mm

iPhone4s~58mm What if your 

smartphone disappears?

Page 14: Ther's STILL plenty of room at the bottom!

HPC:  So much room…

14Copyright Adapteva

$1‐10B $10M?100 ‐ 1000x  ratio

1 ExaflopProcessor  Only Costs (65nm)

Exascale CostsImpractical? 

What if we start over??

Page 15: Ther's STILL plenty of room at the bottom!

Capital Efficiency:  So much room…

15Copyright Adapteva

$10,000

$100,000

$1,000,000

$10,000,000

$100,000,000

$1,000,000,000

Per Product SOC R&D CostsWhat if you could do a 

28nm chip for $100k?

Page 16: Ther's STILL plenty of room at the bottom!

Efficiency

Thermal Balancing

New Memory Hierarchy

Locality, Integration

Distributed Architectures

Parallelism

Redundancy

Programmability

Ease of Use

New Algorithms

TRENDS THAT WILL SHAPE THE FUTURE OF COMPUTING

16Copyright Adapteva

Page 17: Ther's STILL plenty of room at the bottom!

Power Consumption

Thermal Density

Memory Bottlenecks

Latency Wall

Wiring

Frequency Wall

Yield Issues

Time to Market

Software Complexity

Amdahl’s Law

TRENDS THAT WILL SHAPE THE FUTURE OF COMPUTING

17Copyright Adapteva

Efficiency

Thermal Balancing

New Memory Hierarchy

Locality, Integration

Distributed Architectures

Parallelism

Redundancy

Programmability

Ease of Use

New Algorithms

Page 18: Ther's STILL plenty of room at the bottom!

The Future of Computing:Million Way Parallelism

18Copyright Adapteva

20122012

1024 CPUs32KB/core0.2W-20W

~10mm

16K CPUs1MB/core(3D)

0.2W-20W

20222022

~10mm

Page 19: Ther's STILL plenty of room at the bottom!

19Copyright Adapteva

The Future is… Open

Heterogeneous Massively Task-Parallel

Efficient

Grande Challenges Ahead…• Rebuild the computer ecosystem• Rewrite billions of lines of code• Retrain millions of programmers• Rewrite the education curriculum