reiner hartenstein * kaiserslautern university of technology (tu kaiserslautern)

Seminar by Prof. Dr.José Camargo da Costa

Data-stream-based Computing,Enabling Technology for Reconfigurable Computing

Friday, November 22, 2002, 17.00 hrs.

Reiner Hartenstein*

KaiserslauternUniversity of Technology(TU Kaiserslautern)

November 22, 2002, ENE, UnB, Brasilia

*) IEEE fellow

TU KaiserslauternXputer Lab

>> Microelectronics History

• Microelectronics History

• fine grain and coarse grain Morphware

• Anti Matter of Computing

• Anti Machine and its Resources

• Problems to be solved

http://www.uni-kl.de

The History of Paradigm Shifts

“Mainstream Silicon Applicationis switching every 10 Years”

TTL µproc.,memory

“The Programmable System-on-a-Chipis the next wave“

custom

standard

Makimoto’s Wave

ASICs,accel’s

LSI,MSI

morphw

Published

in 1989

The Impact of Makimoto’s Paradigm

Shifts

TTL µproc.,memory

custom

standard

ASICs,accel’s

LSI,MSI

reconfigurable

Proceduralpersonalization via RAM-based

Machine Paradigm

Personalization(CAD) beforefabrication

structuralpersonalization:

RAM-basedbefore run time

Dr. Makimoto: FPL 2000 keynote

Software Industry’sSecret of Success

Repeat Success Story bynew Machine Paradigm !

Makimoto’s 3rd wave

The next EDA Industry Revolution

Transistor entry: Applicon, Calma, CV ...

1992Synthesis (HDLs): Cadence, Synopsys ...

Schematics entry: Daisy, Mentor, Valid ...

[Keutzer / Newton]McKinsey Curves

EDA industry paradigmswitching every 7 years

1999(Co-) Compilation:data-stream-based

[Hartenstein]

Von Neumann does not

support Morphware:

“The Programmable System-on-a-Chip is the next wave“

Ubiquitous embedded systems

20 billion µprocessors (2001)

> 90% in embedded systems

10 times more programmers will write embedded applications than computer software by 2010

That’s where our graduates will go

Embedded systems means:

• hardware / software co-design

• configware / software co-design

• hardware / configware / software co-design

Hardware,Configware

Embedded Systems Requirement:Hardware/Configware and Software as Alternatives

Algorithm

Software

Software only

partitioning

Software & Hardw/ConfigwHardw/Configw only

>> fine grain and coarse grain Morphware

Top 4 FPGA Manufacturers 2000

Xilinx42%

Altera37%

Lattice15%

Actel6%

Top 4 PLD Manufacturers 2000total: $3.7 Bio

•[Dataquest] > $7 billion by

2003. •FPGAs going into every type of application – also SoC

•fastest growing segment of semiconductor market

You do not neet specific silicon !

cost / mio §4

1mask set cost [eASIC]

NRE and mask cost

[dataquest] .

12 12 16 20 26 28 30 >30no. of masks

0.8 0.6 0.35 0.25 0.18 0.15 0.13 0.1 0.07 feature size

Configware and EDA as the Key Enabler

• Growing no. of independent configware houses (soft IP core vendors) and design services provide libraries of "pre-fabricated" re-usable IP cores

• Synplicity 57%, • Mentor 37%, • Synopsys 7%

• Emerging separate EDA software market -FPGA synthesis [2001: Dataquest]:

Throughput vs. Efficiency

0.0012 1 0.5 0.25 0.13 0.1 0,07

MOPS / mW

µ feature size

FPGAs (reconfigurable logic)hardwired

instruction set processors

standard microprocessor

resources needed for

reconfigurability

area used by application

1 Bit CLB

T. Claasen et al.: ISSCC 1999

Wiring by abutment:32 Bit example

*) R. Hartenstein: ISIS 1997

rDPAs (reconfigurable computing)*

Commercial rDPAs

XPU128ACM: Quicksilver Tech

XPU family (IP cores):PACT AG., Munich

http://pactcorp.com

rDPU not used used for routing only operator and routing port location markerLegend: backbus connect

array size: 10 x 16 = 160 rDPUs

http://kressarray.de

SNN filter KressArray Mapping Example

rout thru only

not usedbackbus connect

data streams

KressArray Family generic Fabrics: a few examples

Examples of 2nd Level Interconnect:layouted overrDPU cell - no separate routing areas !

rout-through and function

rout-throug

h only more NNports:

rich Rout Resources

Select Function

Repertory

select Nearest Neighbour (NN) Interconnect: an example

16 32 8 24

2 rDPU

Select mode, number, width of NNports

http://kressarray.de

Antimatter of Computing is available

• Using FPGAs (fine grain morphware) has been just Logic Synthesis on a strange platform

• Coarse Grain rDPAs (Reconfigurable Computing): a fundamental Paradigm Shift

• up several abstraction levels

• Data-stream-based Computing

>> Anti Matter of Computing

• Problems to be solvedhttp://www.uni-kl.de

The anti universe

•Paul Dirac predicted a complete anti universe consisting of antimatter

•“There are regions in the universe, which consist of antimatter .....

•We are not aware, that there is a new area in computing sciences , which consists of antimatter of computing

•.... But there are asymmetries”

•Reconfigurable Computing is made from this antimatter: data-stream-based computing

•when a particle hits its antiparticle, both are converted into energy: Annihilation

anti particles

•1956: anti neutron created on Bevatron

•1928: Paul Dirac: „there should be an anti electron having positive charge“ (Nobel price 1933)

•1932: Carl David Anderson detected this „positron“ in cosmic radiation (Nobel price 1936)

•1955 Owen Chamberlain et al. create anti proton on Bevatron

•1954: new accelerators: cyclotron, like Berkeley‘s Bevatron

•1965: creation of a deuterium anti nucleus at CERN

hydrogen anti hydrogen

•1995: hydrogen anti atom created at CERN – by forcing positron and anti proton to merge by very low energy.

Matter & Antimatter: Atom and Anti Atom

The World of Matter -machine paradigm:the Atom

Anti Matter -

machine paradigm:Anti Atom

++Electron spinning-

--Positron spinning

Matter & Antimatter of Informatics :

instruction stream

spinning

Machine and Anti Machine

- 1936 1st electronic computer (Konrad Zuse)

Machine paradigm:„von Neumann“

1946 v. N. machine paradigm1971 1st microprocessor (Ted Hoff)

data stream spinning

1979 „data streams“ (systolic array: Kung / Leiserson)

Anti Machine paradigm

1990 anti machine paradigm published1995 rDPA / DPSS (supersystolic: Rainer Kress)

novelcompilationtechniquesall ingredients available

DataPathUnit

DataPath

instructionsequencer instruction

stream

Matter vs. antimatter: CPU vs. DPU

DataPathUnit

heavy anti atoms: DPA = DPU array

cohere

Parallelism by Concurrency

independent instruction streamsdifficult ...

>> Anti Machine and its Resources

Dichotomy of machine paradigms

DPUinstructi

on sequence

Minstruction stream

(r)DPU

data stream

M M M M

M M M MasMaddress generato

(r)DPU Array(r)DPA

(r)DPUor

data streams

Terminology: DPU versus CPU ...

• DPU: data path unit• DPA: DPU array• GA: gate array• rDPU: reconfigurable DPU• rDPA: reconfigurable DPA• rGA: reconfigurable GA

• DPU is no CPU: there is nothing central - like in a DPA

DPUDPU

DPUinstructionsequencer

Terminology: Digital System Platforms clearly distinguished

platformsource

running on it

machine paradigm

hardware (not running on it)

nonemorphwar

fine grain

rGA (FPGA)configware

coarse grain

rDPU, rDPAreconfigurable data stream processor

flowware & configware anti

machinedata stream processor (hardwired) flowware

instruction stream processor softwarevon Neumann machine

flowware defines ....

port #

input data streams

|output data streams

port #time

port #

... which data item at which time at which port

flowware manipulates the data counter(s) ...

... software manipulates the program counter

Configware / Flowware Compilation

r. DataPath

rDPA intermediate

high level source program

wrapper

configwareconfigware

mapper

flowwareflowware

scheduler

M M M M

data streams

data sequencer

address generato

... for a Stream-based Soft Machine

SchedulerMemory(data memory)

memory bank

“instructions”

rDPACompiler

Sequencers(data stream

generator)

JPEG zigzag scan pattern

*> Declarations

HalfZigZag isEastScanloop 3 times SouthWestScanSouthScanNorthEastScanEastScanendloopend HalfZigZag;

goto PixMap[1,1]

HalfZigZag;SouthWestScanuturn (HalfZigZag)

HalfZigZag

data counterdata counter

HalfZigZag

EastScan is step by [1,0]end EastScan;

SouthWestScan isloop 8 times until [1,*]step by [-1,1]endloopend SouthWestScan;

SouthScan isstep by [0,1]endSouthScan; NorthEastScan isloop 8 times until [*,1]step by [1,-1]endloopend NorthEastScan;

Flowware language example (MoPL)The same language

principles

GAG Slider Model

LimitStepper

BaseStepper

AddressStepper

LimitStepper

BaseStepper

AddressStepper

sliders

GAGGenericAddress

Generator

floor ceiling

ceiling

address

GAG Slider Operation Demo Example

L0B0AF

ceiling slider

GAG Complex Sequencer Implementation

LimitSlider

BaseSlider

AddressStepper

all `been published

in 1990

LimitSlider

BaseSlider

AddressStepper

LimitSlider

BaseSlider

AddressStepper

GAGGAG

GAUGeneric Addressing Unit

VLIWstack

Generic Sequence Examples

LimitSlider

BaseSlider

AddressStepper

published

in 1990

d) e) f) g)

video scan

-90º rotated video scan

sheared video scan

non-rectangular video scan

zigzag video scan

spiral scan

feed-back-driven scans

atomic scan linear scan

-45º rotated (mirx (v scan))

perfectshuffle

r/w r r

after inner scan line loop unrolling

final design

after scan line

unrolling

hardw. level access optim.

initial design

w/r r r

r r r Bank a

Bank a

Bank b

Storage scheme optimization: scanline unrolling

handle positions

scan window

scan pattern (high level sequencing)

example

intra scan window accesses(low level sequencing)

MoM anti machine architecture

>> Problems to be solved

What is the trend ?

•vN is needed for embedded systems, OS, compilers, Sauerkraut software, non-performance-critical applications, others ….

•vN is obsolete for massive parallelism, except some special application areas

•Anti machine is the way to go for massive parallelism, also data-intensive applications

•Morphware is the way for high performance with short product life cycles, unstable standards

•Data-stream-based Computing is heading for mainstream

–1979 „data streams“ (Kung / Leiserson)

–1997 SCCC (LANL) Streams-C Configurabble Computing

–SCORE (UCB) Stream Computations Organized for Reconfigurable Execution

–ASPRC (UCB) Adapting Software Pipelining for Reconfigurable Computing

–2000 Bee (UCB), ...

–Most stream-based multimedia systems, etc.

–Many other areas ....

Conclusion: all knowledge needed is available

•machine paradigm

•anti architectural resources

•sequencing methodology: hw & sw

•parallel memory IP core and module generator vendors

courses / embedded tutorials:• DATE. Munich, 2001

• ASP-DAC, Yokohama, 2001• SBCCI, Brasilia, 2001

full day courses:

Univ. Montpellier 1998Nokia / Univ. Tampere, Finland, 2002

CNRS Paris France, 2002UnB, Brasilia, 2002

• 10 keynotes 2001 / 2002• 5 invited talks 2001 / 2002

•anything else needed

•compilation techniques

•hw / sw partitioning methodology

•languages

Main problems to be solved

computingin space

computingin time

systolicarrays etc.

and other transformationsmigration by re-timing

this dichotomy iscompletely ignoredby our CS curricula

•Each programmer should have qualified awareness on dichotomy and morphware

•curricular innovations are urgently needed

•Lack of qualified users and implementers

CS education .....

software person

procedural

structural

hardware personAn

Configware / Software Co-Design?Hardware / Software Co-Design?

Annihilation?

avoidable by careful

methodology

However, current CS Education ….

Hardware invisible:under the surface

… is based on the Submarine Model

Brain usage:procedural-only

Software Faculty Colleagues shy away from the Paradigm Shift:their Brain hurts? - can’t be: this Half has been amputated

Algorithm

Assembly Language

procedural high level Programming

Language

Hardware

Software

This model disables ...

Hardware,Configware

Hardware and Software as Alternatives

Algorithm

Software

partitioning

Software onlySoftware & Hardw/Configw

procedural structural

Brain Usage:both Hemispheres

Hardw/Configw only

The Dominance of the Submarine Model ...

Hardware

... indicates, that our CS education system produces zillions of mentally disabled

Persons

(procedural) structurallydisabled

… completely disabled to cope with solutions other than software only

It‘s time to attack the software faculty dictatorship.Get

involved!

TU KaiserslauternXputer Lab Antimatter Search ?

Antimatter Search

in EE & CS we do not need to search

>>> thank you

thank you for your patience

>>> END

reiner hartenstein * kaiserslautern university of technology (tu kaiserslautern)

Documents

enabling technologies for reconfigurable computing part 4:...

reiner hartenstein, university of kaiserslautern, · pdf...

cs curricula update proposed: by adding reconfigurable...

reiner hartenstein, university of kaiserslautern,...

reconfigurable supercomputing: hurdles and chances reiner...

© 2006, reiner@hartenstein.de reconfigurable computing...

reiner hartenstein university of kaiserslautern

reiner hartenstein how to cope with •“dataflow”...

however, we are far >> outline - - tu kaiserslautern ·...

how to cope with the power wall reiner hartenstein tu...

reiner hartenstein, university of kaiserslautern, · pdf...

reiner hartenstein, university of kaiserslautern, germany...

reconfigurable supercomputing: what are the problems? what...

reiner hartenstein, tu kaiserslautern, germany http

1. basics of reconfigurable computing - - tu...

how to cope with the power wall reiner hartenstein tu...

from organic computing to reconfigurable computing reiner...

reconfigurable computing and the von neumann syndrome reiner...

reiner hartenstein (invited paper, invited book chapter):...

dataflow” computing how to cope with reconfigurable...