mit opencourseware 6.189 multicore programming primer ... · csr-1 c is the common intel tflops...

MIT OpenCourseWare http://ocw.mit.edu

6.189 Multicore Programming Primer, January (IAP) 2007

Please use the following citation format:

Bill Thies, 6.189 Multicore Programming Primer, January (IAP) 2007. (Massachusetts Institute of Technology: MIT OpenCourseWare). http://ocw.mit.edu (accessed MM DD, YYYY). License: Creative Commons Attribution-Noncommercial-Share Alike.

Note: Please use the actual date you accessed this material in your citation.

For more information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms

6.189 IAP 2007

Lecture 8

The StreamIt Language

Bill Thies, MIT. 1 6.189 IAP 2007 MIT

Languages Have Not Kept Up

C von-Neumann Modern machine architecture

�� Develop cool architecture withDevelop cool architecture with complicated, ad-hoc languagecomplicated, ad-hoc language

� Bend over backwards to supportold languages like C/C++

Images by MIT OpenCourseW

Two choices:●● Two choices:Two choices:

Images by MIT OpenCourseWare.

Why a New Language?

# of 32

16cores 8

For uniprocessors, PicoPi chipcochip AmbricbriAm cAMA 2045M2045C was: PC102PC102

CiscoCisco

IntelIntelTflopsTflops•Portable

CSR-1CSR-1

•High Performance RazRa aza CaviCav umium•Composable RawRa XLRw XLR OcteonOcteon

•Malleable Niagara CellCeNiagara ll

•Maintainable Boardcom 1480 Opteron 4PBoardcom 1480 Opteron 4PXeX on MPeon MP

Xbox36Xb 0ox360PA-8800PA-8800 OpteronOpteron TanglewoodTanglewood

Power4Power4

4004 80868080

286 386 486 Pentium P2 P3 ItaniumP4

Itanium 2

1 Yonah

PExtremPE e

Athlon

xtreme Power6Power6

1970 1975 1980 1985 1990 1995 2000 2005 20??

Why a New Language?

# of 32

16cores 8

PC102PC102 AMA 2045M2045Uniprocessors: PicoPi chipcochip AmbricbriAm c

CiscoCiscoCSR-1CSR-1

IntelIntelC is the common TflopsTflops

machine language RazRa aza CaviCav umium

RawRa XLRw XLR OcteonOcteon

Niagara CellCeNiagara ll

Boardcom 1480 Opteron 4PBoardcom 1480 Opteron 4PXeX on MPeon MP

Xbox36Xb 0ox360PA-8800PA-8800 OpteronOpteron TanglewoodTanglewood

Power4Power4

4004 80868080

286 386 486 Pentium P2 P3 ItaniumP4

Itanium 2

1 Yonah

PExtremPE e

Athlon

xtreme Power6Power6

1970 1975 1980 1985 1990 1995 2000 2005 20??

Why a New Language?

# of 32

16cores 8

What is the common machine language for multicores?

80868080 286 386 486 Pentium P2 P3 P4 Itanium

Itanium 2

Power4 Opteron

Power6

Niagara

Yonah PExtreme

Tanglewood

Intel Tflops

teonRa

Xbox360Xb

Cavium OcCavRaza

XLR Ra

PA-8800PA

Cisco CSR-1 Ci

Picochip PC102 Pi

Boardcom 1480B Opteron 4P Xeon MP

Opteron

Athlon

Ambric AM2045 Am

Power4 Opteron

Power6

Niagara

YonahPExtreme

Tanglewood

IntelTflops

iumOcteon

scoCSR-1

cochipPC102

oardcom 1480 4PXeon MP

bricAM2045

1970 1975 1980 1985 1990 1995 2000 2005 20?? Bill Thies, MIT. 5 6.189 IAP 2007 MIT

Common Machine Languages

Uniprocessors: Multicores:Common PropertiesCommon Properties Multiple flows of control

Single memory image

Single flow of control

Multiple local memories

Differences:Differences: Number and capabilities of cores

Register File

Communication Model

Functional Units Synchronization Model

von-Neumann languages represent the Need common machine language(s) common properties and abstract away for multicores the differences

6.189 IAP 2007 MIT

Streaming as a Common Machine Language

Speaker

FMDemod

Scatter

Gather

LPF2 LPF3

HPF1 HPF2 HPF3

● For programs based on streams of data � Audio, video, DSP, networking, and

cryptographic processing kernels � Examples: HDTV editing, radar

tracking, microphone arrays, cell phone base stations, graphics

● Several attractive properties � Regular and repeating computation � Independent filters

with explicit communication � Task, data, and pipeline parallelism

Bill Thies, MIT. 7

Streaming Models of Computation

● Many different ways to represent streaming � Do senders/receivers block? � How much buffering is allowed on channels? � Is computation deterministic? � Can you avoid deadlock?

● Three common models: 1. Kahn Process Networks 2. Synchronous Dataflow 3. Communicating Sequential Processes

Streaming Models of Computation

Communication Pattern

Buffering Notes

Kahn process networks (KPN)

Data-dependent, but deterministic

Conceptually unbounded

- UNIX pipes - Ambric (startup)

Synchronous dataflow (SDF)

Static Fixed by compiler

- Static scheduling - Deadlock freedom

Communicating Sequential Processes (CSP)

Data-dependent, allows non-determinism

None (Rendesvouz)

- Rich synchronization primitives

- Occam language

KPN CSP space of program behaviors

The StreamIt Language

● A high-level, architecture-independent language for streaming applications � Improves programmer productivity (vs. Java, C) � Offers scalable performance on multicores

● Based on synchronous dataflow, with dynamic extensions � Compiler determines execution order of filters � Many aggressive optimizations possible

The StreamIt Project

StreamIt Program

Front-end

Stream-Aware Optimizations

Uniprocessor backend

Cluster backend

Raw backend

IBM X10 backend

C/C++ C per tile + msg code

Streaming X10 runtime

Annotated Java

MPI-like C/C++

Simulator (Java Library)

● Applications � DES and Serpent [PLDI 05]� MPEG-2 [IPDPS 06]� SAR, DSP benchmarks, JPEG, …

● Programmability � StreamIt Language (CC 02) � Teleport Messaging (PPOPP 05)� Programming Environment in Eclipse (P-PHEC 05)

● Domain Specific Optimizations � Linear Analysis and Optimization (PLDI 03) � Optimizations for bit streaming (PLDI 05) � Linear State Space Analysis (CASES 05)

● Architecture Specific Optimizations � Compiling for Communication-Exposed

Architectures (ASPLOS 02)� Phased Scheduling (LCTES 03)� Cache Aware Optimization (LCTES 05)� Load-Balanced Rendering

(Graphics Hardware 05)

Example: A Simple Counter

void->void pipeline Counter() { add IntSource(); add IntPrinter();

} void->int filter IntSource() {

int x; init { x = 0; }

Counter

IntSource

IntPrinter

work push 1 { push (x++); } % strc Counter.str –o counter % ./counter –i 4

int->void filter IntPrinter() { 1 work pop 1 { print(pop()); } 2

Representing Streams

● Conventional wisdom: streams are graphs � Graphs have no simple textual representation � Graphs are difficult to analyze and optimize

● Insight: stream programs have structure

unstructured structuredBill Thies, MIT. 13 6.189 IAP 2007 MIT

Structured Streams

parallel computation

may be any StreamIt language construct

joinersplitter

pipeline

feedback loop

joiner splitter

splitjoin

filter ● Each structure is single-input, single-output

● Hierarchical and composable

Filter Example: Low Pass Filter

float->float filter LowPassFilter (int N, float freq) { float[N] weights;

init {

weights = calcWeights(freq); N }

work peek N push 1 pop 1 { float result = 0; for (int i=0; i<weights.length; i++) {

result += weights[i] * peek(i); } push(result); pop();

filter

Low Pass Filter in C

void FIR(int* src, ● FIR functionality obscured by int* dest, buffer management detailsint* srcIndex,int* destIndex, ● Programmer must commit to aint srcBufferSize, int destBufferSize, particular buffer implementationint N) { strategyfloat result = 0.0;for (int i = 0; i < N; i++) {result += weights[i] * src[(*srcIndex + i) % srcBufferSize];

}dest[*destIndex] = result;*srcIndex = (*srcIndex + 1) % srcBufferSize;*destIndex = (*destIndex + 1) % destBufferSize;

Pipeline Example: Band Pass Filter

float→float pipeline BandPassFilter (int N, float low, float high) {

add LowPassFilter(N, low); add HighPassFilter(N, high);

HighPassFilter

LowPassFilter

SplitJoin Example: Equalizer

duplicate

BPF BPF BPF

roundrobin

Equalizerfloat→float pipeline Equalizer (int N, float lo, float hi) {

add splitjoin {

split duplicate;

for (int i=0; i<N; i++)

add BandPassFilter(64, lo + i*(hi - lo)/N);

join roundrobin(1);

add Adder(N);

Building Larger Programs: FMRadio

void->void pipeline FMRadio(int N, float lo, float hi) {

add AtoD();

add FMDemod();

add splitjoin { split duplicate; for (int i=0; i<N; i++) {

add pipeline {

add LowPassFilter(lo + i*(hi - lo)/N);

add HighPassFilter(lo + i*(hi - lo)/N); }

}join roundrobin();

} add Adder();

add Speaker();

Speaker

FMDemod

Duplicate

RoundRobin

LPF2 LPF3

HPF1 HPF2 HPF3

} Bill Thies, MIT. 19 6.189 IAP 2007 MIT

The Beauty of Streaming

“Some programs are elegant, some are exquisite, some are sparkling. My claim is that it is possible to write grand programs, noble programs, truly magnificient ones!”

— Don Knuth, ACM Turing Award Lecture

Image removed due to copyright restrictions.

SplitJoins are Beautiful

split duplicate split roundrobin(N) join roundrobin(N)

split duplicate split roundrobin(1) join roundrobin(1)

split duplicate split roundrobin(2)

join roundrobin(1,2,3)

Matrix TransposeN

Transpose

NBill Thies, MIT. 79 6.189 IAP 2007 MIT

Matrix TransposeN

roundrobin(?)

Matrix TransposeN

roundrobin(?)

Matrix TransposeN

roundrobin(M)

roundrobin(1)

Matrix TransposeN

roundrobin(M)

roundrobin(1)

Matrix Transpose

roundrobin(M)

roundrobin(1) float->float splitjoin Transpose (int M,

int N) { split roundrobin(1); for (int i = 0; i<N; i++) {

add Identity<float>; } join roundrobin(M);

Bit-reversed ordering

● Many FFT algorithms require a bit-reversal stage

● If item is at index n (with binary digits b0 b1 … bk), then it is transferred to reversed index bk … b1 b0

● For 3-digit binary numbers:

000011110011001101010101

000011110011001101010101 RR(w1)

2) RR(w2)

RR(w1)

00001111 00110011 01010101 RR(w3)

000011110011001101010101 RR(1)

00001111 00110011 01010101 RR(4)

complex->complex pipeline BitReverse (int N) { if (N==2) {

add Identity<complex>; } else {

add splitjoin {

split roundrobin(1);add BitReverse(N/2);add BitReverse(N/2);join roundrobin(N/2);

2 2 2 2

1 1 1 1

1 1 rr rr

2 2 2 2

1 1 1 1

1 1 rr rr

8 8 rr

89 6.189 IAP 2007 MITBill Thies, MIT.

N-Element Merge Sort

int->int pipeline MergeSort (int N) {if (N==2) {

add Sort(N);} else {

add splitjoin {split roundrobin(N/2);add MergeSort(N/2);add MergeSort(N/2);join roundrobin(N/2);

} }add Merge(N);

Sort Sort SortSort

Sort Sort Sort Sort

MergeMerge Merge Merge

Merge Merge

N/2 N/2

N/4 N/4 N/4 N/4

N/8 N/8N/8 N/8 N/8 N/8 N/8 N/8

N-Element Merge Sort (3-level)

Sort Sort Sort Sort Sort Sort Sort Sort

MergeMerge Merge Merge

Merge Merge

N/2 N/2

N/4 N/4 N/4 N/4

N/8 N/8 N/8 N/8 N/8 N/8 N/8 N/8

Bitonic Sort

Bill Thies, MIT. 6.189 IAP 2007 MIT

Courtesy of William Thies.Used with permission.

Block Matrix Multiply

Filterbank

FM Radio with Equalizer

Radar-Array Front End

MP3 Decoder

Case Study:MPEG-2 Decoder in StreamIt

MPEG-2 Decoder in StreamIt

macroblocks, motion vectors

frequency encodedmacroblocks motion vectors

motion vectors spatially encoded macroblocks

quantization coefficients

picture type

<PT1, PT2>

add VLD(QC, PT1, PT2);

add splitjoin {

split roundrobin(N∗B, V);

add pipeline {add ZigZag(B);add IQuantization(B) to QC;add IDCT(B); add Saturation(B);

}add pipeline {

add MotionVectorDecode(); add Repeat(V, N);

join roundrobin(B, V); }

add splitjoin {split roundrobin(4∗(B+V), B+V, B+V);

add MotionCompensation(4∗(B+V)) to PT1;for (int i = 0; i < 2; i++) {

add pipeline {add MotionCompensation(B+V) to PT1; add ChannelUpsample(B);

join roundrobin(1, 1, 1); }

add PictureReorder(3∗W∗H) to PT2;

add ColorSpaceConversion(3∗W∗H);

MPEG bit stream

Picture Reorder

joiner

IQuantization

splitter

differentially coded

recovered picture

ZigZag

Saturation

Channel Upsample Channel Upsample

Motion Vector Decode

Y Cb Cr

reference picture

Motion Compensation

<PT1> reference picture

Motion Compensation

<PT1> reference picture

Motion Compensation

Repeat

Color Space Conversion

Bill Thies, MIT. output to player 99 6.189 IAP 2007 MIT

Teleport Messaging in MPEG-2

joiner

splitter

recovered picture

Channel Upsample

Motion Compensation

picture type

MC MCMC

Messaging Equivalent in CThe MPEG Bitstream

File Parsing

Decode Picture

Decode Macroblock

Decode Motion Vectors

Decode Block

Motion Compensation

ZigZagUnordering InverseQuantization

Global VariableSpace

Saturate

Motion Compensation For Single Channel

Frame Reordering

Output Video

MPEG-2 Implementation

● Fully-functional MPEG-2 decoder and encoder

● Developed by 1 programmer in 8 weeks

● 2257 lines of code � Vs. 3477 lines of C code in MPEG-2 reference

● 48 static streams, 643 instantiated filters

Conclusions

● StreamIt language preserves program structure � Natural for programmers

● Parallelism and communication naturally exposed � Compiler managed buffers, and portable parallelization

technology

● StreamIt increases programmer productivity, enables parallel performance

mit opencourseware 6.189 multicore programming primer ... · csr-1 c is the common intel tflops...

Documents

embedded mips64 processors octeon plus cn50xx single and...

advanced performance analysis of hpc workloads on cavium

cavium networks octeon plus cn50xx hardware ... 2008 cavium...

6.189 - lecture 3 - introduction to parallel...

mit opencourseware 6.189 multicore programming primer...

marvell and cavium to...

cavium corporate and product...

cavium, inc. · pdf fileconflict minerals report of cavium,...

6.189 - lecture 2 - introduction to the cell...

6.189 multicore programming primer, january … › courses...

mit opencourseware 6.189 multicore programming primer,...

engineering workshop copyright 2014 cavium inc workload...

6.189 - lecture 10 - performance monitoring and...

cavium networks update - iuma - ulpgcnunez... · ¾world...

towards high-performance ipsec on cavium octeon platform

6.189 - lecture 4 - introduction to concurrent...

6.189 - lecture 4 - introduction to concurrent...

6.189 - lecture 6 - parallel programmng design patterns...

6.189 - lecture 3 - introduction to parallel...

cavium thunder-x