This project is supported in part by the U.S. Department of Energy under Award Number DE-FG02- 08ER25851

http://www.research.ibm.com/austin

http://goo.gl/5eFB

MULTI-PIPESEric Van Hensbergen (IBM Research)Noah Evans (Alcatel-Lucent Bell-Labs)

Pravin Shinde (ETH Zurich)

Traditional Pipes

AAA

BBB

ABABAB

AAA

BBB

ABA

BAB

Large Packets

AAA

BBB

AAA BBB

AAA

BBB

BBB

AAA

Collective Pipes

A

A

ABroadcast

Reduce(+)

Allreduce(+)

(B+C)

B

C

(A+B+C)

B

C

A

Enumerated Packets

1:A 2:B

A

B

A

B

B

A

Control Headers

TYPE

SIZE

DESTINATION

PARAMETERS

pwrite(pipefd, buf, sz, ~(0));

Splicing

spliceto(b) a b = a b

splicefrom(b) a b = a b