AACE ARCHITECTURE AWARE COMPILER ENVIRONMENT PROGRAM

Modern computing architectures change rapidly and exhibit high levels of complexity and heterogeneity. Developing compilers that can boost productivity while producing efficient, optimized code for these rapidly evolving targets is a difficult challenge. Blackjack is part of the DARPA AACE (Architecture-Aware Compiler Environment) effort, which aims to produce modular compilers that can discover their environment and automatically adapt to it, so that it can efficiently optimize programs with minimal user involvement and expertise.

As part of the Blackjack project we have been developing a system benchmark suite, BlackjackBench, that can automatically characterize target architectures in a rigorous and systematic manner. We are also working on providing a comprehensive list of benchmarks and applications that can stress and evaluate the compilers, as well as assessing the productivity and performance benefits of such compiler systems. The target release of the initial benchmark suite is slated for late 2010 or early 2011.

10

12

14

16

18

20

16 32 64 128 256 512

Aver

age

Acce

ss L

aten

cy (n

s)

Tested Line Size (Bytes)

Line Size Discovery on Nehalem

0

2

4

6

8

10

12

1 2 4 8 16 32 64 128 256

Aver

age

Acce

ss L

aten

cy (n

s)

Buffer Size (KiB)

L1 Cache Size Discovery on ATOM

1

2

3

4

5

6

Metrics

Specification of Metadata for Compiler Configuration and System Characterization

Benchmark and Application Evaluation Suite

Evaluation Harness and Database

Evaluation System Selection and Characterization

Prototype Evaluations

BLACKJACK’S APPROACH ISORGANIZED ALONG 6 THRUSTS:

CHARACTERIZATION EVALUATION

Skewed curve:Values that are better to underestimate than overestimate

Normal distribution:Latencies / Bandwidths

Binary Grade: Fail or PassCritical Characteristics with integer values

BLACKJACK’S ROLE WITHIN AACE

AACE SYSTEMSource

Code

CompilerEnvironment Executable

ArchitectureCharacterization

Target Architecture

ConfigurationInformation

RuntimeSystem

Benchmarks andApplications asStress Tests

+ XML Schema+ Micro-Benchmarks

Evaluation System Selection & Characterization

Correctness and Performance Testing

EvaluationHarness & DB

SYSTEM CHARACTERIZATION

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 0.3 0.6 0.9 1.2 1.5 1.8 1.995

Gra

de

Estimated Value (normalized)

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 0.3 0.6 0.9 1.2 1.5 1.8 1.995

Gra

de

Estimated Value (normalized)

64 B24 KiB

A COLLABORATION OF SPONSORED BY

http://icl.eecs.utk.edu/blackjack/

AACE ARCHITECTURE AWARE COMPILER ENVIRONMENT PROGRAM

The project's ultimate goals are to develop full metrics for evaluating the AACE development teams (T1), to implement representative applications and micro-benchmarks, to test and evaluate the productivity, correctness, and performance of multiple AACE prototype systems, to perform system characterizations, and to work with the T1 teams to develop a general characterization methodology and schema.

BLACKJACKBENCH EXAMPLES

CHARACTERIZATION EVALUATION HARNESS

0

0.5

1.0

1.5

2.0

2.5

3.0

0 12 24 36 48 60

Memory

Float

Integer

Tota

l Exe

cutio

n Ti

me

(Nor

mal

ized

to s

ingl

e th

read

)

Thread Count

Effective Contexts, 4xMagny Cours 2.1GHz

32768

Acce

ss L

aten

cy (m

s)

Buffer Size (KiB)

Cache Sizes, Power7 3.0 GHz

0

10

20

30

40

1 2 4 8 16 32 64 128256

5121024

20484096

819216384

Benchmark Data

Remote L3

Local L3

L2

L1

A COLLABORATION OF SPONSORED BY

http://icl.eecs.utk.edu/blackjack/