amoeba-cache adaptive blocks for eliminating waste in the memory hierarchy

Amoeba-Cache Adaptive Blocks for Eliminating Waste in the Memory Hierarchy

Snehasish KumarArrvindh ShriramanEric MatthewsLesley Shannon

Hongzhou ZhaoSandhya Dwarkadas

Amoeba Cache : Adaptive blocks for Eliminating Waste in the Memory Hierarchy 1

Cache data utilization

Amoeba Cache : Adaptive blocks for Eliminating Waste in the Memory Hierarchy 2

Tags Data UntouchedData

Tag Array Data Array

Variable Granularity Blocks

Amoeba Cache : Adaptive blocks for Eliminating Waste in the Memory Hierarchy 3

Tag Array Data Array

How to support variable # of blocks / set ?

How to support variable granularity for each block?

Our Approach : Amoeba Cache

Amoeba Cache : Adaptive blocks for Eliminating Waste in the Memory Hierarchy 4

Unified SRAM Array

Miss Rate

Space Utilisation

Bandwidth

AmoebaCache

Target Metrics

Amoeba Cache : Adaptive blocks for Eliminating Waste in the Memory Hierarchy 5

Reduces L1 and L2 miss rate by 18%

Reduces on-chip bandwidth by 46% Reduces off-chip bandwidth by 38%

Reduces energy by 11%

Improves performance by 10%

Results