multi-core and tera- scale computing a short overview of benefits and challenges csc 2007 andrzej...
TRANSCRIPT
![Page 1: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/1.jpg)
Multi-core and tera-scale
computingA short overview of benefits and
challengesCSC 2007
Andrzej Nowak, CERN28.08.2007
![Page 2: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/2.jpg)
![Page 3: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/3.jpg)
Multi-core and tera-scale computing - Andrzej Nowak, CERN 3
The “free” bonus
>Silicon technology advances more quickly than design capabilities
>Single CPU complexity is rising slowly
>Moving from 90nm and 65nm processes to 45nm and 32nm processes
>Free transistors available Take all you want… eat all you take
![Page 4: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/4.jpg)
Multi-core and tera-scale computing - Andrzej Nowak, CERN 4
The multi-core revolution
>What do we do with extra silicon? Copy what we already have
>First shot at the PC consumer market – Intel’s Hyper-Threading in the Xeons and Pentium 4 (SMT) Idea: do work when nothing is happening Some resources in the CPU core were shared The relation to extra space on die was not direct
>First popular dual-core CPU for Joe Average – the Intel Core Duo Idea: copy a big part of the processor Less resources are shared
>Next generations of x86-like CPUs are coming 6, 8, 16 cores
![Page 5: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/5.jpg)
Multi-core and tera-scale computing - Andrzej Nowak, CERN 5
Multi-core designs
>Many other multi-core CPUs are on the market AMD x2 (and x4 coming soon) ARM specifications for multi-core CPUs
(your iPod is dual core!) Sun’s Niagara processor (8 cores) Cell processor in Playstation 3 units
>Programmers need to take advantage of the new features CERN openlab and Intel are organizing
a multi-threading and parallelism workshop on the beginning of October!
![Page 6: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/6.jpg)
Multi-core and tera-scale computing - Andrzej Nowak, CERN 6
Tera-scale computing
>Computer performance is traditionally expressed in FLOPS (floating point operations per second) CDC 6600 (1966) – 10 MFLOPS, 64kB
memory Your iPod – 100 MFLOPS Your iMac – 3-4 GFLOPS Your graphics card: 300-500 GFLOPS
>Not so far from the magical limit - 1 Teraflop…? Hence the name, tera-scale
![Page 7: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/7.jpg)
Multi-core and tera-scale computing - Andrzej Nowak, CERN 7
Processors in GPUs (digression)
>Newest trend – heavily multi-core (up to 128)
>Blazing fast
>Toolkits available (i.e. NVIDIA CUDA)
>But… Floating point operations are not precise
enough or non-standard Data types are limited Memory handling is not optimized for
general purpose computing Tiny cache, if at all ~150W… for the chip only
![Page 8: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/8.jpg)
Multi-core and tera-scale computing - Andrzej Nowak, CERN 8
Tera-scale computing ctd.
>Intel’s Polaris 80-core prototype ~1 TFLOPS
>Intel’s Larrabee design 16-24 core x86-GPU hybrid ~3 TFLOPS
>Research directions How do you feed 80 hungry cores? Parallelism – fine grained or coarse? Effective virtualization Memory access and bus optimization Resource sharing
![Page 9: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/9.jpg)
Multi-core and tera-scale computing - Andrzej Nowak, CERN 9
Questions for the future
>How many cores does your mother need?
>How many cores do you, a scientist, need?
>How do you effectively use what you have?
>What is the best level to introduce parallelism? Do you need to redesign your software?
>GRID computing or tera-scale homogenous computers? Will virtualization be effective enough?
![Page 10: Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN 28.08.2007](https://reader036.vdocument.in/reader036/viewer/2022062421/56649c775503460f9492beab/html5/thumbnails/10.jpg)
Q&A(1 Swiss minute)
This research project has been supported by a Marie Curie Early Stage Research Training Fellowship of the European Community’s Sixth Framework Programme under contract number (MEST-CT-2004-504054)