understanding parallel computers
DESCRIPTION
Understanding Parallel Computers. Parallel Processing EE 613. Balancing Machine Specifics With Portability. How much do we need to know about the machine architecture Performance goal Game developers, embedded systems, and hardware vendors Coding specific to machine Lifetime goal - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/1.jpg)
Understanding Parallel Computers
Parallel ProcessingEE 613
![Page 2: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/2.jpg)
Balancing Machine Specifics With Portability
• How much do we need to know about the machine architecture– Performance goal
• Game developers, embedded systems, and hardware vendors
• Coding specific to machine
– Lifetime goal• Portability• Generalized code
![Page 3: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/3.jpg)
A Look At Six Parallel Computers
• Chip Multiprocessors– Intel Core Duo– AMD Dual Core Opteron
• Heterogeneous Chip Designs– GPU, FPGA, Cell– Vector
• Clusters– Node – processors, RAM, disk, memory not shared– Typical - eight nodes, control processor, switch– Blade server – includes com ports and cooling fans
• Supercomputers – BlueGene/L (440 PowerPC’s)
![Page 4: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/4.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 5: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/5.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 6: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/6.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 7: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/7.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 8: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/8.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
Now we can put multiple cores on a single chip.
![Page 9: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/9.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
MESI – Modified, Exclusive, Shared, Invalid
![Page 10: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/10.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 11: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/11.jpg)
![Page 12: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/12.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
MOESI – Modified, Owned, Exclusive, Shared, Invalid
![Page 13: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/13.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
Both designs implement a coherent shared memory.
![Page 14: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/14.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 15: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/15.jpg)
Symmetric Multiprocessor (SMP)• Each processor makes memory requests over the common memory bus
• All cache controllers snoop the memory bus and adjust the tags on their cached values to ensure coherent cache usage.
![Page 16: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/16.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
Example – po & p1 have copies of Block X, but p2 writes to Block X.
![Page 17: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/17.jpg)
![Page 18: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/18.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 19: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/19.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 20: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/20.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 21: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/21.jpg)
![Page 22: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/22.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 23: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/23.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 24: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/24.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 25: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/25.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 26: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/26.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 27: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/27.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 28: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/28.jpg)
![Page 29: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/29.jpg)
![Page 30: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/30.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 31: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/31.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 32: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/32.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 33: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/33.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 34: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/34.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 35: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/35.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 36: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/36.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 37: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/37.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 38: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/38.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 39: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/39.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 40: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/40.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 41: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/41.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 42: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/42.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 43: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/43.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 44: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/44.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 45: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/45.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 46: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/46.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 47: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/47.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 48: Understanding Parallel Computers](https://reader034.vdocument.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/48.jpg)
CSE524 Parallel Algorithms Lawrence Snyder