www.compaq.com calcul scientifique hautes performances brest 18-10-2000 ghislain de jacquelot...

www.compaq.com

Calcul scientifique hautes Calcul scientifique hautes performancesperformances

Brest 18-10-2000Brest 18-10-2000

Ghislain de JacquelotGhislain de Jacquelot

consultantconsultant

HPTC Competency Center / AnnecyHPTC Competency Center / Annecy

[email protected]@compaq.com

Compaq Confidentielwww.compaq.com

HPTC Brest 18/10/2000 / G. de Jacquelot

2

AgendaAgenda

Qui est Compaq?Qui est Compaq? Compaq dans le march₫ HPTCCompaq dans le march₫ HPTC Technologie et produitsTechnologie et produits Large Scalable SystemsLarge Scalable Systems Quelques r₫f₫rencesQuelques r₫f₫rences



3

Who is Compaq?Who is Compaq?

$38.5B company$38.5B company World-wide PC market leader (13% share)World-wide PC market leader (13% share) Number one engine in Linux revolution (25% share)Number one engine in Linux revolution (25% share) Alpha/Tru64 UNIX the fastest growing UNIX platform Alpha/Tru64 UNIX the fastest growing UNIX platform

in Europe in 2H1999in Europe in 2H1999 $500M investment in Alpha technology by Compaq, $500M investment in Alpha technology by Compaq,

Samsung, APISamsung, API

Sources: Compaq, IDC, DataquestSources: Compaq, IDC, Dataquest



4

COMPAQ dans le march₫ HPTCCOMPAQ dans le march₫ HPTC



5

IDC Platform Segmentation (1998)IDC Platform Segmentation (1998)

Capability (Capability (supercomputerssupercomputers) ) PVP and MPP: >$1M, ASP>$3MPVP and MPP: >$1M, ASP>$3M

Capacity (Capacity (serversservers)) Enterprise: >$1M, ASP <$1.5MEnterprise: >$1M, ASP <$1.5M Division: $250K to $1M, ASP<$500KDivision: $250K to $1M, ASP<$500K Department: <$250K, ASP<$50K Department: <$250K, ASP<$50K

Compaq AlphaServers address all segmentsCompaq AlphaServers address all segments



6

HPTC Revenue by Segment, 1998 and 1999

1998 1999Growth

(%)Capability 833 930 11,6Enterprise 247 355 43,7Divisional 1 810 1 840 1,6Departmental 2 021 2 640 30,7Total 4 911 5 765 17,4

The HPTC market has grown 17% in 1999 to $ 5.8 Billion

75 % comes from 75 % comes from Divisional and Divisional and DepartmentalDepartmental

However, all segments However, all segments added revenue to the added revenue to the marketmarket..

Source: IDC, 2000



7

Compaq in the HPTC market Compaq in the HPTC market ($5.8B in 1999)($5.8B in 1999)

Source: IDC May 2000

HPTC 1999 Results (IDC 2000)

0

200

400

600

800

1000

1200

1400

HP Compaq SGI IBM Sun Fujitsu NEC Hitachi Tera

Re

ve

nu

e (

$M

)

Technical Capability

Technical Enterprise

Technical Divisional

Technical Departmental



8

Compaq performance in a market Compaq performance in a market which grew 17%which grew 17%

Vendor Marketshare

Growth

HP 23% + 1 pointCompaq 22% + 3 points

SGI 16% - 4 pointsIBM 16% - 3 pointsSUN 12% flat

We have moved into a strong #2 market share position overall, only one point behind the leader HP.

The performance of Compaq represents a growth of more than 30% and is mostly due to the introduction of packaged clusters and the SC series.

* IDC Flash - January 2000



9

Compaq #1 for LinuxCompaq #1 for Linux

IDC just released Linux hardware server statistics -- this is first time IDC or major IDC just released Linux hardware server statistics -- this is first time IDC or major analyst has estimated market shares. Compaq leads with 25% share, way ahead analyst has estimated market shares. Compaq leads with 25% share, way ahead of IBM who is in second place with 10%.of IBM who is in second place with 10%.

The numbers understate volumes, in that IDC does not count workstations The numbers understate volumes, in that IDC does not count workstations deployed as servers.deployed as servers.

Systems Share for

1999Compaq 43,166 24.4%Dell 14,979 8.5%HP 13,821 7.8%IBM 16,790 9.5%Others 86,241 48.7%

The IDC Quarterly Server Tracker, Q499, March 9, 2000

www.compaq.com

STRATEGY in HPTC STRATEGY in HPTC



11

Obstacles à l Obstacles à l ₫volution des ₫volution des performancesperformances

Tem

ps d

e cy

cle

CPU

(nse

c)

11

100100

1010

1010 100100 1K1K 10K10K 100K100K

SC(PVP)

SMPCluster Farm

MPPNombre de CPUs

Limites Physiques

Limites deComplexit₫

Les microprocesseurrs lesplus rapides avec les meilleursr₫seaux d interconnexion de

Clusters de SMP apportent la performance

Applicative Maximale



12

CompaqCompaqs HPTC Strategys HPTC Strategy Build balanced computer systemsBuild balanced computer systems

CPU performanceCPU performance Bandwidth and latency throughout the memory hierarchyBandwidth and latency throughout the memory hierarchy

Make them scaleableMake them scaleable Hardware and system software performanceHardware and system software performance Restrain overheadsRestrain overheads

Make them manageableMake them manageable Coherent file managementCoherent file management System resource managementSystem resource management Software development environmentSoftware development environment

Make them cost-effectiveMake them cost-effective Use proven COTS componentsUse proven COTS components Move functionality into siliconMove functionality into silicon

Make them become SOLUTIONSMake them become SOLUTIONS Partnership with key ISVsPartnership with key ISVs One stop shopping packagesOne stop shopping packages



13

1 2 4 8 16 32 64 128 2561

2

4

8

16

32

64

128

256

CPUs per SMP

SM

Ps

per

Clu

ster

10GF

100GF

1TF

10TF

Shared Memory

Distributed M

emory

AlphaServer SC : Roadmap to Multiple TeraOps

Numberof

SMP nodesin a

SSI system

Processorroadmap



14

CEA/DAM Supercomputer projectCEA/DAM Supercomputer project By far the fastest supercomputer ever sold in By far the fastest supercomputer ever sold in

EuropeEurope More than 2700 Alpha/Unix processorsMore than 2700 Alpha/Unix processors 5 TeraFlops5 TeraFlops 2.7 Terabytes of main memory2.7 Terabytes of main memory Power requirements above one megawattPower requirements above one megawatt 50 Terabytes of fast disk devices50 Terabytes of fast disk devices Approximately 200 cabinetsApproximately 200 cabinets 80 tons80 tons Designed and built by Compaq CSS, Annecy Designed and built by Compaq CSS, Annecy

4000 fully loaded trucks to dig out the IT room4000 fully loaded trucks to dig out the IT room 750 Sq meters, extensible to 1250750 Sq meters, extensible to 1250 A 1.20 meter deep false floorA 1.20 meter deep false floor Power and Cooling up to 4 MWatts Power and Cooling up to 4 MWatts



15

Pittsburgh Supercomputing CenterPittsburgh Supercomputing Centerhttp://www.psc.edu/publicinfo/news/2000/terascale-08-03-00.htmlhttp://www.psc.edu/publicinfo/news/2000/terascale-08-03-00.html

WorldWorlds most powerful s most powerful supercomputer for non-military supercomputer for non-military computational sciencecomputational science

$36M funded by US NSF, operated $36M funded by US NSF, operated by PSCby PSC

Initial installation November 2000Initial installation November 2000 Peak performance over 6 TFLOPSPeak performance over 6 TFLOPS 2,728 CPUs (682 quad-processor 2,728 CPUs (682 quad-processor

AlphaServers)AlphaServers) 2,728 GB memory, 50 TB storage2,728 GB memory, 50 TB storage Proteomics, storm-scale weather Proteomics, storm-scale weather

forecasting, earthquake studies, forecasting, earthquake studies, global climate changeglobal climate change



16

Los Alamos National Laboratory: ASCI QLos Alamos National Laboratory: ASCI Qhttp://www.compaq.com/alphaserver/news/supercomputer_0822.htmlhttp://www.compaq.com/alphaserver/news/supercomputer_0822.html

US Department of EnergyUS Department of Energys National Nuclear s National Nuclear Security Administration Stockpile Stewardship Security Administration Stockpile Stewardship ProgramProgram

Accelerated Strategic Computing Initiative 30 Accelerated Strategic Computing Initiative 30 TeraOPS TeraOPS QQ machine machine

Value >$200M over two yearsValue >$200M over two years 375 AlphaServer GS320 (12,000 375 AlphaServer GS320 (12,000

EV68/1250MHz)EV68/1250MHz) 600 TB storage600 TB storage 2,100 sq m2,100 sq m Optional upgrade to 100 TeraOPSOptional upgrade to 100 TeraOPS



17

BioinformaticsBioinformatics

Most recent and fastest growing application of computing to Most recent and fastest growing application of computing to sciencescience

Map whole genomes to provide target opportunities for new Map whole genomes to provide target opportunities for new drugs, agro-chemicals, and novel chemical solutionsdrugs, agro-chemicals, and novel chemical solutions

Exploding amount of data (multiple TB/yr)Exploding amount of data (multiple TB/yr) Very rapidly evolving application area on the edge of Very rapidly evolving application area on the edge of

human understandinghuman understanding Informative articlesInformative articles

Bioinformatics in the Information Age, Science, 18 Feb 2000, p.1221Bioinformatics in the Information Age, Science, 18 Feb 2000, p.1221 Genomics: Journey to the Center of Biology, Science, 10 Mar 2000, p. 1777Genomics: Journey to the Center of Biology, Science, 10 Mar 2000, p. 1777 Drug Discovery: An Information Revolution, Science, 17 Mar 2000, p. 1951Drug Discovery: An Information Revolution, Science, 17 Mar 2000, p. 1951



18

Compaq: leading bioinformatics IT supplierCompaq: leading bioinformatics IT supplier

All public and most commercial applications run All public and most commercial applications run best on Compaq Alpha/Tru64 UNIX best on Compaq Alpha/Tru64 UNIX

Leading public gene sequencing centers world-Leading public gene sequencing centers world-wide use Compaq Alpha serverswide use Compaq Alpha servers

~ MIT Whitehead Institute (USA)MIT Whitehead Institute (USA)~ Washington University, St Louis (USA)Washington University, St Louis (USA)~ The Sanger Centre (GB)The Sanger Centre (GB)~ Centre National de Sequencage (France)Centre National de Sequencage (France)

Without CompaqWithout Compaqs Alpha technology and Tru64 Unix s Alpha technology and Tru64 Unix software our efforts to analyze and decode software our efforts to analyze and decode chromosome 22 would not have been successful.chromosome 22 would not have been successful.

- Richard Durbin, Assistant Director, The Sanger Centre, - Richard Durbin, Assistant Director, The Sanger Centre, Cambridge UK, 7 December 1999Cambridge UK, 7 December 1999



19

Celera Genomics (Rockville MD, USA) Celera Genomics (Rockville MD, USA) http://www.compaq.com/alphaserver/news/celera_june00.htmlhttp://www.compaq.com/alphaserver/news/celera_june00.html

Private company competing with public institutions Private company competing with public institutions to complete human genome sequenceto complete human genome sequence

Most powerful non-governmental computing facility Most powerful non-governmental computing facility in the worldin the world

>800 Compaq AlphaServer/Tru64 UNIX systems>800 Compaq AlphaServer/Tru64 UNIX systems >250 GSCH (Giga-Sequence-Comparisons per >250 GSCH (Giga-Sequence-Comparisons per

Hour)Hour) 50 TB database on Compaq StorageWorks - 50 TB database on Compaq StorageWorks -

database growing at 10 TB/yeardatabase growing at 10 TB/year



20

Some Compaq Automotive HPTC CustomersSome Compaq Automotive HPTC Customers

YokohamaYokohamaPorschePorscheHondaHonda

VisteonVisteonNissanNissanGoodyearGoodyear

ToyotaToyotaMazdaMazdaFordFord

SubaruSubaruMagna InternationalMagna InternationalFerrariFerrari

RenaultRenaultKawasakiKawasakiDensoDenso

PSA Peugeot CitroënPSA Peugeot CitroënHyundaiHyundaiDaimlerChryslerDaimlerChrysler



21

Calcul scientifique hautes-performancesCalcul scientifique hautes-performancesLes ₫l₫ments essentielsLes ₫l₫ments essentiels

Mat₫riel:Mat₫riel: ProcesseursProcesseurs Syst₩mes multiprocesseurs SMPSyst₩mes multiprocesseurs SMP Syst₩mes parall₩les à m₫moire Syst₩mes parall₩les à m₫moire

distribu₫edistribu₫e Logiciel:Logiciel:

LibrairiesLibrairies AdministrationAdministration ApplicationsApplications

www.compaq.com

ProcesseursProcesseurs



23

Processeurs AlphaProcesseurs Alpha

Engagement fort de Compaq sur AlphaEngagement fort de Compaq sur Alpha les meilleures performances du march₫les meilleures performances du march₫ migration de Tandem Himalaya vers Alphamigration de Tandem Himalaya vers Alpha

Architecture: pas de changement de direction Architecture: pas de changement de direction RISC, execution Out-of-order RISC, execution Out-of-order Pas de changement de technologie compilationPas de changement de technologie compilation

Accent sur les performances applicatives plutôt que Accent sur les performances applicatives plutôt que les performances cr₨tes les performances cr₨tes



24

Processeurs EV6x (Alpha 21264)Processeurs EV6x (Alpha 21264)

EV67: Plus haute performance du march₫EV67: Plus haute performance du march₫ fr₫quence ₫lev₫e (667 - 730 MHz)fr₫quence ₫lev₫e (667 - 730 MHz) support de caches Dual Data Readsupport de caches Dual Data Read performance actuelle (667MHz 8Mo de cache)performance actuelle (667MHz 8Mo de cache)

40 Specint9540 Specint95 82.7 Specfp9582.7 Specfp95

EV68EV68 fr₫quence de 833 à 1.5 GHzfr₫quence de 833 à 1.5 GHz technologie 0.18 micron, puis 0.13.technologie 0.18 micron, puis 0.13. sup₫rieur à 100 SpecFpsup₫rieur à 100 SpecFp



25

Alpha 21264 (EV6)Alpha 21264 (EV6)

Instr. Cache (64KB)2-Set

ALU Shifter

Branch Predictor

DataCache (64KB)2-SetWrite-Back

Level 2Cache

andBus

Interface Unit

Integer RegMap

FP Reg Map

Integer Issue Queue

(20)

FP Issue Queue

(20)

ALU Shifter Multiplier

ALU

ALU

FP ADD

FP DIV/SQRT

FP MUL

Address

Address

4 Instructions

Sys Bus

64-bit

L2 Cache Bus

128-bit

Phys Addr

44-bit

ExecutionOut of Order

InstructionsVideo

Pr₫diction debranchement

avanc₫eCache & SystemBus à haut d₫bit

Jusqu à 80instructions en

cours d ex₫cution

Cache niveau 1128 KB on-chip



26

Alpha 21264 (EV6 - EV67)Alpha 21264 (EV6 - EV67)

Out-of-order executionOut-of-order execution Grands caches primaires (64k Data + Grands caches primaires (64k Data +

64k Instr)64k Instr) 1.33 Gflops cr₨te à 667 MHz1.33 Gflops cr₨te à 667 MHz Plus de 82 Specfp95Plus de 82 Specfp95 A chaque cycle, 4 op₫rations parmi:A chaque cycle, 4 op₫rations parmi:

4 instructions enti₩res4 instructions enti₩res 2 instructions flottantes2 instructions flottantes 2 instructions d 2 instructions d acc₩s m₫moireacc₩s m₫moire



27

Evolutions EV6Evolutions EV6

EV67EV67 fr₫quence sup₫rieure à 800 MHzfr₫quence sup₫rieure à 800 MHz sup₫rieur à 100 SpecFpsup₫rieur à 100 SpecFp

EV68EV68 fr₫quence de 900 à 1.4 GHzfr₫quence de 900 à 1.4 GHz technologie 0.18 microntechnologie 0.18 micron ₫₫volution jusqu volution jusqu à mi-2002à mi-2002



28

Alpha 21364 (EV7)Alpha 21364 (EV7) Utilise un cUtilise un cur à base dur à base dEV6 + am₫liorationsEV6 + am₫liorations

Out-of-Order ExecutionOut-of-Order Execution 64K + 64K cache primaire64K + 64K cache primaire 2 unit₫s flottantes, 4 unit₫s enti₩res, 2 load/store.2 unit₫s flottantes, 4 unit₫s enti₩res, 2 load/store.

Fr₫quence > 1 GhzFr₫quence > 1 Ghz Cache de niveau 2 int₫gr₫ (1.75 MB)Cache de niveau 2 int₫gr₫ (1.75 MB) Contrôleur m₫moire int₫gr₫Contrôleur m₫moire int₫gr₫ Contrôleur dContrôleur dinterconnexion int₫gr₫ (4 ports)interconnexion int₫gr₫ (4 ports) Contrôleur I/O int₫gr₫Contrôleur I/O int₫gr₫ Support du mode lock-step (syst₩mes Support du mode lock-step (syst₩mes

TANDEM)TANDEM)



29

Alpha 21464 (EV8)Alpha 21464 (EV8)

M₨mes fonctionalit₫s dM₨mes fonctionalit₫s dinterconnexion que linterconnexion que lEV7EV7 Horloge plus rapide (1.5+ GHz)Horloge plus rapide (1.5+ GHz) 6 Gflops (sans instructions Mult/Add)6 Gflops (sans instructions Mult/Add) Bande passante m₫moire: 10+ Go/s soutenus Bande passante m₫moire: 10+ Go/s soutenus Nouveau coeurNouveau coeur Cache interne plus grandCache interne plus grand Simultaneous MultithreadingSimultaneous Multithreading Technologie 0.125 micronTechnologie 0.125 micron 250 + millions de transistors 250 + millions de transistors



30

Processeur Alpha 21464 (EV8)Processeur Alpha 21464 (EV8)

Superscalaire Multithreading SimultaneousMultithreading

Thread 1

Thread 2

Thread 3

Thread 4

Thread 5

Temps

www.compaq.com

La gamme de serveursLa gamme de serveursAlphaAlpha



32

Serveurs AlphaServeurs Alpha

DS10, DS10LDS10, DS10L 1 cpu 1 cpu (466 ou 600 MHz)

DS20, DS20EDS20, DS20E 2 cpus 2 cpus (500 ou 667 MHz)(500 ou 667 MHz)

ES40ES40 4 cpus 4 cpus (500 ou 667 MHz)(500 ou 667 MHz)

GS80, GS160, GS320GS80, GS160, GS320 8, 16 ou 32 cpus 8, 16 ou 32 cpus (731 (731 MHz)MHz)



33

PPerformanceerformance

AlphaServer AlphaServer

GS60E/140GS60E/140

S₫rie DSS₫rie DS

S₫rie ESS₫rie ES

S₫rie GSS₫rie GS

AlphaServerAlphaServerDS20/EDS20/E

AlphaServer AlphaServer ES40ES40

AlphaServer AlphaServer DS10L / DS10DS10L / DS10

OpenVMS

AlphaServers



34

Technologie Cross-barTechnologie Cross-bar

R₫ponse aux probl₩mes:R₫ponse aux probl₩mes: Bande passanteBande passante LatenceLatence ScalabilityScalability

technologie Bus technologie Cross-bar

CPU CPUCPU CPU

SwitchSwitchMEM MEMMEM MEM

CPU CPUCPU CPU

MEM MEMMEM MEM



35

DS20DS20

Dual processor - EV67 @ 667 MHz

Pedestal enclosure

4GB maximum memory

128 GB internal storage (18GB drives)

6 PCI slots (6 64-bit PCI, 1 shared ISA)

Redundant power supply (N+1)

Switch bandwidth: 5,2 GB/s

Measured performance per CPU:

40,1 SPECint95

83,6 SPECfp95



36

Le serveur ES40Le serveur ES40

Le Serveur le plus performant de sa cat gorie:₫ Jusquà 4 processeurs Alpha21264 cadenc s à 667MHz, ₫Cache secondaire de 8 MB, technologie DDRArchitecture Crossbar interne de 5.2 GB/secJusquà 32 GB de m moire centrale,₫Jusquà 144 GB de stockage en interne

4 ou 8 disques Hot-Swap Ultra2 SCSI2 bus PCI 64 bits 33 MHz (~260 Mo/s chacun)6 ou 10 slots PCI



37

AlphaServer ES40AlphaServer ES40

SuperI/O

SC

SI/N

IC

PC

I 2

PC

I 1

PC

I 7

PC

I 6

PC

I 5

Serial, Parallelkeyboard/mousefloppy

64b (266MB/S)64b (266MB/S)

PC

I 8

Each @ 128b (4GB/S)

Crossbar Switch

Each @ 64b (2.6GB/S)

Quad Ctl

Da

ta S

lices (8

)

PCI 1 PCI 0

256b (2.6GB/S)

256b (2.6GB/S)

SDRAM Memoryup to 16GB

Bank 3

Bank 2

Bank 1

Bank 0Alpha 264

L2 Cache

PCI-ISA USB

PC

I 9

PC

I 4

PC

I 3ServerMgt.

Floppy

CD



38

Technologie NUMATechnologie NUMA

Non Uniform Memory AccessNon Uniform Memory Access M₫moire logiquement partag₫eM₫moire logiquement partag₫e M₫moire physiquement distribu₫eM₫moire physiquement distribu₫e

M moire₫

CPU CPUCPU CPU CPU CPUCPU CPU

Interconnexion



39

Coh₫rence de cache: CC-NUMACoh₫rence de cache: CC-NUMA

Cache Coherent Non Uniform Memory AccessCache Coherent Non Uniform Memory Access Une donn₫e X est pr₫sente dans le cache des Une donn₫e X est pr₫sente dans le cache des

processeurs 0, 2 et 3processeurs 0, 2 et 3 Le processeur 0 modifie la donn₫eLe processeur 0 modifie la donn₫e

Snoopy bus protocol

Directory based

CPU 3 CPU 1CPU 2 CPU 0

Cache CacheCache Cache

CPU 3 CPU 1CPU 2 CPU 0

Cache CacheCache Cache

Mem X

CPU n

Cache

Mem X ...001101 - Dirty



40

Quad Building Block: QBBQuad Building Block: QBB

M moire₫

CPU CPUCPU CPU CPU CPUCPU CPU

Interconnexion



41

Compaq AlphaServer GS80, Compaq AlphaServer GS80, GS160 et GS320 GS160 et GS320

Serveurs dServeurs dentrepriseentreprise Scalabilit₫ - NUMAScalabilit₫ - NUMA 32 Alpha Processeurs EV67 32 Alpha Processeurs EV67

128 GB M₫moire128 GB M₫moire 64 bus PCI 64 bus PCI



42

Cross-bar et NUMA: GS80, GS160 et GS320Cross-bar et NUMA: GS80, GS160 et GS320

EV6 EV6EV6 EV6

Mem MemMem Mem

I/O Switch

EV6 EV6EV6 EV6

Mem MemMem Mem

Global Port I/OSwitch

4 PortAdapter2GB/sec

PCIPCIPCIPCI

PCIPCIPCIPCI

PCIPCIPCIPCI

PCIPCIPCIPCI

4 PortAdapter2GB/sec

· De 1 à 4 Cpus par bloc (QBB)

· 4 connexions à 1.6GB/sec entre CPU et m₫moire simultan₫ment.

· Bande passante m₫moire de 6.4GB/sec par QBB

· Jusquà 4Go par carte m₫moire, 16Go par QBB

· de 2 to 8 bus PCI (28 slots) par QBB

- 2Go/sec I/O BW (full-duplex)

· Pas de limitation de slots (cpus, m₫moire, entr₫es-sorties)



43

AlphaServer GS 320AlphaServer GS 320

Glo

bal

Sw

itch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch

EV67 EV67EV67 EV67

Mem MemMem Mem

I/OSwitch



44

GS320GS320

Front Back

QBBs #1-4

QBBs #5-8

Global Switch



45

AlphaServers GS: Composants Hot-swapAlphaServers GS: Composants Hot-swap



46

Architectures à base dArchitectures à base dEV7, EV8EV7, EV8

364M

IO364

M

IO364

M

IO364

M

IO

364M

IO364

M

IO364

M

IO364

M

IO

364M

IO364

M

IO364

M

IO364

M

IO

www.compaq.com

Syst₩mes parall₩les à Syst₩mes parall₩les à m₫moire distribu₫em₫moire distribu₫e



48

Memory Channel 2

Interconnexion de nouvelle g n ration₫ ₫Syst me fiable, à grande bande passante et faible ₩latenceTechnologie Full Duplex à 100 Mo/sCommutateur « crossbar » 8x8, 800 Mo/s de bande passante agr g e₫ ₫Distance de 3 km en fibre ou 10 m en LVDS

Nouvel adaptateur PCI90 Mo/s de bande passanteLatence MPI de 5 usec



49

6 ES40, 4 CPUSEV67@667MHz

2Goctets de RAM 48 Goctets de disques

Crossbar Memory Channel II D bit ₫ Nud à Nud: 100Moctets/sec Latence: 5 micro sec Maximum de 8 noeuds connect s ₫ sur le switch

/ tmp

Tru64 UNIX V5.0 Tru Cluster Software V5.0 LSFImage Syst meUnique (Cluster File System)₩

Exemple de cluster memory channel

Stockage



50

Measuring interconnect performanceMeasuring interconnect performance

BandwithBandwith Fast Ethernet: 6 Mbytes / secondFast Ethernet: 6 Mbytes / second Gigabit Ethernet: 40 Mbytes / secondGigabit Ethernet: 40 Mbytes / second Memory Channel: 85 Mbytes /secondMemory Channel: 85 Mbytes /second Quadrics: 208 Mbytes / secondQuadrics: 208 Mbytes / second

LatencyLatency Ethernet: 60-100 microsecondsEthernet: 60-100 microseconds Quadrics and MC2: 5 microsecondsQuadrics and MC2: 5 microseconds



51

Compaq AlphaServer SC SeriesCompaq AlphaServer SC Series



52

La gamme Compaq AlphaServer La gamme Compaq AlphaServer SC SeriesSC Series

Syst₩me ₫volutif, massivement parall₩le à m₫moire Syst₩me ₫volutif, massivement parall₩le à m₫moire distribu₫e, à base de composants standard:distribu₫e, à base de composants standard:

Mat₫rielMat₫riel Noeuds de calcul AlphaServer SMPNoeuds de calcul AlphaServer SMP Interconnect QSW AlphaServer SCInterconnect QSW AlphaServer SC

LogicielLogiciel Syst₩me dSyst₩me dexploitation Tru64 UNIX, cluster file system exploitation Tru64 UNIX, cluster file system

et outils det outils dadministration de Compaq.administration de Compaq. Parallel file system, syst₩me de gestion de ressources Parallel file system, syst₩me de gestion de ressources

et librairies MPI, SHMEM de QSW.et librairies MPI, SHMEM de QSW. Environnement de d₫veloppement et outils de Compaq Environnement de d₫veloppement et outils de Compaq

et de soci₫t₫s tierces (Etnus, Pallas, Platform)et de soci₫t₫s tierces (Etnus, Pallas, Platform)



53

AlphaServer SC Network SoftwareAlphaServer SC Network Software

Resources Management System (RMS)Resources Management System (RMS) Administration du switch et des partitions: Pandora Administration du switch et des partitions: Pandora MPIMPI ShmemShmem Parallel File System (PFS)Parallel File System (PFS) Elan card software supportElan card software support



54

Interconnect AlphaServer SC Interconnect AlphaServer SC Quadrics Supercomputers WorldQuadrics Supercomputers World

PCI interface Elan-3PCI interface Elan-3 DMADMA Get et putGet et put 200 Mo/s/rail200 Mo/s/rail

switch switch fat treefat tree Elite Elite composants crossbar 8 portscomposants crossbar 8 ports formats 16 or 128 portsformats 16 or 128 ports cables jusqucables jusquà 20mà 20m latence de 35 nanosecondes par latence de 35 nanosecondes par

cross-barcross-bar Equilibrage automatique de chargeEquilibrage automatique de charge Latence: <3 Latence: <3 mms DMA/shmem, <6 s DMA/shmem, <6

mms MPIs MPI



55

Quadrics Switch and Interconnect Quadrics Switch and Interconnect CablesCables



56

ASCI PathforwardASCI Pathforward



57

SAN for an AlphaServer SC SAN for an AlphaServer SC configuration (50 TB / 7.5 GB/s Bw)configuration (50 TB / 7.5 GB/s Bw)

RAID CTLR RAID CTLR

14 disks

14 disks File-server nodes

Fits in a cabinet



58

Nos r₫f₫rences r₫centes SCNos r₫f₫rences r₫centes SC

LANL (ASCI-Q)PSCCEA - DAMLLNL2 sites class s₫CEA civilOAKRIDGE National LabsNCARWRIGHT PATTERSON CSC



59

Beowulf clustersBeowulf clusters

Often considered as a cheap solution !Often considered as a cheap solution ! Hard to manage, but !Hard to manage, but !

Compaq developed software for easier Compaq developed software for easier administrationadministration

CMUCMU Cluster Management Utility Cluster Management Utility

Experience with third-party interconnects Experience with third-party interconnects integration (Myrinet)integration (Myrinet)



60

Screaming Power in a 1U Package

Easy to scale by adding another serverEasy to scale by adding another server

Fastest Uni processor design Fastest Uni processor design in a 1U form factorin a 1U form factor Fastest Memory Access with the Highest Bandwidth Fastest Memory Access with the Highest Bandwidth

memory in its classmemory in its class High speed I/O with a High speed I/O with a FullFull Sized 64 bit PCI slot Sized 64 bit PCI slot 40 CPUs in ONE rack !40 CPUs in ONE rack ! Rack or Desktop-ready for space constrained Rack or Desktop-ready for space constrained

environmentsenvironments Compaq Compaq Tru64 UNIXTru64 UNIX, , OpenVMSOpenVMS and Linux support and Linux support

Fastest 1U Server available anywhere!



61

Quelques r₫f₫rences en Europe Quelques r₫f₫rences en Europe CSC AirbusCSC Airbus (UK)(UK) 16 XP1000 EV6716 XP1000 EV67 LinuxLinux EtherEther SRC Airbus(UK)SRC Airbus(UK) 11 XP1000 EV6711 XP1000 EV67 LinuxLinux EtherEther DTU (Denmark)DTU (Denmark) 60 XP1000 EV6760 XP1000 EV67 Tru64Tru64 EtherEther U of Coimbra (P)U of Coimbra (P) 13 XP1000 EV6713 XP1000 EV67 LinuxLinux EtherEther Wuppertal (Ger)Wuppertal (Ger) 128 DS10 128 DS10 LinuxLinux

MyrinetMyrinet CSC (Finland)CSC (Finland) 128 DS10 EV67128 DS10 EV67 ??

MyrinetMyrinet

www.compaq.com

LogicielLogiciel



63

Compaq Tru64 UNIX 5.0

Syst me d ₩ exploitation 100% 64 bitsAdministration simplifi e et centralis e sur un seul utilitaire ₫ ₫

TruCluster V5Large choix dinterfaces : Motif, WEB, à partir dune station NTTuning dynamique

Support des tr s grandes configurations₩Plus de CPU, file system de 10 To, 128 Go de m moire, 10.000 utilisateurs₫



64

TruCluster Software V5.1TruCluster Software V5.1The cluster is the systemThe cluster is the system

Easier managementSingle System View

·Cluster File System

·Cluster Alias

·Easier Management

/

/usr /var /...

/... /... /.../... /...



65

System administration toolsSystem administration tools

Tru64 UNIX Tru64 UNIX Sysman provides single-system Sysman provides single-system interface interface

Choice of GUI, web-based or command-lineChoice of GUI, web-based or command-line Automated system utilities Automated system utilities

console softwareconsole software SRA broadcasts data over SC networksSRA broadcasts data over SC networks

Hardware monitoring and diagnosticsHardware monitoring and diagnostics interfaces to Sysman interfaces to Sysman



66

Tru64 UNIX V5.0A Features and BenefitsTru64 UNIX V5.0A Features and Benefits SysMan StationSysMan Station

A single, consistent presentation format that offers a graphical representation of a system (or cluster) monitoring status from the CPU down to the level of individual components.



67

Configuration View Window: File System



68

Configuration View Window: System Nodes



69

Tru64 UNIX V5.1 Features and BenefitsTru64 UNIX V5.1 Features and Benefits Compaq Insight ManagerCompaq Insight Manager

Allows the monitoring of Compaq systems (including Tru64 UNIX systems, Windows NT workstations, PCs, and laptops) in a network.

Systems can be managed from anywhere

Access is: http://fully_qualified_hostname:2301



70

Tru64 UNIX V5.1 Features and BenefitsTru64 UNIX V5.1 Features and Benefits

NetRAIN supportNetRAIN supportImproves the reliability of transmitted data by allowing a failover from one controller to another when a fault is detected. (base component, no license is required)

Host

tu0 tu1

Virtual network interface

tu0 is the active interface. If tu0 fails, tu1 becomes the active one. UNIX or TruCluster will not be impacted if a failure occurs

nr0



71

Tru64 UNIX V5.0A Features and BenefitsTru64 UNIX V5.0A Features and Benefits LLogical ogical SStorage torage MManager - anager - OverviewOverview

Volume02RAID 0

Volume03JBOD

Volume01RAID 1

LSM builds LSM builds virtual disksvirtual disks on top of partitions known as on top of partitions known as logical volumeslogical volumes..

dsk0 dsk8

dsk1

dsk1f

dsk1g

dsk9

dsk9f

dsk9g

Plex-04

Plex-03

*sd = sub-disk

Plex-02Plex-01

dsk9f-sd1dsk1f-sd1

dsk8-sd1dsk0-sd1

dsk1g-sd1

CONCATENATED sub-disks

dsk9g-sd1

dsk9g-sd2

/DATA1

/DATA2 /DATA3STRIPPED sub-disks



72

TruCluster V5.1 featuresTruCluster V5.1 features

Cluster File-SystemCluster File-System Globally visible within the clusterGlobally visible within the cluster Physically connected to several nodesPhysically connected to several nodes At one time, all I/O requests handled by one of the nodes.At one time, all I/O requests handled by one of the nodes. Automatic failover to make another node handle the I/O requests, in case of Automatic failover to make another node handle the I/O requests, in case of

failurefailure..

Cluster aliasesCluster aliases Generic name and IP address to make an IP/UDP connection to the clusterGeneric name and IP address to make an IP/UDP connection to the cluster Automatic load-balancingAutomatic load-balancing or Priority-based addressingor Priority-based addressing



73

Cluster File System (CFS)Cluster File System (CFS)

Single namespaceSingle namespace shared rootshared root single copy of most management filessingle copy of most management files

Same management tools as baseSame management tools as base Single security domain Single security domain

single user, group, and passwd filessingle user, group, and passwd files clusterwide access control lists clusterwide access control lists



74

CFS: more detailsCFS: more details

CFS is transparent, in use even for local files. CFS is transparent, in use even for local files. A mount anywhere is a mount everywhere.A mount anywhere is a mount everywhere. RAID + Multi-pathing = No single point of data RAID + Multi-pathing = No single point of data

destruction or unavailability.destruction or unavailability. Full POSIX semantics, cache coherencyFull POSIX semantics, cache coherency

no sync on close neededno sync on close needed



75

Cluster-Wide Directory StructureCluster-Wide Directory Structure

usr

vmunixetc

member 1

vmunixetc

member 2

vmunixetc

member 3

members

cluster etc var

data1 data2 data3 data4

data

/

All Nodes see each others local files



76

AlphaServer SC System SWAlphaServer SC System SW Performance Visualizer (PVIS)Performance Visualizer (PVIS)

SC system performance resource monitoringSC system performance resource monitoring Developers can monitor application executionDevelopers can monitor application execution System managers can see system resource System managers can see system resource

usageusage



77

Environnement de d₫veloppementEnvironnement de d₫veloppement

Compilateurs : Fortran 95, HPF, C, C++

Debugger : Vampir

Profiler : Totalview

Gestionnaire de ressources : LSF

Biblioth que Math matique : CXML₩ ₫

Compaq Visual Fortran



78

CompilersCompilers Compaq Fortran Compaq Fortran

Fortran 90, Fortran 95 and HPF compliantFortran 90, Fortran 95 and HPF compliant Directed decompositionDirected decomposition

Compliant with OpenMP and HPF standardsCompliant with OpenMP and HPF standards assisted OpenMP parallelization with KAPassisted OpenMP parallelization with KAP

Data localization directives for NUMA Data localization directives for NUMA Compaq C Compaq C

ANSI compliantANSI compliant Supports parallel directives (OpenMP)Supports parallel directives (OpenMP)

Compaq C++Compaq C++ ANSI compliantANSI compliant



79

Compaq Extended Math Library (CXML)Compaq Extended Math Library (CXML)

BLAS 1,2 & 3BLAS 1,2 & 3 LapackLapack Solvers de matrices creuses:

Direct It₫ratif

Traitement du signal (FFT, Convolution, etc) Les routines cl₫s sont parall₫lis₫es (SMP) SCIPORTSCIPORT



80

Message-passing librariesMessage-passing libraries

Shared memory and Memory Channel 2Shared memory and Memory Channel 2 PVMPVM MPIMPI

QuadricsQuadrics MPI (MPI 1 + some MPI 2 extensions)MPI (MPI 1 + some MPI 2 extensions)

MPI IOMPI IO Get/PutGet/Put

SHMEMSHMEM



TotalView and VampirTotalView and Vampir VAMPIR VAMPIR Parallel MPI Event Analysis Parallel MPI Event Analysis



TotalView and VampirTotalView and Vampir VAMPIR Communication StatisticsVAMPIR Communication Statistics

Communication Statistics (Timeline menu)

www.compaq.com

IntroducingIntroducing

Compaq Visual FortranCompaq Visual Fortran



85

CompaqCompaq®® Visual Fortran Visual Fortran

Offers a combination of:Offers a combination of: The robustness and reliability of CompaqThe robustness and reliability of Compaqs Fortran s Fortran

95 compiler95 compiler The easy-to-use MicrosoftThe easy-to-use Microsoft®®

visual development visual development environmentenvironment



86


32-bit Development System for 32-bit Development System for xx86 (Intel86 (Intel®® , AMD, AMD®®, , ) PCs running:) PCs running:

WindowsWindows® ® 20002000 Windows NTWindows NT®® 4 4 Windows 98Windows 98 Windows 95Windows 95



87

* Previous standards (Fortran 90, FORTRAN 77, FORTRAN IV) are also supported


The Compaq Fortran CompilerThe Compaq Fortran Compiler Full support of the Fortran 95 Standard*Full support of the Fortran 95 Standard* Compaq Fortran (formerly DIGITALCompaq Fortran (formerly DIGITAL®® Fortran) Fortran) and and

Microsoft Fortran language extensions for easy Microsoft Fortran language extensions for easy code portability among platformscode portability among platforms



88


Offers Portability from other PlatformsOffers Portability from other Platforms Microsoft-recommended upgrade for PowerStation Microsoft-recommended upgrade for PowerStation

4.0 users4.0 users Provides a consistent Fortran language dialect Provides a consistent Fortran language dialect

from desktop to mainframe-class systemsfrom desktop to mainframe-class systems Compatible with Fortran code written for other Compatible with Fortran code written for other

Compaq Fortran platforms: Compaq Fortran platforms: Compaq Tru64Compaq Tru64TMTM UNIX UNIX® ® Alpha Alpha LinuxLinux®® Alpha Alpha OpenVMSOpenVMSTM TM AlphaAlpha



89


Microsoft visual development environmentMicrosoft visual development environment Windows-based application developmentWindows-based application development Visual editor with color coded syntax highlightingVisual editor with color coded syntax highlighting Visual debuggerVisual debugger Context-sensitive online documentationContext-sensitive online documentation Same development environment used by Microsoft Same development environment used by Microsoft

Visual C++Visual C++® ® V6V6



90


Visual development toolsVisual development tools DebuggerDebugger Source Code BrowserSource Code Browser Windows resource editorWindows resource editor Fortran Module Wizard for working with COM ObjectsFortran Module Wizard for working with COM Objects Fortran COM Server Wizard for creating COM Fortran COM Server Wizard for creating COM

servers (Professional and Enterprise Editions)servers (Professional and Enterprise Editions) Graphical viewer for visualizing multi-dimensional Graphical viewer for visualizing multi-dimensional

arrays (Professional and Enterprise Editions)arrays (Professional and Enterprise Editions)



91

Back to Main Menu

www.compaq.com

Applications resultsApplications results

Fluent 5Fluent 5http://www.fluent.com/software/fluent/fl5bench/index.htmhttp://www.fluent.com/software/fluent/fl5bench/index.htm



93

Fluent benchmarksFluent benchmarks

Small1

0

1000

2000

3000

4000

5000

6000

1 2 4 8 16 32 64

Origin3000 400MHz

Compaq AlphaServerES40 668MHz

RISC System/600044P-270

N4000 (N-Class) 552Mhz

Source: http://www.fluent.com/software/fluent/fl5bench/index.htmAugust 2000



94


Small2

0

1000

2000

3000

4000

5000

6000

7000

1 2 4 8 16 32 64

Origin3000 400MHz







95


Small3

0

1000

2000

3000

4000

5000

1 2 4 8 16 32 64

Origin3000 400MHz







96


Medium1

0

500

1000

1500

2000

2500

1 2 4 8 16 32 64

Origin3000 400MHz







97


Medium2

0

1000

2000

3000

4000

5000

6000

1 2 4 8 16 32 64

Origin3000 400MHz







98

Fluent benchmarksFluent benchmarksMedium3

0100200300400500600700800900

1 2 4 8 16 32 64

Origin3000 400MHz







99

Fluent benchmarksFluent benchmarksLarge1

0

200

400

600

800

1000

1200

1400

1600

1 2 4 8 16 32 64

Origin3000 400MHz







100


Large2

0

200

400

600

800

1000

1200

1400

1600

1 2 4 8 16 32 64

Origin3000 400MHz







101

Fluent benchmarksFluent benchmarksLarge3

0

50

100

150

200

250

300

1 2 4 8 16 32 64

Origin3000 400MHz







102

www.compaq.com calcul scientifique hautes performances brest 18-10-2000 ghislain de jacquelot...

Documents

hptc compaq dans

hptc slide

teraops compaq confidentiel

est compaq

tbyear compaq confidentiel

hptc brest

compaq confidentiel

compaq sur alpha