cluster computing at compagnie générale de géophysique · june 4, 2003 cluster computing at cgg...
TRANSCRIPT
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Cluster Computingat
Compagnie Générale de Géophysique
June 25th 2003
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Processing(Software, site design
& services)
Reservoir servicesSpec data
Acquisition(Equipment & services)
CGG in the Oil and Gas industryCGG in the Oil and Gas industry
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Intermediate5-50 TB /proj
Final0.1-1 TB /proj
Seismic data processing Seismic data processing
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Calgary
Maracaibo
Caracas
Luanda
Port Harcourt
Cairo
Muscat
OsloLondon
Paris
Kuala Lumpur
Perth
VillahermosaHouston Abu Dhabi
Jakarta
Porto La Cruz
Vienna
Stavanger
Aberdeen
London
Massy La Defense
Assen
Pau
Oslo
CGG World wideCGG World wide
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Evolution of processing powerEvolution of processing power
5 000
10 000
15 000
20 000
25 000
1997 1998 1999 2000 2001 2002 2003
CLUSTERNUMAVECTOR
G Flops
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Tapes ( > 1000 TB in 100 GB LTO)
HSMserver
Disks ( >100TB in 13TB Raid)
Solaris
Users workstations
SolarisSolaris
Solaris
SUN
servers
SUNSUN
SUN
SGISGI
SGI
WidowsWindows
Linux
Users workstations
LinuxLinux
Linux
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
mediators
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
Cluster
iSCSI bridge
Typical site architecture Typical site architecture
SAN GBit
GBit
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Disks
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
mediators
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux
Cluster
Cluster operationsCluster operations
Code
Input Data chunk #1 Result chunk #1
Input Data chunk #nResult chunk #n
SAN G Bit
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
1CPU 2CPU 4CPU NUMA
Ratio performances / $ for various nodes(for 1 CPU on targeted application )
Ratio performances / $ for Pentium generations(for 2-CPU nodes on targeted application )
100BT Gbit Myrinet NUMA
Ratio performances / $ for various interconnect(for 2-CPU nodes on targeted application )
N-2 N-1 N
Cluster architecture: nodeCluster architecture: node
Packaging (blades v/s 1U)
- smaller footprint (no need to re-build rooms)- higher heat density (cooling is difficult)- price / performance remains higher than 1U
1U except where footprint is key constraint
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Cluster architecture: racks Cluster architecture: racks
GB / 100 BT
KVM/Serial concentrator
64 CPU
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Cluster architecture: rowsCluster architecture: rows
GB / 100 BT
KVM/Serial concentrator
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB / 100 BT
KVM/Serial concentrator
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB / 100 BT
KVM/Serial concentrator
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB / 100 BT
KVM/Serial concentrator
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB / 100 BT
KVM/Serial concentrator
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB / 100 BT
KVM/Serial concentrator
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB / 100 BT
KVM/Serial concentrator
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB Switch
512 CPU
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
Cluster architecture: site Cluster architecture: site
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB Switch
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB Switch
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs 2 CPUs
2 CPUs 2 CPUs
2 CPUs
GB Switch
GB Switch
Up to 6000 CPU / site today
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
I.T. resultsI.T. results
Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003
“The installation of such a processing capacity is a key component of Houston processing center’s strategy to develop business in Depth Imaging in the gulf of Mexico: this enables Oil & Gas companies to better represent complex sub salt structures.“
Michel Darbousset,Executive V.P. Processing & ReservoirsCGG Americas.
Business resultsBusiness results