cluster computing at compagnie générale de géophysique · june 4, 2003 cluster computing at cgg...

13
Cluster Computing at CGG Cluster Computing at CGG L. Clerc / JY Blanc L. Clerc / JY Blanc June 4, 2003 June 4, 2003 Cluster Computing at Compagnie Générale de Géophysique June 25 th 2003

Upload: others

Post on 14-Mar-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Cluster Computingat

Compagnie Générale de Géophysique

June 25th 2003

Page 2: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Processing(Software, site design

& services)

Reservoir servicesSpec data

Acquisition(Equipment & services)

CGG in the Oil and Gas industryCGG in the Oil and Gas industry

Page 3: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Intermediate5-50 TB /proj

Final0.1-1 TB /proj

Seismic data processing Seismic data processing

Page 4: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Calgary

Maracaibo

Caracas

Luanda

Port Harcourt

Cairo

Muscat

OsloLondon

Paris

Kuala Lumpur

Perth

VillahermosaHouston Abu Dhabi

Jakarta

Porto La Cruz

Vienna

Stavanger

Aberdeen

London

Massy La Defense

Assen

Pau

Oslo

CGG World wideCGG World wide

Page 5: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Evolution of processing powerEvolution of processing power

5 000

10 000

15 000

20 000

25 000

1997 1998 1999 2000 2001 2002 2003

CLUSTERNUMAVECTOR

G Flops

Page 6: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Tapes ( > 1000 TB in 100 GB LTO)

HSMserver

Disks ( >100TB in 13TB Raid)

Solaris

Users workstations

SolarisSolaris

Solaris

SUN

servers

SUNSUN

SUN

SGISGI

SGI

WidowsWindows

Linux

Users workstations

LinuxLinux

Linux

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

mediators

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

Cluster

iSCSI bridge

Typical site architecture Typical site architecture

SAN GBit

GBit

Page 7: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Disks

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

mediators

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

LinuxLinuxLinuxLinuxLinuxLinuxLinuxLinux

Cluster

Cluster operationsCluster operations

Code

Input Data chunk #1 Result chunk #1

Input Data chunk #nResult chunk #n

SAN G Bit

Page 8: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

1CPU 2CPU 4CPU NUMA

Ratio performances / $ for various nodes(for 1 CPU on targeted application )

Ratio performances / $ for Pentium generations(for 2-CPU nodes on targeted application )

100BT Gbit Myrinet NUMA

Ratio performances / $ for various interconnect(for 2-CPU nodes on targeted application )

N-2 N-1 N

Cluster architecture: nodeCluster architecture: node

Packaging (blades v/s 1U)

- smaller footprint (no need to re-build rooms)- higher heat density (cooling is difficult)- price / performance remains higher than 1U

1U except where footprint is key constraint

Page 9: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Cluster architecture: racks Cluster architecture: racks

GB / 100 BT

KVM/Serial concentrator

64 CPU

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

Page 10: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Cluster architecture: rowsCluster architecture: rows

GB / 100 BT

KVM/Serial concentrator

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB / 100 BT

KVM/Serial concentrator

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB / 100 BT

KVM/Serial concentrator

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB / 100 BT

KVM/Serial concentrator

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB / 100 BT

KVM/Serial concentrator

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB / 100 BT

KVM/Serial concentrator

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB / 100 BT

KVM/Serial concentrator

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB Switch

512 CPU

Page 11: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

Cluster architecture: site Cluster architecture: site

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB Switch

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB Switch

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs 2 CPUs

2 CPUs 2 CPUs

2 CPUs

GB Switch

GB Switch

Up to 6000 CPU / site today

Page 12: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

I.T. resultsI.T. results

Page 13: Cluster Computing at Compagnie Générale de Géophysique · June 4, 2003 Cluster Computing at CGG L. Clerc / JY Blanc Cluster Computing at Compagnie Générale de Géophysique June

Cluster Computing at CGGCluster Computing at CGG L. Clerc / JY BlancL. Clerc / JY BlancJune 4, 2003June 4, 2003

“The installation of such a processing capacity is a key component of Houston processing center’s strategy to develop business in Depth Imaging in the gulf of Mexico: this enables Oil & Gas companies to better represent complex sub salt structures.“

Michel Darbousset,Executive V.P. Processing & ReservoirsCGG Americas.

Business resultsBusiness results