fresh technologies power innovative, efficient and...

25
Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei Technologies Dominik Dziarczykowski

Upload: duonglien

Post on 19-Mar-2018

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Fresh Technologies

Power Innovative, Efficient and

Scalable HPC

Huawei Technologies

Dominik Dziarczykowski

Page 2: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Huawei at a Glance

228Ranking in

the Fortune

Global 500

170+Countries

16R&D centers

~170,000Employees

A Global

Leader of ICT

Solutions

76,000R&D employees31

Joint

innovation

centers

Page 3: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

MAXIMIZE EFFICIENCY ACCELERATE WORKLOAD

MAXIMIZE PERFORMANCE FOR

INDIVIDUAL WORKLOAD

Flexible, modular architecture

Multiple innovative form factors

Deep optimization with hardware

acceleration

Super Fat nodes

CONVERGED HPC & BIG DATA

MAXIMIZE HARDWARE ROI

Single HPC cluster and storage

system for both traditional HPC

MPI workload and Hadoop

Innovative big data analytic

appliance with deep hardware

and software optimization for

maximum cost effectiveness

Simplify HPC systems today

MORE COMPUTE LESS SPACE

LOWER POWER CONSUMPTION

End-to-end energy efficient design

HVDC

High Ambient Temperature ~40oC

Direct Liquid Cooling ~ 84% coverage

Tight integration with Huawei data

center infrastructure

SDS

Big Data

SDI

Page 4: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Huawei HPC Solution Portfolio

Parallel file systemParallel environment System

deployment

Customized

development

Backup and

restoration

Compiling and development environment

Industry

applications

Service

platforms

CAE/CFD Life sciencesAerospaceAnimation rendering

Meteorological environment Physics & chemistry

GPGPURack server Cabinet storage

Phi Rack storage

Solid-state storage GE switchIB/10GE switchBlade server

Windows Linux

+

Computing Storage Network

Hardware

resources

OS Computing environment

System

environment

CHESSPBS Works Platform JH Scheduler Cloud renderingBright Cluster Manager

Cluster

management

Container data centerModular data center

Infrastructure

Page 5: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Values of Huawei HPC Solution

Optimal

Performance

Energy

Saving

Fast

Delivery

Page 6: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Optimal Performance : High-density Solution

High-Performance Servers

Compute node

Highlight

42+TFLOPS Computing

Capability/Chassis

10 Year Network Evolution

100GE,16G/32G FC, IB EDR

6 Type of nodes Housing

Thin,Fat,IO,Management

E9000Switch

Page 7: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

20+TFLOPS Computing

Capability/Chassis

Optimal Performance : Accelerator Solution

High-Performance Servers Highlight

16× ES3000 V2

PCIe cards

8× double slots

GPGPU/Phi

X6800

Storage node

I/O node

Phi

GPGPU

Compute node

Page 8: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Optimal Performance : Memory-Intensive Solution

HPC Fat Node: KunLun 9032 with up to 24TB Memory Space Per Single Node

The world’s

First 32P x86Mission Critical Server4S

8S

16S

32S

Dell Lenovo HP Huawei

RAS 2.0Unique CPU & memory

hot-swapCPU

CPUMemory

Memory

Page 9: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Distributed NAS Highlight

Optimal Performance : Storage Solution

400GB/s Bandwidth

linear enhancement

100PBThe biggest file system

N+M data protection

A fully symmetrical distributed

architectureOceastor9000

Backend

IB or 10GE

Front-end :

IB or 10GE

GE

management

Page 10: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Green Design Highlight

Energy Saving: Liquid Cooling Solution

40% Energy Saving

45 kW/Cabinet Heat

Dissipation Capability

9 Reliability technologiesLiquid Cooling

Page 11: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Modular architecture, 1 week Installation Highlight

Fast Delivery: All-In-Room Solution

70% less delivery period

25% less initial investment

Modular for easy expansion

Management

Server

Storage

Monitoring

Network

Power supply

Page 12: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Innovation of Huawei HPC Solution

Green

Design

Convergency

HPC & BIG DATA

Accelerated

Workload

Page 13: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Energy Efficient Server Design

Bottom line of Greener IT

Higher Temperature

Up to 8%↓ WW DC power consumption w/ 5ºC↑

HVDC

Up to 9-15% conversion efficiency

improvement

Free Air Cooling

Up to 20-70% cooling saving

In-Memory Computing

Up to 90+% less power

consumption than HDD-based

SSD Storage

Up to 60+% less power consumption than

HDD-based

Air Containment

Up to 30%↑ in cooling efficiency

Green IT Reduces Energy Bill & CO2 Emission, Extends DC Life, Lowers TCO

Hot Water

Eliminate Chiller Free cooling

Right-sized Power

~20% better power & cooling utilization

End to End Green HPC Design

Hardware Acceleration

~ 2X+ Performance Per Watt

Page 14: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

+ =X6800 server PCIe SSD card The high I/O storage server meets the

service requirements for high concurrent I/O

performance and high I/O throughput

bandwidth.

Supports a maximum of four HH HL Huawei ES3000 PCIe cards per node.

750,000

70075,000

15,000

PCIe SSD 15Krpm SAS disk SSD FC array with 24 disks

100% random read IOPS@4KB

3000

200500

1,500

PCIe SSD 15Krpm SAS disk SSD FC array with 24 disks

Max read/write bandwidth (Mbps)

HUAWEI Turnkey PCIe SSD Acceleration

Page 16: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

The NÜWA Super Efficient Hardware

• 5 RU

• Up to 640 CPU & 1280 iGPU cores

• 640GB LLC, 320 MC, 2+TB/s MemBW

• Up to 80 NVMe devices

• 1.28 – 2.56TB DRAM

• 10 slots for standard PCIe (x8, x16)

• Robust, redundant, non-blocking PCIe switch-

fabric

• Hot-swap capability

• Redundant management CPU w/ fail-over1X NUWA with 160X C2758 equals

64X 2P Xeon E5-2620 V2 or

25X 2P Xeon E5-2697 V2

Page 17: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Intelligence on Demand, Convergence for the Future

Unified Storage V3

5300, 5500, 5600, 5800, 6800Block + File

Mass Data Storage

UDS

Object for Nearline & Offline Market

All-in-one Mass Data Storage

OceanStor 9000

File + Object + Analysis + Archiving

P15P22P1P8

P15P22P1P8

P15P22P1P8

P15P22P1P8

P15P22P1P8

P15P22P1P8

Unified block & file storage

In-depth technical

convergence

Advanced conception

For global cloud data centers:

Decentralized & distributed

architecture & highly efficient

global data sharing

All-in-One storage solution

simplifying data lifecycle

management

Complete HUAWEI OceanStor PortfolioVirtualization, SSD, Distributed Storage, Software Defined Storage

Full flash Storage

Dorado 2100G2 & 5100Block

Full flash storage: best ratio

of performance/price

Page 18: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Joint Innovation with Openness and

Collaboration

OS

System

Integration

Hardware

Cluster

Management

Application

CAE Rending Life sciences Climatic Geoscience

Page 19: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Page 19 HUAWEI TECHNOLOGIES CO., LTD.

Huawei Innovate Manufacturing CAE

Solution with ESI

IC.IDO Virtual Reality Solution

• Immersive 3D experience in real time and real

scale

• Interactive & eye-catching presentations

facilitate processes

Virtual Performance Solution

• Support multiple domains of industry

• Shorten product development cycles

• Improve simulation performance by 50% with

tuning software & hardware

Huawei Virtual Manufacturing Solution

Page 20: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Page 20 HUAWEI TECHNOLOGIES CO., LTD.

Huawei HPC Success Cases

Central Asia

ChinaEurope

North America

South America

University of Nebraska-Lincoln

University of Tennessee, Knoxville

Digital Domain

Macau University of Science and Technology

GlobalFoundries

Kyushu University

Institute of Disaster Prevention

Hebei Environmental Protection Agency

Beijing Data Communication Research

Institute

Beijing Jiaotong University

BeiHang University

Southwest University

Zhejiang University

Capital Medical University

China Electric Power Research Institute

Shanghai Aerospace Power Machinery

Research Institute

ZhongXin Biotechology -HPC bioinformatics

based cloud platform

Sino-Singapore Tianjin Eco-city

Project Phoenix

Beijing Forestry University

Shanghai Institute of Satellite Engineering

Henan Environmental Protection Agency

Zhuozhou Geophysical Bureau

Turkish Academic Network and

Information Center

Yıldız Technical University

Istanbul Technical University

Harran University

Mexico Water Conservancy Bureau

The Ministry of agriculture of Mexico

Universidade Presbiteriana Mackenzie

Chile observatory

Poznan Supercomputing and Networking

Center (PSNC / PCSS)

Interdisciplinary Centre for Mathematical and

Computational Modeling, University of

Warsaw (ICM)

Gdansk University of Technology (TASK)

Daimler AG

Newcastle University in U.K.

Illumination Mac Guff HPC

St.Petersburg State University HPC

Deltares, Netherland

Ehrenburg Water Research Institute

Rijkswaterstaat

Universidad De Burgos

Southeast Asia

Page 21: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Page 21 HUAWEI TECHNOLOGIES CO., LTD.

Daimler AG Uses Huawei HPC Platforms for Core

Automotive R&D

Reliable System

Secure Business Continuity

Outstanding Performance

Maximize Simulation Efficiency

Flexible Platform

Optimize Application Deployment

Huawei Blade & High-Density Server

Page 22: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Page 22 HUAWEI TECHNOLOGIES CO., LTD.

Background

Benefits

Liquid cooling case: Poznan Supercomputing

and Networking Center

High Performance Computing centre within PSNC:

provides computing power, disc space and archiving systems for

science, business and public institutions; appears on the

TOP500 list of the most powerful computing systems in the

world.

total computing power 1.4Peta-Flops, TOP80 in TOP500

(2015 Nov, http://top500.org/list/2015/11/)

Innovation – Direct Liquid Cooling

Efficiency – 80% heat removed by liquid

Openness – Support Partner for Customization

Page 23: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Page 23 HUAWEI TECHNOLOGIES CO., LTD.

Background

Benefits

University of Warsaw , Poland

The University of Warsaw has its seat in the capital of

Poland, one of the most dynamically developing European

cities. The ICM – Interdisciplinary Centre for Mathematical

and Computational Modeling is a Supercomputers Centre

and makes its resources: high power computers,

professional graphic stations and specialized software

available to the Polish scientific community. Its HPC system

ranks in the list of top500.

Interdisciplinary Centre for Mathematical

and Computational Modelling

Performance – Rpeak 279.5 TFlops

Innovation – Seamless integration with legacy

systems

Efficiency – Linpack >80%

Page 24: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei

Page 24 HUAWEI TECHNOLOGIES CO., LTD.

Newcastle University in UK

Background

Founded early in the 19th century, Newcastle University

has earned its fame by providing high-quality teaching

and research courses.

This project is to be implemented in a few phases. The

system needs to be easily expanded.

Benefits

Rapid deployment – reduces service time to three days.

Simple management – Unified management

Easy expansion – meet requirements for the next five

years.

Page 25: Fresh Technologies Power Innovative, Efficient and ...hpcadvisorycouncil.com/.../D.Dziarczykowski.Huawei.pdf · Fresh Technologies Power Innovative, Efficient and Scalable HPC Huawei