t21.fujitsu world tour india 2016-education, research and design

0 Copyright 2016 FUJITSU

Fujitsu HPC Solutions Empowering Science & Research …. and no worries.

Ashok Chaudhary Sr. Application Analyst Fujitsu India

Fujitsu World Tour 2016


This session is about: We underline, here, Fujitsu’s High Performance Computing(HPC) competence and how Fujitsu is helping hundreds of scientists and researchers in Indian academia & research to redefine their science environment and streamlined processes to enhance throughput.


You just do the science and leave the High-end computation worries to us ……


Technological revolution had taken over biological evolution by far.


Today – Data-Intensive High-end computing Science ……….. Scientists are overwhelmed with humongous data from many different sources

Data captured by instruments

Data generated by simulations

Data generated by sensor networks

Few thousand years of Experimental Science description of natural phenomenon

Few hundred years of Theoretical Science Newton’s Laws, Maxwell’s Equations

Few decades of Computational Science Simulation of complex Science


Human Society

Contributing to a secure and prosperous society, through new drug development and improved weather forecasting.

Creating a Better Life Health & Safety

Innovating Manufacturing Industry

Powerful new innovating manufacturing methods through high-speed ,accurate analysis / simulation.

Unveiling Mysteries Science

Exploring the origins of humankind ,space, and the universe through high-speed data processing and simulation.

Why ? Scientific & Technical Computing

Scientific & Technical computing has brought about not only "problem-solving" but also "creating new value".


All start with Supercomputers…


Innovation

Flexibility

Simplicity


High Performance & Technical Computing

Experience and Tradition Means Achievements


Fujitsu in Scientific / Technical Computing Aerospace

Japan Aerospace Exploration Agency (JAXA)

Advanced Research Institute for Cosmic Ray Research of Tokyo

Meteorology Japan Meteorology Agency

Astronomy National Astronomical Observatory of Japan

Manufacturing

Super-Kamiokande/

Image from Kamioka Observatory, Institute for

Cosmic Ray Research, University of Tokyo

Image from Japan

Meteorology Agency Supercomputer 「FX1」/

Image from JAXA

Greenhouse gases Observing

Satellite 「IBUKI」/

Image from JAXA

Supercomputer 「HX600」/

Image from Kyoto University

Supercomputer

Optical Telescope 「Subaru」/

Image from National

Astronomical Observatory of

Japan

Educational Institute Kyoto University -


Technology Solutions PRIMERGY based HPC Ecosystem

Services and Support

Japan Global lead in High Performance Computing

Strategy, Development, Services and Support

Systems Europe,

ict GmbH - a company

HPC certified expert partner program

HPC application champions

Benchmarking Laboratories

Research & Development

Fujitsu’s HPC competency network


High Performance Computing tradition

AP3000

PRIMEPOWER

HPC2500

FX1

K computer

FX10

Japan’s First

Vector (Array)

Supercomputer

(1977)

F230-75APU

VPP5000

VPP300/700

VPP500

VP Series

NWT*

PRIMERGY BX900 / BX400 PRIMERGY RX200 AP1000

FX100

Japan’s Largest

Cluster in Top500

(July 2004)

Top500 1st.

(Nov. 1993)

Gordon Bell Prize

(1994, 95, 96

Top500 1st.

(June and

November 2011)

PRIMERGY CX400-M1

PRIMERGY CX400-M2

PRIMERGY CX600-M1


Augsburg factory

77000 m² total space / 35000 m² dedicated to production

Daily production

10000 mainboards for Fujitsu products and Industry customers

14000 thin clients, PCs, Workstations and mobile PCs

1200 servers and storage systems

80 racks integration


R&D Activities in Fujitsu HPC

The Parallel Applications Lab


What is the Parallel Application Lab ?

The lab is running as part of Fujitsu Systems Europe activities since 1996. Mission is to be a center of excellence in parallel programming, from mastering key technologies to providing consultancy and customer support world wide

Past and current activities Deep involvement in technologies development (Fujitsu MPI-2 and related performance analysis tools

Investigation of new HPC solutions like XEON-PHI, parallel file systems and new interconnect technologies

Port, adapt and tune large industrial applications on Fujitsu platforms (SPARC or Intel based), sustain Fujitsu performance benchmark activities.

Work in close cohesion with end users to innovate.

The team Multi-disciplinary team of experts covering most of scientific computing areas including computer science,

mathematics, computational fluid dynamic, climate and weather forecast, life science, physics and astrophysics.


Study and tuning of numerical models

Weather forecast and climate modeling:

Unified Model from UK-Met and Harmony from HIRLAM Consortium

and COSMO

Life science and multiple integrated cores

technology evaluation with NCBI-Blast, GROMACS, …

Deep imaging for oil exploration

RTM Algorithms

Architecture for small and medium

sized cluster

Resource optimization and performance tuning toward best ratio price /performance for SMEs and small to medium

research groups

Smooth Integration new IOs technologies inside

compute nodes

Integrated Data Analytic solutions with latest MIC Technology from Intel

Integration and application on

boarding for HPC-Gateway

Development and tuning of complex applications with remote vizualization

solution

On Boarding of application in the web

based HPC-Gateway for end users

On-going activities


Some Achievements


The “K” Computer

The Largest commercial system in production:

No. 4 On the TOP500

700000 cores / 1410TB memory

Fujitsu Interconnect

11280TFlops peak / 10510TFlops Linpack


ITER Project (Spain)

No. 138 on TOP500 (SC2013)

273,97 Tflops Rmax Linpack


Fujitsu HPC-Gateway

INTELLIGENT APPLICATION PLATFORM for Business Managers, End-user and Administrators

~

Simplicity Expertise


Democratising HPC

HPC expert

Standardise processes

Remote visualisation

Traceability, machine

learning

HPC consumers

Higher productivity and

throughput

New applications and

physics

New processes

FTS CONFIDENTIAL

HPC Gateway accompanies and enable users across the increasing spectrum of needs

HPC calculators

First applications

New domains

Consumer processes

Exp

onen

tial

use

r b

ase


Adaptable productive interface, coherent integrated workplace

Seamless on/off-premise service approach

Work with expert and intelligent methods

Full oversight

Analytics for description, prediction and prescription

Tracking and auditing

Benefits to all

Business manager End-User IT Administrator

Secure and robust usage

Lower issue support, more value-adding development

Enhanced view of resource accounting


Gateway Platform Architecture

Platform Database

REST API

Desktop Web Application Python, Curl, CLI

Client GUI

Workflow

Cluster Agent

Batc

h

manag

er

OS

Data

File

s

Applications

Cluster Agent

Batc

h

manag

er

OS

Data

File

s

Applications

Cluster Agent

Batc

h

manag

er

OS

Data

File

s

Applications

Cluster Agent

Batc

h

manag

er

OS

Data

File

s

Applications


User Perspective

Intuitive interface

Web desktop Inline wiki docs Dashboard option Self-defined layout

REST API

Applications Monitoring

Fast simple 2D graphing

Real-time job data First “at a glance”

review of app

Mobility Data collection

Mobile device app Compact input Alerts/progress reports

Encoded application methods Dynamic and extendable

automated workflows Record inputs

Remote Visualisation

Interactive and lossless transmission of 3D graphics

Collaboration through team sharing of remote desktop

Multi-user mode

Attach existing GUI Integrate with Gateway

Platform functions Enable command-line actions

Attach existing GUI Integrate with Gateway

Platform functions Enable command-line actions

Record and track usage Identify trends and links Optimise processes

Projects/Teams

Structure applications and data around business

In-built security layer Role-based access


Gateway as a Consolidated Global Workplace

Unique web desktop for productivity at first login for novice and expert users

Central access to global services and data

Simplicity in work management and collaboration

Seamless multi-cluster and multi-site scale-out


Full Production Dashboard

Self-service organisation of windows and tools for own operational needs


80M Engineers + Non-engineers

Application Editing – Creating relevant interface

Standard view with

application controls,

basic batch setup

and auto/explicit run

directory

8M Engineers

750K CAE Users

Source: Cambashi, Beyond CAE, Front End Analytics (2014)

Emerging concept of apps help bring

a wider range of users into simulation

Cross between workflow and

traditional simulation suite

Apps speak language of intended

user – for simulation analyst and

design engineer

Advanced view with

detailed batch

controls and direct

application control file

input

Dedicated app for

targeted model and

precise parameters


Application Management

Service interface to methods

for applications, processes

or workflows

Controlled view of available

methods

Wiki inline documentation,

tooltips for common

commands

Tagging for search and filter

Easy application onboarding


Project

Project

Team

Team

User Management

Access to objects and data controlled by Team and Project structures

Graphical administration interface

Identity mapped to system credentials

FIles

Mount points

Tasks

Project

Mem

ber

Edit

or

Adm

inis

trat

or Methods

Monitors

Processes

Team M

emb

er

Edit

or

Adm

inis

trat

or

Identity


Dynamic Application Result Monitoring

Embedded with application method

Tabular and graph-based tracking of application metrics

Extraction application dependent

Self-service plots


Rich File Exploration

All expected features plus range

of useful extras

Enhanced with file-specific and

dynamic functions

Direct activation of Remote

Terminal

Viewer for image files

Access controlled by team

membership


Remote visualisation options

Dynamic monitoring within the

web desktop

Precision design/engineering with

accelerated imaging


Let’s Talk