kisti supercomputing center cas workshop 2003 (sep. 7-11, 2003) the development of collaborative...

KISTI Supercomputing Center

CAS Workshop 2003 (Sep. 7-11, 2003)

The Development of Collaborative Virtual Environment

S/W for Meteorology

Minsu Joh ([email protected])

Head of Supercomputing Application Technologies Department


Extending the Horizon of Science and Technology

This presentation will show youthe activities of constructing

a leading-edge research environmentin virtual space

for computational scientists.



Project Overview what VR Grid Project is

Plans & Achievements during the 1st & 2nd year of the VR Grid Project Future Plans for the remaining year of the VR Grid Project

Contents

Introduction who KISTI Supercomputing Center is



Introduction



Korea Institute of Science and Technology Information

a Government supported Research Instituteto serve Korea Scientists and Engineers with

Scientific/Industrial Data Bases, Research Networks & Supercomputing Infra.

Key statistics Organization: 3 divisions, 2 centers, 3 branch offices Personnel:

about 300 regular staffs, 100 part timers, 150 related workers Annual revenue:

more than USD60M, mostly funded by the central government



provides powerful HPC & Networking Resources leads cutting-edge researches in Computational Science leads national Grid activities

Key statistics Organization: 6 departments Personnel:

about 60 regular staffs, 30 part timers, 20 related workers Annual revenue:

more than USD32M, mostly funded by the central government

Supercomputing Center



Vision

e-Science National Center forApplication Sciences

Grid TechnologiesNational Center for

Integrative Highend Resources

Networking

National Center for

High PerformanceResearch Network

Supercomputing

National Center forSupercomputing

Resources & Technologies



Started the 1st supercomputer service with Cray 2S in 1988 Started the 2nd supercomputer service with Cray C90 in 1993 Started a parallel computing service with Cray T3E in 1997 Started the 3rd supercomputer service with NEC SX-5/6, IBM p690/p690+ in 2001

Supercomputer Service

1988 1993 20001997 2001

Cray-2S1st SC System

until 1993

Cray C902nd SC System

until 2001

Cray T3Euntil 2002 NEC SX-5

IBM p6904node

2002

PC Cluster128node

2003

IBM p690+17node

NEC SX-6TeraCluster256node+

HP GS320HPC160/320



Computing Resources

System Name NEC SX-5/SX-6 IBM p690/p690+

Introduction 2001.5./2003.2. 2002.1./2003.7.

Peak Perf. 80/160Gflops 665.6/3,699.2Gflops

Memory 128/128GB 672/3,712GB

CPU# 8/16 128/544

The 3rd Supercomputing

Systemsin Korea

(2001.5.~ )240Gflops 4,365Gflops

<Vector> <Parallel>



I-Desk

COVISEEnsightAVS MPE

Hardware

Software

Visualization Resources

SeeMore(CAVE-like System)



Project Overview



National Program(2002-2006) planned by MIC Total Budget: approximately USD 33M KISTI as the leading organization

Grid NOC

Middleware Development

Grid Applications

Network Operation& Infra Development

Research

Application& Research

Grid Forum KoreaSecretariat

National Grid Project



High Speed Network Infrastructure

Internet Infrastructure(NGI)

Grid Middleware

Computational,

Data & Access

Grid (VR Grid)

Supercomputers,

Storages &

Instruments

Grid Applications

Enhancing Korea’s Competitiveness in Science & Technology

Goal of the National Grid Project



participation MOA

Fund

Global Grid Forum

endorsement

support

GFK

NTG

collaboration

ApGrid

collaboration

PRAGMA NPACI

iHPC(Singapore)TACC(Japan)

NCHC(Taiwan)APAC(Australia)

EU

International Grid Activities



VR Grid Project Subproject of National Grid Project Total Budget: approximately USD 1M

Construct Tele-immersive

Visualizaton System over Networks

Fish-tankstyle

Workbenchstyle

CAVEstyle Projection

Based VRMonitorBased VR



Goal of the VR Grid Project

Establish a Virtual Collaboratory

Develop 3D Data Managing System

making/displaying/exploring/analyzing Data, simultaneously

Collaborative Virtual Environment




3D SV S/W

VR S/W CVE S/W

Vis5D

CAVE5D CAVE6D

CAVELib

CAVERNSoft

computer-based, distributed, virtual space in which people can interact with others,

or with virtual objects



Virtual Collaboratory

Computational Grid VR Grid

Display/ExploreData

MakeData

Data Grid

Access Grid

Store/RetrieveData

Storages

DB serversetc.

computersCompute

&Visualize

Retrieve&

Visualize

Transfer&

Discuss

AnalyzeData

virtual research environment wherescientists can access computational

resources, share data, and interact with collaborators, regardless of geographical

location



Construct Tele-Immersive Visualization Environment for Collaborative Work

Develop Application S/Ws for Collaborative Virtual Environment

Build Collaborative Environment between VR Grid and (Access/Computational/Data) Grids

Project Objectives



Cooperative Institutes

VR Grid Application S/Ws

VR Grid Middleware

VR Grid Testbed

Cooperation

3D Model development

Technology development

Access

Compu.

Data

Grids

Process Summary

Interface developmen

t

<domestic> <overseas>



Plans & Achievements



Plans in 2002

Construct VR Grid Testbeds

Develop Application S/W for Meteorology

Validate VR Grid through Testbeds



Achievements in 2002

Formed Testbed Partnerships KISTI-UIC (overseas), KISTI-KMA(domestic)

Developed Application S/W for Meteorological data MeteoView

Validated VR Grid through Testbeds



Testbed Infrastructure in 2002

APII TestbedKREONet2 (STAR TAP)

Australia

Seoul

KMA

USA

EVL/UIC

시카고KORNET

STAR TAP

Daejeon

KISTI

cave style to cave style cave style to workbench style high vs low latency network



45Mbps

KISTI UIC

CAVE6D+

STAR TAP

Overseas VR Grid Testbed (1/2)



Domestic VR Grid Testbed (2/2)

315Mbps

KISTI KMA

MeteoView, CAVE6D+

KREONET



CAVE6D vs CAVE6D+

<Differences between CAVE6D and CAVE6D+>

-Modifier: KISTI-CAVERNsoft G2/Quanta-High latency

-Developer: EVL/UIC -CAVERNsoft G1-Low latency

CAVE6D+CAVE6D

<Sample image of CAVE6D+ in SeeMore>



Graphic Server

Virtual Reality System

CVE

Data storage

0.000000 -17.563999 6.757000 0.008000 -0.163000 0.000000 -17.461000 6.802000 0.011000 -0.165000 0.000000 -17.297001 6.940000 0.009000 -0.127000 0.000000 -17.239000 7.016000 0.010000 -0.114000 0.000000 -17.200001 7.091000 0.018000 -0.116000 0.000000 -17.170000 7.167000 0.030000 -0.133000

G/S

G/S

VR

VR

WAN

WAN

WAN

each site has its own graphic server exchange the position data, state variable name available on high latency network

Virtual Collaboratory in 2002



MeteoView (1/4)

<Sample images of MeteoView in SeeMore>

Visualization S/W for Meteorological data on CAVE using CAVELib and Quanta audio conferencing is available contour/shading/isosurface/wind vector are available



3D Contour/Shading

CONTOUR

SHADING

XY Contour

YZ Contour

XZ Contour

XY Shading

YZ Shading

XZ Shading

MeteoView (2/4)



3D Iso-Surface

Iso-surface (Temp=220K) Iso-surface (Temp=220K) with Cross-sections

MeteoView (3/4)



Wind Vector at 500hPa Wind Vector at 500hPa with Iso-surface (u wind = 5

m/s)

3D Wind Vector

MeteoView (4/4)



Plans in 2003

Optimize VR Grid through active testbeds collaboration

Enhance Application S/W, MeteoView with volume rendering and computational steering capability

Develop Interface Technology between VR Grid and Access Grid



Achievements in 2003

Formed Testbeds 3 institutes(overseas), 4 institutes(domestic)

Enhanced the Performance of MeteoView Volume Rendering

Designed interface CAVE system & Access Grid system SeeMore(KISTI)-AGS(KJIST)



<Overseas Testbeds> <Domestic Testbeds>

3 overseas institutes - IHPC, Univ. of Queensland, Univ. of Illinois at Chicago 4 domestic institutes - Iwha Woman’s Univ., ICU, KJIST, POSTECH

Partnerships



Implemented Volume Visualization Near Real-time Volume Visualization using 3D Texture Mapping Hardware in the Onyx3400 IR3

MeteoView+ (1/2)



Proxy geometries (simple polygon slices) are rendered 3D Texture (volume dataset) is applied in the proxy geometries Appropriate color table and alpha blending are applied

Realize the Near Real-time Volume Visualization using 3D Texture Mapping Hardware

MeteoView+ (2/2)



Client B

Address table

VR Grid(Client A)

Needed at least 3 differentImages at one time

KJIST NMR

Panoramic display

Needed at most 3 different Images

at one time

e-VR Grid(Client B)

UIC EVL e-AG(Client C)

register as a receiver

Needed at most 2 different Images

at one time

register as a receiver

register as a sender

Send images

KISTI CAVE

Receive images

Receive images

camera 1 camera 2 camera 3

VR Grid Server

Client Areceiver address

Number of needed display is 3

Client Csender address

Number of needed display is 2

This time it is a sender!

Designing interface to share the immersive media among asymmetric systems such as CAVE & VR Grid

Interface btw CAVE & e-AG



Future Plans



Remaining Plans in 2003

Validate VR Grid over active Testbeds 3 institutes(overseas), 4 institutes(domestic)

Enhance the Performance of MeteoView Computational Steering

Developed interface CAVE systme & Access Grid System SeeMore(KISTI)-AGS(KJIST)



Graphic Server-Data Visualization-CVE S/W Implementation -Comp./VR/Data Grids connection

Computing Server-Numerical Simulation-Numerical Data Generation-Data Transfer (G/S)

Display System-Data Display-Request Data Visualization (G/S)-Request Numerical Simulation (C/S)

VR-Based User Interface, VRUI

Implement Computational Steering (1/3)

data transfer

display

visualize

compute



Visualization

Collaboration

Audio. conf.

Steering

Meteoview Supercomputers

Climate Model

modeloutput

triggering command

- Change parameter- Execute model

generateoutput

TCP

TCPTCP

TCP

SteeringManager

NetworkNetwork




IBM p690/p690+

NEC SX-5/6

SGI Onyx3400

Trimension ReaCTor Graphic Server

Computing System

Display System

PC Cluster




VR

Data storage

CVE

G/S

Tele-Vis.

Tele-Vis.

Supercomputer

ComputationalSteering

VR

VR

0.000000 -17.563999 6.757000 0.008000 -0.163000

0.000000 -17.461000 6.802000 0.011000 -0.165000

0.000000 -17.297001 6.940000 0.009000 -0.127000

0.000000 -17.239000 7.016000 0.010000 -0.114000

0.000000 -17.200001 7.091000 0.018000 -0.116000

0.000000 -17.170000 7.167000 0.030000 -0.133000


Establish Virtual Collaboratory one tele-immersive graphic server send visualized image computational steering



Build Collaborative Environment

KJISTKJIST

KISTIKISTI

EVL/UICEVL/UIC

between VR Grid and Access Grid

<Domestic/overseas testbed for collaborative environment between VR Grid and Access Grid>



Summary



Goal of the VR Grid Project

Establish a Virtual Collaboratory

3D Massive DataMaking / Displaying / Exploring /

AnalyzingSimultaneously




Graphic Server

Virtual Reality System

CVE


Data storage

0.000000 -17.563999 6.757000 0.008000 -0.163000 0.000000 -17.461000 6.802000 0.011000 -0.165000 0.000000 -17.297001 6.940000 0.009000 -0.127000 0.000000 -17.239000 7.016000 0.010000 -0.114000 0.000000 -17.200001 7.091000 0.018000 -0.116000 0.000000 -17.170000 7.167000 0.030000 -0.133000

G/S

G/S

VR

VR

WAN

WAN

WAN



VR

Data storage

CVE

G/S

0.000000 -17.563999 6.757000 0.008000 -0.163000

0.000000 -17.461000 6.802000 0.011000 -0.165000

0.000000 -17.297001 6.940000 0.009000 -0.127000

0.000000 -17.239000 7.016000 0.010000 -0.114000

0.000000 -17.200001 7.091000 0.018000 -0.116000

0.000000 -17.170000 7.167000 0.030000 -0.133000

Virtual Collaboratory in near future

Tele-Vis.

Tele-Vis.

Supercomputer


VR

VR





Computational Grid VR Grid

Display/ExploreData

MakeData

Data Grid

Access Grid

Store/RetrieveData

Storages

DB serversetc.

computersCompute

&Visualize

Retrieve&

Visualize

Transfer&

Discuss

AnalyzeData



The VR Grid Project will provide Scientists with

a leading-edge research environment in virtual space.



For More Information

Visitwww.supercomputing.re.kr

www.kisti.re.kr

Mail to [email protected]

kisti supercomputing center cas workshop 2003 (sep. 7-11, 2003) the development of collaborative...

Documents

horizon of science

computational science

science technologygoal

vr grid project future

technology project overview

computational scientists

research instituteto

related workers annual