International Data Acquisition for Disaster Prevention and Data Access

Technology

Hyunseung ChooSungkyunkwan University

http://monet.skku.ac.krchoo@skku.ac.kr

■ Introduction

■ Earth System weather prediction, earthquakes, and environments

■ From Networking to Grid Computing ET over Grid

■ The Proposal Importance Current status Proposed approach Final goals Members and organizations

■ Conclusion

Contents

■ Observations■ Data Collection■ Data Analysis■ Weather Forecasting

Technology for the Weather Forecasting

Global Infrastructure for Earth System

Nature

■ Exponential Growth of Network Technology

Network vs. Computer Performance Computer speed doubles every 18 months Network speed doubles every 9 months Difference = order of magnitude per 5 years

1986 to 2000 Computers: x 500 Networks: x 340,000

2001 to 2010 Computers: x 60 Networks: x 4000

From Networking to Grid Computing (1/2)

■ Definition of GRID Research infrastructure for dynamic collecting and sharing research resources connected by high-speed networks

GRID

Problem solving Experts

Scientific Research Instrument

Large Scale Data

Supercomputer

From Networking to Grid Computing (2/2)

Grid Based Resource Integration

■ Challenge to huge problems that require massive capability over limited resources at multiple sites Grid Computing

Networking of locally distributed high performance (HP) resources HP computers, storages, experimental facilities, etc. IT infrastructure to group systems as a single system Classified into Access Grid, Computational Grid and Data Grid

■ Core applications based on Grid “IT + Application” : Environment Technology (ET), Bio Technology (BT), Nano Technology (NT), Space Technology (ST), Cultural Technology (CT), etc.

■ Investigated HPCN since late 1980 in US, JP, EU Concentrate to Grid Technology since 2000

Pan-Korean Distributed HPC Resources

Daejeon

Kwangju Pusan

Chuncheon

Incheon

Suwon

ChonanChongju

Jeonju

Chang-won

Ulsan

Pohang

Seoul

Daegu

Cheju

• Computers

• Supercomputers• Experimental Facilities

• High Speed Networks

• Databases• Mass Storage

• Visualization

Environment

• Access Grid System

Importance of R&D Project

■KOREN based distributed Grid Computing environments Overcome limitations of the meteorology area through Grid

Limitations on computing, networking and data storing Solve earlier problems based on disaster prevention data Data format for providers ⇒ Data format for consumers Offer common collaborative environments to weather experts Substitute clusters for supercomputers

■Disaster prevention system by forecasting natural disasters RT data transmission, high-speed producing and processing Parallel technology for numerical models on natural disasters

Low-cost RT disaster prediction Severe weather prediction, environments, East Sea earthquake tsunami (a ti

dal wave) Currently depend on GTS in the Japan Meteorological Administration

Final Goals on R&D Project

■ KOREN based Grid system for international disaster prevention

■ KOREN/APII based international joint production of disaster related prevention data■ development of high speed data access and process system model■ parallelization of current SWs and sharing international disaster prevention resources

KMA SKKUSWU PKNU

UCLA(US)

Nagoya U.(JP)

NIED(JP)

Key Elements on R&D Project

■Current year Sharing data for weather prediction with Japan (APII, Nagoya

Univ.) Sharing East Sea seismological information (National Research

Institute for Earth Science and Disaster Prevention of Japan) Numerical models for disaster preventions in Grid environments Access Grid for multicasting based on KOREN

■Current year + 1 Sharing and verifying weather data (UCLA) RT transmission of disaster prevention data Development of applications for disaster preventions (MPICH-

G2)

■Current year + 2 Use of Data Grid for massive data transmission Use of international core technology for disaster preventions

(KOREN, APII)

Data for Disaster Preventions

■ International data collection for weather prediction, climates, earthquakes and environments for disaster predictions RT and distributed collection of weather prediction, climates, earthquakes a

nd environments over the entire earth Access Grid

Collaborating organizations for international data sharing Based on APII-testbed

■Disaster prediction modeling based on the data collection RT locating/allocating distributed computational resources

Computational Grid Data acquisition for analyzing and forecasting global weather prediction

■RT delivery systems for disaster predictions information KOREN + Grid technology => constructing IT infrastructure

Members and Organizations

Collaborative working environmentfor producing disaster prevention data

(PKNU(KR), Nagoya Univ.(JP))

Production of data for weather predictionby using Grid

(PKNU(KR), UCLA(US))

Seismological observation networkbetween Korea and Japan

(KMA(KR), NIED(JP))

KORENAPII-Testbed

Communication infrastructure for disaster prevention(SKKU(KR), SWU(KR))

• Protocols for monitoring seismic activity• Virtual collaboration environment

KOREN & APII-Testbed Based Virtual Collaboration Environment For Disaster Preventions

Approaches (2003)

PKNU(KR)

UCLA(US)

Nagoya Univ.(JP)

NIED(JP)

KMA(KR)

SKKU(KR)

SWU(KR)

RT data exchangefor weather prediction

Analysis & sharing of massive seismological & meteorological data

Policies for sharingdata among parties

- Data authorization- International cooperation- Collecting individual opinions

Production of data forsevere weather prediction

based on AG

Access Grid (AG)

-AG environments throughout six parties-Securing AG technique for KOREN

Access G

rid

Dem

o1 s

t R

ep

ort

Weekly

Sem

inar

Invit

ed

Talk

s

2nd Year

KOREN/APII-Testbed BasedVirtual Collaboration Environments

Approaches (2004-2005)

KOREN, APII-Testbed based data production for international environments, earthquakes and severe weather prediction,

distributed data access techniques and its applications

Combining AG + MPICH-G2 + DG Constructing IT Infrastructure

Inte

rnati

on

al C

on

fere

nce

Fin

al R

ep

ort

s

Resu

lts f

rom

2004

Weekly

Sem

inar

Invit

ed

Talk

s

KOREN, APII-Testbed basedinternational environments, earthquake

and severe weather prediction data

MPICH-G2-Applications in Grid environments

AG based environments, earthquake and severe weather prediction data

Data Grid (DG)

-Integrated management-Management of distributed data

Inte

rnati

on

al C

on

fere

nce

2 nd

Rep

ort

s

Resu

lts f

rom

2003

Weekly

Sem

inar

Invit

ed

Talk

s

PKNU(KR)

UCLA(US)

NagoyaUniv.(JP)

NIED(JP)

KMA(KR)

SKKU(KR)

SWU(KR)

From 1st Year

Current year +1

Current year +2

Research Goal (2003)

■ Access Grid connecting KMA, SKKU, SWU and PKNU by KOREN

■ Seismological observation network between Korea and Japan by APII-testbed Extended TCP/UDP protocols for high-speed communications

■ Data production line for disaster preventions based on MPICH-G2/GQ

■ Problem detections and solutions on operations for collaborative working environment based on KOREN/APII-testbed

■ Proceeding to the next year Tuning among participating organizations

Example: Organization for Access Grid

Example: Applications in Access Grid

■ Establishment of collaborative working environments among parties including universities, laboratories and offices

Restrictions in R&D Project

■ Lack of techniques to establish efficient collaborative working environments Sharing computational resources through high

speed networkssupercomputers, cluster systems, massive storages

Policies through the tuning of management strategies

■ Lack of human resources in Grid environments Need re-education programs Invited talks and international technical forums

Improving National Security by establishing international networks for disaster preventions

Radical pervasive effect through a technology transfer

Create applications using KOREN and APII-testbed

→ Unification Effect on various areas

Applications and Effects

“ET over IT”Construction of co-work environments

based on KOREN and APII-testbed

“α over IT”

Conclusion

■ Production and practical use of data for disaster preventions in temporally and spatially distributed computing environments combining KOREN with Grid computing technology

■ Raising human resources for Grid technology Producing detailed user guide books/manuals and

sharing knowledge through them

■ The synergy effect caused by clustering supercomputers through KOREN

■ Efficient use of world best IT infrastructure