steering and interactive visualization on the grid using the unicore grid middleware k. benedyczak...

19
Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2 , A. Nowiński 1 , K.S. Nowiński 1 , P. Bała 1,2 (1) ICM, Warsaw University, Poland (2) Faculty of Mathematics and Computer Science, N. Copernicus University, Torun, Poland

Upload: dorothy-king

Post on 05-Jan-2016

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware

K. Benedyczak1,2, A. Nowiński1, K.S. Nowiński1, P. Bała1,2

(1) ICM, Warsaw University, Poland(2) Faculty of Mathematics and Computer Science, N. Copernicus

University, Torun, Poland

Page 2: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

Unicore middleware

Well known Very stable Message based protocol No streaming at all Very good security model Intensive SSL usage Good firewall passing

Page 3: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

Firewall

Unicore architecture

Client

Gateway

NJS

TSI

Single entrypoint

NJS

TSI

USpace

UUDB

USpace

UUDB

SSL

Page 4: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

VisIt – a visualization toolkit Well known protocol for remote visualization and

steering Easy to use Reversed connection direction – simulation connects

to visualization Service registry and specific protocol – SEAP Very well developed binary data conversion

procedures No java binding May use multiple connections for single session

Page 5: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

VisIt - architectureExample session: Simulation starts Simulation queries SEAP

poeriodically Visualization starts and

registers on SEAP server

Simulation gets visualization address from the SEAP

Simulation connects to the Visualization

Data is exchangedSimulation(Visit client)

Visualization(Visit server)

SEAP server

Data

(may u

seM

ultip

le

connectio

ns)

Page 6: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

IVis Streaming extension for Unicore

developed in ICM Uses Unicore gateway extension

feature Developed as system for access to

groving files Easily extendable Very good performance Authorization done separately

Page 7: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

IVis architecture

Firewall

Client

Gateway

NJS

TSI

Still single entry point

IVis server

USpace

UUDB

IVisExtension

Page 8: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit Support for running VisIt over Unicore

infrastructure Does not require changes in simulation and

visualization Implements most important parts of the

protocol Require SEAP usage by both simulation &

visualization Implementation using IVis server and

Unicore client extension plugins.

Page 9: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit - schemaVisit Server

(Visualization) Unicore Client

UVisit plugin

FirewallGateway

NJS

TSI

IVis server

IVis Extension

Visit client(simulation)

UVisit module

SEAP

Run job

SEAP

Data

Data

Page 10: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit – seap split Seap server has to be split:

Client part included into UVisit plugin Server part in the UVisitServer, module

of IVis server Seap data has to be modified

(destination address) Endpoint created on the request Data on the server valid only as long

as the client is connected

Page 11: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit implementacja - tunnel Single secure (SSL) connection to the

gateway used to transfer SEAP and data

Very simple message-based protocol used to separate streams on the endpoints (client&server)

Small overhead Multiple visualization streams can be

run through the single tunnel

Page 12: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit – plugin Runs at UVisit ‘server’

(visualization) endpoint

Implemented as the Unicore extension plugin

Can connect to multiple sites at once

User can see registered SEAP entries

Only .visitrc setup required

Page 13: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit - setup Working IVis installation required

(gateway and server) On the user endpoint valid .visitrc

pointing to the client host is required On the server config file must be

edited to define server location On the job server valid .visitrc

pointing to the server required That’s all…

Page 14: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit limitations:

Requires forcing of single connection for control and data

Requires SEAP usage Problems with multiple users on the

same server – Visit security is limited

Page 15: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit demo application UVisit lacks nice

graphic demo Application created

for UVisit, but works with plain visit as well

Simulation of diffusion and advection in the complex velocity field defined by randomly moving vortices

Simple steering included

Page 16: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

UVisit demo application Visualization in

java stand-alone application

Minimal proxy in C required (no java binding for Visit!)

Available in UVisit package

Page 17: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

Conclusions

UVisit is a successful implementation of streaming in unicore

Does not require changes in the legacy code (or minor changes only)

Good performance No changes required in unicore

Page 18: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

Future development

Currently we are working on mechanism similar to the IVis/UVisit for unigrids environment - UGSF

We develop Web-Service integrated streaming in the new infrastructure

Page 19: Steering and Interactive Visualization on the Grid Using the UNICORE Grid Middleware K. Benedyczak 1,2, A. Nowiński 1, K.S. Nowiński 1, P. Bała 1,2 (1)ICM,

Thank you!