bringing interactivity to 3d visualisation on the grid

The SEE-GRID-2 initiative is co-funded by the European Commission under the FP6 Research Infrastructures contract no. 031775

www.see-grid.eu

SEE-GRID-2

Bringing Interactivity to 3D Visualisation on the Grid

Branko MarovićBranislav Čukanović, Dragan Okiljević, Ivica Barišić,

Jovana Vuleta, Danijel Bašić, Vladimir Čakarević et al.

University of BelgradeBelgrade University Computing Center - RCUB

http://www.rcub.bg.ac.yu

CE EGEE and SEE-GRID-2 Summer School on Grid Application Support – Budapest 6th July 2006 2

Introduction

ObjectiveComplete interactive analysis of 3D datasets from medical imaging devices (CT, MR, PET, SPECT…)Easy remote access over the InternetGeneralized 3D tools for diagnosis, surgical planning, and therapy evaluationVirtual distant examination based on 3D datasets

Basic ideaSplit the system into a client and server partDedicate the server part to access and processing of volumetric dataProduce a lightweight client for user interaction and 3D renderingExploit grid resources and paradigms to overcome implementation issues


Screnshots - From Atoms to Galaxies


VIVE Gridification

General benefits Distribution of processing and data over several nodes Data transfer and replication Security – high sensitivity of medical data Application-specific monitoring

New grid-specific components TCP binder (Client-server Three-tier)

Mediating between clients and server jobs Pool of server jobs Persistence Collecting monitoring and performance data

3D image management (LFC web front end, spatially segmented file format) Measurement archive and web view of collected data

Adaptations Server (lcg-ManageSoftware, file I/O to both nearby classic and remote

DPM/SRM SEs) Glue web user interface Client – longer delays and protocol changes


Performance Patterns

Start-up delay must be avoided at any cost!Network delay Must be made acceptable

for small transactions OK for long-running

requests

Texture Generation (ms)

28 29 44 48 50

213

282

30 35 40 44 57

22

63

25 14 19 34 49

0

50

100

150

200

250

300

AE

GIS

02-R

CU

B

AE

GIS

01-P

HY

-SC

L

BG

02-I

M

SZ

TA

KI

AE

GIS

03-E

LEF

-LE

DA

BG

01-I

PP

RO

-01-

ICI

BA

-01-

ET

FB

L

AL-

02-F

IE

BA

-02-

ET

FIS

BA

-04-

PM

FS

A

AL-

01-I

NIM

A

Communication

Processing

Mesh Generation (ms)

2826 63

61

1610

4

3907

2036

5785

0

2195

3

2649

3

1255

3

3220

0

10000

20000

30000

40000

50000

60000

70000

AE

GIS

02-

RC

UB

AL-

02-F

IE

BA

-04-

PM

FS

A

BA

-01-

ET

FB

L

BG

01-I

PP

Communication

Processing

Server Startup Delay (ms)

108

120

124

127

133

143

150

156

188 224

250

250

380

515

0

100

200

300

400

500

600

AL-

02-F

IE

BA

-01-

ET

FB

L

AE

GIS

02-R

CU

B

BG

01-I

PP

BA

-04-

PM

FS

A

BA

-02-

ET

FIS

BG

02-I

M

AE

GIS

03-E

LEF

-LE

DA

AE

GIS

01-P

HY

-SC

L

RO

-01-

ICI

HR

-01-

RB

I

TR

-03-

ME

TU

AL-

01-I

NIM

A

SZ

TA

KI


VIVE Grid Architecture

VO Services

Grid SiteComputing Element

Worker Node

Field ServerJob

ResourceBroker

Browser

Java VM

Applet

VRMLEngine

3DBehavior

Job Submission

VIVE Portal

TCP Binder

WebApplication

GridUser

InterfaceWebServer

JobControl

ToolUpdates(TCP)

SceneSetup

(HTTP)

DBMS

StorageElement

LFC ReplicaManager

InformationSystem

GridSite

Selection

ImageData

(RFIO)

Gatekeeper

ToolUpdates(TCP)


TCP Binder

Pool of server jobs Pre-emptive submission

prevents delays Adapt to site

responsiveness Prevent flooding of

queues Job lifetime management Maintaining the

satisfactory number of jobs in the pool

Per-site policy

SUBMITTED

READY

BUSY

AGED

MaxSubmissionTimerecalculated

responsearrivalMaxSubmissionTime

elapsed

MaxAgedTimeelapsed

user sessionfinished

job allocatedfor user

responsearrival

jobdiscarding


Performance measurement


Stripping:Partitioned Volume Processing

Split a complex request into subvolumesAllocate satellite jobs from TCP binderIssue several parallel requests as client Retrieve partial resultsIntegrate and return the final result

Site A

Site B

Site C


Developer Resources

Grid environment is constantly evolving, but Useful features persist New are constantly being added Bugs are being fixed Gained knowledge remains relevant, must be updated Applications can be easily migrated to new/updated APIs

LCG-2 User Guide https://edms.cern.ch/file/454439//LCG-2-UserGuide.html

SEEGRID Wiki http://wiki.egee-see.org/index.php/SEE-GRID_Wiki

Waiting for gLite User Guide


Software/Job Management

Software installation management using ESM toolsExperiment Software Installation in LCG-2 http://goc.grid.sinica.edu.tw/gocwiki/Experiments_Software_Installation

SEEGRID Wiki “SEE-GRID ESM Software Installation Guide” http://wiki.egee-see.org/index.php/SEE-GRID_ESM_Software_Installation_Guide

Site configuration Using ESM tools Example JDL and shell scripts for installation, validation, and removal

Job managementEDG WMS API (LCG-2) – C++ & Java http://www.to.infn.it/grid/workload_management/apiDoc/edg-wms-api-

index.htmlExec/spawn of shell scripts that create and submit JDL – simple, but no direct feedback on jobsgLite http://egee-jra1-wm.mi.infn.it/egee-jra1-wm/glite-wms-api-index.shtml


Data Management

LCG-2 (LCG-2 User Guide, “man” pages) LCG-UTILS API – C/C++ LFC API – C/C++, Python GFAL API – C/C++, Python

http://grid-deployment.web.cern.ch/grid-deployment/gis/GFAL/GFALindex.htmlSEEGRID Wiki “SG Using file replicas and RFIO: UI configuration, rfiod, usage in apps, limitations and workarounds”

http://wiki.egee-see.org/index.php/SG_Using_file_replicas_and_RFIO:_UI_configuration%2C_rfiod%2C_usage_in_apps%2C_limitations_and_workarounds

Configuring UI, SE, RB Site testing of RFIO/GFAL Typical problems and solutions Java access to LFC and LCG-UTILS

Java LFC/GFAL wrapper http://grid02.rcub.bg.ac.yu/LFCJavaAPI/index.html

Customizable LFC web front end (upload, list, replicate, delete) http://grid02.rcub.bg.ac.yu/repmngr/

gLite http://grid-deployment.web.cern.ch/grid-deployment/documentation/

DataManagement/R3.0/


What VIVE Can Offer to Developers?

ReadyExperience in ESM software installation managementJava LFC/GFAL wrapperCustomizable LFC web front end

In developmentPerformance measurement facility Service implementing measurement archive Event recording API used by applications, sensors, and monitoring points or agents to put

events into measurement archive Basic archive querying API suitable for creation of reports HTML-based web application for querying of the archive and display of reports Advanced features, like generation and display of aggregations, a Web service, and MRTG

graphs support could also be added.3D Java environment framework NetBeans/Swing based GUI: view and tool management Integration of tool GUI and 3D appearance Scene, lighting, navigation Java 3D sensors, 3D and GUI events

VIVE Visualisation of other volumetric data sources: Earth sciences (atmospheric science, geology,

oceanography), aerodynamics, astrophysics, thermodynamics, and dynamics of fluids.App-ware for interactive applications?

Based on TCP binder experience


Java Web Start NetBeans Java 3D EJB3/Hibernate MySQL Servlets/JSP Java JNI Unix shell scripts Grid APIs (GRAM, MDS, WMS, GFAL, LCG-UTILS, LFC,…) DICOM JPEG Applets Sockets Java CGI-Bin VRMLC++

Implementation Technology Evolution

t


Thank you.

bringing interactivity to 3d visualisation on the grid

Documents

data sources

replicationreplication

data storageserver

server jobsallocating

server partdedicate

d tools

display monitoring data

medical devicesupload