www.eu-eela.org e-science grid facility for europe and latin america gridwwin: porting glite to run...

www.eu-eela.org

E-science grid facility for Europe and Latin America

GridwWin: porting gLite to run under WindowsFabio Scibilia – Consorzio COMETA

30/06/2008

2www.eu-eela.eu Catania (Italy) , Joint EELA/EGEEIII Tutorial for Trainers, 30.06.2008 – 04.07.2008

WMProxyUser

Interface

Computing Element

Information Index

Logging & Bookkeeping

Job

sub

mit e

ven

t

Authentication & authirization

(GSI)

Input Sandbox

Output Sandbox

Publish

Storage Element

Logical File Catalogue

Ou

tpu

t S

an

db

ox

Inp

ut

Sa

nd

bo

x

Grid files info

Computing resource

Grid Terminal

Preliminars: gLite architecture


User Interaface

LRMS

Gatekeeper

Grid Infrastructure

Site administration

Worker Nodes

WMProxy

Local user

Grid user

• Local Resource Manager (LRMS)– It is NOT a Grid component– Local administration– Dispatches job across Worker

Nodes– Accessed by local users

• Computing Element– Service oriented– Faces computing power to the grid

• Gatekeeper– Access point of the CE– Manages one or more job queues– Wraps the LRMS

• Worker Nodes– More than one (cluster)– Execute both local and grid jobs

To execute grid jobs, a specific

environment must be set

Preliminars: Computing Element


• Presently on gLite– Grid users use the gLite

middleware from Linux-based User Interfaces via CLI

– (almost) All gLite resources are Linux-based

• This implies– Grid users need to be trained

– Only Linux-based applications can be deployed onto the Grid

• Porting of gLite to Windows– User Interface

– Computing Element (farm)

Gatekeeper + LRMS

User Interface

Linux WNs

WMProxy

User Interface

WindowsXP Wns

new users come in to the grid !

windows applications can run on the grid !

Targets


• Grid2Win GUI– wxWindows– Cross platform– Open source– Indipendent of underlying CLI– Installer 11Mbytes (including the

cygwin DLL)

• gLite Command Line Interface– Recompiled via Cygwin tools

under Windows XP

• Cygwin– Emulates POSIX environment

on Windows– Only the Cygwin DLL must be

installedLinuxWinXP

ygwin

gLite CLI gLite CLI

Win2Grid GUIPlatform independent

Porting strategy


• User Interface– Client tools

Grid Security Infrastructue (GSI) Workload Management Service (WMS) Logging and Bookkeeping (L&B) Data Management Service (DMS) Information System (BDII)

– Grid2Win Graphical User Interface

• Computing Element

– Torque/MAUI (PBS) Linux head node Windows XP Worker Nodes

– Microsoft Compute Cluster Server (CCS) Linux auxiliary node Windows XP CCS farm

Done !!!

Done !!!

Prototype !!!

Prototype DONE!!!

What is already done


• Grid Security Infrastructure– Credentials management with

VOMS extensions voms-proxy-* commands

• Workload Management– Job submissions and output

retrieving glite-wms-job-* commands edg-job-* commands

• File Transfer– Secure transfer with credential

management GSIFTP (globus-url-copy) RFIO commands (rf-*)

• Data Management– File Catalogue Browsing

lfc-* command

– Data Movement and Replication

lcg-* commands

• Information System– Command lines

lcg-info lcg-infosites

– Grid2Win GUI LDAP Explorer integrated in

our GUI

Status of porting


• Computing Element (CE)– Scientific Linux

– PBS server

• Worker Nodes (WNs)– MS Windows XP

– PBS mom

– gLite clients

– We are providing for an installer

gLite CLI

WinXP

Cygwin

PBS

job run

Gatekeeper

PBS

CE on PBS

WinXP WNs

WMProxy

Porting PBS as CE on Windwos


• CCS– Microsoft CCS farm with a

head node an more worker nodes

• Auxiliary Nodes– Globus Gatekeeper (Linux)

– Service interface to the grid

• CCSJob Client Server– To put in communication the

Gatekeeper (Linux) with the CCS head node (Windows)

– To call CCS primitives

– SSL channel

Gatekeeper

CCSJobClient

CCSJobServer

CCS head node

WinXP x64 WNs

Auxiliary node

CCS Farm

CCS primitives tunnelling

Integrating CCS as native CE


Questions …

www.eu-eela.org e-science grid facility for europe and latin america gridwwin: porting glite to run...

Documents