1 other features and next steps gergely sipos mta sztaki hungarian academy of sciences
DESCRIPTION
3 P-GRADE and user roles Portal Administrator: installs P-GRADE Portal 2.7 Grid Application Developer develops a grid application with P-GRADE Portal 2.7 sends the application to the grid portal developer End Users executes the published application with custom input parameters by creating application instances using the published application as a template Grid Portal Developer Creates new classes from the Application Specific Module for P-GRADE by changing the names of the classes develops a Gridsphere portlet that fits to the application I/O pattern and the end users’ needs connects the GUI to P-GRADE Portal using the programming API of P-GRADE Application Specific Module using the Application Specific Module he publishes the grid application and its GUI for end usersTRANSCRIPT
1www.portal.p-grade.hu
Other features and next stepsOther features and next steps
Gergely Sipos Gergely Sipos [email protected]@sztaki.hu
MTA SZTAKIMTA SZTAKIHungarian Academy of SciencesHungarian Academy of Sciences
2
• Develop an application specific portlet:–To hide application logic from end users:
Separate grid experts from grid users
Complete P-GRADE Complete P-GRADE development cycledevelopment cycle
• Develop your jobs locally• Compile your jobs for the grid
– Compiler portlet• Compose workflows from your jobs and execute it
– Workflow editor, workflow manager, Information system portlets
• Scale up the workflow to a parameter study– Define input files (or add Input file generator)– Add output file collector
3
P-GRADE and user rolesP-GRADE and user rolesPortal Administrator:
• installs P-GRADE Portal 2.7
Grid Application Developer• develops a grid application with P-GRADE Portal 2.7• sends the application to the grid portal developer
End Users• executes the published application with custom input parameters by creating application instances using the published application as a template
Grid Portal Developer•Creates new classes from the Application Specific Module for P-GRADE by changing the names of the classes•develops a Gridsphere portlet that fits to the application I/O pattern and the end users’ needs• connects the GUI to P-GRADE Portal using the programming API of P-GRADE Application Specific Module• using the Application Specific Module he publishes the grid application and its GUI for end users
4
P-GRADE PORTAL 2.7 server
Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)
DetailedDetailed Scenario Scenario
Publisher Partof Applicationspecificmodule
Portlet to publish applications
Registry of published applications
EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)
Portal Administrator installs the P-GRADE portal 2.7.
Then adjusts the portlet to publish applications
5
P-GRADE PORTAL 2.7 server
Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)
DetailedDetailed Scenario Scenario
Publisher Partof Applicationspecificmodule
Portlet to publish applications
Registry of published applications
Grid Application
EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)
Grid Application Developer creates own Grid Application.
6
P-GRADE PORTAL 2.7 server
Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)
DetailedDetailed Scenario Scenario
Publisher Part of Applicationspecificmodule
Portlet to publish applications
Registry of published applications
Application specific portlet
Grid Application
EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)
Grid Portal Developer develops a Application specific portlet using Java Server Pages and Gridsphere Tag Library Updates the the application specific package: connects Grid application to new portlet
7
P-GRADE PORTAL 2.7 server
Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)
DetailedDetailed Scenario Scenario
Publisher Part of Applicationspecificmodule
Portlet to publish applications
Registry of published applications
Application specific portlet
Grid ApplicationGrid Application
(Template)
EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)
Grid Portal Developer develops a Application specific portlet using Java Server Pages and Gridsphere Tag Library Updates the the application specific package: connects Grid application to new portlet
8
P-GRADE PORTAL 2.7 server
Services of P-GRADE Portal(workflow management, parameter study management, fault tolerance, …)
DetailedDetailed Scenario Scenario
Publisher Part of Applicationspecificmodule
Portlet to publish applications
Registry of published applications
Application specific portlet
Grid ApplicationGrid Application
(Template)Grid Application
EGEE and Globus Grid services (gLite WMS, LFC, …; Globus GRAM, GridFTP, …)
Grid Application
End users can create projects from a Published Grid Application Template.Then they can adjust parameters, and run in Grid via Application specific portlet!
9
IInterface nterface toto publish publish a a P-GRADE ApplicationP-GRADE Application
Grid Application Developer can publish the application by a pre-developed portlet
Button to revoke an already published application
Button to publish the application
Select an application
10
Matrix multiplication on EGEEMatrix multiplication on EGEEend users’ point of viewend users’ point of view
Do you see the grid somewhere?
11
Manage your computationsManage your computationsButton to load a multiplication
project
Button to delete a multiplication project
Button to create new multiplication project
12
Define a new multiplication Define a new multiplication tasktask
Name of the current project
Matrix A (you can define values for Y)Matrix B is
fixed
13
Define values for YDefine values for Y
Parameters can be adjusted as Set, Range and Random.
14
Monitor progressMonitor progress
Click to start computation
Click to get status of computation
Status bar of computation
15
Get resultGet result
Click to Download Results
16
Part IISupport of legacy codes, code
reusability and grid interoperability
17
GEMLCA P-GRADE Portal 2.4.1GEMLCA P-GRADE Portal 2.4.1
• P-GRADE Portal extended with GEMLCA Grid service back-end– To share jobs and legacy codes as application components with others– A step towards collaborative e-Science
• Developed by the University of Westminster (London)• Support for Globus 4 grids (besides GT2 and EGEE)• Available on the UK NGS and OGF GIN Portals• http://www.cpc.wmin.ac.uk/ngsportal/index.php
P-GRADE Portal
GEMLCAGlobus 4 VOs
Globus 2 VOs
LCG / gLite VOs
jobjobjobjob
Legacy code
Legacy codeLegacy code
Legacy codeLegacy code
Legacy code
18
Combine legacy codeswith new codesinside the same workflow!
Code Code invocationinvocation
Code Code invocationinvocation
Job Job submissionsubmission
Job Job submissionsubmission
Combining legacy and Combining legacy and non-legacy (job) componentsnon-legacy (job) components
Publish successfully executed new code as legacy code
19
NGS P-GRADE PortalNGS P-GRADE Portal
• NGS P-GRADE portal is a production service of the UK NGS
• It has several advanced extensions to the original P-GRADE portal:– Integration with the GEMLCA legacy code service– Integration with SRB– Integration with OGSA-DAI
• The next part of the lecture shows these features of the NGS P-GRADE portal
44
Running at OSG
Running at EGEE
Running at NGS
From NGS SRB (both)
From NGS SRB
From NGS GFTP
From local
(both)
From NGS SRB To EGEE
SRM
Running at NGS
Running at NGS
From NGS
GFTP
To NGS SRB
Workflow level Interoperation of local, SRB, Workflow level Interoperation of local, SRB, SRM and GridFTP file systems SRM and GridFTP file systems
• Dynamic port-level integration of Grid data resources:
•Different port types, including local, remote and SRB ports, can be freely mixed as input or output of workflow components. •This solution allows the seamless interoperation of SRB catalogues, GridFTP file systems and EGEE storage elements
45
So here we are!So here we are!GridFTP, SRM, GridFTP, SRM, SRB and OGSA-DAI workflow SRB and OGSA-DAI workflow
level integrationlevel integration
Portalserver
Grid infrastructure
Computing resources
GridFTP servers
REMOTE INPUTFILES
REMOTE OUTPUT
FILES
LOCAL INPUT FILES
LOCAL OUTPUT
FILES
LOCAL INPUT FILES
LOCAL OUTPUT FILES
User levelstorage
EGEE Storage
elements
Control of remote input/output
Workflow level Interoperation of local,
GridFTP, SRM and SRB file catalogues
and databases exposed by OGSA-DAI
SRB servers
OGSA-DAI
services
Data manipulation
Input to workflows
Output from workflows
48
Next stepsNext steps
How to get involved
49
Portal installationsPortal installations
• P-GRADE Portal services:– SEE-GRID infrastructure– Central European VO of EGEE– GILDA: Training VO of EGEE– Many national Grids (UK National Grid
Service, HunGrid, Turkish Grid, etc.)– US Open Science Grid, TeraGrid– OGF Grid Interoperability Now (GIN) VO– …Portal services and account request:http://portal.p-grade.hu/index.php?m=3&s=0 Account request form on portal login page
50
Installing P-GRADE PortalInstalling P-GRADE Portal
– (If you are the administrator of a Grid/VO then) get the installation package from SourceForge
• http://sourceforge.net/projects/pgportal• Server requirements
http://portal.p-grade.hu/index.php?m=13&s=0 • Local user support must be provided by you
– If you are member of an EGEE / Globus VO that does not have P-GRADE Portal yet, then
• Ask SZTAKI to add your VO to the Multi-grid P-GRADE Portal Installation
• Ask the manager of your VO to install P-GRADE Portal
52
Support servicesSupport services
http://portal.p-grade.hu• Training:
– Training events, trainer community: email list: [email protected]
– Portal to access GILDA resources– Online tutorials
• User forum • Installation and operational support team• Application Development and Porting Support:
www.lpds.sztaki.hu/gasuc