http:// dorii joint research activities dorii joint research activities status and progress 4 th...
TRANSCRIPT
http://www.dorii.eu/
DORII Joint Research ActivitiesDORII Joint Research Activities
Status and Progress
4th All-Hands-Meeting (AHM)
Alexey Cheptsov
on behalf of the JRA
16.06.2009, Santander, Spain
DORII Joint Research Activities Goals and Objectives 1/2
The Remote Instrumentation Infrastructure. Layered viewThe Remote Instrumentation Infrastructure. Layered view
The JRA aim at setting up a middleware framework, extended and enhanced towards support of Remote Instrumentation Applications, enabling full-service management, maintenance and exploitation of heterogeneous instrumentation and acquisition devices on the Grid.
The JRA aim at setting up a middleware framework, extended and enhanced towards support of Remote Instrumentation Applications, enabling full-service management, maintenance and exploitation of heterogeneous instrumentation and acquisition devices on the Grid.
Visualization and Interactivity (Int.EU.Grid)
Workflow Management
(VLab)
Middleware Services
Middleware Services
Core middleware stack (EGEE)
Core middleware stack (EGEE)
Computation Grid
Storage Grid
Application Development on Grid (g-Eclipse)
Application Development on Grid (g-Eclipse)
Management of Grid resources
(GRIDCC)
Management of Grid resources
(GRIDCC)
The DORII middleware architectureThe DORII middleware architecture
Remote Instrumentation on Grid (RinGRID, GRIDCC)
DORII Middleware FrameworkDORII Middleware Framework
Management & Development
tools
Management & Development
tools
DORII Joint Research Activities Goals and Objectives 2/2
Parallel application
support (Open MPI)
The time planning of JRA tasksThe time planning of JRA tasks
Time planning and tasks performed 1/14
M1 M2 M3 M4 M5 M6 M7 M8 M9 M10 M11 M12 M13 M14 M15 M16 M17 M18 M19 M20 M21 M22 M23 M24 M25 M26 M27 M28 M29 M30
IdentificationAdaptationFinal Report
1.1 M1: First release of SW M2: Updated Release M3: Updated Releases1.2.1-11.2.1-21.2.1-31.2.2-11.2.2-21.2.2-31.2.2-41.2.2-51.2.2-61.2.3-11.2.3-21.2.3-31.2.4-11.2.4-21.3-11.3-21.3-3Final Report
Color Coding: ALL PSNC ELETTRA GUP HLRS
DJRA1.1 DJRA1.2 DJRA1.3
The time planning of JRA tasks. AdaptationThe time planning of JRA tasks. Adaptation
Time planning and tasks performed 2/14
M1 M2 M3 M4 M5 M6 M7 M8 M9 M10 M11 M12 M13 M14 M15 M16 M17 M18 M19 M20 M21 M22 M23 M24 M25 M26 M27 M28 M29 M30
IdentificationAdaptationFinal Report
1.1 M1: First release of SW M2: Updated Release M3: Updated Releases1.2.1-11.2.1-21.2.1-31.2.2-11.2.2-21.2.2-31.2.2-41.2.2-51.2.2-61.2.3-11.2.3-21.2.3-31.2.4-11.2.4-21.3-11.3-21.3-3Final Report
Color Coding: ALL PSNC ELETTRA GUP HLRS
Task 1.3 – Integration of all enhanced components into a common framework
Time planning and tasks performed 3/14
Plan for adaptation of the components to the requirements of the Remote Instrumentation Infrastructure
Plan for adaptation of the components to the requirements of the Remote Instrumentation Infrastructure
Time planning and tasks performed 4/14
Developer support environmentDeveloper support environment
https://gforge.hlrs.de/projects/dorii-jra/https://gforge.hlrs.de/projects/dorii-jra/
GForge is a collaborative software development environment, also adopted in the DORII JRA.
• a set of collaborative and groupware tools (mailing lists, forums, bug and issue trackers, etc.)
• a set of collaborative and groupware tools (mailing lists, forums, bug and issue trackers, etc.)
• additional services, such as File Release System, Document Management Service, etc.
• additional services, such as File Release System, Document Management Service, etc.
Main features:Main features:• a subversion-based version control system for storing and management of the source code, documentation and other files
• a subversion-based version control system for storing and management of the source code, documentation and other files
Time planning and tasks performed 5/14
Source code version control systemSource code version control system
Release 1.0 of the DORII middleware components
trunk
DORII.eu
applicationsmiddleware
VCR WfMS
OPATM-BFM SWAN
g-Eclipse
Open MPI
branch
release Your application
application farm
user domain
Common LibVisualization
Time planning and tasks performed 6/14
Release of the 1st version of the DORII middleware frameworkRelease of the 1st version of the DORII middleware framework
Time planning and tasks performed 8/14
Early deployment of the pilot applications on the DORII infrastructure
Early deployment of the pilot applications on the DORII infrastructure
Time planning and tasks performed 9/14
Evaluation of the user feedback, mainly on the user interface (VCR)
Evaluation of the user feedback, mainly on the user interface (VCR)
With regard to the middleware architecture, the overall rating was goodWith regard to the middleware architecture, the overall rating was good
but…
Grid security requires some simplification
Slowness of performing some operations must be overcome and perceived effectiveness improved
Reliability must be improved (already foreseen by the Plan for Adaptation)
Application customization and usability must be improved
Integration with data bases (i.e. for the availability of historical data), as well as meta- and semantic data
Tools for postprocessing and advanced visualization (of data acquired and postprocessed) must be integrated as well
Time planning and tasks performed 10/14
User support in JRAUser support in JRA
Helpdesk – an online issue and bug tracker
Helpdesk – an online issue and bug tracker
[email protected] support mailing listdorii-user-support@...
user support mailing list
www.dorii.eu/middlewareDORII middleware page
www.dorii.eu/middlewareDORII middleware page
Time planning and tasks performed 11/14
Collaboration within the workpackageCollaboration within the workpackage
Time planning and tasks performed 12/14
Participation in conferencesParticipation in conferences
Instrumenting the Grid (INGRID’09) conference
Parametric Jobs Facilitation of IE Usage in Grid Applications. K. Bylec, S. Mueller, M. Pabiś, M. Wojtysiak, P. Wolniewicz
Analysis and optimization of performance characteristics of parallel scientific applications on the Grid (a case study for the OPATM-BFM environmental application). A. Cheptsov, B. Koller, S. Salon, P.Lazzari
HPC-Europa seminars
Our scientific activitiesOur scientific activities
Time planning and tasks performed 13/14
Participation in conferencesParticipation in conferences
Computational Methods in Science and Technology
Towards deployment of the Remote Instrumentation e-Infrastructure (in the frame of the DORII project) – published
International Conference for High-Performance Computing, Networking, Storage and Analysis
Grid Support of Scientific Instrumentation in Practice – The Remote Instrumentation e-Infrastructure – submitted
IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS'2009)
Remote Instrumentation Infrastructure for e-Science. Approach of the DORII project – accepted
Our scientific activitiesOur scientific activities
Scientific articlesScientific articles
Time planning and tasks performed 14/14
1st annual DORII review
a draft of the presentation incorporating the suggestions of the Coordinator is done
internal discussion takes place
2nd release of the middleware
main outcome – the common library and basic support of it in
Further integration of components, according to the Plan for Adaptation of Components
Important deadlines and milestonesImportant deadlines and milestones