keith g jeffery director, it & international strategy ngg next generation grids vision

Keith G Jeffery

Director, IT & International Strategy

NGGNext Generation GRIDs

Vision

© Keith G Jeffery

Director, IT & International Strategy2CoreGRID SummerSchool Bonn 200607

Structure

• Starters– Who am I– Why am I talking about NGG– What was NGG

• Main Dish– NGG1– NGG2– NGG3– Ongoing Work– Futures

• Dessert– Conclusion

© Keith G Jeffery


Starters

Director IT & International Strategy CCLRC

Who?

© Keith G Jeffery


Starters

• Why (am I talking about this)

– One of three initiators of NGG

• Thierry Priol, INRIA

• Domenico Laforenza, CNR

– Participant in all three NGG Expert Groups

• Editor-in-Chief NGG2

• Chair NGG3

© Keith G Jeffery


Starters

• What (was NGG) ?

– A group of experts nominated by the EC

– Brought together to provide a vision for GRIDS in Europe

– Producing reports

– Used with Calls in FP6

© Keith G Jeffery


Structure




© Keith G Jeffery


• Background– UK e-Science Programme initial paper 1999

• General-purpose ICT environment not metacomputing

• End-user interacts with an intelligent system to clarify request. System executes with end-user steering if required.

• Knowledge and Information as important as CPU power

• Integration with W3C and especially Web Services concept

Main Dish

© Keith G Jeffery


Main Dish• Initiation of NGG• EC persuaded of importance of GRIDs

– Started in IST/Environment (early 2000) with IT architectural framework for FP6 projects

– Set up GRID Unit under Wolfgang Boch (late 2002)

• January 2003: large workshop (GRID Unit)– (~ 240 participants)– Keynotes:

• Thierry Priol (INRIA, FR) • Domenico Laforenza (CNR, IT) • Keith Jeffery (CCLRC, UK)

© Keith G Jeffery


Main Dish• 3 keynote speakers asked to help set up expert group to do report (NGG1)• H. Bal NL Dept. of Computer Science, Vrije Universiteit, Amsterdam• C. de Laat NL Faculty of Science, Informatics, University of Amsterdam• S. Haridi SE SICS• K. Jeffery UK RAL• J. Labarta ES Universitat Politecnica Catalunya• D. Laforenza IT ISTI-CNR• P. Maccallum UK Life Science Informatics Solutions Ltd.• J. Massó ES GRIDSYSTEMS• L. Matyska CZ Faculty of Informatics, Masaryk University• T. Priol FR IRISA• A. Reinefeld DE Konrad-Zuse-Zentrum für Informationstechnik• A. Reuter DE European Media Lab GmbH• M. Riguidel FR ENST• D. Snelling UK Fujitsu Laboratories of Europe• M. van Steen NL Dept. of Computer Science, Vrije Universiteit, Amsterdam)

• NGG1 Report completed June 2003– http://www.cordis.lu/ist/grids/index.htm– Ancillary information to FP6 second call

© Keith G Jeffery


Main Dish

• NGG1 Goals – The research objective:– Overcome present architectural and design limitations

hampering the use and wider deployment of computing and knowledge Grids and to enrich its capabilities by including new functionalities required for complex problem solving. This should help the larger uptake of Grid type architectures and extend the concept from computation Grids to knowledge Grids, eventually leading to a “semantic Grid”.

– With the following research focus:– Architecture, design and development of the next generation

Grid beyond extensions of existing technologies, leading to open standards, and including security built-in at all levels, programming environments, resource management; economic and business models for new services, customisable middleware, interoperability with existing Grid and Web services. An integrated and comprehensive approach including stakeholders from all relevant levels is required.

© Keith G Jeffery


• NGG1 Visions

• We start out with the end user perspective. Only with an indication of how the Grid might be deployed in the everyday life of individuals and businesses can the importance of Grid technology be addressed.

• The architectural perspective envisions the Grid as a structural entity with a collection of capabilities and properties. The perspective is critical in providing an indication of the scale expected from NGG, in term of numbers, geography and administrative domains.

• The software perspective, finally, focuses on how programming on a Grid will look, which algorithmic problems have to be solved in order to build an infrastructure as described form the architectural perspective, and which constraints have to be observed when developing a NGG.

Main Dish

© Keith G Jeffery


• NGG1 Requirements

• Transparent and reliable• Open to wide user and provider communities• Pervasive and ubiquitous• Secure and provide trust across multiple administrative

domains• Easy to use and to program• Persistent• Based on standards for software and protocols• Person-centric• Scalable• Easy to configure and manage

Main Dish

The Invisible GRID

© Keith G Jeffery


inteliGRIDSemantic Grid

based virtual organisations

ProvenanceProvenance for Grids

DataminingGridDatamining

tools & services

UniGridSExtended OGSA

Implementation based on UNICORE

K-WF GridKnowledge based

workflow & collaboration

GRIDCOORDBuilding the ERAin Grid research

European - wide virtual laboratory for longer term Grid research - creating the foundation for the next generation Grids

COREGRID

EU - driven Grid services architecture for business

and industryNEXTGRID

Mobile Grid architecture and services for dynamic

virtual OrganisationsAKOGRIMO

Grid-based generic enablingapplication technologies to

facilitate solution of industrialproblemsSIMDAT

OntoGridKnowledge Services for

the semantic Grid

HPC4UFault tolerance,dependability

for Grid

Figure 1: The Call 2 Projects as a ‘house’

Call2 (NGG1) Projects Funded

Main Dish

NOTE

© Keith G Jeffery


• NGG1 left some undefined research areas• Call2 projects did not address all areas of

research opportunity

• NGG2 convened to update the vision:– Particularly security / trust– Particularly self-* properties– Particularly semantic description of

components

• More participation from industry• Report September 2004

Main Dish

© Keith G Jeffery


Application A Application B Application C

Grids Middleware Services Needed for A

Grids Middleware Services Needed for B

Grids Middleware Services Needed for C

Grids Foundations for Operating System X

Grids Foundations For Operating System Y

Operating System X

Operating System Y

Grids Operating System(including Foundations)Modular and dynamically loadable

NGG2 Architecture

Main Dish

© Keith G Jeffery


• NGG2

• Emphasis on

– Autonomic, self-managing systems

– Using middleware and foundationware

– Emerging realisation of the need for advanced semantic descriptions in metadata

Main Dish

The self-* invisible GRID

© Keith G Jeffery


• Call 5 Projects paid attention to NGG2 report

• XtreemOS (IP) seeks to extend the Linux operating system to Grid environments and virtual organisation contexts. It proposes to design, implement and evaluate a Grid operating system. Many results will be made available and supported as open-source.

• BEinGRID (IP) seeks to undertake 19 business experiment pilots designed to implement and deploy Grid solutions in a broad spectrum of European business sectors. A knowledge and tool repository will also be developed consisting of Grid service components and best practices to support European businesses with the take-up of Grid. The proposed work will start with available Grid tools and then later bringing in newer tools and this should enhance the potential impact.

• BREIN (IP) seeks to develop a user-centric Grid framework by applying agent technologies and semantic web technologies, with the aim of providing businesses with a means of deploying Grids to solve their specific business problems. The proposal will contribute towards closing the gap between high-level business security requirements and low-level security policies. Business management of Stuttgart Airport is addressed as an application.

Main Dish

© Keith G Jeffery


• KnowARC (STREP) develops a high performance, robust and easy to use Grid-based solution for know-how sharing between virtual organisations, based on the Advanced Resource Connector (ARC) middleware. The work focuses on building industrial quality, standards-compliant, interoperable Grid foundations for know-how sharing services for business and society. The work will be validated in applications in health care, genetics research, and simulations in the automotive industry.

• AssessGrid (STREP) fosters the adoption of risk management into the Grid, focusing on the development and integration of methods, metrics and analysis tools enabling Service Level Agreement (SLA) negotiations. The proposal addresses risk awareness and management, self-organising, fault-tolerant actions and capacity planning, closing the gap between the development of SLAs as concept and as a widely accepted tool for commercial Grid uptake.

• A-WARE (STREP) develops a stable and commercially exploitable technology able to give easy access to Grid resources via a web thin-client approach based on user-friendly interfaces, hiding the complexity of the underlying Grid middleware. The proposal is based on the Grid portal EnginFrame and on Unicore/GS technologies.

Main Dish

© Keith G Jeffery


• QosCosGrid (STREP) develops core Grid technology capable of providing quasi-opportunistic supercomputing (QOS) Grid services and technology that will enable users to develop applications with supercomputing requirements without the need to deploy supercomputers themselves. Validation will be undertaken in the application areas stellar dynamics and evolution, biochemistry, ecological evolution, gene regulation networks, and business supply chains.

• GridTrust (STREP) develops the technology to manage trust and security for the Next Generation Grid from the requirement level down to the application, middleware and foundation levels. The work will focus on linking trust, security and privacy requirements with policies, trust and security.

• GridEcon (STREP) addresses Grid business models and Grid economics, working on the development of solutions and extensions to Grid technology for economics-aware Grid applications so that Grid business models can be implemented. It will advance the state-of-the-art in the financial and economic aspects related to large-scale Grid deployment. The proposal defines micro-economic models for resource sharing across organisations and analyse new paradigms of accounting and settlement in the utility service model.

Main Dish

© Keith G Jeffery


• GREDIA (STREP) creates a platform for design and deployment of secure applications support for mobile devices to be integrated in the Grid. The work will advance the SYMBIAN mobile operating system to exploit Grid opportunities.

• ARGUGRID (STREP) addresses the development of an agent based approach to the configuration and orchestration of resources and services in Grids environments. The work will provide a new model for programming the Grid at a semantic, knowledge-based level of abstraction.

• SORMA (STREP) deals with the development of methods and tools for an efficient market-based allocation of resources, through a self-organising resource management system, using market-driven models supported by extensions for Grid infrastructures. Topics addressed include open Grid markets, economics-driven Grid middleware, and intelligent tools.

• Chemomentum (STREP) seeks to develop a Grid services based environment to enable innovative research by providing a Grid-enabled work flow centric workbench to support decision making processes. Based on UNICORE enhancements, the work will focus on a workflow engine for execution of complex, multi-step, multi-site work flows on the Grid.

Main Dish

© Keith G Jeffery


• Edutain@Grid (STREP) focuses on the development of real-time on-line interactive applications, aiming at reducing the development and hosting costs, fostering business and societal uptake of the Grid. Applications in on-line gaming and e-learning will be used for validation.

• g-Eclipse (STREP) aims to provide an integrated environment for Grid users, operators and developers on top of the Eclipse framework, and to allow for easy adaptation by new Grid applications.

• Grid4All (STREP) will bring Grid computing to millions of users beyond the academic and industrial communities. It combines elements of peer-to-peer and Grid technologies in an open Grid middleware framework. Secure peer-to-peer techniques will be used to federate large numbers of small-scale resources into large-scale Grids. The proposal addresses the areas of autonomic software, Grid economics, and semantics.

• GridCOMP (STREP) aims to develop a standard and domain-independent Grid component platform for developing efficient Grid applications, supporting dependability and security. Non-functional aspects will be covered that allow components to be seamlessly executed with minimal programmer intervention, thus implementing the invisible Grid concept.

Main Dish

© Keith G Jeffery


• Nessi-Grid (SSA) supports the NESSI European Technology Platform, a European Industry Initiative that covers the areas of Grids and Service Oriented Architectures (SOA).

• DEGREE (SSA) is focused on Grid applications in the Earth Sciences domain. It seeks to support both Grid research and take-up through technical surveys, requirement analysis, and white papers.

• CHALLENGERS (SSA) will create a consolidated vision for Grid technologies for the coming decade and develop a research agenda and a roadmap of key technology challenges in this area. Business, economic and societal impact, as well as the convergence with other technology areas will be assessed.

Main Dish

© Keith G Jeffery


• NGG3 • September 2005 - January 2006 • Much increased participation from industry

(NESSI ETP)• Draft report to EC DG INFSO F2 in December for

EC internal discussions on FP7• Final Report in January 2006• Key messages

– GRIDs environment layering too complex– Use SOKU

• Service Oriented Knowledge Utility

Main Dish

© Keith G Jeffery


• NGG3• SOKU Concept

– dynamically composed utility environment• SOKU components

– Grid/Web services with attitude• Semantic metadata self-description

allowing self-organising, self-composing– like an OO class with attitude– like a KE Frame with attitude– like a (rather elaborate) function signature

Main Dish

© Keith G Jeffery


• Ongoing Work: Strategic Direction

– A subset of NGG expert group formed the CHALLENGERS SSA

• Ongoing Work: International

– Grid@Asia

• Ongoing Work: Training

– Fellowships eg CoreGRID

– Workshops especially in SSAs

Main Dish

© Keith G Jeffery


Dessert• Conclusion

• NGG1 brought together academic visionaries in GRIDs with two from industry to converge a European vision based on general purpose environment (not only linked supercomputers)

invisible GRID Call 2 projects

• NGG2 brought more from industry and a realisation that needed more middleware and foundationware

self-* invisible GRID Call 5 projects

• NGG3 had major industry influence (NESSI) and emphasised semantically-enhanced self-* invisible GRID

SOKU ?FP7 projects?

Keith G Jeffery

Director, IT & International Strategy

Prof. Keith G JefferyDirector, IT and International Strategy

CCLRC Rutherford Appleton Laboratory

[email protected]

keith g jeffery director, it & international strategy ngg next generation grids vision

Documents