The NextGRID Architecture
Guy LonsdaleC&C Research Laboratories, NEC Europe Ltd.
The financial support of the European Commission is gratefully acknowledged. Material in this presentation reflects only the author’s views and the Commission is not liable for any use that may be made of the information contained herein.
OGFOGF--20, 20, ““Grid Means BusinessGrid Means Business””, Collaborative Grids Session , 9.5.07, Collaborative Grids Session , 9.5.07
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
2
Presentation Overview
Intro to the NextGRID projectSummary of Key Architectural FeaturesExamples of use/impact in NextGRID application experiments
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
3
The Grid “Today”Is a huge success for both business and scienceSignificant business adoption of cluster Grids -“mature technology” – Merrill LynchBut we see different facets
The scientific community has embraced collaboration and new applicationsThe business community has embraced resource management and provision
Since 2002 the research community has been working on combining the above…
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
4
Grid Research Vision
Grid serviceproviders Grid
offering services
Transparent and reliable Persistent, pervasive and ubiquitous
Open to wide user & provider communitiesSecure, with trust across multiple domains
Easy to use, configure and managePerson-centric yet Scalable
Standards based
Next Generation Grid Experts group: ftp://ftp.cordis.lu/pub/ist/docs/ngg_eg_final.pdf
European citizens
Private sectorPublic sector
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
5
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
6
Tomorrow’s (Next)GRIDNextGRID focuses on Grid for businessVision is of future Grids:
that are economically viable;in which new and existing business models are possible;in which development, deployment and maintenance are easy; andin which the provisions for security and privacy give confidence to businesses, consumers and the general public.
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
7
Creating the next generation GridNextGRID Project Cycles
conceptualisationdesignexperimentationanalysis
Design
Analysis
Conceptualisation
Experimentation
Identification of Fundamental Requirements NextGRID architectural principles
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
8
Requirements – Architectural PrinciplesFlexible Business ModelsSpecific Quality of Service Terms
Open to extension, flexible and able to allow business relationship management
Dynamic SecurityComms & operational security + dynamically changing trust relationships.
Dynamic Compositionlate in the service provisioning lifecycle, linked to dynamic security
Economic SustainabilityPrivacyFacilitated Management
semi-automatic and at minimal cost, integration with business infrastructure
Interactive Supportimpacting both the service level agreements & basic infrastructure
Primary PrinciplesSLA-Driven DynamicsDynamic FederationMinimal Grid Infrastructure:
Balancing simplicity with sufficient features to support viable business models
Secondary PrinciplesDynamic Service LifetimeDynamic Content Support
Service content able to evolve during service lifetime
ManageabilityAutonomously, encompassing large-scale Grids
DiscoveryOpen Design and Development Process:
Interoperable Grids, subject to some commonalities of design.
For further details – NextGRID White Paper
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
9
Presenting/representing the ArchitectureNextGRID is a Service Oriented Architecture
Some NextGRID Approaches
NextGRID ServiceNextGRID Service
SLA
SLA
SLA
SLA
SLA
SLA?
SLA SLA
NextGRID ServiceNextGRID Service
SLA
SLA
SLA
SLA
SLA
SLA?
SLA SLA
service provider
service
UserSLA
ConfigurationPolicy
MonitoringPolicy
EventEvent
Business layer
Technology layer
service provider
service
UserSLA
ConfigurationPolicy
MonitoringPolicy
EventEvent
Business layer
Technology layer
Highly CompositionalAll the pieces are not needed all the timeThe interactions are not (statically) defined
Flat Rather than Hierarchal
Encapsulation rather than layering
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
10
Enabling Dynamics: SLAs
service provider
service
SLA
Business layer
Technology layer
service provider
service
SLA
Business layer
Technology layer
service provider
service
SLA
Business layer
Technology layer
BusinessContext
ServiceContext
SystemsContext
ApplicationsContext
Produ
ct an
d ser
vice
deve
lopmen
t
Negoti
ation
and
sales
Imple
mentat
ion
Execu
tion
Asses
smen
t
Decom
mission
Continuous Feedback
TerminateMonitorSurveillanceMaintain, Bill
Take ordersProvision
NegotiateIndividualcontracts
DevelopTemplates,Parametricboundaries
Reassess
Produ
ct an
d ser
vice
deve
lopmen
t
Negoti
ation
and
sales
Imple
mentat
ion
Execu
tion
Asses
smen
t
Decom
mission
Continuous Feedback
TerminateMonitorSurveillanceMaintain, Bill
Take ordersProvision
NegotiateIndividualcontracts
DevelopTemplates,Parametricboundaries
Reassess
Produ
ct an
d ser
vice
deve
lopmen
t
Negoti
ation
and
sales
Imple
mentat
ion
Execu
tion
Asses
smen
t
Decom
mission
Continuous FeedbackContinuous Feedback
TerminateMonitorSurveillanceMaintain, Bill
Take ordersProvision
NegotiateIndividualcontracts
DevelopTemplates,Parametricboundaries
Reassess
Bi-partite SLAs: Key NextGRID Innovation – supports the full service provisioning lifecycle
Corner Stone of the Architecture
Evolution of existing SLA structures
More Collaborative
in Nature
Linked to high level business goals
Key business and market enabler
Bi-partite SLAs
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
12
Negotiation Example
<discover><publish>
SLAT<id>NGE1SLAT</id>
NGE<id>1</id><requirements><capabilities>
NGE<id>2</id><requirements><capabilities>
SLA<id>NGE1SLA</id>
Fn<id>NGE1Fn</id>
<instantiate>
SLA<id>NGE2SLA</id>
Fn<id>NGE2Fn</id>
<instantiate>
offer(SLA)
accept(SLA)
NGE<id>1</id><requirements><capabilities>
NextGRIDEntity
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
13
Business Value: Dual UseManagement Efficiency
Improved Data Center AutomationFrequent management functions can be automated more easily through SLA driven dynamics
Greater Flexibility in Deploying ResourcesUnderutilized resources are easily detected
New Business ModelsPersistent “On Demand” Services
With SLA managed QoS
Dynamic, Distributed, Transient PartnershipsThrough integration of dynamic security and SLAs.
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
14
Architectural components
Dynamic Orchestrators(discovery, workflow, invocation, etc)
ManagementSystemsand SLAs
Data-centricFunctionalSystems
DynamicTrust andSecurity
Base standards (http, wsdl, soap, naming,notification, addressing, policy, security…)
Defines services provided over
bipartite relationships
Allows composed services to deliver
business value
Allows consistent description and
management of all applications
Protects services and bipartite relationships
Provides basic facilities and
interoperability
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
15
Primary RelationshipsRegistry
Functional
SLAManagement
Trust andSecurity
Naming andAddressingOrchestration
Register Discover
Resolve
Mint
Administer policy
Monitor/Control
Get tokens
Negotiate SLA
Invoke
Get tokenassertions
Register /Discover
Get tokenassertions
Get tokenassertions
Get tokenassertions
Schemas
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
16
Key outputs
Grid Standards resulting from and
influenced by NextGRID
Generalised Specifications
Architectural Component
Designs
Software Components
Case Studies
Generalised Specifications
Download Generalised Specifications at: http://www.nextgrid.org
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
17
Generalized Specifications
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
18
Cookbook Example:Grid Virtual Infrastructure Model
<<component>>Prioritiser
<<component>>Discoverer
<<component>>Selector
<<component>>VIM Enactor
<<component>>Grounding
<<component>>VIM Enactor
<<component>>Grounding
<<component>>Application service
<<component>>QoS History
<<component>>VIM Enactor
<<component>>Grounding
<<component>>Security Token Service
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
19NextGRID Application Areas
Digital MediaDigital Media(DM)(DM)
FinancialFinancialApplications:Applications:
Supply Chain Management (SCM)Supply Chain Management (SCM)Electronic Data Record (EDR)Electronic Data Record (EDR)
ProcessingProcessing
Images provided by Dreamstime.com, SAP, Kino, GridSystems
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
20
Financial Applications: Implied VolatilityScenario A Financial Services Grid involving 4 parties:
Compute resource providerFinancial service providerFinancial data providerFinancial service customer
Objectives:orchestrate interactions between these partiesallow them to centrally register and discover resources.
Uniform method of describing numerousheterogeneous resourcesCommon interface allows parties using different languages, tools, software to interact and simplifies the processSystem flexibility allowing new schemas and intermediaries to be added without affecting existing operation
Application Benefits
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
21
Financial Applications: Derivative PricingScenario
Pricing of complex optionsResults should be available within seconds or lessin order to
adapt prices, hedging strategies to market changesallow fast and reliable pricing of products tailored to the needs/demands of potential customers
Application Benefits & Experiment Feedback Viability of NextGRID-relevant security components & interoperability across Windows-Linux/OSS systems Secure data transfer: a necessary condition for use of external servicesA bank could dynamically manage and enforce who is able to access the service under which SLA.Feedback on handling security (token re-use) for interactivity
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
22
ScenarioCustomer with huge data sets to be processed under time-constraints (not possible locally)Data set published as a NextGRID secure service &service provider (for processing) sought.Service provider receives a job submission & URL of the customer data service.The service provider distributes jobs across machines, each to receive only subset for processing.
End to End data transmission highly improves scalability and performance.NextGRID provides a coherent set of specifications to manage security, trust, service discovery, SLA negotiation and QoS management (covers the whole “transaction” life-cycle).
Application Benefits
Electronic Data Record (EDR) Processing
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
23
ScenarioSupply Chain Management
Customer:Runs an SAP SCM solution & seeks to outsource Dialogue instances running on SAP WebAS.Seeks Provider offering hosting of Dialogue Instances while the business data remains at the customer site.Given an existing SLA, initiates the use of the service by sending application specific configuration data.
Provider:Offers hosting of Dialogue Instances & utilizes NextGRID Operational Mngmt Framework.Installs SAP binaries and the SAP Application Management Framework.SAP Dialogue Instances are deployed dynamically based on NextGRID
policies with a threshold on the mean response time of the system.
Dynamic management of Dialogue Instance will reduce TCO.Policy controlled management introduces high flexibility.Event driven operations of business applicationsSecurity
Application Benefits
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
24
ScenarioSelection of service providersfor a job submissionDecision supported byanalysis of QoE (Quality of Experience) datafrom previous job executions
Rating of the service providers
Rating of service providers based on QoE parametersDifferent/customized rating for each job typeEffective expenditure of consumer’s budget ( providers)Achieving higher QoS for the consumers
Digital Media Production
Application Benefits
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
25
The Grid of the futureService orientation brings collaborative Grids within reach of businessIn NextGRID we’ve focussed on
Flexible Business Models Specific QoS TermsDynamic Security Dynamic CompositionEconomic Sustainability PrivacyFacilitated Management Interactivity Support
Next steps are to create Service Oriented Knowledge Utilities - SOKUs
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
26
The Future
See http://www.cordis.europa.eu/ist/grids
Copyright © 2007 NEC Europe and other members of the NextGRID Consortium, www.nextgrid.org.
27
Acknowledgements
All NextGRID PartnersFor direct contributions to the presentation:
Applications teams at First Derivatives, GridSystems, KINO, NEC, NTUA, QUB,SAPPaul McKee (BT), Mark Parsons (epcc), Dave Snelling (Fujitsu Labs Europe)
The financial support of the European Commission is gratefully acknowledged. Material in this presentation reflects only the author’s views and the Commission is not liable for any use that may be made of the information contained herein.