workflow on the grids surface
DESCRIPTION
Workflow on the GRIDs surface. GRIDs ‘surface’ provides Computational capabilities of GRID Information presentation capabilities of WWW Information management capabilities But not yet environment for workflow. Knowledge Layer. Information Layer. Data to Knowledge. Control. - PowerPoint PPT PresentationTRANSCRIPT
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 1
Workflow on the GRIDs surface
• GRIDs ‘surface’ provides – Computational capabilities of GRID– Information presentation capabilities
of WWW– Information management capabilities
• But not yet environment for workflow
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 2
The GRIDs Architecture
Knowledge Layer
Information Layer
Computation / Data LayerDat
a to
Kno
wle
dge
Control
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 3
The GRIDs Architecture
Dat
a to
Kno
wle
dge
Control
Par
ticl
e P
hysi
cs A
ppli
cati
on
Gen
omic
s A
ppli
cati
on
Env
iron
men
tal A
ppli
cati
on
E-B
usin
ess
App
lica
tion
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 4
A POSSIBLE ARCHITECTURE
U:USER
S:SOURCE R:RESOURCE
Rm:ResourceMetadata
Ra:ResourceAgent
Ua:User Agent
Um:User Metadata
Sm:SourceMetadata
Sa:Source Agent brokers
The GRIDs Environment
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 5
A Brief History of GRIDs
• 1G: custom-made architecture machines to user– Pioneering metacomputing
• 2G: proprietary standards and interfaces– I-WAY GLOBUS, UNICORE, CONDOR, LEGION
AVAKI
• 2.5G: added in FTP, SRB, LDAP, AccessGRID• 3G: adopted W3C concepts for open interfaces –
OGSA / OGSI: note especially OGSA/DAI– But built on 2.G foundations
e-ScienceApps
e-ScienceR&D
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 6
But…..
• This comes nowhere near the requirements as originally defined for GRIDs
• Too low-level (programmer not end-user level)– Insufficient representativity– Insufficient expressivity– Insufficient resilience– Insufficient dynamic flexibility
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 7
Services: Challenges 1
DescriptionLocationRequirements
matchingComposingUtilising
metadata
Functional Program
Code(to deliver the service)
Service description(descriptive metadata)
InputParameterdefinitions
OutputParameterdefinitions
Restrictions on use of service(restrictive metadata)
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 8
Services: Challenges 2
Composition End-to-end FR
satisfaction End-to-end NFRs
satisfaction Avoiding emergent
properties Conditions of use of
services Processes wrapped with data wrapped with
processing, storage etc wrapped with real
estate wrapped with staff
MultipleInstancesParallelexecution
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009 9
e-,i-,k-infrastructure
serverserver server server
detectors
e-
i-
k- Deduction & induction – human or machine
Physical
Information
Systems
server
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
10
Middleware – and as SOKUs
e-
i-
k-
Lower middleware(hides physical heterogeneity)
Upper middleware(hides syntactic heterogeneity)
K- upper middleware(resolves semantic heterogeneity)
K- lower middleware(presents declared semantics)
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
11
Workflow on the GRIDs Surface
• Nirvana is– GRIDs ‘surface’
• Providing computation, information presentation and information management
– Plus Self* resilience– Plus capabilities to support workflow
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
12
Overall : The Way Forward
SCIENTIFIC DATASETS
Data
Information
Knowledge
PUBLICATIONS
Data
Information
Knowledge
CRIS
Management of Research
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
13
PUBLICATIONS
Data
Information
Knowledge
Overall : The Way Forward
Digital Curation Facility
SCIENTIFIC DATASETS
Data
Information
Knowledge
CRIS
Management of ResearchCDR
(CERIF)
Portal with knowledge-assisted user interface
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
14
Overall : The Way Forward
Digital Curation Facility
SCIENTIFIC DATASETS
Data
Information
Knowledge
PUBLICATIONS
Data
Information
Knowledge metadata
Portal with knowledge-assisted user interface
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
15
Overall : The Way Forward
Digital Curation Facility
SCIENTIFIC DATASETS
Data
Information
Knowledge
PUBLICATIONS
Data
Information
Knowledge metadata
publish
validate
Portal with knowledge-assisted user interface
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
16
Overall : The Way Forward
Digital Curation Facility
SCIENTIFIC DATASETS
Data
Information
Knowledge
PUBLICATIONS
Data
Information
Knowledge metadata
publish
validate
GRIDs
Portal with knowledge-assisted user interface
Ambient, Pervasive Access
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
17
Overall : The Way Forward
Portal with knowledge-assisted user interface
Digital Curation Facility
SCIENTIFIC DATASETS
Data
Information
Knowledge
PUBLICATIONS
Data
Information
Knowledge metadata
publish
validate
GRIDs
Ambient, Pervasive Access
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
18
Overall : The Way Forward
Portal with knowledge-assisted user interface
Digital Curation Facility
SCIENTIFIC DATASETS
Data
Information
Knowledge
PUBLICATIONS
Data
Information
Knowledge metadata
publish
validate
GRIDs
Ambient, Pervasive Access
©euroCRIS/Keith G Jeffery CRIS: Stakeholders, Benefits, History, Process, Architecture
20081009
19
Overall : The Way Forward
Portal with knowledge-assisted user interface
Digital Curation Facility
SCIENTIFIC DATASETS
Data
Information
Knowledge
PUBLICATIONS
Data
Information
Knowledge metadata
publish
validate
GRIDs
Ambient, Pervasive Access