service-oriented grid middleware hu chun-ming (on behalf of mr. huai jin-peng) beihang university...
TRANSCRIPT
Service-Oriented Grid Middleware
HU Chun-Ming (On behalf of Mr. HUAI Jin-Peng)Beihang University
CIAPR IV 2004Shanghai, P.R.China
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 2
Agenda
• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware
– Grid Middleware in China– NSFC: Network-based Research Environment
• Related Works in Beihang University– Beihang University: A Brief Introduction– Related Works in Beihang University
• What to Do Next?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 3
Opportunity of Grid Computing
openness dynamicdistributed
Geography DistributedLack of Centralized ControlHighly Autonomy
Open ProtocolsSystem and Apps :
Heterogeneitydiversity
Node : Connectivity
Provide new opportunity and challenge for information science technology
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 4
Evolvement of Internet-oriented Software
Host PC
Scope
NetworkApplication
WordProcessing
MathematicComputing
InternetApplication
Intranet
MainframeComputing
Client/Server
Client/Network
Internet
Evolvement of Computing Paradigm
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 5
Evolvement of Internet-oriented Software
compact loosecoupling
Scope
XML/HTTP
MOM
ORB
NetworkApps
HomogeneityApps
Program
Web Services
Services
Components
Objects
InternetApps
granularity/coupling
Evolvement of Access Methods
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 6
Past & Present:Contributions of Computing Technologies
• A New Approach to do Research– High Energy Physics– Earth Simulation– ……
• An Effective Manner to do Communication– E-Mail– FTP– WWW– ……– Help the R&D Cooperation by providing a convenient
Intercommunication Manner
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 7
Today’s R&D ActivitiesBrings New Requirements
• Collaboration in Wider Area:– Cross the boundary of Domain, Subject, Organization…– Share the Resource / Collaborate between Resources
Domain Typical Project Main Characteristic
high-energy physics
Long Experimental Period
High Volume of Experimental Data
Rapidly Aggregation and Sharing of Analysis result
Participation of scientists all over the world
Biologic
computing
Distributed storage of genic data
Diverse Data/Metadata Format
Dynamic Information
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 8
Summary
• So, It is necessary to give a better approach to:– SHARE the resource capacity in Wider Area.– COLLABORATE among more Resources to
solve “BIGGER” problems
– Give scientist a more EASY-TO-USE interface to help them using the environment with TRANSPARENCE.
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 9
Agenda
• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware
– Grid Middleware in China– NSFC: Network-based Research Environment
• Related Works in Beihang University– Beihang University: A Brief Introduction– Related Works in Beihang University
• What to Do Next?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 10
• In the past:– Computing capability: the only evaluation means
• In a network computing environment:– We need another dimension:
• SHARING & COLLABORATING Capability!
How to evaluate: the Value of Computing Technology to science research
Internet
VS
KFlops MFlops GFlops TFlops ComputingCapability
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 11
How to evaluate: the Value of Computing Technology to science research
Sharing and cooperatingcapability
Computing capability
intranet extranet internet
MFlops
GFlops
TFlops
– X: Sharing and cooperating capability
– Y: Computing capability
Internet
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 12
How to evaluate: the Value of Computing Technology to science research
Sharing and cooperating capability
Computing capability
intranet extranet internet
MFlops
GFlops
TFlops
Internet
Grid (for example, e-Science)
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 14
Grid Related Project
• Projects– PACI/DTF/EDTF
– Science Grid
– DoD GIG
– EU DataGrid
– UK e-Science
• Industry– CORBA,DCOM, J2EE, Web Services
– IBM: Business on Demand/Business Grid
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 15
Sharing & CollaborativeTwo Threads…
• Sharing of – Information:
• Enterprise Computing
• CORBA, COM, EJB.
– Computing Power:• Cluster, Metacomputing
• Computing Grid
• Key points!– Service-oriented
or Service-centric
– Middleware Network Computing
DistributedComputing
Distribute obj./component
CORBA DCOM Java/EJB
Web service
Service Oriented Computing
Parallel computingand
Distributed system
clusterMeta-computing
Computing grid
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 16
Conclusion
• 2 Threads are now merging…– Enterprise Computing – Grid Computing
• 2 Key Technology for Resource sharing and collaborating:– Service centered is an important technical trend
to construct large scale distributed system– Middleware is an important approach to bring
interoperation and integration to R&D resources
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 17
Knowledge GridData Grid
Conclusion
• Our points:– The GRID is an application pattern– The Web Services is a technical approach to realize the G
RID– Service Grid : Using Web Services (or other service-orie
nted framework, eg.Jini) to make resources capability sharing & collaborating in a WIDE AREA NETWORK such as Internet.
• xxGrid?
Service Grid (as Infrastructure)Abstraction; Registry; Broker
ComputationalGrid Information
Grid
BioGridVirtual
ObservatoryCampus Grid
OtherApp Grid
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 18
Agenda
• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware
– Grid Middleware in China– NSFC: Network-based Research Environment
• Related Works in Beihang University– Beihang University: A Brief Introduction– E-Science Related Works in Beihang University
• What to Do Next?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 19
Grid Middleware in China
• What’s Middleware– Middle of the Apps & Resources
• Grid Middleware– Including:
• Software (Application) Server
• Common Services/Basic Services
• Toolkits
• Programming & Application Models (?)
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 20
Grid Middleware in China
• NSFC– Network-based Science Research Environment (NSFC e-Science Pro
ject)• Ministry of Science and Technology
– National High-tech Project (863)• CAS: VEGA• NUTD: GridDAEN
• Ministry of Education– ChinaGrid CGSP
• Chinese Academy of Science– China Science Data Grid (SDG)
• Other Works– Campus Grid: Tsinghua University: TG, HUST: HauU– ……
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 21
Agenda
• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware
– Grid Middleware in China– NSFC: Network-based Research Environment
• Related Works in Beihang University– Beihang University: A Brief Introduction– E-Science Related Works in Beihang University
• What to Do Next?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 22
Essence of the Project
Application demand’s Set
D(Demand)
Resource’s Set
R(Resource)
T
Dynamic Mapping between Set D & RTo achieve MAX VALUE of the whole system
Max (Wd *∑ benefit (D) + Wr * ∑ usage (R) )
M:D R
Forecasting &
Optimizing
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 23
Essence of the Project
Application demand’s Set
D(Demand)
Resource’s Set
R(Resource)
T
Dynamic Mapping between Set D & RTo achieve MAX VALUE of the whole system
Max (Wd *∑ benefit (D) + Wr * ∑ usage (R) )
M:D R
Forecasting &
Optimizing
Treating Resources as services: Masking the heterogenous resourcesServices Composition: Cooperative work of resourcesService-Oriented Architecture : loose coupling, dynamic compositionMiddleware: Simplify the development, deployment and management of system
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 24
Testing Environment of NSFC E-Science Project
• Testing Environment – Testing bed
• Network + Physical Resources
– Testing Software Infrastructure• Runtime
• Common Services
• Toolkits & API
• Programming (Application) Model
– Testing Applications
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 25
Testing Environment ——Testing Software Infrastructure
• The basic idea of software platform – Resources encapsulation – Service share – Cooperative work
• Dynamic binding between application and resources
• Service Composition: describe the complex job.
The integrate experimentation platformbased network of science activity environment
high-energy physics
Biology computing
Atmosphere inspection ……
Computing resources
Storage resources
Instrument and equipment
Software resources ……
Service share
Resources encapsulation
Resources encapsulation
Resources encapsulation
Resources encapsulation
Service share Service share Service share
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 26
Testing Environment ——Testing Software Infrastructure
Resource Service Layer
Application Support Layer
User Supporting Layer
Security and
system Mngt.
Dev.Methods
& Tools
Applicationdevelopers
Platform managers
Computing resources
Storage resources
Instrument and equipment
Software resources ……
Resources encapsulation
Resources encapsulation
Resources encapsulation
Resources encapsulation
Scientists(End User)
high-energy physics
Biology computing
Atmosphere inspection ……
Service shareService share Service share Service share
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 27
Testing Software Infrastructure——9 Key Technologies
Platfo
rmA
rchitectu
re
Resources Encapsulation &Service Runtime Management
Res. Integrating
Mngt.(MDS.) Common Services
(for Resource Sharing)
Service Composition & Collaboration
User Supporting Tech.(GUI, Portal, Programming model) D
om
ain A
pp
s D
evelop
men
t Meth
od
s&
Tech
no
log
ies
Ma
na
ge
men
t
Se
curity
high-energy physics
Biology computing
Atmosphere inspection ……
Computing resources
Storage resources
Instrument and equipment
Softwareresources ……
guide assistant
support
compatible
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 28
Testing Software Infrastructure——3 Objectives
• Collaborate-able– Dynamic Relations between Resources– Multi-granularity Collaboration (Data, Service, Process
…)
• Manageable– Uniform Resource Abstraction– Management Architecture– Self-Orgnization, Self-Configration, Self-Optimization
• Trust-able– Trust Management: Policy based Access Control– Reliability: Fault-Detection, Fault-Tolerance, QoS Mngt.
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 29
Agenda
• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware
– Grid Middleware in China– NSFC: Network-based Research Environment
• Related Works in Beihang University– Beihang University: A Brief Introduction– E-Science Related Works in Beihang University
• What to Do Next?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 30
Beihang UniversityBeijing University of Aero. & Astro. (BUAA). Since 1952
• Founded in 1952, with Merger of the Aeronautical Departments of 8 Famous Universities, including Tsinghua University and Beiyang University.
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 31
Beihang UniversityBeijing University of Aero. & Astro. (BUAA). Since 1952
• 1952 BIA: Beijing Institute of Aeronautics• 1988 BUAA: Beijing University of Aeronautics & Astronautics• 2002 BUAA: Beihang University
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 32
Beihang UniversityBeijing University of Aero. & Astro. (BUAA). Since 1952
Now BUAA has evolved into a Multi-disciplined Research-oriented University of Science & Engineering with an emphasis on Aviation and Space Travel.
It is one of the important bases for educating and training High-Quality personnel and conducting scientific research in China.
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 33
Agenda
• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware
– Grid Middleware in China– NSFC: Network-based Research Environment
• Related Works in Beihang University– Beihang University: A Brief Introduction– Related Works in Beihang University
• What to Do Next?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 34
Related Works in BUAA
• Network Computing and Software– WebSASE: Web Service based Application S
upporting Environment– Grid middleware : Web Service based Gri
d System —WebSASE4G
• Domain-Oriented Software Production Platform - SoftProLine
• Information Security
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 35
Web service and Grid computing
• Web service– a novel middleware in application data and funct
ion sharing on Internet. – a business application pattern on Internet – provides description , index ,query, accessing, c
ommunication and interaction criterion through International standard open protocols ( i.e. UDDI 、 WSDL 、 SOAP and so on )
– widely adopted/supported by enterprises.
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 36
WebSASE: An Overview
• Supporting simple Web service and complicated Web service applications
Web service complicated application Pattern
•use MVC pattern for reference to construct application
•Deal with business logic by Web service recursion nesting
•Provides means to concentrated exhibition and customization the users’ view
Model/Instance
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 38
WebSASE4G: An Overview
• What is WebSASE4G?– A web service-oriented Grid application supporting Environment
(WebSASE for Grid)– WebSASE (Web Services-based Application Supporting Environment)
Web service-oriented middleware and software running supporting environment which unifies application deployment, running, monitor and management
• WebSASE4G’s characters– Web service technology abstract based and realized grid services
including resource services, common services and domain services. – Realized unified grid services’ publication, running and
management ,providing open grid service running environment– Constructing grid service basic architecture which supporting resource
services, common services and domain services’ running
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 39
WebSASE4G: Components Architecture
Heterogeneous resource
[5]
GridserviceSecuritycontrol
mechanism
[4]
DistributedManagement
andMonitor
mechanism
Grid service
Common
Supporting
platform
Grid Resource
Image process
Grid application
biology information
remoteeducation
Mass data hydrodynamics
[1] Grid service representing 、mutual operation mechanism
And grid service container
[2]Metadata
And DistributedInformation
Servicearchitecture
[6] service data storage and Effective trans-Mission mechanism
[7] Grid service exhibition and unified accessing mechanism
[3] Grid job schedule and coordination mechanism
…
Grid Service Server Resource integration and service control
Grid Service Workflow EngineService-oriented job description,
schedule and running
Grid Service PortalEnd-user oriented interaction
GISA
providingUnified
Services view
CA&
SOAPSecure
communication
AMC+
Plugins GSDesigner
auxiliarytoolkit
Java-based SOG-API
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 40
WebSASE4G resource (service) and service instances status monitor
Web-based job schedule and implement monitor
WebSASE4G is a service-oriented, OGSA-based computing Environment which provides necessary running platform and auxiliary development toolkits.
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 41
WebSASE4G kernel system
UDDI server
Visual composed serviceModeling toolkit
BHU WSDesignerSimplifies gridServices development
WebSASE4G is a service-oriented, OGSA-based Grid supporting Platform which provides necessary runningplatform and auxiliary development toolkits developed by BUAA.
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 42
Grid application Aero & Astro Digital Museum
airplane exhibit hall
Realization technology Museum entrance
Grid technology
Multimedia technology
virtual realism technology
Human-machine interaction technolo
gy
Database technology DB DBDB
Human-machineinteraction
Mechanism
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 43
Domain-oriented Software Production Platform
• Gap Between Requirement and SA– Requirement project: describing the problem an
d restriction - what is it? – Software architecture : providing the blue print
to problem solving - How ?
ProblemTransition and Coherent Evolution from Requir
ement Modeling to Software Architecture ?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 44
• Software stipulations model GOP– GOP establishs graceful mapping between formaliz
ed stipulations and software design ; • Soft-bus based Multi-Engine Coordination A
rchitecture– Matching from software architecture to component – A domain-oriented software production platform—S
oftProLine– “Zero Programming” under Domain Model
SoftProLine
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 45
Network Security
• Design and analysis for network security protocols
• Access Control of distributed systems
• Secure group communication
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 46
A novel cryptographic protocol algebra model is Proposed
• A new algebra theory is built for describing the run and security of protocols. • Attack acts and security properties of protocols are characterized with algebraic and logic techniques.
We built the rigorous mathematical basis and developed a new approach to the formal analysis of security protocols
Network Security Results of security protocols
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 47
Protocol Murφ Brutus Athena STA SPANSPK 1706 1208 36 - 5NSSK - - 68 - 32TMN - 3327 - - 5
S.Kerberos - 3405 - - 6Andrew RPC - - 47 - 7
NSLPK - 146 19 60 29ISO 3-Pass - - 12 - 5
The efficiency of ACT-SPA
An efficient automatic analysis system (ACT-SPA) is developed
Network Security System for security protocols
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 48
IntegrationOur Aims...
Security and U
ser Managem
ent
System platform
Web service & Grid service running supporting plat
Software resource
Web service CORBA EJBOther
components
Operationsystem
databaseBasic
service
Service compose and management
Running tools Service schedule
Software producing plat for domain (Softproline)
Tools for registry
and deploy
Description for
Requirements
tools for Software
Developing
→Perfect Running Environment+ Effective Software Development
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 49
Agenda
• Backgrounds• Grid Computing & Service Grid• Service-Oriented Grid Middleware
– Grid Middleware in China– NSFC: Network-based Research Environment
• Related Works in Beihang University– Beihang University: A Brief Introduction– Related Works in Beihang University
• What to Do Next?
May 21, 2004 HU Chun-ming: Service Oriented Grid Middleware 50
What to do next?
• Killer Applications over SOG– Large Scale Data Visualization?– E-Science for Scientists over China?– SDG?– IBM Business Grid?
• Yesterday: NGN = IP + QoS– What’s the “NGG” Job-oriented End-to-end Quality o
f Services In Service Grid• Physical Model for Service Computing
– Statistical Physical Model for Large Scale Network?– Behavior of Service Computing?
• SOA’s Rapid Develop Model & Method