presentation talk

Upload: jd300

Post on 09-Apr-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/8/2019 Presentation Talk

    1/62

    128th Nov 2003 GRID COMPUTING

    GRID Computing: On the path

    to utility computing

    -Dr. Srinivas Padmanabhuni

    SETLabs

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    2/62

    228th Nov 2003 GRID COMPUTING

    Agenda

    Why GRID?

    What is GRID?

    Where GRID applies? How is GRID constructed?

    OGSA = Standards based GRID

    Conclusions and Call For Action

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    3/62

    328th Nov 2003 GRID COMPUTING

    Why GRID?

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    4/62

    428th Nov 2003 GRID COMPUTING

    Todays IT architecture is complex and

    unmanageable

    access tier

    web tier

    application tier

    database tier

    edge routers

    routingswitches

    authentication, DNS,

    intrusion detect, VPNweb cache

    1st level firewall

    2nd level firewall

    load balancingswitches

    webservers

    web page storage(NAS)

    databaseSQL servers

    storage areanetwork(SAN)

    applicationservers

    files(NAS)

    switches

    switches

    internet

    internetinternet

    internet

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    5/62

    528th Nov 2003 GRID COMPUTING

    Moores Law for Computing Speed..

    Source: IntelSource: Intel

    0.10.1

    11

    1010

    100100

    1,0001,000

    10,00010,000

    19701970 19801980 19901990 20002000 20102010

    MHzMHz

    Pentium 4 ProcessorPentium 4 Processor

    Pentium III ProcessorPentium III ProcessorPentium II ProcessorPentium II Processor

    Pentium ProcessorPentium Processor486 Processor486 Processor

    386 Processor386 Processor286286

    80868086

    80858085

    80808080

    40044004

    10 GHz by 201010 GHz by 2010

    http://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    6/62

    628th Nov 2003 GRID COMPUTING

    Network is growing even faster

    Network vs. computer performanceComputer speed doubles every 18 months

    Network speed doubles every 9 months

    Difference = order of magnitude per 5 years

    1986 to 2000

    Computers: x 500

    Networks: x 340,000

    2001 to 2010Computers: x 60

    Networks: x 4000

    Moores Law vs. storage improvements vs. optical improvements. Graph from Scientific American

    (Jan-2001) by Cleo Vilett, source Vined Khoslan, Kleiner, Caufield and Perkins.

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    7/62728th Nov 2003 GRID COMPUTING

    Putting together network and computing

    speed rates of growth..1,000,000,000,000

    100,000,000,000

    1970

    Moore/

    Transistors

    Gilder/

    Bandwidth

    Metcalf/

    Network

    Nodes

    10,000,000,000

    1,000,000,000

    100,000,000

    10,000,000

    1,000,000100,000

    10,000

    1,000

    100

    10

    11975 1980 1985 1990 1995 2000 2005 2010

    2,300 6,000 29,000 275,000 1.2 mil 5.5 mil 42 mil 252 mil 1.344 bil

    50 50 56 1,544 45,000 145,000 10 mil 2.43 bil 200.49 bi l

    4 111 200 10,000 300,000 1 mil 140 mil 3.5 bil 300 bil

    Moores Law. Transistors on a single chip

    doubles approximately every1824 months.

    Gilders Law.

    Aggregate bandwidth triplesapproximately every year.

    Metcalfes Law. The value of a network may

    grow exponentially with thenumber of participants.

    Source: Cambridge Energy Resource Associates10616-17

    http://192.168.206.10/home.asphttp://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    8/62828th Nov 2003 GRID COMPUTING

    Low Infrastructure Utilization in todays IT

    architecture..

    24-hourPeriodUtilization

    Prime-shiftUtilization

    Peak-hour

    Utilization

    52%N/AN/AStorage

    2-5%5-10%30%Intel-

    based

  • 8/8/2019 Presentation Talk

    9/62928th Nov 2003 GRID COMPUTING

    To summarize

    Moores law improvements in computing produce highlyfunctional end-systems

    The Internet and burgeoning wired and wireless provideuniversal connectivity

    Collaborative modes of working and problem solvingemphasize teamwork, computation Network exponentials produce dramatic changes in

    geometry and geography Standards for application to application communication

    getting universal acceptance Pressure on effective utilization of resources inenterprises due to current low utilization rates..

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    10/621028th Nov 2003 GRID COMPUTING

    Enter on-demand computing and

    related concepts On-Demand Computing: A conglomerate of multiple concepts

    to enable respond to elastic computing demand using inelastic computingresources IBM calls it e-business On-Demand, Sun calls it N1, HP calls it adaptive

    management, Microsoft calls it the Dynamic Systems Initiative

    Utility Computing: Computing Resources made available (likeelectricity etc.) as needed, and charged on usage Autonomic Computing: A self-managing computing model

    where computing resources are controlled without human intervention,includes self-healing, self-protecting, self-optimizing, and self-configuringfeatures.

    GRID Computing: Pooling of multiple resources coordinated toappear as a single virtual resource to the external world

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    11/621128th Nov 2003 GRID COMPUTING

    What is GRID?

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    12/621228th Nov 2003 GRID COMPUTING

    The pigeons showed that..

    Unity is Strength

    A story first...

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    13/621328th Nov 2003 GRID COMPUTING

    Defining GRID..

    "A computational grid is a hardware and software

    infrastructure that provides dependable, consistent,

    pervasive, and inexpensive access to high-end

    computational capabilities.-The Grid: Blueprint for a New Computing Infrastructure; Morgan

    Kaufmann; San Francisco; 1999

    Flexible, secure, coordinated resource sharing

    among dynamic collections (VOs) of individuals,institutions, and resources

    -The Anatomy of the Grid: Enabling Scalable Virtual Organizations

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    14/621428th Nov 2003 GRID COMPUTING

    What constitutes GRID?

    Coordination of resources that are not subject tocentralized control

    Heterogeneous mix of resources

    Loosely Coupled connections ..

    Flexible and Dynamic Collection.. Usage of standard, open, general-purpose protocols

    and interfaces

    Virtualization of resources to create VOs..

    Non-Trivial quality of service Resources may be processors, computers, clusters,

    data, databases, scientific instruments, displays, etc..

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    15/621528th Nov 2003 GRID COMPUTING

    What is not a GRID?

    A cluster of homogeneous machines..

    A network attached storage device..

    A standalone scientific instrument..

    A huge standalone supercomputer..

    A Massively Parallel Processing computer.. A multi-processor computer..

    A high-speed network..

    A homogeneous cluster of computers

    Each is an important component of a Grid,

    but by itself does not constitute a Grid

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    16/621628th Nov 2003 GRID COMPUTING

    A Picture of GRID

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    17/621728th Nov 2003 GRID COMPUTING

    History of the GRID

    1986 - First Connection Machine CM-1 1987 - First CM-2 1988 - Condor project begins 1990 - PVM project begins 1991 - WWW created by Tim Berners-Lee at CERN 1991 - UK JANet goes IP 1991 - nCUBE running Oracle PS achieves 1,037 Tps (2x mainframe

    speed, 0.05x cost) 1992 - CODINE project underway 1993 - First Cray T3D

    1993 Legion, a GRID Object model project launch 1994 - Nimrod project launched Jul 1996 - SETI@home launched 1997 - Globus under development 1997 - UNICORE project launch Mar 1997 - Condor deployed at NCSA 1997 - Entropia Inc founded to commercialise PC cycle scavenging

    Sep 1997 - Building a computational Grid workshop, ArgonneNational Lab

    Oct 1997 - SRB v1.0 released

    Jul 1998 - Foster/Kesselman: The GRID book Aug 1998 - Applied Meta Inc commercialises Legion Oct 1998 - Globus v1.0.0 released Jun 1999 - Grid Forum 1 Jan 2000 - UNICORE stage 2 launch Jul 2000 - SUN buys Gridware Inc Grid Engine Oct 2000 - NASA IPG prototype completed

    Jan 2001 - EU DataGrid project launch

    Mar 2001 - Global Grid Forum 1

    Jul 2001 - UK e-Science Programme launch

    Aug 2001 - US TeraGrid project launch

    Nov 2001 - GEANT, the pan-EU gigabit network,

    activated

    2002

    Dozens of application communities &projects in scientific and technical

    computing

    Major infrastructure deployments

    De facto standard technology: Globus

    ToolkitTM

    Growing industrial interest

    Global Grid Forum: ~1000 people,

    30+ countries Jan 2002 - OGSA announced

    Feb 2002 - OGSA-DAI project launch

    Jun 2002 - NEC Earth Simulator achieves

    35 Tflops

    2003

    Enterprise Attention around GRID

    GT3.0 based on OGSA released.

    Commercial Offerings from Vendors (IBMetc).

    http://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    18/621828th Nov 2003 GRID COMPUTING

    In summary..

    GRID technology refers to the enablingtechnology for creating a large and powerfulVIRTUAL ORGANIZATION out of a pool ofheterogeneous resources

    The connections are loosely coupled

    The resources are heterogeneous ranging fromcomputers to databases to instruments to

    networks Non-Trivial Quality of Service offered by the VO

    Composition of VO is dynamic and flexible

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    19/621928th Nov 2003 GRID COMPUTING

    Where GRID applies?

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    20/622028th Nov 2003 GRID COMPUTING

    What GRID computing can do..

    Improve Resource Utilization Exploit underutilized resources (CPU, storage)

    Improved load balancing

    Provide high computing power Simulate Parallel CPU capacity

    Pool Individual computing power

    Provide additional storage

    Pool individual storage units Provide additional bandwidth

    Pool bandwidth from multiple units

    Enhanced collaboration among multiple stakeholders Beyond the enterprise

    Over a geographical spread (e.g. Collaborative research)

    Enhanced access to other resources Software, Licenses, Equipment

    Reliability based on Software

    IT effectiveness Ease of management of IT infrastructure

    Ability to execute Parallelizable applications

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    21/62

    2128th Nov 2003 GRID COMPUTING

    Domains where GRID can be

    applied Scientific Domain

    GriPhyN (US Grid Physics Network for Data-intensiveScience) for Elementary particle physics, gravitationalwave astronomy, optical astronomy (digital sky survey)

    DataGrid (led by CERN) for Analysis of data fromscientific exploration

    Financial Domain Analytics (Risk Analysis and Modeling)

    Portfolio Rebalancing

    Treasury and Federal Banking

    Life Sciences and Pharma Data Mining for Bioinformatics

    Drug Discovery

    Corporate Applications Business Intelligence

    IT Effectiveness

    Digital Content Distribution

    Automotive Collaborative Design Combat Systems Design

    Stealth Design of defense systems

    Government Tax Processing Census applications Online Processing

    Atmospheric Science Imagery and Geo-Spatial

    Intelligence Weather /Ocean Forecasting

    Defense and Security Nuclear weapons advanced

    simulation and modeling Threat Analysis Cryptanalysis

    Weapons Performance Analysis Economics

    Econometric modeling

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    22/62

    2228th Nov 2003 GRID COMPUTING

    A typical use case for data mining

    in Bio-Informatics

    MiningResource Bio Data Base 1

    StorageResource

    Bio Data Base 2

    Bio-M

    iningApplicatio

    n

    Request for a

    data mining resource

    Request for a

    Transient storage

    resource

    Search Request

    Search RequestStore Intermediate Result

    Store Intermediate Result

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    23/62

    2328th Nov 2003 GRID COMPUTING

    How is GRID constructed?

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    24/62

    2428th Nov 2003 GRID COMPUTING

    Overall GRID Architecture

    Application

    Collective

    Resource

    Connectivity

    Fabric

    Application

    TransportInternet

    Link

    GRID

    Internet

    Source: The Anatomy of the GRID, Foster, Kesselman and Teucke

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    25/62

    2528th Nov 2003 GRID COMPUTING

    Fabric Layer

    Fabric layer: Provides the resources to which sharedaccess is mediated by Grid protocols.

    Example: computational resources, storage systems,catalogs, network resources, and sensors.

    Fabric components implement local, resourcespecific operations.

    Richer fabric functionality enables moresophisticated sharing operations.

    Sample resources: computational resources, storageresources, network resources, code repositories,catalogs.

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    26/62

    2628th Nov 2003 GRID COMPUTING

    Connectivity Layer

    Communicating easily and securely.

    Connectivity layer defines the corecommunication and authentication protocols

    required for grid-specific network functions. This enables the exchange of data betweenfabric layer resources.

    Support for this layer is drawn from TCP/IPs IP,

    TCL and DNS layers. Authentication solutions: single sign on, etc.

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    27/62

    2728th Nov 2003 GRID COMPUTING

    Resources Layer

    Resource layer defines protocols, APIs, and SDKs forsecure negotiations, initiation, monitoring control, accountingand payment of sharing operations on individual resources.

    Two protocols information protocol and managementprotocol define this layer.

    Information protocols are used to obtain the informationabout the structure and state of the resource, ex:configuration, current load and usage policy.

    Management protocols are used to negotiate access to theshared resource, specifying for example qos, advanced

    reservation, etc.

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    28/62

    2828th Nov 2003 GRID COMPUTING

    Collective Layer

    Coordinating multiple resources.

    Contains protocols and services that captureinteractions among a collection of resources.

    It supports a variety of sharing behaviors withoutplacing new requirements on the resources beingshared.

    Sample services: directory services, coallocation,brokering and scheduling services, data replicationservice, workload management services,collaboratory services.

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    29/62

    2928th Nov 2003 GRID COMPUTING

    Applications Layer

    These are user applications that operatewithin VO environment.

    Applications are constructed by calling upon

    services defined at any layer. Each of the layers are well defined using

    protocols, provide access to useful services.

    Well defined APIs also exist to work with these

    services.

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    30/62

    3028th Nov 2003 GRID COMPUTING

    Implementations

    Till date mostly proprietary

    implementations

    Globus (Open Source) Toolkit the most

    popular one

    OGSA (Open Grid Services Architecture),

    a move for open standards for grid

    Globus Toolkit 3.0 recently released

    OGSA compliant

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    31/62

    3128th Nov 2003 GRID COMPUTING

    User

    Userprocess #1

    Proxy

    Authenticate &create proxycredential

    GSI(Grid

    ecurityInfrastruc-

    ture)

    Gatekeeper(factory)

    Reliable

    remoteinvocation

    GRAM(Grid Resource Allocation & Management)

    Reporter(registry +discovery)

    Userprocess #2Proxy #2

    Create process Register

    Globus Toolkit 2.0 : Proprietary

    Implementation Grid protocols (GSI, GRAM, ) enable resource sharing within

    virtual orgs; toolkit provides reference implementation ( = Globus

    Toolkit services)

    q Protocols (and APIs) enable other tools and services

    for membership, discovery, data mgmt, workflow,

    Other service(e.g. GridFTP)

    Other GSI-authenticatedremote service

    requests

    GIIS: GridInformationIndex Server(discovery)

    MDS-2(Monitor./Discov. Svc.)

    Soft stateregistration;

    enquiry

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    http://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    32/62

    3228th Nov 2003 GRID COMPUTING

    OGSA = Standards for GRIDImplementations

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    33/62

    3328th Nov 2003 GRID COMPUTING

    Open Grid Services Architecture

    Based on Service oriented Architecture

    virtualize resources

    unify resources/services/information

    Leverages useful Web Services properties

    Standards for service description and discovery

    Leverage commercial efforts in Web Services

    Leverages existing grid systems properties

    Service Semantics

    Lifecycle management

    Reliability and Security models

    Resource Management Authorization etc.

    Provides a unifying architecture for computational Grids

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    34/62

    3428th Nov 2003 GRID COMPUTING

    Web Services A web service is a software application identified by a URI, whose interfaces and bindings are capable

    of being defined, described and discovered by XML artifacts. A web service supports direct interaction

    with other software agents using XML based messages exchanged via internet based protocols Source:WS Architecture Working Group W3C

    Web Services are software applications based on openstandards. These applications can be :

    Published,

    Searched,

    Located, and

    Invoked by other applications on internet/intranet/extranet

    Strict adherence to standards makes it easy for one

    application to talk to another

    XML is the lingua-franca of communication

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    35/62

    3528th Nov 2003 GRID COMPUTING

    OGSA is an implementation of a Service Oriented

    Architecture (SOA)

    Service Providers

    Provide service functionality which is

    published by the Service discovery agency

    Discovery Agency

    Maintain a registry of services, their interface

    descriptions, provider information and

    invocation methods

    Service Requestors

    Locate required service from the services

    published by the Discovery agency, and get

    all the information for binding to the service

    from the agency

    SERVICE

    PROVIDER

    DISCOVERY

    AGENCY

    SERVICE

    REQUESTORFIND

    PUBLI

    SH

    BIND

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    36/62

    3628th Nov 2003 GRID COMPUTING

    The Open Grid Services

    Architecture

    Open Grid Services Infrastructure

    OGSA services: registry,

    authorization, monitoring, data

    access, management, etc., etc.

    TransportProtocolHosting EnvironmentHosting Environment

    Host. Env. & Protocol Bindings

    OGSAsche

    mas

    More specialized &

    domain-specific

    services

    Other

    schemas

    Web Services

    O G id S i A hit t

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    37/62

    3728th Nov 2003 GRID COMPUTING

    Web Services: Basic Functionality

    OGSA

    Open Grid Services Architecture

    - Detailed

    OGSI: Interface to Grid Infrastructure

    Applications in Problem Domain X

    Compute, Data & Storage Resources

    Distributed

    Application & Integration Technology for Problem Domain X

    Users in Problem Domain X

    Virtual Integration Architecture

    Generic Virtual Service Access and Integration Layer

    -

    Structured DataIntegration

    Structured Data Access

    Structured DataRelational XML Semi-structured

    Transformation

    Registry

    Job Submission

    Data Transport Resource Usage

    Banking

    Brokering Workflow

    Authorisation

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    38/62

    3828th Nov 2003 GRID COMPUTING

    Concepts in OGSA

    NamingGlobally & uniquely identify a grid service instance by a GSH (Grid Service Handler in the form ofa URI).

    GSH is a URI

    (http://192.168.0.1:8080/ogsa/services/base/multirft/MultiFileRFTFactoryService)

    Can be thought of as a network pointer to a grid service but does not provide enough information to

    access a grid service.

    GSH needs to be resolved to a GSR in order to access a grid service instance.

    GSR is A temporal, binding specific end-point that provide access to a grid service instance.

    GSR is a WSDL document that describe how to reach a grid service instance

    Factories

    Create new grid service instances and maintain a group of service data elements which can bequeried. A factory have a associated registry to keep track of instances and enable discovery.

    Instances

    Client communicate with Grid service instance via GSR (Grid Service Reference). GSH ismapped to the appropriate GSR via the registry.

    Stateful Web Services

    A grid service instance has a state.

    A run time view of Open Grid Services

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    39/62

    3928th Nov 2003 GRID COMPUTING

    Serviceregistry

    Servicerequestor

    (e.g. userapplication)

    Servicefactory

    CreateService

    Grid ServiceHandle

    Resourceallocation

    Serviceinstances

    RegisterService

    Servicediscovery

    Interactions standardized using WSDL

    Service dataKeep-alivesNotificationsServiceinvocation

    Authentication& authorizationare applied toall requests

    A run-time view of Open Grid Services

    Infrastructure (OGSI)

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    40/62

    4028th Nov 2003 GRID COMPUTING

    XML definition for a WSDL GSR

    XML definition for a GSH

  • 8/8/2019 Presentation Talk

    41/62

    4128th Nov 2003 GRID COMPUTING

    WSDL: Recap Data Types

    Endpoint

    HTTP Binding

    Abstract Interface

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    42/62

    4228th Nov 2003 GRID COMPUTING

    GWSDL: Differences and Example

    Differences

    Interface InheritanceAbility to describe additional information elements with interface definitions

    serviceData special elements for life cycle (can be static or dynamic)Typical attributes: goodFrom, goodUntil, availableUntil

    Example:

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    43/62

    4328th Nov 2003 GRID COMPUTING

    OGSI Grid Service Behavior portTypesPortType Name Interface Description

    and OperationsService Data elements

    defined by this

    portType

    Default service data(static) values

    GridService (required) All Grid services implementsthis interface andprovides theseoperations andbehaviors. OperationsfindServiceDatasetServiceData

    requestTerminationTimeAfterrequestTerminationTimeBeforedestroy

    InterfacesserviceDataNamefactoryLocatorGridServiceHandleGridServiceRefrencefindServiceDataExtensibility

    setServiceDataExtensibilityterminationTime

    Factory (optional) To create a new Grid service.

    Operations1.createService

    1.createServiceExtensibility None

    HandleResolver (optional) A service providedmechanism to resolve aGSH to a GSROperations1.FindByHandle

    handleResolverScheme None

    G idS i tT

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    44/62

    4428th Nov 2003 GRID COMPUTING

    GridService portType

    Operations

    Operation Description

    findServiceData Query information about the Gridservice instance

    setServiceData Modify service data values

    requestTerminationAfter Specify earliest desiredtermination time

    requestTerminationBefore Specify latest desired terminationtime

    destroy Terminate Grid service instance

    http://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    45/62

    4528th Nov 2003 GRID COMPUTING

    OGSI Grid Service Notification portTypes

    PortType Name Interface Description

    and Operations

    Service Data elements

    defined by thisportType

    Default service data

    (static) values

    NotificationSource (optional) This enables a client tosubscribe for notificationbased on a service datavalue change.Operations1.subscribe

    notifiableServiceDataNamesubscribeExtensibility

    NotificationSink (optional) Implementing this interfaceenables a Grid serviceinstance to receivenotification messagesbased on a subscription.Operations1.deliverNotification

    None None

    NotificationSubscription(optional)

    Calling a subscription of aNotification Sourceresults in the creation ofa subscription Gridservice.OperationsNone defined

    subscriptionExpressionsinkLocator

    None

    OGS G S G

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    46/62

    4628th Nov 2003 GRID COMPUTING

    OGSI Grid Service Grouping

    BehaviorPortType Name Interface Description

    and OperationsService Data elements

    defined by thisportType

    Default service data(static) values

    ServiceGroup (optional) An abstract interface to represent agrouping of zero or moreservices. This interface extendsthe GridService portType.OperationsNone defined but can useoperations defined in GridService

    portType.

    MembershipContentRuleentry

    None

    ServiceGroupRegistration (optional) This interface extends the ServiceGroupinterface and provides operationsto manage a ServiceGroupincluding adding/delete a serviceto/from a group.Operationsaddremove

    addExtensibilityremoveExtensibility

    ServiceGroupEntry (optional) This is a representation of an individualentry of a ServiceGroup and iscreated onServiceGroupRegistration "add".Each entry contains a servicelocator to a member Grid serviceand information about themember service as defined bythe Service group membershiprule (content).Operations

    None defined

    memberServiceLocatorcontent

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    47/62

    4728th Nov 2003 GRID COMPUTING

    A DBaccess Grid service will support at least twoportTypes

    GridService

    DBaccess

    Each has service data GridService: basic introspection information, lifetime,

    DBaccess: database type, query languages supported,

    current load, ,

    Maybe other portTypes as well

    E.g., NotificationSource

    GridService DBaccess

    DB info

    Name, lifetime, etc.

    Example:

    Use Case Revisited: Database Service for BioInformatics

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    48/62

    4828th Nov 2003 GRID COMPUTING

    Transient Database Service

    GridService

    DBaccessFactory

    Factory info

    Instance name, etc.

    GridService Registration

    Registry info

    Instance name, etc.

    GridService DBaccess

    DB info

    Name, lifetime, etc.

    GridService

    DBaccess

    DB info

    Name, lifetime, etc.

    What servicescan you create?

    What databaseservices exist?

    Create a databaseservice

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    E l

    http://192.168.206.10/home.asphttp://192.168.206.10/home.asphttp://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    49/62

    4928th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    I want to createa personal database

    containing data one.coli metabolism

    .

    .

    .

    Database

    Factory

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    E l

    http://192.168.206.10/home.asphttp://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    50/62

    5028th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Find me a datamining service, andsomewhere to store

    data

    Database

    Factory

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    E l

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    51/62

    5128th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    GSHs for Miningand Databasefactories

    Database

    Factory

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    E l

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    52/62

    5228th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Create a data miningservice with initial

    lifetime 10

    Create adatabase with initiallifetime 1000

    Database

    Factory

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    E l

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    53/62

    5328th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    Database

    Factory

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Database

    Miner

    Create a data miningservice with initial

    lifetime 10

    Create adatabase with initial

    lifetime 1000

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    E ample

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    54/62

    5428th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    Database

    Factory

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Database

    Miner

    Query

    Query

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    Example:

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    55/62

    5528th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    Database

    Factory

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Database

    Miner

    Query

    Query

    Keepalive

    Keepalive

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    Example:

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    56/62

    5628th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    Database

    Factory

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Database

    MinerKeepalive

    KeepaliveResults

    Results

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    Example:

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    57/62

    5728th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    Database

    Factory

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Database

    Miner

    Keepalive

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    Example:

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    58/62

    5828th Nov 2003 GRID COMPUTING

    Example:

    Data Mining for Bioinformatics

    UserApplication

    BioDB n

    Storage Service Provider

    Database

    Factory

    MiningFactory

    CommunityRegistry

    DatabaseService

    BioDB 1

    DatabaseService

    .

    .

    .

    Compute Service Provider

    .

    .

    .

    Database

    Keepalive

    Source: Grid Services and Web Services Tutorial: GlobusWorld 2003

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    59/62

    5928th Nov 2003 GRID COMPUTING

    Conclusionsand

    Call For Action

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    60/62

    6028th Nov 2003 GRID COMPUTING

    Conclusions

    GRID is based on idea of virtualization of a pool ofheterogeneous resources into one scalable virtualorganization

    GRID provides enhanced throughput, resource

    utilization, non-trivial QoS, leveraging heterogeneousresources

    GRID is suitable for computationally intensive and otherresource intensive works across multiple verticals

    GRID computing is REAL today and businesses are

    leveraging GRID OGSA, the standard for GRID, based on web services

    will be mainstream and will enhance penetration of GRID

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    61/62

    6128th Nov 2003 GRID COMPUTING

    Call for Action

    Read about GRID..

    Download GLOBUS Toolkit 3.0..

    Identify potential application areas of Pilot

    for GRID

    Run Pilot GRIDs with a dedicated set of

    services for focused problems

    Build Solutions and Take to Clients..

    GRID COMPUTING IS REAL TODAY

    http://192.168.206.10/home.asp
  • 8/8/2019 Presentation Talk

    62/62

    THANKS

    http://192.168.206.10/home.asp