03-keynotespeech-albunshaft(ibm).ppt
TRANSCRIPT
Grid Computing and
IBM’s On-Demand Strategy
Albert J. BunshaftVice PresidentGrid Sales and Business Development
“An enterprise whose business processes -- integrated end-to-end
across the company and with key partners, suppliers and customers
-- can respond with speed to any customer demand, market
opportunity or external threat” – Sam Palmisano, Oct 2002
Goal: On Demand Business
Responsive
Variable
Focused
Resilient
= Profit
Source: e-business Adoption Tracking Study, 1Q02
0%
20%
40%
60%
80%
100%
Total IT Market Co. Size 1,000+ IBM's Top 400 Cust.
On the Cusp of the On Demand Phase
Enterprise
Integration
AccessOn
Demand
Open standards-based, heterogeneous, integrated
and enabled with autonomic capabilities…
On Demand Operating Environment
Virtualized
Autonomic
Open
Integrated
Operating Environment RequirementsBusiness Attributes
Resilience around the world, around the clock
Focus on core competencies / what’s
differentiating
Variable cost structures
Responsive in real time
Computing Model Evolution
Mainframes“The Glass House”
Client-ServerPC’s / LAN’s
Network ComputingThe Internet
Gateway
Hub Server Group
Local
Director
Network
Business LogicPresentation
WebSphereApplication
Server
NetscapeEnterprise
Server WebSphereApplication
Server
JDBC
HTTP
MQ
ProfileCapture
DatabaseServers
SecurityGateways
DB2SecurityServers
MQMQ
ApplicationLogging
GatewayLogging
MQ MQ
SecurityClient
SNA
SNA
SNA
Back-endSystems
zSeries
ComplexIMSData
CICS
zSeries
SysplexIMSData
zSeries
SysplexIMSData
zSeries
SysplexIMSData
zSeries
TPF
Front-end for Web presence for financial services
Typical Financial Subsystem Configuration
Current IT EnvironmentDistributed, Heterogeneous, Complex
Gateway
Hub Server Group
Local
Director
Network
Business LogicPresentation
WebSphereApplication
Server
NetscapeEnterprise
Server WebSphereApplication
Server
JDBC
HTTP
MQ
ProfileCapture
DatabaseServers
SecurityGateways
DB2SecurityServers
MQMQ
ApplicationLogging
GatewayLogging
MQ MQ
SecurityClient
SNA
SNA
SNA
Back-endSystems
zSeries
ComplexIMSData
CICS
zSeries
SysplexIMSData
zSeries
SysplexIMSData
zSeries
SysplexIMSData
zSeries
TPF
Front-end for Web presence for financial services
Typical Financial Subsystem Configuration
Current IT EnvironmentDistributed, Heterogeneous, Complex
Complexity, TCO
Tech. Cost, Utilization
Server / Storage Utilization
52%N/AN/AStorage
2-5%5-10%30%Intel-based
<10%10-15%50-70%UNIX
60%70%85-100%Mainframes
24-hour Period Utilization
Prime-shift Utilization
Peak-hour Utilization
Source: IBM Scorpion White Paper: Simplifying the Corporate IT Infrastructure, 2000
Untapped Potential
Value is expressed relative to the ASCI White Supercomputer (12.3 Teraflops) *
* Cost of one ASCI White Supercomputer= $110M
Total Cost of Ownership
Integration32.0%
Hardware10.0%
Software12.0%
Personnel16.0%
Maintenance30.0%
IT Budgets
HardwareSoftwarePersonnelMaintenanceIntegration
32%
30%
Integration32.0%
Much More than Hardware and Software Costs
16%Personnel
16.0%
Traditional Computing
Processing
Operating System
Storage
I/O Data
Applications
Virtualized ComputingVirtual Computing Resources
Grid Computing
Storage
ApplicationsApplicationsProcessingProcessing
Operating System
DataData
I/O
Distributed Computing Over a Network, Using Open Standards to Enable Heterogeneous Operations
Grid Technology Enables
Increased Server UtilizationWorkload Management and ConsolidationReduced Cycle Times
Collaboration and Access to DataFederation of DataGlobal Distribution
Resilient / Highly Available InfrastructureBusiness ContinuityRecovery and Failover
Supporting Heterogeneous Resources Through Open Standards….
Increased Server Utilization
• Exploit distributed resources to provide capacity for high-demand applications
– Existing applications that cannot be run effectively on a single processor
– New large scale application that provide strategic business advantages
• Reduce infrastructure cost associated with over-provisioned resources
– Balance workload based on policies
– Optimize for cost or throughput
• Reduce the cost of manpower to manage and configure resources
– Fewer resources to manage for the same workload
Collaboration and Access to Data
• Enable collaboration across applications to integrate results
– Leverage Distributed Data and Resources
• Support large multi-disciplinary collaborations
– Link Business Processes
– Federation of Data
• Both within a single organization and between partners
– Exploit Replication Services Across Enterprises Simulation
PricingDesign
Design
Design Analytics
IBMIBMIBM
• Use distributed resources to balanceworkload– Scheduler manages job distribution– Failover and recovery leverage distributed
resources– Schedulers uses policies and priorities
to determine how to meet goals
Resilient / Highly Available Infrastructure
11223
4567
8910
11
JobScheduler
JOB 1JOB 1 JOB 2JOB 2 JOB 3JOB 3JOB 1JOB 1 Recovery /Restart
Recovery /Restart
The Value of Open Standards
Networking:The Internet
(TCP/IP)
Communications:e-mail
(pop3,SMTP,Mime)
Information:World-wide Web
(html, http, j2ee, xml)
Applications:Web Services
(SOAP, WSDL, UDDI)
Distributed Computing:Grid
(Globus -> OGSA)
Operating System: Linux
The Value of Standard
TCP/IP
TCP/IP
Grid Middleware Today
Grid Middleware
OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled
OGSA
Open Grid Services Architecture (OGSA)
OGSA
“The TCP/IP of Grid Computing”
Pro
fessio
nal S
erv
ices
Network
OGSA Enabled
Storage
OGSA Enabled
Servers
OGSA Enabled
Messaging
OGSA Enabled
Directory
OGSA EnabledFile
Systems
OGSA Enabled
Database
OGSA EnabledWorkflo
w
OGSA Enabled
Security
OGSA Enabled
Web Services
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Sevices
Open Grid Services Architecture (OGSA)
Applications
Au
ton
om
ic C
ap
ab
ilit
ies
Architecture Framework
OGSA Structure
Architecture Framework
Pro
fessio
nal S
erv
ices
Network
OGSA Enabled
Storage
OGSA Enabled
Servers
OGSA Enabled
Messaging
OGSA Enabled
Directory
OGSA EnabledFile
Systems
OGSA Enabled
Database
OGSA EnabledWorkflo
w
OGSA Enabled
Security
OGSA Enabled
Web Services
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Sevices
Applications
Au
ton
om
ic C
ap
ab
ilit
ies
General Middleware
Web Services
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management
Services
Web Services
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Services
OGSA Structure
OGSA Structure – OGSI
Architecture Framework
Web Services
HandleMapNotificationFactoryManagementRegistryLifecycleDiscovery
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Services
• Exploits existing web services properties– Interface abstraction (WSDL)
– Protocol, language, hosting platform independence
• Enhancement to web services– State Management
– Event Notification
– Referenceable Handles
– Lifecycle Management
– Service Data Extension
Architecture Framework
Web Services
HandleMapNotificationFactoryManagementRegistryLifecycleDiscovery
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Services
the globus project tm
www.globus.org
• Open source• Reference
implementation
Hosting platform
(Java)
Other Possible Hosting
Platforms(environments)
PythonGlobus (C/C++)
Microsoft (C#)
OGSA Structure – Open Hosting
Web Services
Architecture Framework
HandleMapNotificationFactoryManagementRegistryLifecycleDiscovery
OGSI – Open Grid Services Infrastructure
Service Collections
JobScheduling
FileTransfer
DataReplicationProvisioningLogging
ProblemDetermination
ResourceManagement
ClusterManagement
Policy
OGSA Structure – Software Evolution
Globus Toolkit 3the globus project tm
www.globus.org
Grid ServicesSystem Management Services
Architecture Framework
Service Collections
JobScheduling
FileTransfer
DataReplicationProvisioningLogging
ProblemDetermination
ResourceManagement
ClusterManagement
Policy
OGSA Structure – Software Evolution
Websphere Application Server
Globus Toolkit 3the globus project tm
www.globus.org
Websphere
OGSI
Grid ServicesSystem Management Services
• Value-added Grid Middleware and management applications
the globus project tm
www.globus.orgTivoli
• Open architecture for “Grid Services”• Some “open source” reference
implementations• Vendor provider “value added”
implementationsthe globus project tm
www.globus.org
WebSphere
Architecture Framework
OGSA Enabled
OGSA Enabled
OGSA Enabled
Messaging
OGSA Enabled
Directory
OGSA EnabledFile
Systems
OGSA Enabled
Database
OGSA EnabledWorkflo
w
OGSA Enabled
Security
OGSA Enabled
OGSI – Open Grid Services Infrastructure
Grid ServicesSystem Management Sevices
Au
ton
om
ic C
ap
ab
ilit
ies
OGSA
IBM
Glo
bal
Ser
vice
s
Products and Services for Grids
The Path to Standardization
• IBM working with Globus / GGF on OGSA• Work within other standards bodies to define new or
extend existing standards to support required distributed services
• Accelerate delivery through partners
the globus project tm
www.globus.org
The Path to Standardization
• Activities:• Extending existing standards to support Grid requirements
• XML, SOAP, WSDL/EL, Web services security etc.
• Globus /GGF partners to complete architecture of core
components• OGSI Specification Finalized (January)
• Technology Demonstration later this year (January)
• Alpha version mid-2003• Working with software vendors
• To migrate current offerings to architecture framework • Provide value added implementations of OGSA services
including:•Workload management•Cluster management
•Automation•Data Replication
What Makes Up a Grid?
StorageData
Applications
Processing I/O Operating System
IBM Solutions for Grid Computing
Au
ton
om
ic C
om
pu
tin
g
Pro
fess
ion
al S
ervi
ces
TotalStorage, GPFS
DB2 WebSphere
eServer MQSeries Tivoli
WebSphere is the Web Services Engine OGSA will Run on WebSphere, Integrated into Websphere
WebSphere Enhancements Make Grids Better Service Desk for Web Service Failover, Scaling Service Bus for Internal Communications WS Security Allegro for Web Service Provisioning
Websphere with OGSA Will Be Integrated into IBM Server and Storage Platforms
MQ Series for Robust Messaging, Message Hubs
IBM Grid Products - WebSphere
Tivoli is the Systems Management Platform for IBM’s Grid solutions Autonomic Services Will be Delivered Through Tivoli
eAutomation for Dynamic Setup and Configuration of Resources eUtility to Build On Demand Services eDisaster Recovery to Manage Business Continuity eWorkload Management
OGSA is the Foundation for Tivoli’s Autonomic Products
IBM Grid Products - Tivoli
DB2 Data Management Software Provides Information Virtualization (Data Grid) Federated DB2 Tools Provide Integration of Multiple Data Sources,
Types, Products Query Optimization Improves Performance in Federated Model Virtual Information Systems Makes Applications More Flexible Replication Services Improve Resiliency and Performance
Future Enhancements to DB2 Build Upon Data Grid Capabilities OGSA Enablement, Wrappers for Other Grid Products Increased Scattering, Replication, and Redundancy Capabilities
IBM Grid Products - DB2
Data Management Software
eServer Products are All Being OGSA Enabled Each eServer Platform Provides Unique Grid Value
Linux Available Across all Platforms xSeries for Intel workloads, dense Blade packaging pSeries for RISC workloads, scalability, partitioning, workload
management iSeries for OS/400 workloads, scalability, robustness, partitioning zSeries for robustness, dynamic partitioning, workload management,
usage-based charging All eServer Platforms Provide a Path to Grid
OGSA to be Packaged with All Platforms Leveraging WebSphere Cross Platform Capabilities
IBM Grid Products - server
server
TotalStorage Solutions Provide Foundation for Data Grids StorageTank for Heterogeneous File Systems General Parallel File Systems (GPFS) for High Performance File
Systems SHARK and FAStT for Storage Area Network Solutions
Virtualization of Storage Drives higher storage efficiency Simplifies data access Increases resiliency
Storage Enables Grid Applications and Collaboration
IBM Grid Products – TotalStorage
IBM Grid Products – IBM Global Services
Business Consulting Services e-Business Strategy Buy/Supply/Sell/Support Enterprise Resources e-Business Integration
Integrated Technology Services e-Business Infrastructure Networking & Connectivity Infrastructure and Systems
Management Business Continuity and Recovery Technical Support
Strategic Outsourcing Services Outsourcing for Non-Core Processes Manufacturing, Banking, Gov’t
Agencies, etc. e-Business Hosting Services
Offering product-like, standardized offerings
Foundation for e-Business on Demand Learning Services
Developing and delivering training solutions
Comprising IBM and non-IBM components
Focusing on IT, professional, and management development
IBM Global Services
Grid Adoption Curve
Early Adopters Mainstream
.Retail/Dist
Small/Med Business
Core-business
Government
● Supercomputing, Universities
Life Sciences &
Healthcare●● Corporate Research, Manufacturing, Pharmaceuticals
Financial Services ● ● Service Provider
Emerging xSPs ●
P2P, SETI,
Globus●
High Performance Computing Applications
Commercial Applications
Ind
ustr
y A
ccep
tan
ce
1999 2003 2004 2005 20062001 20022000
• Business Needs– Improve operating efficiency– Reduced capital expenses– Accelerate business processes– Improve enterprise collaboration– Adapt to unpredictable demand cycles
• IT Needs– Unlock value of existing IT– Technology Refresh– Faster computations– Integrate heterogeneous resources– Improve redundancy and resiliency– Respond to surges in IT demand
Grid Computing Addresses Business and IT
• Business Needs– Improve operating efficiency– Reduced capital expenses– Accelerate business processes– Improve enterprise collaboration– Adapt to unpredictable demand cycles
• IT Needs– Unlock value of existing IT– Technology Refresh– Faster computations– Integrate heterogeneous resources– Improve redundancy and resiliency– Respond to surges in IT demand
Grid Infrastructure
Industry Applications
DerivativesAnalysis
Statistical Analysis
Portfolio Risk
Analysis
Batch Throughput
Product Design
Process Simulation
FiniteElement Analysis
Failure Analysis
Cancer Research
Drug Discovery
Protein Folding
Protein Sequencing
Collaborative Research
Weather Analysis
HPC
Unique by Industry with Common Characteristics
Seismic Analysis
Reservoir Analysis
Bandwidth Consumption
Digital Rendering
Multiplayer Gaming
Primary Focus
Energy
Financial Services
Manufacturing
LS/
BioinformaticsTelco & Media
Gov’t & Education
Grid Application Focus Areas
Backup / Resiliency
Grid
Leverages existing computing and data assets to efficiently meet unexpected surges in systems usage, meet redundancy requirements and improve business continuity
Business Intelligence /
Analytical Grid
Faster and more comprehensive business planning and analysis through the sharing of data and computing power (e.g. actuarial analysis, customer segmentation, portfolio analysis and modeling , marketplace simulations, etc.)
Engineering / Product
Design Grid
Enables the sharing of data and computing power, for computing intensive engineering and scientific applications, to accelerate product design (e.g. rendering, product simulations, etc.)
GlobalizationGrid
Provides significant levels of computing and data infrastructure to remote, lesser developed and/or recently “acquired” parts of your business by leveraging existing resources (e.g. M&A, Geo expansion, etc.)
Research & Development
Grid
Accelerates and enhances the discovery process by enabling the sharing data and computing power seamlessly for research intensive applications (e.g. drug discovery, etc.)
Scientific Grid Examples
UK Research GridUK Research Grid
Collaborative, scientific researchCollaborative, scientific research
The Tera GridThe Tera Grid
Most powerful, heterogeneous GridMost powerful, heterogeneous Grid
National Digital Mammographic ArchiveNational Digital Mammographic Archive
UPennMedical and diagnostic content
UPennMedical and diagnostic content
Indiana Virtual MachineIndiana Virtual MachinePurdue and Indiana University1.4 teraflopsUltra-large calculationsSimulating homeland security
Purdue and Indiana University1.4 teraflopsUltra-large calculationsSimulating homeland security
#1
Commercial Examples
John DeereJohn Deere
IBM DB2 DataJoinerVLDB Award Largest ‘federated’ database2.5 Billion RecordsDB2, Oracle, MS SQL
IBM DB2 DataJoinerVLDB Award Largest ‘federated’ database2.5 Billion RecordsDB2, Oracle, MS SQL
Financial ServicesFinancial ServicesLinux based GridBlade, Grid, Utility technologyCredit Derivatives, Risk Management, Interest Rate Derivative Analysis
Linux based GridBlade, Grid, Utility technologyCredit Derivatives, Risk Management, Interest Rate Derivative Analysis
IBM Chip and Server DesignIBM Chip and Server Design AventisAventisIBM DiscoveryLinkDrug discovery collaborationDiverse, highly distributed
IBM DiscoveryLinkDrug discovery collaborationDiverse, highly distributed
120TB of WW File Sharing & CollaborationThousands of Unix servers
120TB of WW File Sharing & CollaborationThousands of Unix servers distributing workloaddistributing workload
Manual Infrastructure Set
Up
Automated Infrastructure Set
Up
Servers/Storage Utilities
Application UtilitiesBusiness Process
UtiltiesComputing
Utilities
Evolutionary Paths of Computing
Standalone Servers
Multiprocessor Servers
Clusters, Blades Virtual Servers
IntragridsMulti-enterprise
GridsExtra and Intergrids
Grid
Manual analysis and problem solving
Centralized tools,manual actions
Cross-referencecorrelation and
guidance
System monitors, correlates and
takes action
Dynamic business-policy-basedmanagement
Autonomic
business on demandTM
Enterprise
Integration
Access
Accounting & Service Level Agreements
Heterogeneous Workload Management
End-to-End Systems Management
Governance & Policy Standards
Security
Autonomic Functionality Disaster Recovery
Enterprise Quality of Service Across the GridCommercializing the Grid - Considerations
Reduced Complexity
Quality of Service
Increased Productivity
Make vs.
Buy Options
Variable Cost Flexibility
Realized Value of Grid ComputingOn Demand Operating Environment
Summary & Next Steps
• Grid is evolving very rapidly
• Academia, Scientific & Technical communities leading, but quickly moving to commercial customers
• OGSA & Web Services are the standards of choice
• Korean community actively involved in WW and AP efforts
• Next Steps messages:– Education: IBM Learning Services– Join in: www.globus.org & www.ggf.org– Keep up to date: www.ibm.com/grid– Start a project….jump in