cloud computing

51
Cloud Computing Techniques for Simulation Models and Mapping Systems Tilani Gunawardena

Upload: tilani-gunawardena-phdunibas-bscpera-fheauk-amiesl

Post on 12-Apr-2017

65 views

Category:

Education


0 download

TRANSCRIPT

Page 1: Cloud Computing

Cloud Computing Techniques for Simulation Models and Mapping Systems

Tilani Gunawardena

Page 2: Cloud Computing

RoadMap

• Introduction • Experiences/Models• Research Work

Page 3: Cloud Computing

What is Cloud

• “Cloud” is actually a metaphor for the Internet

Page 4: Cloud Computing

Cloud Computing• Cloud computing is the use of computing resources

(hardware and software) that are delivered as a service over a network -wikipedia

• Provides :variety of computing resources all delivered over the Internet.

– Servers– Storage – Applications(email, communication, games)

• Delivers a hosting environment that is immediate, flexible, scalable, secure, and available while saving corporations money, time and resources.

Page 5: Cloud Computing

Comparison• Grid computing: A form of distributed Computing

– Cluster of loosly coupled, networked computers acting in concert to perform large tasks

• Utility computing: The packaging of computing resources, such as computation and storage, as a metered service similar to a traditional public utility such as electricity

• Autonomic computing :computer systems capable of self-management

• Data Centre Clusters• High Performance Computing• Web Services : communication between two electronic devices

over the world wide web

Page 6: Cloud Computing

Characteristics of Cloud Computing• Scalability: Upgrades and changes to the

services are done instantaneously and easily enabling the cloud computing service to be resilient

• Agility: As a shared resource, the cloud provides flexible, automated management to distribute the computing resources among the cloud’s users.

• Reliability & Fault Tolerance• Service oriented• Utility based

Page 7: Cloud Computing

Characteristics of Cloud Computing

• Security: Security is often as good as or better than under traditional systems

• Application Programming Interface: API accessibility to software that enables machines to interact with cloud software

• Cost: Cost is greatly reduced • Device and location Independence• On demand service

Page 8: Cloud Computing

Why Cloud ComputingAnalogy:

”If you only need milk, would you buy a cow? “

• Yahoo email, Gmail, or Hotmail• The server and email management software is all on the cloud ( internet) and is totally

managed by the cloud service provider Yahoo , Google

software /hardwaresending emails

Page 9: Cloud Computing

• In Business View: When it’s smarter to rent than to buy…..

• Techie’ s View: It offers the ability to access softwares or information that can be delivered on-demand, over the internet, without the need to store it locally……

Page 10: Cloud Computing

• Cloud Computing Provides all the infrastructure needed to run applications over the Internet

• Cloud computing can do everything………. or only some things if you don't need everything.

Page 11: Cloud Computing

Layers of Cloud Computing

• Clients• Services• Application• Platform• Storage• Infrastructure

Page 12: Cloud Computing

Client• Consists of computer hardware and/or computer software

which relies on cloud computing for application delivery, or which is specifically designed for delivery of cloud services and which, in either case, is essentially useless without it. – Mobile (Android, iPhone, Windows Mobile) – Web browser (Google Chrome, Mozilla Firefox)– Operating Systems– Computers

Page 13: Cloud Computing

ApplicationCloud application services or “Software as a Service (SaaS)” deliver software as a service over the Internet, eliminating the need to install and run the application on the customer’s own computers and simplifying maintenance and support.• CRM• Email• Virtual Desktop• Communication• Games

Page 14: Cloud Computing

Infrastructure• Cloud infrastructure, such as Infrastructure as

a service, is the delivery of computer infrastructure, typically a platform virtualization environment, as a service.

Page 15: Cloud Computing

Platform• A cloud platform, such as Platform as a service, the

delivery of a computing platform, and/or solution stack as a service, facilitates deployment of applications without the cost and complexity of buying and managing the underlying hardware and software layers. – Web application frameworks

o Python Django (Google App Engine) o Ruby on Rails (Heroku) o .NET (Azure Services Platform) – Web hosting (Rackspace) – Force.com

Page 16: Cloud Computing

Services• A cloud service includes "products, services and solutions that are

delivered and consumed in real-time over the Internet". For example, Web Services ("software system designed to support interoperable machine-to-machine interaction over a network") which may be accessed by other cloud computing components, software, e.g., Software plus service, or end users directly.

• Identity (OAuth, OpenID) • Integration (Amazon Simple Queue Service) • Payments (Amazon Flexible Payments Service, Google Checkout, PayPal) • Mapping (Google Maps, Yahoo! Maps) • Search (Alexa, Google Custom Search, Yahoo! BOSS) • Others (Amazon Mechanical Turk)

Page 17: Cloud Computing

Storage

• Database (Amazon SimpleDB, Google App Engine's BigTable datastore)

• Network attached storage (MobileMe iDisk, Nirvanix ,CloudNAS)

• Synchronization (Live Mesh Live Desktop component, MobileMe push functions)

• Web service (Amazon Simple Storage Service, Nirvanix SDN)

Page 18: Cloud Computing

Popular Clouds Storages

• Amazon s3 • Google Docs• Apple iCloud• DropBox• SkyDrive• Box• SugarSync

Page 19: Cloud Computing
Page 20: Cloud Computing
Page 21: Cloud Computing

Cloud Anatomy

Page 22: Cloud Computing

IaaS• IaaS is the delivery of technology infrastructure as an on

demand scalable service • The IaaS layer extends the virtualization layer by providing

the mechanisms to provision and control the virtual machines in a utility computing manner.

• The end user is able to control cost by knowing exactly how much each virtual machine instance costs per minute/hour.

– Usually billed based on usage– Usually multi tenant virtualized environment

Page 23: Cloud Computing

PaaS• PAAS(Platform as a service) • Platform as a service, another SAAS, this kind of cloud computing

providing development environment as a service. You can use the middleman’s equipment to develop your own program and transfer it to the users through internet and servers.

• PaaS provides all of the facilities required to support the complete life cycle of building and delivering web applications and services entirely from the Internet.

– Typically applications must be developed with a particular platform in mind

– Multi tenant environments– Highly scalable multi tier architecture

Page 24: Cloud Computing

SaaS• This kind of cloud computing transfer programs to millions of users through

browser • user’s views,: this can save some cost on servers and software. • In the provider’s views, they only need to maintain one program, this can also

save cost– Ex: Salesforce.com ,Google Apps and Zoho Office are also providing this kind of

service

• SaaS is a software delivery methodology that provides licensed multi-tenant access to software and its functions remotely as a Web-based service.

– Usually billed based on usage– Usually multi tenant environment– Highly scalable architecture

Page 25: Cloud Computing

Type of Services: Location of the cloud

• Public clouds• Private clouds• Community clouds• Hybrid clouds

Page 26: Cloud Computing

Public clouds

• Resources are dynamically provisioned on an on-demand, self-service basis over the Internet, via web applications/web services, open API, from a third-party provider who bills on a utility computing basis.

• These services are free or offered on a pay-per-use model.

Ex: Amazon AWS ,Microsoft and Google own and operate the infrastructure and offer access only via Internet.(direct connectivity is not offered)

Page 27: Cloud Computing

Private clouds

• Private cloud is cloud infrastructure operated solely for a single organization, whether managed internally or by a third-party and hosted internally or externally

• Ex: IBM, HP, Microsoft

Page 28: Cloud Computing

Community clouds

• A community cloud is formed when several organizations with similar requirements share common infrastructure. Costs are spread over fewer users than a public cloud but more than a single tenant.

• Ex: All Government organizations within the state of California may share computing infrastructure on the cloud to manage data related to citizens residing in California.

Page 29: Cloud Computing

Hybrid clouds • A hybrid cloud environment consists of some

portion of computing resources on-site (on premise) and off-site (public cloud).

Page 30: Cloud Computing

Best Cloud Computing companies 2012

• Google –SaaS,PaaS• Amazon-IaaS– Elastic Compute Cloud (EC2) – Simple Storage Service(S3)

• Microsoft Azure Service Platform-PaaS

Page 31: Cloud Computing

Amazon Cloud • Amazon cloud called AWS is a collection of remote

computing services (web services) that together make up a cloud computing platform, offered over the Internet by Amazon.com. – Amazon Elastic Compute Cloud (EC2) :provides resizable

compute capacity in the cloud – Amazon Simple Storage Service (S3) :Online storage web

service – Amazon SimpleDB :Web service providing the core

database functions of data indexing and querying in the cloud

Page 32: Cloud Computing

Microsoft • Windows Azure :is a platform for running

Windows applications and storing their data in the cloud

• Microsoft Dynamics CRM Online • Microsoft Office 365 • Microsoft Private Cloud

Page 33: Cloud Computing

Google

• Google App Engine :creates apps on Google’s platform that are easy to manage and scale

• Google Compute Engine • Google BigQuery :Analyze Big Data in the

cloud• Google Cloud Storage

Page 34: Cloud Computing

Cloud Computing techniques Within Google

• GFS: Data storage technology • BigTable: Data management technology • Map Reduce: Programming model and task

scheduling model

Page 35: Cloud Computing

Applications

• Practically limitless

• With the right middleware, a cloud computing system could execute all the programs a normal computer could run.

• Everything from generic word processing software to customized computer programs designed for a specific company could work on a cloud computing system

Page 36: Cloud Computing

Cloud Computing for Research Community

• For research groups cloud computing can provide convenient access to reliable, high performance clusters, without the need to purchase and maintain or even understand sophisticated hardware and high performance computational methods.

Page 37: Cloud Computing

Large Scale Data Analysis on Cloud Systems

• Cloud systems can be effectively exploited for this purpose as they provide scalable storage and processing services, together with software platforms for developing and running data analysis environments– Scalable Storage– Computing facilities

• The Google File System (GFS) and Hadoop Distributed File System (HDFS) are two examples of proven approaches to creating distributed highly fault tolerant massive storage systems.

Page 38: Cloud Computing

What does the cloud allow us to do that we could not do before?

• Compute- intensive problems– large-scale image processing, – sensor data correlation, – social network analysis, – encryption/decryption, – data mining, – simulations, – pattern recognition, are strong examples of problems that can be solved in the cloud computing domain.

Page 39: Cloud Computing

• Pay-as-you-go basis: 1000 computers used for 1 hour costs the same as one computer used for 1000 hours. If your problem can be computed in a way that takes advantage of parallel processing, you can now get the answer 1000 times as fast for the same amount of money.

• Embarrassingly parallel: Cloud computing works best when a problem can be broken down into a large number of relatively independent tasks, each running on its own computer.

Page 40: Cloud Computing

Using the Cloud for Simulation and Analysis

Page 41: Cloud Computing

Simulations and Analysis Via Cloud

Page 42: Cloud Computing

Autodesk Simulation 360

• Engineering simulation• Predict, optimize, and validate design decisions

with proven simulation technology• Better manage your simulation workflow and

workload• Run and access simulations anywhere, anytime• Reduce costs with minimal hardware

investments and pay-as-you-go software

Page 43: Cloud Computing

NEEShub tools: OpenSees in the Clouds

• OpenSees is a software framework for simulating the seismic response of structural and geotechnical systems.

• It is the computational platform for research in performance-based earthquake engineering at PEER

• Version 2.2.2 now available with over 80 material types, 30 element types, 20 integration schemes, 15 numerical solvers, 10 solution algorithms

Page 44: Cloud Computing

• Steel Building Study :– 7200 records ,2 min a record ,240 hours or 10 days ,Ran on

2000 processorson teragrid in less than 15 min

• Concrete Building Study: – 113 records, 4 intensities ,3 hour a record, would have taken

1356 hours or 56.5 days Ran on 452 processors of a Teragrid in less than 5 hours.

Page 45: Cloud Computing
Page 46: Cloud Computing

CUDA in the Cloud

• CUDA is a parallel computing platform and programming model invented by NVIDIA.

• It enables dramatic increases in computing performance by harnessing the power of the graphics-processing unit (GPU). – Peer1: Is a long-established hosting company with data

centers across the U.S., in Canada, and Europe. – Hoopoe:is an Israel-based project designed to build cloud-

based GPU computing systems based on Tesla GPUs– Amazon EC2: Supports GPU clusters using CUDA

programming.

Page 47: Cloud Computing

Benefits of Cloud Computing

• Eliminate expense of acquiring, managing and operating hardware• Elastic computing Pay-as-you-go model /Reduced cost• More Storage• There will never be a worry about running out of disk space• Automatically Updated• Shared Resources• No software needs to be installed, saving time and money • Enable services to be used without understanding their infrastructure• The cloud service providers will supply all the Backup and Recovery

facilities• Mobility

Page 48: Cloud Computing

Risk of Cloud Computing• In July 2008, Amazon’s S3 cloud storage service went down for the

second time that year. A lot of applications were hosted by the company and all those services could not be accesses until techs cloud fix the problem. Some applications were down for eight hours.

• Data: Sometimes it is more difficult to integrate your applications if they are geographically dispersed. That it is easier to manage and access your data if it is nearby, and not under someone else’s control.

• You do not have control over the remote servers, their software, or their Security

• Your data is at the mercy of a third-party company • Additional cost of data transfer fees • It may be difficult to migrate massive amounts of data from the provider

Page 49: Cloud Computing
Page 50: Cloud Computing

Conclusions• Cloud computing is still struggling in its infancy with negative and positive

Comments.• cloud computing is rapidly emerging as a viable alternative to traditional

approaches • Data security is an important factor for cloud computing and to day modern

Encryption algorithms play the main role in data security of cloud computing• Real business value can be realized by customers of all sizes• Cloud solutions are simple to acquire, don’t require long term contracts and

are easier to scale up and down as needed• Proper planning and migration services are needed to ensure a successful

implementation• Third party monitoring services ensure customer are getting the most out of

their cloud environment

Page 51: Cloud Computing

Thank You !