cloud computing and software engineering
TRANSCRIPT
![Page 1: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/1.jpg)
Cloud Computing
and
Software Engineering
Ravindra Dastikop http://dastikop.blogspot.in
View video of this presentation : http://youtube.com/user/dastikop
![Page 2: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/2.jpg)
Purpose
●Cloud represents at the same time a new emerging
opportunity and new challenge
●This presentation aims to identify the challenges
inherent to cloud applications and suggests some
approaches towards the same.
![Page 3: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/3.jpg)
Agenda for Presentation
●What is a Cloud Application? (project) ●Cloud resources for cloud application
developers●Cloud application examples○General examples○Cloud applications (that our students have
built) ●A sample cloud Application demo●Q & A session ●Summary
![Page 4: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/4.jpg)
Evolution of Computer
Applications
![Page 5: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/5.jpg)
Desktop Applications
Full control and ownership of machine, data, software
![Page 6: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/6.jpg)
Web Application
No ownership, data stored elsewhere, application comes from service provider
![Page 7: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/7.jpg)
Rich, remote and responsive (now)
Picture credit: http://wiki.sproutcore.com
![Page 8: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/8.jpg)
Goal of Cloud Applications
●Cloud application represents the state of
art in application development
●They try to combine best of both worlds -
○richness of desktop with
○remoteness of web applications
![Page 9: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/9.jpg)
Cloud Application : Meaning
●Cloud computing applications are the applications available
as SaaS over the internet
●which facilitates the user to run those applications without
installing them on his own computer.
●This saves the cost of infrastructure and hardware
maintenance.
● In general cloud computing customers do not own the
infrastructure but use it from a third party provider as a
service.
![Page 10: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/10.jpg)
Cloud Application : Where do they come from?
●Cloud computing applications are loaded at the
server of service provider and the service provider
give access to these applications through an
interface using internet.
●Every customer has its own unique account from
which they log on to the cloud of the provider and
access the application they have paid for.
●Service provider also provides space at his own
server for the customer’s data.
![Page 11: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/11.jpg)
CloudApp : A Simple Example
CloudApp allows you to share as well as save files
easily on the web. It works well for links, images,
video and music. Check out how the entire thing
works-
●Select a file
●Drag the file to the menu bar
CloudAPP
![Page 12: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/12.jpg)
Any Questions?
![Page 13: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/13.jpg)
Cloud Apps: The difference
Statelessness and server failures are givens in the cloud
The big difference between a traditional application and cloud application is that cloud application itself is able to provision the resources that the application needsUsing API’s applications for cloud can be designed so that they request more resources from the cloud provider
![Page 14: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/14.jpg)
Cloud Apps: The difference
Cloud Applications have to be stateless
If cloud application has states, it becomes a challenge
In cloud if something dies, you kill it and reincarnate
There is no concept of a local disk, no registry
All these is encapsulated by being a stateless
application
![Page 15: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/15.jpg)
Cloud Apps: The difference
Cloud applications need to be designed for
redundancy and should acknowledge that commodity
machines are being used in the cloud
It is a guarantee that machines are going to fail, hence
cloud application need to designed for redundancy
![Page 16: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/16.jpg)
Cloud Apps: The difference
Cloud Apps parts can be scattered in many places
● Presentation layer might be on the Facebook storage could be on Amazon’s S3
● application logic could run somewhere else entirely
In traditional applications, entire application used to built on own servers
Building cloud application requires solid engineering and design
![Page 17: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/17.jpg)
Cloud Apps: The difference
Database are not same in the cloud
Cloud databases are non-relational schema-free
![Page 18: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/18.jpg)
Cloud Apps: The difference
Database are not same in the cloud
Example:
Google App Engine uses Google’s Big Table data store
for persistent storage. Big Table is not a SQL
database, and the reason for that is because some of
the functionalities supported by SQL databases - for
example- joins- make it very difficult to split a
database across multiple machines
![Page 19: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/19.jpg)
Cloud Apps: The difference
Database are not same in the cloud
In cloud database using Big Table - denormalization
is encouraged from the design phase.
This enables developers to store data in multiple
places at the same time. As a consequence
applications run very efficient queries
![Page 20: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/20.jpg)
Cloud Apps: The difference
Database are not same in the cloud
What developers have found that in very high-traffic
situations, relational databases are extremely
difficult to manage and that ends up being a huge
money and resource sink for developers
![Page 21: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/21.jpg)
Cloud Apps: The difference
Get used to rapid change in the cloud
● Things change much more rapidly in the cloud.
● Cloud providers offer new releases several time a year
and each upgrade might have something a developer
wants to take advantage of
● A developer need to stay abreast of those developments,
keep eye on lot of the different blogs and also particpate
in webinars
![Page 22: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/22.jpg)
Cloud Apps: The difference
Developer need to be aware of different design
patterns such as eventual consistency- in which a
change to an application might not register for a few
million seconds. The consequence of that is that you
can not utilize a database to keep track of the next
value “
This needs a different programming approach when
they are utilizing the cloud because of such things
![Page 23: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/23.jpg)
Cloud Apps: The differenceDevelopers can let go most of plumbing concerns
in the Cloud
The loosely coupled nature of web makes it an easier
development platform.
Developers can focus on innovation and business logic
instead of worrying about plumbing and infrastructure such
as the operating system and hardware.
Cloud service providers offer security, workflow,
administration and load-balancing as seperate modules
![Page 24: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/24.jpg)
Cloud Apps: The difference
One enterprise wanted to build college
admission applications on Microsoft’s .NET
platform but found that it was many times
cheaper to develop on Force-.com- this is
because of its use of pre-built functionality.
![Page 25: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/25.jpg)
Any Questions?
![Page 26: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/26.jpg)
Cloud Apps: The difference
Developers need to keep in mind the
difference between cloud platforms and
licensing models different cloud models have
different pricing models
![Page 27: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/27.jpg)
Cloud Apps: The differenceDevelopers should develop applications in such a way
that they could be moved off that platform
For example, Google enables such mobility by
supporting the popular Python language and the
Django web framework and supports open source
uploading and downloading tools for moving data in
and out of GAE
![Page 28: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/28.jpg)
Software engineering
Software engineering is the application of systematic,
disciplined, quantifiable approach to the development,
operation, and maintenance of software
Cloud computing offers new possibilities for
multilateral software
![Page 29: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/29.jpg)
Cloud Apps: The differenceASPECT Traditional
Softwaremultilateral development (Cloud
Software Composition
coherent set of software modules
interoperable third party components
![Page 30: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/30.jpg)
Cloud Apps: The differenceASPECT Traditional Software multilateral
development ( Cloud
source code
full source available no source code for third party companies
![Page 31: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/31.jpg)
Cloud Apps: The differenceASPECT Traditional Software multilateral
development ( Cloud
execution model
single computer often distributed between multiple computeres
![Page 32: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/32.jpg)
Cloud Apps: The differenceASPECT Traditional Software multilateral
development ( Cloud
Ownership and control
single team or enterprise
distributed between multiple enterr
![Page 33: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/33.jpg)
Cloud Apps: ChallengesASPECT cloud computing Challenge
Source code
No source code for third party compoenents
system comprehension
Execution model
often distributed between multiple computers
state inspection and debugging
Ownership and control
distributed separation of ownership
![Page 34: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/34.jpg)
Any Questions?
![Page 35: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/35.jpg)
Cloud Apps: key principles
● The Map-Reduce paradigm for independent
computation
● schema-free databases and their use
● service-oriented computing
● multi-tenancy
● security and compliance
● design for resilience
● loosely-coupled
![Page 36: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/36.jpg)
Cloud Apps: promises
● Reduced development time through use of
high-level service
● maximum utilization of resources: pay for
what u use
● reduced operation costs
● increased development productivity
●
![Page 37: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/37.jpg)
Cloud Computing Resources
What is available for developers
![Page 38: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/38.jpg)
Cloud Application Building ResourcesOpen source● Java● C# DotNet ● AJAX- real time collaboration● GAE- Google Application Engine ● PHP It provides web developers with a full suite of tools for
building dynamic websites● Python: integrate your systems more effectively ● API - Royal route resources Google APIs, ● Facebook
Commercial ● AWS - Amazon Web services● Microsoft Azure
![Page 39: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/39.jpg)
Any Questions?
![Page 40: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/40.jpg)
Developing a Cloud Application
Demonstration
![Page 41: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/41.jpg)
Cloud applications using Open sources
Cloud Teaching System using
Google Application Engine(GAE)
(Our Final Year Project)
A Placed and Happy Student
![Page 42: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/42.jpg)
My Maps Locator
developed using Google Map API
Challenge is customizing it for Mobile
A simple Cloud application
![Page 43: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/43.jpg)
Examples- Business
Housing Maps Route Finder
![Page 44: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/44.jpg)
Facebook Game
Deployed on AWS.
Fametown
Best ExampleTwitter
![Page 45: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/45.jpg)
Cloud Application Using Open Source
Social site aggregator
usingFacebook
TwitterLinkedlin
( A Final Year Project )
![Page 46: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/46.jpg)
CloudCourse: An Open source cloud application
CloudCourse is a course scheduling system. It is built on
GAE
CloudCourse
![Page 47: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/47.jpg)
Cloud Applications using Open Source
AlumniMaps
Procures Facebook users data and Plots on Google
Uses Flex, Google Maps API, Facebook API
Final Year Project
A Happy Student
![Page 48: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/48.jpg)
Training and Placement cell ( PES, Mandya
Training and Placement cell
using Google App Engine and Google APP Store
![Page 49: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/49.jpg)
Virtualization Project ( NIE, Mysore)
![Page 50: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/50.jpg)
Cloud Computing for SMES- BVB Students
Cloud Computing for SMEs
First version of this project is done by a group of Hyderabad engineering students.
BVB gr oup is build it further on
![Page 51: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/51.jpg)
FaceBook Applications
Developing a Facebook Application: First Step
Developing FB applications: Tools
![Page 52: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/52.jpg)
Blog Post Translator Application Objective:
To translate Blog post in English to Different languages
Resource used
● Google App Engine- A Paas Solution● Google Translate API
● Language: Python
![Page 53: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/53.jpg)
AWS Applications
Building Your First Cloud Application on AWS
![Page 54: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/54.jpg)
MS in Software Engineering
![Page 55: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/55.jpg)
To be Presented atRecent Advances in Web Technologies,
St.Joseph Engineering College, Mangalore,
27-29 Jan, 2011
Cloud Computing:Engineering Approach
click here to see updated version
Ravindra Dastikop
email : [email protected]
http://dastikop.blogspot.com
![Page 56: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/56.jpg)
Purpose
In this this presentation , we ●explain why cloud applications business
appeal ● list challenges encountered during
development of cloud scale applications●provide an introduction to newly emerging
discipline – Cloud Engineering●Share our experience of Cloud Engineering
![Page 57: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/57.jpg)
http://dastikop.blogspot.com
Agenda for Presentation ●Challenges- Developing a cloud
application?●Cloud Engineering – Discipline for
develop cloud applications●Q & A●Summary
![Page 58: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/58.jpg)
http://dastikop.blogspot.com
Emergence of Cloud Computing Age
●Cloud has become a preferred destination for enterprises to host applications
●Designing and building applications for the Cloud requires specialized skills
●It demands a new mind set and also architecrual thinking (MS)
![Page 59: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/59.jpg)
Understanding Cloud Phenomenon
In order to understand Cloud Engineering, it is necessary to know about Cloud Computing and Cloud application. Please refer to the following presentations before u proceed further
●Cloud computing- Foundation of Cloud computing ●Cloud application- Fruits of Cloud Computing ●
![Page 60: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/60.jpg)
The Challenge
Developing Cloud scale Applications
![Page 61: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/61.jpg)
Cloud Application: An Example
The Cloud Evolution
CloudApp
allows something as fun and simple as sharing of images, links, music, videos and files by simple choosing a file and drag it to the menu bar to be easy, faster and reliable
by providing short link automatically copied to your clipboard that you can use to share your upload with co-workers and
friends.
![Page 62: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/62.jpg)
http://dastikop.blogspot.com
Why cloud-deployable applications?
●Cloud computing infrastructure is an interesting proposition because of its
●Pay-per-use model●Ability to leverage the benefits of platform
as a services.●Result: Cloud application is
○A major requirement (business)○A challenge for developers
![Page 63: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/63.jpg)
How a FREE Cloud Application can become a business
Cloudapp Pro is available with more features and is now charged
![Page 64: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/64.jpg)
http://dastikop.blogspot.com
Challenges in Cloud Computing
● Number 1. Business Continuity and Service Availability● Number 2. Data Lock-In● Number 3. Data Confidentiality/Auditability● Number 4. Data Transfer Bottlenecks● Number 5. Performance Unpredictability● Number 6: Scalable Storage● Number 7: Bugs in Large-Scale Distributed Systems● Number 8: Scaling Quickly● Number 9: Reputation Fate Sharing● Number 10: Software Licensing
Source:
![Page 65: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/65.jpg)
Cloud engineering- Business Reason
●Cloud services typically deliver commodity-like capabilities, often with consumer-grade service-level agreements, and organizations will be dealing with the inherent challenges in this business model
![Page 66: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/66.jpg)
http://dastikop.blogspot.com
Requirements of Cloud application
●High reliability ●Dynamic scalability
○Millions of users○Volumes of data
●Low latency●Across all layers
○Database○Messaging○Web
![Page 67: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/67.jpg)
http://dastikop.blogspot.com
Cloud EngineeringBuilding Cloud applications
![Page 68: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/68.jpg)
Cloud Engineering
●Cloud Engineering is the process of designing the systems necessary to leverage the power and economics of cloud resources to solve business problems.
![Page 69: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/69.jpg)
Cloud Engineering An Analogy
Comparing CE with Transportation engineering
![Page 70: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/70.jpg)
Transportation engineering ( Golden Qudrangle
![Page 71: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/71.jpg)
Transportation engineering
Build Roads
![Page 72: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/72.jpg)
Transportation engineering
Build Vehicles ( Applications)
![Page 73: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/73.jpg)
Transportation Engineering
Develop Standard Practices (Rules)
![Page 74: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/74.jpg)
Cloud engineering Cycle
Source:
![Page 75: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/75.jpg)
http://dastikop.blogspot.com
TRADITIONAL APPROACH
1
2
3 4
![Page 76: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/76.jpg)
http://dastikop.blogspot.com
![Page 77: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/77.jpg)
http://dastikop.blogspot.com
Engineering Perspective
Research and Practical challenges
![Page 78: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/78.jpg)
http://dastikop.blogspot.com
A cloud application: Ticketing System
●Describe the systems
![Page 79: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/79.jpg)
Cloud Engineering : Simple definition
Cloud engineering is the process of designing systems to leverage cloud
architecture
![Page 80: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/80.jpg)
http://dastikop.blogspot.com
Challenge No 1: High ReliabilityServices without any disruption
●Vertical scaling○ Adding more CPUs and Disks○ Example: A Dating web site scaled up their application
to handle over a billion requests per month by moving to 512 GB RAM, 32 CPU Machine
○ Cost 100K USD ( costly high-end configuration ●Horizontal scaling
○ Second option is to use run application on commodity hardware, scaling horizontally by adding more box, as the need to scale up arose
●Moving application to cloud
![Page 81: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/81.jpg)
http://dastikop.blogspot.com
Applications scale up
●Scaling up must happen in all tiers – ○web, ○messaging and ○database
![Page 82: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/82.jpg)
http://dastikop.blogspot.com
Scaling Up database-1
●Databases are not built for scale●The primary factor for scaling up a database is
disk I/O performance●Vertical Scaling can be achieved by adding high-
end disks with greater speeds and replication●Affordable RAID 6 or RAID 10 disk can be used
to improve disk performance●RAID disks Upper limit on disk transfer speed is
200MBps to 1GBps- which limits scaling
![Page 83: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/83.jpg)
http://dastikop.blogspot.com
Scaling up of database –Option 2
●Adding more database instances with master-slave replication strategy where master handles writes, and replicates data to multiple slaves
●MySQL supports master-slave scale-out configuration where data gets replicated transparently to the slaves.
●When application spends most of the time in reads, the application scales as the reads can be served from any slaves
![Page 84: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/84.jpg)
http://dastikop.blogspot.com
Example- Master-slave
●Master-slave is deployed in Dekoh.com.●During user registration at Dekoh.com where all
new users sign-up requests, which involve write-to database, are routed to the master, and the login requests to slaves
●Since user login occurs frequently compared to user registration, the above configuration scales up well,
●Master does not scale when there are more writes and when it also adds a slave lag as the data gets replicated
![Page 85: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/85.jpg)
http://dastikop.blogspot.com
Sharding and De-normalization
●Portioning data across master would distribute writes to different instances and both the reads and writes scale well
●To achieve reliability replication should be used along with lesser number of slaves to overcome the slave lag
●Example: Flickr.com ○ Moved from pure replication to the Sharding
mechanism to be able to scale●Shading schemes – need changes in application
architecture
![Page 86: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/86.jpg)
http://dastikop.blogspot.com
The consequence of Sharding
●Portioning data into shards add more complexity in terms of maintaining the integrity of data, application architecture and Joins. ( ACID)
●Any change in the portioning scheme would require reorganizing the entire data which is expensive
●Joins are not possible as data is broken up into different shards. (Join demands data to be available on same memory space)
●Solution is to introduce some kind of de-normalization – (end of a cherished practice)
![Page 87: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/87.jpg)
http://dastikop.blogspot.com
De-normalization
●De-normalization is basically bringing , often redundant data together, to improve the query performance. (fundamental go for a toss)
![Page 88: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/88.jpg)
http://dastikop.blogspot.com
De-normalization – an example● One application has a message infrastructure where messages are
sent to recipients (users).● Messages are stored in “Message” Table and the “recipient” table
contains message to recipient mapping.● To obtain recent 10 messages sent to a particular recipient, all
messages-ids for recipient are obtained from the “recipient” table and a join is performed on the “message” table filtering the recent 10 timestamps.
● If there are lot of messages, sent to a particular recipient, a join is performed on the messages table with lot of rows from the “recipients” table and then the time stamp filter is applied.
● Instead, if the timestamp of the message is duplicated in the recipient table, it is easy to filter out the first 10 messages ids and then perform a join.
● With this approach the query takes lesser time to execute and minimize disk I/O
![Page 89: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/89.jpg)
http://dastikop.blogspot.com
Cloud Engineering by Google
● Google has come out with its own datastore implementation
● Google’s Bigtable is a distributed ‘scheme-less” key-value store, which was developed for the web search engine.
● It is applied to Orkut, Docs, Google Maps, Earth and others.
● Bigtable runs on the top of Google File System and provides the needed scalability at its core, supporting high availability at the file system level
● Google App Engine offers Bigtable as the primary datastore for application developers.
![Page 90: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/90.jpg)
http://dastikop.blogspot.com
Cloud Engineering by Amazon
● Amazon’s SimpleDB is a distributed key-value store which supports a SQL-like syntax for retrieving data and exposes REST API for all operations.
● SimpleDB is available as a paid service and is very effective when working with huge amount of data
● Limitations ● Restrictions imposed on size of results, comparisons,
predicates used in the query● No supports for transactions, aggregate functions, data
types and full-text search ● For above reasons, adoption of service is less.
![Page 91: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/91.jpg)
http://dastikop.blogspot.com
Cloud Engineering by Facebook
● Facebook uses Apache Hive● It is a data warehouse that runs on the top of the Hadoop
distributed system● Facebook uses Hive to analyze historical data of users
and content using brute force mechanism● Hive is not a datastore but is only used for analytics on
the large amounts of data.● The other datastore include
○ HBase○ Hypertable○ Cassandra○ CoudDB○ Voldermort
![Page 92: Cloud computing and software engineering](https://reader034.vdocument.in/reader034/viewer/2022052700/55a739211a28ab280e8b4583/html5/thumbnails/92.jpg)
Contact Information
Ravindra DastikopAssistant Professor, CSE
SDM College of Engineering & TechnologyDharwad 580 002
email: [email protected]
web site: http://dastikop.blogspot.com