![Page 1: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/1.jpg)
Click to edit Master subtitle style
11/2/10
VMM-Level Distributed Transparency Provisioning Using Cloud Infrastructure Technology
Mahsa Najafzadeh, Hadi Salimi, Mohsen Sharifi and Ali HamidiDistributed Systems Laboratory,School of Computer Engineering,Iran University of Science and Technology,Presented in SVM 2010,Presenter: Hadi [email protected]
![Page 2: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/2.jpg)
11/2/10
Agenda
• Introduction to Virtualization Technology (VT)• Virtualized Distributed Environments• Cloud Computing • Cloud Infrastructure Technology (CIT)• CIT Research Challenges• Available CIT Solutions
o OpenNebulao Nimbuso Eucalyptuso Amazon Elastic Cloud Computing (EC2)o Xenoserver
![Page 3: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/3.jpg)
11/2/10
Introduction of Virtualization
• Displaying a real system as a different virtual system or even as multiple virtual systems(multiplex)[SMI05]
• Three main advantages of VT [UHL05]:! Isolation
!Consolidation !Migration
![Page 4: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/4.jpg)
11/2/10
Virtual Distributed Environments
• A distributed environment: A collection of independent computers that appears to users as a single coherent system [TAN02]
• Virtual distributed environment: Using virtualization technology in distributed environment such as Cloud Computing
• The need of the research and industry communities to complex computing systems in large scales
![Page 5: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/5.jpg)
11/2/10
Cloud Computing
• No common definition exists yet [VOA09]• Our definition of Cloud Computing is:
“A distributed virtual environment in which a large set of virtualized computing resources, different infrastructures, various development platforms and useful software are delivered as a service to customers as a pay-as-you-go and transparent manner usually over the Internet”
![Page 6: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/6.jpg)
11/2/10
Cloud Infrastructure Technology (CIT)• A software layer that can provide system services in support of
virtual machines such as scheduling, management and so on
![Page 7: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/7.jpg)
11/2/10
CIT Research Challenges• Load Balancing [ZHA09]
The need to a specific CIT to be able to schedule virtual machines on physical workstations to balance the workload:
• Image Management [CAI09] The support mechanisms in CIT for managing the virtual machine images effectively and transmitting them in a virtualized distributed environment efficiently
• Security [YUN10]
The CIT has to manage user demands and the related security issues
![Page 8: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/8.jpg)
11/2/10
CIT Research Challenges (Cont’d)
• Service-Level Agreements [SAK08] A true commercial CIT must support SLAs in order to make a tradeoff between customer objectives and low level system issues such as computing costs
• Autonomic Scalability [CHI09]
Implementation of proper mechanisms in CIT layer for making infrastructures with the ability of scaling up or down automatically in face of the change of demands
• Energy Efficiency [ABD09] Tackling energy-awareness issues in virtualized environments by implementation of effective mechanisms in the CIT layer
![Page 9: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/9.jpg)
11/2/10
Available Cloud Infrastructure Technology Solutions
• OpenNebula [BAL09] • Nimbus [KEA08]
• Eucalyptus [NUR09 ]• Amazon Elastic Compute Cloud (EC2) [VAR08] • Xenoserver[KOT05]
![Page 10: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/10.jpg)
11/2/10
OpenNebula
• An advanced software framework for Cloud computing that supports Xen, KVM and VMware virtualization platforms
• Enable the dynamic placement of groups of interconnected virtual machines on distributed infrastructures
![Page 11: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/11.jpg)
11/2/10
Nimbus
• A CIT that is placed on the virtual infrastructure and provides the ability of dynamic management of virtual machines in the virtualized distributed environments
• Nimbus supports Xen and KVM virtualization technologies and acts similar to OpenNebula in many aspects such as creating and managing of VMs
• Handling the related security issues
![Page 12: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/12.jpg)
11/2/10
Eucalyptus
• An open source software layer that implements the infrastructure as a Cloud
• Eucalyptus’s architecture is modular, simple, and hierarchical
![Page 13: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/13.jpg)
11/2/10
Amazon Elastic Compute Cloud(EC2)• One of the Amazon web services that provides a resizable
capacity in Cloud computing environment• EC2 makes a business CIT for Cloud computing environments • Its main objective is to provide the needed capacity of
customers on demand Compute
Store Message
Elastic ComputeCloud(EC2)
Simple QueueService(SQS)
Simple Storage Service(S3)
![Page 14: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/14.jpg)
11/2/10
Xenoserver
• A CIT that provides a form of transparency in Global Public Computing model (any user, any code, anywhere)
• Global Public Computing is the same as Cloud Computing
![Page 15: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/15.jpg)
11/2/10
Case Study
• Provisioning Packet Compression Network Service for Virtualized Execution Environments:– Transparent
• No changes in applications
• No compilation or configuration of operating system
– Dynamically configurable• Administrator can (de)activate it easily
• Can be configured to serve selected virtual machines
1515
![Page 16: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/16.jpg)
11/2/10
Virtualization Technology
• Virtual Machine Monitor (VMM)– Has direct access to physical resources– Multiplex physical resources to virtual machines
• Implementation of a Service to change the way virtual machines access to resources inside VMM
Transparent Service• Transparent services need no modifications to applications or
operating systems.
1616
![Page 17: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/17.jpg)
11/2/10
Implementation
• Xen– Open Source– High Performance
• In a Xen-based virtualized environment Dom0 has direct access to physical resources.
1717
![Page 18: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/18.jpg)
11/2/10
Implementation (Cont’)• Typical networking path of an application running inside
DomU in a Xen-based environment
1818
Hardware
Xen
Dom0 DomU
TCP/IP Stack
Frontend Driver
Shared Memory Segment
Backend Driver
Bridging, Routing,…
Real Driver
NIC
Application
![Page 19: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/19.jpg)
11/2/10
Implementation (Cont’)
• Packet Compression Network Service has been Implemented as a Netfilter Kernel Module inside Dom0.– Transparent = Needs no change in applications and guest operating
systems– Can be dynamically inserted inside Dom0 kernel.– Provides a file-based configuration system using Proc filesystem.– Administrators can (de)activate it for specific virtual machines.
![Page 20: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/20.jpg)
11/2/10
Implementation (Cont’)• Packet Compression Network Service inserted inside Dom0
kernel
Hardware
Xen
Dom0 DomU
TCP/IP Stack
Frontend Driver
Shared Memory Segment
Backend Driver
Bridging, Routing,…
Real Driver
NIC
Application
Packet Compression Service
![Page 21: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/21.jpg)
11/2/10
Implementation (Cont’)• Packet Compression Network Service inserted inside Dom0
kernel
Dom0
Physical Machine 1NIC
Xen
DomU Guest
TCP Application
Packet Compression Service
Frontend Driver
Shared Memory
Backend Driver
Real Driver
Bridging, Routing
Dom0
Physical Machine 2 NIC
Xen
DomU GuestPacket Compression
Service
Frontend Driver
Shared Memory
Backend Driver
Real Driver
Bridging, Routing
WAN
TCP Application
![Page 22: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/22.jpg)
11/2/10
Evaluation
• Network performance evaluation results using Iperf benchmark
2222
0
2
4
6
8
10
12
Banndw
ith (Mbps)
![Page 23: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/23.jpg)
11/2/10
Conclusion• Cloud Computing as a distributed virtual environment.
• Clouds needs a software layer to provide virtual machines with different transparency types.
• As a case study, was presented the design and implementation of a transparent network service on Xen.
• This service can be operable without any change in operating system or applications.
![Page 24: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/24.jpg)
11/2/10
References
• [SMI05] J. E. Smith and R. Nair, "The Architecture of Virtual Machines", IEEE Computer Magazine, May 2005.
• [UHL05] R. Uhlig, G. Neiger, D. Rodgers et al., “Intel virtualization technology,” COMPUTER, vol. 38, no. 5, pp. 48-56, 2005.
• [TAN02] A.S Tanenbaum, M.V Steen and P. Hall, “Distributed Systems: Principles and Paradigms”, ISBN 0130888931,2002.
• [VOA09] J. Voas and J. Zhang, “Cloud Computing: New Wine or Just a New Bottle?”, Published by the IEEE Computer Society, 2009.
• [BAL09] C. V. Blanco, "The OpenNebula Virtual Infrastructure Manager", Xen Directions Europe 2009 joint with LinuxTag, Berlin, Germany, June, 2009.
• [KEA08] K. Keahey, T. Freeman, “Contextualization: Providing One-Click Virtual Clusters”, eScience 2008, Indianapolis, IN. 2008.
![Page 25: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/25.jpg)
11/2/10
References (Cont’d)
• [NUR09] D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, D. Zagorodnov, “The Eucalyptus Open-Source Cloud-Computing System”, International Symposium on Cluster Computing and the Grid, China, 2009.
• [VAR08] J. Varia,”Cloud Architecture”, J. Varia, “Cloud architectures”, Technical report, available at http://aws.typepad.com/aws/2008/07/white-paper-on.html
• [KOT05] E. Kotsovinos, ”Global Public Computing”, PhD dissertation, available as Computer Laboratory Technical Report UCAM-CL-TR-615, ISSN 1476-2986,2005.
• [ZHA09] Y. Zhao, and W. Huang, “Adaptive Distributed Load Balancing Algorithm based on Live Migration of Virtual Machines in Cloud,” 5th International Joint Conference on INC, IMS and IDC, NCM, Seoul, Korea,2009.
• [CAI09] G. Cai-dong, Z. Yu, and W. Jian-ping, “Image Knowledge Management and Rapid Precise Image-mining Technology Investigation in Internal Cloud Computing,” First International Conference on InformationScience and Engineering, ICISE, Nanjing, Jiangsu, China, 2009.
![Page 26: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/26.jpg)
11/2/10
References (Cont’d)
• [YUN10] Y. Jung, and M. Chung, “Adaptive Security Management Model in the Cloud Computing Environment,” 12th International Conference on Advanced Communication Technology, ICACT, Gangwon-Do, South Korea, 2010.
• [SAK08]R. Sakellariou, and V. Yarmolenko, “Job Scheduling on the Grid: Towards SLA-Based Scheduling,” In L. Grandinetti, editor, High Performance Computing and Grids in Action pages 207–222, 2008.
• [ABD09] H. S. Abdelsalam, K. Maly, R. Mukkamala, and D. Kaminsky,
“Analysis of Energy Efficiency in Cloud,” Computation-World, 416-421,
2009.• [CHI09]T. C. Chieu, A. Mohindra, A. A. Karve, and A. Segal, “Dynamic
Scaling of Web Applications in a Virtualized Cloud Computing Environment,”International Conference on e-business, ICEBE, Macau, China, 2009.
![Page 27: VMM-Level Distributed Transparency Provisioning Using Cloud ... · Computing model (any user, any code, anywhere) ... Transparent Service •Transparent services need no modifications](https://reader033.vdocument.in/reader033/viewer/2022060521/604f90ca2923064ffc116a12/html5/thumbnails/27.jpg)
11/2/10
Any Questions?