-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
1/48
Cloud ComputingOpenStackVNG Infrastructure platform
Tran Anh Nhan
IRD department headPham Tran Kim Chi Lead System Engineer
May 2014
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
2/48
Cloud Computing - OpenStack - VNG - IRD
Agenda
VNG - IRD What is Cloud Computing?
OpenStack Architecture
OpenStack Networking
Deployment Model
Ceilometer
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
3/48
Cloud Computing - OpenStack - VNG - IRD
New Section
VNG Corp introduction
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
4/48
Cloud Computing - OpenStack - VNG - IRD
VNG Corporation
Game publisher/developer (VLTK, VLCM,Gunny, Boom, Khu vuon tren may,ZingPlay )
Online music/media (ZingMP3, ZingTV) Social network (Zing Me, Zalo)
E-commerce (123mua.vn, 123pay.vn)
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
5/48
Cloud Computing - OpenStack - VNG - IRD
IRD DepartmentResearch and build the infrastructure platform forVNG to enhance business, optimize quality and cost,meet the new technology. Content Delivery Network (CDN) system is used
by all VNG products that want to optimize static
bandwidth. Live-streaming system is a streaming platform for
Zing events, Talk TV. OpenStack provides servers and networks for
some products with a small scale (in pilot phase.Project Team is receiving feedback for furtherenhancement).
Object storage (in POC phase).
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
6/48
Cloud Computing - OpenStack - VNG - IRD
New Section
What is Cloud Computing?
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
7/48
Cloud Computing - OpenStack - VNG - IRD
References
Gartner Synergy research
The National Institute of Standards and
Technology (NIST) Cloud computing today
451 Research
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
8/48
Cloud Computing - OpenStack - VNG - IRD
Number & trend
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
9/48
Cloud Computing - OpenStack - VNG - IRD
Number & trend
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
10/48
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
11/48
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
12/48
Cloud Computing - OpenStack - VNG - IRD
What is Cloud computing?
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
13/48
Cloud Computing - OpenStack - VNG - IRD
Cloud Services
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
14/48
Cloud Computing - OpenStack - VNG - IRD
Cloud Services
AWS #1 of cloud services provider - What services
AWS provide? Amazon Web Services (AWS) continues to dominate
the IaaS and PaaS space in terms of revenue. AWS:3.8$B revenue (2013)
Compute & Networking (Amazon EC2, Auto Scaling,
Elastic Load Balancing, Route 53 ,..) Storage & CDN (Amazon S3, Amazon Glacier a low
cost storage for backup, Amazon EBS, CloudFront/CDN)
DB Cache: RDS (MySQL, Oracle, SQL Server, and
PostgreSQL), DynamoDB (NoSQL data store),ElastiCache (In-Memory Caching Service), Redshift(Data Warehouse Service)
Application services: Elastic Transcoder,..
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
15/48
Cloud Computing - OpenStack - VNG - IRD
Cloud Orchestration Framework
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
16/48
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
17/48
Cloud Computing - OpenStack - VNG - IRD
History
OpenStack is an open source IaaSinitiative for managing and creating hugegroups of virtual private servers in a cloud
computing environment. It was initiallydeveloped by Rackspaceand NASA.
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
18/48
Cloud Computing - OpenStack - VNG - IRD
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
19/48
Cloud Computing - OpenStack - VNG - IRD
Nowadays
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
20/48
Cloud Computing - OpenStack - VNG - IRD
Servers Storage
Network switch Network switch Network switch
Virtualization Solution (VMWare VCenter,Citrix XEN Server, Ovirt, Proxmox.)
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
21/48
Cloud Computing - OpenStack - VNG - IRD
Cloud Infrastructure
Modular architecture Designed to easily scale out
Based on set of core services
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
22/48
Cloud Computing - OpenStack - VNG - IRD
OpenStack Platform
Servers Storage
Network switch Network switch Network switch
Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
23/48
Cloud Computing - OpenStack - VNG - IRD
Infrastructure As A Service Overview
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
24/48
Cloud Computing - OpenStack - VNG - IRD
Infrastructure As A Service roles
Cloud Ops: monitor/add/remove physicalcompute nodes, storage nodes, controllernodes, network nodes.
App Owner: add/remove/upgrade cloud
services, check billing status. Dev Ops: launch/ terminate/ scale instances,
storage. Register/ unregister new image.Backup/ restore instances/ storage. These
tasks can be done via dashboard or API. App Devs: call the dev ops tasks inside
application logical flow.
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
25/48
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
26/48
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
On-Demand Self-Services
Resource
pooling
Broad
Network
Access
Mesearued
services
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
27/48
Cloud Computing - OpenStack - VNG - IRD
OpenStack Architecture
Hypervisor
Server
Storage Network
Nova compute Cinder Neutron
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
28/48
Cloud Computing - OpenStack - VNG - IRD
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
29/48
Cloud Computing - OpenStack - VNG - IRD
New SectionOpenStack Networking
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
30/48
Cloud Computing - OpenStack - VNG - IRD
OpenStack Networking
management network
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
31/48
Cloud Computing - OpenStack - VNG - IRD
Network Node Compute Node
phy-br-
em2
phy-br-
em2
em1: 172.16.0.2 em1: 172.16.0.3
em2: no ip address
em2: no ip address
Nova API
ovs/ br-int
dnsmasq
dchp agentIP name space
Nova Compute
tap-xx
qvo-xx
int-br-em2
tap-xx qvb-xx
Linux bridgeqbr-xxxxx
Instance
eth0
ovs/ br-int
qvo-xx
int-br-em2
veth
Neutron API0.0.0.0:9696
dedicated physical VLAN for neutron traffic between nodes
neutron ovs plugin
veth
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
32/48
Cloud Computing - OpenStack - VNG - IRD
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
33/48
Cloud Computing - OpenStack - VNG - IRD
New SectionDeployment Model
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
34/48
Cloud Computing - OpenStack - VNG - IRD
CinderAPI
COROSYNC + HAProxy
Controller 01 Controller 02
RabbitMQ
Keystone
GlanceAPI
NovaAPI
PACEMAKER
Compute node 1
Compute node n
Ceph node 1
Ceph node n
QEMU
Driver
Ceph node 2Compute node 2
RBD Driver
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
35/48
Cloud Computing - OpenStack - VNG - IRD
OpenStack Networking
Neutron Server
Switch InterfaceDriver
Physical switch
Controller Node
OVS Plugin
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
DHCP
InstancesInstances
OVS Plugin
Openvswitch
Instances
Compute Node
Neutron OVS agent
InstancesInstances
L3 Agent DHCP L3 Agent
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
36/48
Cloud Computing - OpenStack - VNG - IRD
Feature
Launch instance
Snapshot/ restore instance
Attach device to instance
Snapshot/ restore attach device Scale up instance
Internal network for instances
Provide instances with VLAN as productrequires.
Instances are stored totally in Ceph Storage.
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
37/48
Cloud Computing - OpenStack - VNG - IRD
DEMO
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
38/48
Cloud Computing - OpenStack - VNG - IRD
New SectionCeilometer
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
39/48
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
40/48
Cloud Computing - OpenStack - VNG - IRD
Monitoring
Monitor physical host by cacti, graphite,zabbix.
Monitor instances status by ceilometer.
Monitor OpenStack statistics byceilometer.
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
41/48
Cloud Computing - OpenStack - VNG - IRD
Ceilometer
Objectives Ceilometer component
Ceilometer collect data
Access collected data
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
42/48
Objectives
Provide a infrastructure to collectany information in OPS.
Publish information for other
monitoring. Integrate with Heat for trigger auto
scale.
Celiometer - OpenStack - VNG - IRD
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
43/48
Ceilometer collect data
Bus listener Polling agent
Push agents
Celiometer - OpenStack - VNG - IRD
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
44/48
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
45/48
Cloud Computing - OpenStack - VNG - IRD
Process meter
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
46/48
Access collected data
Via API Via Ceilometer command
Celiometer - OpenStack - VNG - IRD
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
47/48
Cloud Computing - OpenStack - VNG - IRD
DEMO
-
8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG
48/48
Q & A