[openstack day in korea] understanding openstack from sdn/nv viewpoint
DESCRIPTION
OpenStack Day in Korea. Understanding OpenStack from SDN/NV ViewpointTRANSCRIPT
Understanding OpenStack-leveraged
Service Realization from SDN/NV
Viewpoint
OpenStack Day in Korea
Dr. JongWon Kim
Networked Computing Systems Laboratory
School of Information and Communications
Gwangju Institute of Science & Technology (GIST)
Date: 2014. 2.18 Place: Sejong University, Seoul
Future
Landscape
GE Industrial Internet
Open Platform (Tool)
Service Software
Open Computing + Networking for
Future Internet Service Realization
Open
Infrastructure (Resource)
Big
Data
IoT /
Social
Contents
Open
Computing
+ Networking
Cloud
Open Innovation
Platform
Open Networking
Testbed R&D
Open Networking
Software R&D
산학연 R&D Consortium
FI Arch.
Services DevOps
with Testbed
CCN & DTN
Open Networking Research R&D
Balanced Service Composition based on
Programmable (and Virtualized) Resources
- 5 -
Workload
Fluidity
Workload
Abstraction
Application-centric
Virtual Playground
Templates
Software-Defined Data Center: Unified, Programmable & Virtualized Rsources
Configuration/Control/Visibility Challenges
for Software-Defined Infrastructure
Application-centric Virtual Playground with
SmartX Boxes (vNetworking/vCompute/vStorage Capabilities)
Compute
Storage
Networking X
Virtual Playground (Box, Role, Topology) Templates
Zero-touch Configuration
Flexible Control
(forwarding, …)
Instant Visibility
Collective Analysis
DevOps
Testbed: Wild &
Organized Playground
- 8 -
Play (Experiment) • Configuration • Control • Visibility
(Power User)
(Provider)
Provide Playground with Resources
DevOps
Testbed: DevOps + Key Components
Open SW Community
Meta-Operation
Programmable & Virtualized Resource Pool
Control Framework Instrumentation & Measurement
Experiment Control
Federation
F3 Racing Team = TB Center
White (=Dummy) Box SmartX Box
SDN & NfV (Network functions Virtualization)
Deployment Targets (v0.6)
Network Service Providers
(+ Multi-campus Enterprises)
Content/Application Service Providers
Cloud Data Center Networking
vSwitch
Networking Mobile / Wireless
Networking
Network functions Virtualization
Inter-DC / Multi-layer Optical Networking
Overlay Virtual
Networking
Last modified: 11/04/2013
Secure
Networking
Cloud WAN Fabric
(IP+Optical Integration)
Wireless +
Mobile
Wireless +
Mobile Wireless
+ Mobile
Futuristic Multilayer-integrated &
Convergent Networks (Cloud WAN Fabric + Service-aware Edge)
Cloud Data
Centers
Cloud Data
Centers
Service-aware Edge (MiddleBox, …)
Cloud DC
Cloud DC
Cloud Data
Centers
IP??, More Switching + Simpler Routing?
Last
Modified
11/02/2013
• Amazon AWS
• Microsoft Azure
• OpenStack
Cloud DC Traffic
Cisco Global Cloud Index
Cloud Market Trends
3-Tier
Application
Pattern @ DC
CLOS-based DC
Networking
Software-Defined Resource Convergence
• Toward Software-defined Data Center (Computing / Storaging) ⁞
– MicroServers
– Hyper-convergence boxes
⁞
– Networking specialized (with in-network processing) boxes
⁞
• Toward SDN-coordinated MiddleBox (Networking)
SmartX Box: Design and Prototyping with
OpenStack Leverage Simplified SmartX Rack
SmartX Box
Pools of SmartX Boxes: Massive scalability and pay-as-
you-grow flexibility
CPUs / GPUs
SSD / HDDs
Open vSwitch / NICs
VM VM VM VM VM
COMPUTE NETWORKING
STORAGE
OF@TEIN with SmartX Box vs ON.Lab’s
OpenCloud Pilot
VMVM
VM
L2
A Virtual PlaygroundFor Experiment A
L2
L3
VM
OF@TEIN Underlay Network
VMVM
VM
L2
A Virtual PlaygroundFor Experiment B
L2
L3
VMVM
VM
VM
L2
A Virtual PlaygroundFor Experiment Z
L2
L3
VM∙∙∙Service layer
(experiment layer)
Virtual Resourcelayer
Physical resource layer
VCPU
Memory
VM#1
Kernel OSKVM(Hypervisor)
Opnestack
Storage(SSD/HDD) Memory CPU NIC
SmartX Box #1
NovaVCPU Vmemory
Cindervstorage
Neutronvswitch
VCPU
Memory
VM#2
VCPU
Memory
VM#3
∙∙∙
VCPU
Memory
VM#1
Kernel OSKVM(Hypervisor)
Opnestack
Storage(SSD/HDD) Memory CPU NIC
SmartX Box #2
NovaVCPU Vmemory
Cindervstorage
Neutronvswitch
VCPU
Memory
VM#2
VCPU
Memory
VM#1
Kernel OSKVM(Hypervisor)
Opnestack
Storage(SSD/HDD) Memory CPU NIC
SmartX Box #K
NovaVCPU Vmemory
Cindervstorage
Neutronvswitch
VCPU
Memory
VM#2
VCPU
Memory
VM#3
ON.Lab OpenCloud Pilot
DevOps-based Templates for Virtual Playground
+ OpenStack Convergent Service APIs
+ SDN-Coordinated vNetworking
Representing Service Realization
Data Service
Engine
Data Model
Narinet OFS
NIA(Seoul)
OF@TEIN Infrastructure (2012~2013)
Indonesia
Malaysia
Vietnam
Philippines
Networked
Tiled Display
SmartX
Racks
(Type B)
EU (SmartFIRE)
Japan or USA
OF@TEIN OpenFlow Switch
Exp. Node (with HD camera)
Exp. Node (traffic generator)
Exp. Node
OpenFlow Production Switch
OpenFlow FlowVisor
OpenFlow Controller
OF@TEIN Portal
OF@TEIN SDN Tools
SmartX Rack
Jeju (Jeju)
26
Thailand
GIST (Gwangju)
VoD
Korea U
(Seoul)
Postech
(Pohang)
OF@KOREN
SmartX
Racks
(Type C)
Last Update: 2013-08-18
[Part 1] OF@TEIN Infrastructure: System
& Network Resources
27
VM
VM
VM
SmartX Racks
Networking &
FlowSpace
Resources
User Experiment
Software
OF@TEIN
Portal
User Experiment
Visibility
[Part 2] Supporting OF@TEIN SDN
Experiments
System, Network,
FlowSpace
Monitoring
FlowSpace
Management
Computing
Resource
FlowVisor
Configuration, Control, Visibility
L2 L3
A Virtual Playgroud
for
L2
VM VM VM VM
Resource Provisioning
for
Admin. Slice
PowerUser Slice
OF@TEIN SmartX Rack (Type B & B+)
Worker VM #1
Monitoring
Agent
Worker VM #2
Worker VM #3
Remote Power Mng.
NF/OVS Capsulator
Node
VM
#2
OpenFlow
Agent
SmartX-
Rack Agent
MediaX-VT
Agent
VM
#1
Dataplane OF Switch
Data Manag.
Management
VM (SmartX-Rack
/ OpenStack /
Monitoring Agents)
Worker VM #1
Worker VM #2
Worker VM #3 O
pe
n
vS
wit
ch
Management Switch
Remote Power Management
Storage
Manage
ment
• 3 Tier Nodes (Capsulator, OF Switch, Worker) • 3 Network Planes: Power + Management / Control / Data
SmartX Rack (Type B)
VM
VM
VM
OFS
VM
VM
VM
OFS
SmartX Rack (Type B+)
VM
VM
VM
OVS
VM
VM
VM
OVS
DevOps wth Chef: Automatic Installation + Configuration (+Verification) …
Box
Role (Function)
OF@TEIN SmartX Box (SmartX Rack Type C):
Site Installation
Postech KOREN NOC
GIST
Korea U Jeju Univ
Internet
SmartX Box C13
Br-int Br-tun
Worker nodes
SmartX Coordinator Box
Br-int
Br-ex Br-tun
Gateway Node OpenStack Orche-stration Node
Power / Management
Control Data
SmartX Box C14
Br-int Br-tun
Worker nodes
SmartX Box C15
Br-int Br-tun
Worker nodes
SmartX Box C12
Br-int Br-tun
Worker nodes
SmartX Box C11
Br-int Br-tun
Worker nodes
GIST
Last Update: 2013-11-01
VLAN ID = 602
VLAN ID = 603
VLAN ID = 601
P M C D
Provisioning Center Node
SmartX Control Box
SmartX SandBox
KOREN Network
Intel ONP
IBM M4
Unified and Virtualized Resources for
OF@TEIN Virtual Playground
VM VM
VM
L2
A Virtual Playground For Experiment A
L2
L3
VM
OF@TEIN Underlay Network
VM VM
VM
L2
A Virtual Playground For Experiment B
L2
L3
VM VM
VM
VM
L2
A Virtual Playground For Experiment Z
L2
L3
VM ∙∙∙ Service layer
(experiment layer)
Virtual Resource layer
Physical resource layer
VCPU
Memory
VM#1
Kernel OS KVM(Hypervisor)
Opnestack
Storage
(SSD/HDD) Memory CPU NIC
SmartX Box #1
Nova VCPU Vmemory
Cinder vstorage
Neutron vswitch
VCPU
Memory
VM#2
VCPU
Memory
VM#3
∙∙∙
VCPU
Memory
VM#1
Kernel OS KVM(Hypervisor)
Opnestack
Storage
(SSD/HDD) Memory CPU NIC
SmartX Box #2
Nova VCPU Vmemory
Cinder vstorage
Neutron vswitch
VCPU
Memory
VM#2
VCPU
Memory
VM#1
Kernel OS KVM(Hypervisor)
Opnestack
Storage
(SSD/HDD) Memory CPU NIC
SmartX Box #K
Nova VCPU Vmemory
Cinder vstorage
Neutron vswitch
VCPU
Memory
VM#2
VCPU
Memory
VM#3
KVM KVM
Open vSwitch
KVM
Open vSwitch Open vSwitch
L2
A Virtual Playground
L2
L3
Overlay Tunnels
Hardware
Software
Configuration
Narinet Open vSwitch
Control
Open vSwitch
VM VM VM
Neutron Swift Cinder
NOVA Glance
OF@TEIN Virtual Playground Creation: Autonomic Installation & Configuration with Templates
SmartX Box (Type C)
SSD/ HDDs
CPUs/ GPUs
Box Template A
Open vSwitch
VM VM
Neutron Swift Cinder
NOVA Glance
SSD/ HDDs
CPUs/ GPUs
Box Template B
VM
VM
Box
Coord
inator
Com
puting
Default
Role
CCN
X
Web
S
erve
r
Traffic
gene
rator
Topology
VM Images
Node Graphs
Visibility
VM VM VM VM
VP Template G-A’’
VP Template G-A’ VP Template G-A
Dynamic Virtual Playgrounds for SmartX
Box (Preliminary for Box/Role/Topology Templates)
13min 25min
13 min
13 min
25 min
25 min *Installation time은 추가 설치 내용에 따라서 변경
Connecting SmartX Racks (Type A*/B/B+)
for Static/Multi-user Playground
Site Overlay vNetworking: NVGRE Tunneling
& Tagging/Steering/Mapping
WAN
NVGRE
Tunnels * An OpenFlow Network
Island
HP
OF
Switch
HP
OF Switch
OVS Capsulator
OVS OF
Switch
Narinet
Capsulator
VM
VM
VM
VM
VM
VM
Gateway
Router
Flow Mapping with
Admin SDN Controller
Flow Steering with
User SDN Controllers
HP
OF Switch
Flow VLAN-ID Tagging for Hypervisor VMs
Embedding Virtual Nodes into SmartX Box (Partially for Role/Box/Topology Templates)
SmartX Rack (Type B+)
Overlay vNetworking: Automatic Site Tunnel
Configuration & FlowSpace Management (Partially for Topology/Box/Role Templates)
VM
VM
VM
VM
HP5400
VM
VM
VM
VM
VM
VM
VM
VM
HP3500
Admin SDN Controller
Current Bridge state Current Tunnel state
Add_gre_tunnel() Add_flow_table() Clear_site()
Set_DPID() Set_controller()
Configuration Controller list DPID list Site-Capsulator list (IP, PORT) Allowed flows-tunnel mapping list
Management OVS-Bridge information Capsulator Flow table GRE Tunnel information Tunnel list
OpenStack Neutron ML2 (Modular Layer 2)
Plugin
Open DayLight Project OVSDB Integration
Open Software and Demo
Running OF@TEIN Experiments
Demo
Visual
OF@TEIN Network
Monitoring
39
OF@TEIN System
Monitoring
User Experiment
Console
User Experiment
Visibility
OF@TEIN FlowSpace Monitoring
OF@TEIN Portal
OF@TEIN (SmartX Rack
A*/B/B+)
OF@TEIN (SmartX Box
= SmartX Rack Type C)
Play SDN (+ Cloud Computing) experiments with your own controller!
FlowVisor (v1.4) OF@TEIN
Admin Script
VL
AN
-ba
sed
Flo
wR
an
ge
VL
AN
-ba
sed
Flo
wR
an
ge
VL
AN
-ba
sed
Flo
wR
an
ge
VL
AN
-ba
sed
Flo
wR
an
ge
NOX Controller
Floodlight Controller
Open Daylight
Controller
FlowSpace
Management Floodlight Controller
OF Switch
OF Switch
OF Switch
DPID-PortRanges FlowRanges
OF@TEIN Networking & FlowSpace Resources
VLAN ID
Supporting Multiple SDN Users with their
own Controllers via FlowVisor
Preliminary OF@TEIN Experiment LifeCycle
Design
Execute Finish
Note: Based on simple
PING experiment
FlowSpace Register
(FlowVisor)
Design Experiment
Experiment Credential
(SU Key Exchange)
Remote Access
(SU account)
Establish Management Environment
Custom Images
(Linux+SSH)
Data and Image Replication
(FTP)
Box Inst. &
Conf. Templates (SSH + Chefs)
Topology (Datapath & Tunnel )
Templates (OVS+BASH)
Resources Allocation
Configure & Initialize Services
Role
(function) Inst. & Conf. Templates (SSH +Chefs)
Script (BASH)
Log Files (BASH File I/O)
Experiment Output/ Status
(BASH stdout)
Monitor & Analyze
Experiment
Experiment UI Display
(Java Script)
Experiment Analysis
Display Management (Java Script)
Script (BASH
Clean Up Output or Status
(BASH stdout)
Draft Script
(BASH)
Check & Execute
Experiment
Resource Clean Up
Host/IP Resolution
(Hostname file)
Box Register (Horizon)
Provision
Thank you!
Send Inquiry to [email protected]
http://netmedia.gist.ac.kr
Gwangju Institute of
Science & Technology
Thank you!
43