cron: cyber-infrastructure for reconfigurable optical networks pi: seung-jong park, co-pi: rajgopal...

1
CRON: Cyber-infrastructure for Reconfigurable Optical Networks PI: Seung-Jong Park, co-PI: Rajgopal Kannan GRA: Cheng Cui, Lin Xue, Praveenkumar Kondikoppa, Chui-Hui Chiu Computer Science and Center for Computation & Technology CRON (http://www.cron.loni.org) Experimental Networking Testbed for 10Gbps High Speed Networks and Cloud Computing Research Over High Speed Networks. Introduction to CRON Research Impact of CRON Next generation networking and computing research Distributed computing for large scale computational sciences Physics, Computational Biology, Remote visualization, etc Federation with MAX PlanetLab Components Hardware Cisco N5000 switch with 48 X 10Gbps ports High-end servers with 10GE NICs 10Gbps hardware emulators Software Emulab-based interface & controller 10Gbps software emulators (optimized Dummynet & Netem) Example Scenario Y-shape Topology 1 virtual router (3X10Gbps NICs) 3 X 10Gbps virtual links (30ms delay) 2 competing flows Software OS: Ubunto 64bit & FreeBSD 64bit Measurement S/W : Nuttcp & iPerf TCP variants: TCP Reno, HSTCP, Cubic , HTCP, Hadoop etc. Virtual Cloud Computing Clusters with 10Gbps High Speed Network at CRON Configuration of Multiple Clouds over CRON CRON@ProtoGeni MAX@PlanetLab GENI Aggregate Managers (AM) at CRON and MAX provide resources to experimenters with GENI credentials. A GENI user creates slice/slivers which hold a collection of computing resources capable of running an experiment from CRON and MAX. The Internet2 ION Aggregate Manger does VLAN stitching to connect CRON and MAX. <stitchingResourceid="urn:aggregate=geni.maxgigapop.net:r spec=maxpl_lsutestslice1:stitching=3022" type="p2pvlan"> CLC-Cloud2 CLC-Cloud1 NC1-Cloud1 NC2-Cloud1 NC1-Cloud2 NC2-Cloud2 Router1 Router2 10Gbps,120ms LAN-Cloud1 LAN-Cloud2 Link Create Nodes set CLC-Cloud1 [$ns node] set NC1-Cloud1 [$ns node] set NC2-Cloud1 [$ns node] Create a LAN set LAN-Cloud1 [$ns make-lan "$CLC-Cloud1 $NC1-Cloud1 $NC2-Cloud1" 1000 Create a link with delay set Router1toRouter2 [$ns duplex-link $Router1 $Router2 10000Mb 120ms D planetlab 2 planetlab 3 planetlab 5 MAX Aggregate Manager CRON Router LONI Switch Internet Internet2 ION (10Gbps) Node1 Node2 Node3 CRON Aggregat e Manager Listresources Createslice Createsliver Experiments VLAN3022 VLAN3023 VLAN3025 VLAN stitching Data plane Control plane Resource allocation ION Aggregate Manager MAX PlanetLab (PlanetLab Framework) MAX Dragon Switch CRON (ProtoGeni Framework) High Speed Networks Based on Emulation Control Plane Cloud Management System (Eucalyptus) Cloud Management System (Eucalyptus) VM VM VM VM VM VM VM VM VM VM VM VM VM VM Distributed Computing Framework (Hadoop, MapReduce) Computational Biology Applications Software Stack Network Topology CRON Experiment Scenario over CRON Configure Cloud Computing Clusters and High Speed Networks 2 Virtual Eucalyptus Clouds connected with 10Gbps routers and links 2 virtual routers and emulated network links Install Distributed Computing Framework Hadoop, HDFS Run Computational Biology Applications Hadoop-based Java codes for AutoDock and CloudBurst Configure a experiment slice with a TCL script over CRON Physical machines with Ubuntu 10.04 OS 2 virtual routers connecting 3 X 10Gbps virtual links 1 emulated link with 10Gbps bandwidth and 120ms delay Setup virtual machines at two virtual clouds Create an additional virtual interface with NEuca@Renci

Upload: colin-gerald-carson

Post on 26-Dec-2015

218 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: CRON: Cyber-infrastructure for Reconfigurable Optical Networks PI: Seung-Jong Park, co-PI: Rajgopal Kannan GRA: Cheng Cui, Lin Xue, Praveenkumar Kondikoppa,

CRON: Cyber-infrastructure for Reconfigurable Optical Networks

PI: Seung-Jong Park, co-PI: Rajgopal Kannan

GRA: Cheng Cui, Lin Xue, Praveenkumar Kondikoppa, Chui-Hui ChiuComputer Science and Center for Computation & Technology

CRON (http://www.cron.loni.org)Experimental Networking Testbed for 10Gbps High Speed Networks and Cloud Computing Research Over High Speed Networks.

Introduction to CRON

Research Impact of CRONNext generation networking and computing researchDistributed computing for large scale computational sciences Physics, Computational Biology, Remote visualization, etc.

Federation with MAX PlanetLab

ComponentsHardware

Cisco N5000 switch with 48 X 10Gbps ports

High-end servers with 10GE NICs10Gbps hardware emulators

Software Emulab-based interface & controller 10Gbps software emulators

(optimized Dummynet & Netem)

Example ScenarioY-shape Topology

1 virtual router (3X10Gbps NICs)

3 X 10Gbps virtual links (30ms delay)

2 competing flows

SoftwareOS: Ubunto 64bit & FreeBSD 64bitMeasurement S/W : Nuttcp & iPerfTCP variants: TCP Reno, HSTCP,

Cubic , HTCP, Hadoop etc.

Virtual Cloud Computing Clusters with 10Gbps High Speed Network at CRON

Configuration of Multiple Clouds over CRON

CRON@ProtoGeni MAX@PlanetLabGENI Aggregate Managers (AM) at CRON and MAX provide resources to experimenters with GENI credentials.A GENI user creates slice/slivers which hold a collection of computing resources capable of running an experiment from CRON and MAX.The Internet2 ION Aggregate Manger does VLAN stitching to connect CRON and MAX. <stitchingResourceid="urn:aggregate=geni.maxgigapop.net:rspec=maxp

l_lsutestslice1:stitching=3022" type="p2pvlan">

CLC-Cloud2CLC-Cloud1

NC1-Cloud1

NC2-Cloud1

NC1-Cloud2

NC2-Cloud2

Router1 Router2

10Gbps,120ms

LAN-Cloud1 LAN-Cloud2

Link

① Create Nodes set CLC-Cloud1 [$ns node] set NC1-Cloud1 [$ns node] set NC2-Cloud1 [$ns node]② Create a LAN set LAN-Cloud1 [$ns make-lan "$CLC-Cloud1 $NC1-Cloud1 $NC2-Cloud1" 10000Mb 0ms]③ Create a link with delay set Router1toRouter2 [$ns duplex-link $Router1 $Router2 10000Mb 120ms DropTail]

planetlab2

planetlab3

planetlab5MAX Aggregate Manager

CRONRouter

LONI Switch

Internet

Internet2 ION(10Gbps)

Node1

Node2

Node3

CRON Aggregate Manager

① Listresources ② Createslice ③ Createsliver ⑥ Experiments

VLAN3022

VLAN3023

VLAN3025

⑤ VLAN stitching

Data planeControl plane

④Resource allocation

IONAggregate Manager

MAX PlanetLab (PlanetLab Framework)

MAX Dragon Switch

CRON(ProtoGeni Framework)

High Speed NetworksBased on Emulation

Control Plane

Cloud Management System (Eucalyptus)

Cloud Management System (Eucalyptus)

VM VM VM VM VM VM VM VM VMVMVMVMVM VM

Distributed Computing Framework (Hadoop, MapReduce)

Computational Biology Applications

Software Stack

Network Topology

CRON

Experiment Scenario over CRON

Configure Cloud Computing Clusters and High Speed Networks2 Virtual Eucalyptus Clouds connected with 10Gbps routers and links2 virtual routers and emulated network links

Install Distributed Computing FrameworkHadoop, HDFS

Run Computational Biology ApplicationsHadoop-based Java codes for AutoDock and CloudBurst

Configure a experiment slice with a TCL script over CRONPhysical machines with Ubuntu 10.04 OS2 virtual routers connecting 3 X 10Gbps virtual links 1 emulated link with 10Gbps bandwidth and 120ms delay

Setup virtual machines at two virtual cloudsCreate an additional virtual interface with NEuca@Renci