geni spiral 1 - internet2 · geni spiral 1 – multiple integrated ... – infinera transport...
TRANSCRIPT
October 6, 2008 www.geni.net 1
GENI Spiral 1 Global Environment for Network Innovations
Heidi Picher Dempsey ([email protected]), Michael Patton ([email protected])
GENI Project Office
www.geni.net Clearing house for all GENI news and documents
October 6, 2008 www.geni.net 2
GENI Spiral 1 - Outline
• Introduction and Context
• System Engineering
• System Integration
• Summary
October 6, 2008 www.geni.net 3
The GENI Vision A national-scale suite of facilities to explore radical designs for a future global networking infrastructure
Mobile Wireless Network Edge Site
Sensor Network
Federated International Infrastructure
Programmable & federated, with end-to-end virtualized “slices”
Heterogeneous, and evolving over time via spiral development
Deeply programmable Virtualized
October 6, 2008 www.geni.net 4
GENI in Context Supports the Evolving NetSE Research Agenda
“Voice of the Community” Definitive source of “what we need in GENI” Authors of GENI Research Agenda Technical advisory to GPO
Project management System engineering Prototype selection, funding, guidance Integration and early trials Home for Working Groups
Network Science & Engineering (NetSE)
Council
NSF CISE
GENI Project Office (GPO)
Evolving GENI Prototype Facility Suite
Evolving NetSE Research Agenda
3 to 4 years
October 6, 2008 www.geni.net 5
Spiral Development The GENI project evolves through a well-structured, adaptive process
• An achievable Spiral 1 Rev 1 control frameworks, federation of multiple substrates (clusters, wireless, regional / national optical net with early GENI ‘routers’, perhaps some existing testbeds), Rev 1 user interface and instrumentation.
• Envisioned ultimate goal Example: Planning Group’s desired GENI facility suite, probably trimmed some ways and expanded others. Incorporates large-scale distributed computing resources, high-speed backbone nodes, nationwide optical networks, wireless & sensor nets, etc.
• Spiral Development Process Re-evaluate goals and technologies yearly by a systematic process, decide what to prototype and build next.
GENI Prototyping Plan
Use
Planning
Design
Build out Integration
Use
October 6, 2008 www.geni.net 6
GENI’s Critical Technical Risks These risks drive the Prototyping Goals for GENI Spiral 1
GENI Clearinghouse
Components
Aggregate A Computer Cluster
Components
Aggregate B Backbone Net
Components
Aggregate C Metro Wireless
Create my slice
Critical Risk #1 Clearinghouse & control framework is central but never demonstrated
Critical Risk #2 End-to-end slices across multiple technologies have never been demonstrated
October 6, 2008 www.geni.net 7
Key Goals for GENI Spiral 1 Drive down the critical technical risks in GENI’s concept
GENI Clearinghouse
Components
Aggregate A Computer Cluster
Components
Aggregate B Backbone Net
Components
Aggregate C Metro Wireless
Create my slice
Goal #1 Fund multiple, competing teams to develop GENI Clearinghouse technology, encourage strong competition within the first few spirals
Goal #2 Demonstrate end-to-end slices across representative samples of the major substrates / technologies envisioned in GENI; Spiral 1 employs VLANs as “low hanging fruit”
October 6, 2008 www.geni.net 8
GENI Spiral 1 creates an early, nation-wide “native mode” GENI prototype suite as the framework for later spirals of integration and refinement.
Spiral 1 extensively leverages existing infrastructure and NSF-funded efforts
October 6, 2008 www.geni.net 9
A caveat GENI Spiral 1 will be very early prototyping!
• We are not trying to build a “real GENI” with these D&P efforts!
• We are trying to build a series of exploratory prototypes that will help the GPO, and the community as a whole, better understand the design space, risks, and potential research benefits of such facilities.
• We are attempting to gain insight and perform first explorations – not construct a production system.
October 6, 2008 www.geni.net 10
GENI Spiral 1 - Outline
• Introduction and Context
• System Engineering
• System Integration
• Summary
October 6, 2008 www.geni.net 11
GENI Spiral 1Overview
• Competing approaches to the GENI control framework • Prototypes of cutting-edge technology to implement slices, GENI’s
key virtualization feature, including sliceable switches, Ethernets, computing and server, optical equipment, wireless nodes, sensors, and the beginnings of sliceable FPGAs
• Interconnected national backbones, regional networks, and campus networks that can try out “native mode GENI” in Ethernet frames, thus allowing non-IP experimentation across wide-area slices
• Tools and techniques for user opt-in • GPO system engineering and integration
www.geni.net 11
GENI Spiral 1 – multiple integrated prototypes capable of limited operations in the first 6-12 months.
October 6, 2008 www.geni.net 12
GENI System Decomposition Overview
October 6, 2008 www.geni.net 13
GENI Spiral 1 - Outline
• Introduction and Context
• System Engineering
• System Integration
• Summary
October 6, 2008 www.geni.net 14
CREATE GENI SPIRAL 1—Integrate Across Projects and Technologies
• Integrate end-to-end data (experiment), control, measurement, and basic O&M functions at most sites.
• Integrate programmable GENI nodes in multiple substrate types including at least 2 major backbones, regional optical networks, campus networks, and wireless infrastructures.
• Integrate connections from campus/subscriber sites to programmable nodes in different substrates, enabling GENI "native mode" parts of Spiral 1. ("Native mode" won't extend to arbitrary Internet end users in Spiral 1)
• Integrate IP connectivity to/from GENI infrastructure. • Support users and traffic for live experiments in Spiral 1.
Spiral 1 Integration Priority Goals
October 6, 2008 www.geni.net 15
Spiral 1 Integration Priority Goals (cont)
STIMULATE BROAD COMMUNITY PARTICIPATION—Build Control Plane and Tools
• Integrate 27 projects in 5 prototype control frameworks. Show basic control functions operating between group members. We expect multiple users for each reference Clearinghouse and Component/Aggregate Manager software implementation.
• Operate multiple prototype Clearinghouses. (Operations between clearinghouses, is desirable, but not a priority for Spiral 1.)
• Develop Spiral 1 security design, security policies, and O&M policies for all deployed GENI infrastructure
• Provide researcher helper tools and measurement tools
BUILD A STRONG INDUSTRIAL/ACADEMIC BASE—Encourage Active Use
• Support active research experiment(s) in each clearinghouse. Spiral 1 researchers will be early adopters from outside the developer community.
• Integrate academic and commercial infrastructures in projects • Plan for large-scale commercial and academic environments
www.geni.net 15
October 6, 2008 www.geni.net 16 www.geni.net 16
Spiral 1 IP-only Integration Example
Substrate with Nodes
Aggregate with Resources
Slice
GENI IP dataplane
Experiment Plane
Experiment Control Plane
O&M Plane
Researcher server software running on shared GENI servers
Processors (virtual machines)
Clearinghouse
4 Nov 07
Aggregate Manager
Researcher
Internet End Users . . .download and use researcher's client software
. . .configures resources for experiment
Internet IP traffic border
October 6, 2008 www.geni.net 17
Spiral 1 "Native GENI" Integration Example
A host in Stanford connects to a cluster in Princeton, a city bus in Amherst, MA, and a mid-Atlantic compute engine, using a combination of IP tunnels, RON and Internet2 virtual Ethernets, and "Native GENI" topology.
www.geni.net 17
Enterprise GENI VLAN
Internet2 Virtual
Ethernet
GPN Programmable
Topology
Edge Compute
Resources
IP tunnels
Substrates
Researcher- Selected Topology
Slice Dataplane
October 6, 2008 www.geni.net 18
GENI Spiral 1: Shared Network Resources
Internet 2
1578 Overlay Hosting Nodes
1579 ProtoGENI
1595 Great Plains Network
1646 CMU Testbeds
1609 DETER
1642 Instrumentation
Tools
1613 Enterprise
GENI 1600
PlanetLab
1658 Mid-Atlantic
Network
1602 Sensor/Actuator Net
1582 ORCA/BEN
1599 Vehicular Mobile Net
1660 ORBIT
1601 Virtual Tunnels
1657 WIMAX
1663 Digital Object Regis
1633 Kansei Sensor Network
1628 Measurement
System
NLR
1604 GENI Meta Ops
1643 Programmable
Edge Node
1622 Provisioning
Service
1650 Regional Opt-In
1632 Security Architecture
1645 Million- Node GENI
Key: Layer 2 backbone connections (e.g. GbE)
General Internet
Any Internet connection
1610 GENI at 4-Yr Colleges
1653 Optical Layer Meas
1631 Optical Metrics
1619 Optical Access Nets
1621 GUSH Tools
www.geni.net 19
Internet2 Backbone Node Connection
• Internet2 will provide GENI a 10Gbps wave over the full Internet2 network footprint
– Infinera transport equipment interfaces the network line side using the Optical Transport Network (OTN) standard at the OTU-2 level (10Gbps)
– Infinera transport equipment interfaces the client line side with either GbE or 10GbE interfaces (among others e.g. SONET OC-n)
– Indiana GRNOC demarcation at Ethernet IF to Infinera transport
• Internet2 access (Infinera Transport) doesn’t allow optical experimentation • GENI node/subnet connections through additional Ethernet switch
Infinera Transport
Ethernet Switch
OTU-2 10 GbE
GbE GENI node/
subnet Ethernet
Internet
October 6, 2008
www.geni.net 20
Example Internet2 Regional Integration: Great Plains GENI
• GpENI provides a mix of networking technologies (optical switches and transport, sensors, FPGA’s) to be programmed and/or shared
• Optical experimentation at the regional optical network domain • Internet2 connection at Kansas-City, MO POP
www.geni.net 21
National Lambda Rail Backbone Node Connection
• Cisco ONS supports access to direct optical layer experimentation • NLR FrameNet services can provide GENI a 10Gbps Ethernet frame
service over the full NLR network footprint – Cisco transport equipment (MSPP + ONS) interfaces the network line side using
the Optical Transport Network (OTN) standard at the OTU-2 level (10Gbps) – Cisco transport equipment interfaces the client line side with either GbE or
10GbE interfaces (among others e.g. SONET OC-n) – GENI node/subnet connections may need Ethernet switch – Indiana GRNOC operates FrameNet
Cisco ONS 15808
Ethernet Switch
OTU-2 10 GbE
GbE Cisco MSPP 15454
OC-192
hν GENI node/subnet
Ethernet
Internet
October 6, 2008
www.geni.net 22
Example NLR Regional Integration: ORCA - BEN
• BEN provides a mix of networking technologies (optical and photonic switches) to be programmed and/or shared
• NLR connection at Raleigh, NC POP (near NCSU) October 6, 2008
www.geni.net 23
Cluster A Integration (uses DETER control framework)
www.geni.net 23
CENIC Los Nettos Internet2
DETER security testbed (100+ nodes, ISI, UC Berkley)
Global Research NOC (Indiana)
October 6, 2008
www.geni.net 24
Cluster B Integration (uses PlanetLab control framework)
www.geni.net 24
CENIC Great Plains Network Mid Atlantic Crossroads NEREN NOX NJEDge.Net MAGPI Internet2
PlanetLab resources (800+ nodes) VINI resources (virtual topologies) Enterprise GENI (VLAN slices) WU Overlay Hosting Nodes
Global Research NOC GUSH Tools Provisioning Service October 6, 2008
www.geni.net 25
Cluster C Integration (uses ProtoGENI Control Framework)
www.geni.net 25
Front Range GigaPOP KyRON Merit Southern Crossroads Three Rivers Optical Ex. Internet2
Emulab resources (370+ nodes) CMU Mobile and Broadband Testbeds (and users) UKY Edulab (compute/store) Virtual Tunnels (VINI,BGPMux)
Global Research NOC Instrumentation Tools (students) Measurement System (researchers) October 6, 2008
www.geni.net 26
Cluster D Integration (uses ORCA Control Framework)
www.geni.net 26
NCREN NEREN NOX OSCnet NRL
Metro-Scale Optical Testbed (BEN) ORCA resource leasing software CASA (radar, video, weather sensors) Kansei wireless sensor network arrays (~100 sensor nodes each)
Global Research NOC
October 6, 2008
www.geni.net 27
Cluster E Integration (uses ORBIT control framework)
www.geni.net 27
NJEDge.Net MAGPI NLR
ORBIT testbed software WINLAB wireless testbeds resources (400+ sensor nodes) NICTA (Australia) wireless outdoor traffic testbed) WIMAX base station demo
Global Research NOC
October 6, 2008
www.geni.net 28
• Detailed engineering for experiment plane (data) connections across multiple substrates in progress
• Engineering for control plane functions for 5 frameworks in progress • O&M integration follows control and data integration • Most projects start this October (track progress on web). Meeting at
GENI Engineering Conference 3 on 28-30 October (http://www.geni.net/GEC3/GEC3.html).
• Working Groups for review, feedback, design becoming active – End User Opt-In – Experiment Workflow and Services – Control Framework – Operations, Management, Integration and Security – Substrates
www.geni.net 28
Spiral 1 Integration Status
October 6, 2008
October 6, 2008 www.geni.net 29
GENI Spiral 1 - Outline
• Introduction and Context
• System Engineering
• System Integration
• Summary
October 6, 2008 www.geni.net 30
GENI Spiral 1 • Provides the very first, national-scale prototype of an interoperable
facility suite for Network Science and Engineering experiments
• Creates an end-to-end GENI prototype in 6-12 months with broad academic and industrial participation, while encouraging strong competition in the design and implementation of GENI’s control framework and clearinghouse
• Includes multiple national backbones and regional optical networks, campuses, compute and storage clusters, metropolitan wireless and sensor networks, instrumentation and measurement, and user opt-in
• Early Spiral 1 “native mode” GENI prototype suite will support early live experiments, and provide the framework for later spirals of integration and refinement.
Nothing like GENI has ever existed; the integrated, end-to-end, virtualized, and sliceable set of facilities created in Spiral 1 will be entirely novel.
October 6, 2008 www.geni.net 31
Questions
courtesy xkcd.com
?