sponsored by the national science foundation a geni wimax infrastructure for research experiments...

Sponsored by the National Science Foundation

A GENI WiMAX Infrastructure for Research Experiments

Harry Mussman

GENI Project Office at Raytheon BBN Technologies

Sept 20, 2010www.geni.net

Sponsored by the National Science Foundation 2Sept 20, 2010

• What is GENI?– Infrastructure for research in network science and

engineering– Prototyping using spiral development– Conceptual design

• Meso-scale infrastructure build-out

• WiMAX base station

• WiMAX research experiments


What is GENI?

• The Global Environment for Network Innovations (GENI) is a novel suite of infrastructure now being designed to support experimental research in network science and engineering.

• Networks are broadly defined with multiple layers of abstraction, from physical substrates, through the architecture and protocols, to networks of people, organizations, and societies.


Prototyping GENI

• GENI prototyping began in 2007, when NSF awarded the GENI Project Office (GPO) role to BBN Technologies.

• The GPO subsequently initiated a community-based design and planning process, and issued a set of academic / industrial subcontracts to begin to build, integrate and operate the earliest GENI prototype called GENI Spiral 1.

• With the completion of Spiral 1 after one year, a second round of subcontracts was issued to begin to build GENI Spiral 2.

• See www.geni.net for a comprehensive view of GENI.


Spiral Development

GENI Prototyping Plan

Use

Planning

Design

Build outIntegration

Use

• Now: End of GENI Spiral 2Early experiments, meso-scale build, interoperable control frameworks, ongoing integration, system designs for security and instrumentation, definition of identity management plans.

• Envisioned ultimate goal Incorporates large-scale distributed computing resources, high-speed backbone nodes, nationwide optical networks, wireless & sensor nets, etc.

• Spiral development processRe-evaluate goals and technologies yearly by a systematic process, decide what to prototype and build next.


Spiral 2 Academic-Industrial Teams

CNRI


Conceptual Design

Federated heterogeneous infrastructure

Evolving over time via spiral development

Deeply programmableVirtualized (shared)


• What is GENI?

• Meso-scale infrastructure build-out– Started in Spiral 2– Includes WiMAX build-out at 9 sites

• WiMAX base station



Meso-scale Infrastructure Build-out

WiMAX

ShadowNet

Salt Lake CityKansas City

DCAtlanta

StanfordUCLAUC BoulderWisconsinRutgersNYU PolytechnicUMassColumbiaBBN Technologies

OpenFlowBackbonesSeattleSalt Lake CitySunnyvaleDenverKansas CityHoustonChicagoDCAtlanta

OpenFlowStanford

U WashingtonWisconsin

IndianaRutgers

PrincetonClemson

Georgia Tech


WiMAX Build-out Essentials

• Operation in Educational Broadband Services band

• WiMAX base station kit provided for each site

• Experiment control structure using OMF/OML


WiMAX Base Station


WiMAX Build-out Essentials (1)

• Operation in Educational Broadband Services band– 2.6 GHz, 10MHz or 5MHz bands– Educational licenses still held by some universities– Many universities have leased license to Clearwire, but

Clearwire is obligated to continue some “educational use”

– Can often get experimental license for a band, subject to use by owner/lessee (e.g., Clearwire)

– Some 5 MHz bands found with no owners/lessees– See http://groups.geni.net/geni/wiki/WiMAXInteg#a5.4GENIWiMAXLicenses

and Tony Michel at Raytheon BBN Technologies



• WiMAX base station kit provided for each site– Open and programmable– Virtualizible (can be shared, to support multiple

experiments)– Affordable (because limited to one 120-degree sector)– Software developed by Rutgers WINLAB and NEC

Labs; see http://groups.geni.net/geni/wiki/WiMAX

– Commercial WiMAX hardware (and low-level software) provided by NEC

– Kits built and distributed by Rutgers WINLAB; see http://groups.geni.net/geni/wiki/WIMXRG



• Experiment control structure uses OMF/OML– ORBIT Management Framework (OMF) – ORBIT Measurement Library (OML) – Both developed and supported by Rutgers WINLAB

and NICTA (Australia)– OMF provides tools to describe, instrument, and

execute experiments; see http://omf.mytestbed.net/

– OML allows sampling, processing and collection of measurements from resources within an experiment; see http://omf.mytestbed.net/wiki/oml

– OMF/OML has been extended to support mobile experiments; see http://groups.geni.net/geni/wiki/ORBIT


WiMAX Build-out Status

• See current view at http://groups.geni.net/geni/wiki/WiMAXInteg

• All sites have FCC licenses– Most obtained experimental license within a few weeks after application

to the FCC• Sites in operation:

– Rutgers WINLAB (2Q09)– BBN Technologies (3Q10)– NYU Polytechnic (3Q10)– Stanford (separate process)

• Sites still being planned or installed:– UCLA– UC Boulder– Wisconsin (will add two kits to existing Cisco system)– UMass Amherst– Columbia Univ


WiMAX installation at Rutgers WINLAB

• Outdoors:– NEC 120-degree

sector antenna

• Indoors:– NEC Outdoor Unit

(ODU)

– NEC Indoor Unit (IDU)

– Server with ASN GW


Coverage map of the WiMAX BaseStation

MeasuredRSSI


WiMAX installation at Raytheon BBN Technologies

• Outdoors:– Omni antenna (on top)

– NEC 120-degree sector antenna (aimed towards Boston)

– Patch antenna

– GPS antenna (for timing)

– NEC Outdoor Unit (ODU)

– Coax switching and power junction box

• Indoors:– NEC Indoor Unit (IDU)

– Base Station Server

– OMF/OML Server


WiMAX installation at NYU Polytechnic

• Outdoors:– NEC 120-degree

sector antenna

– GPS antenna (for timing)

– NEC Outdoor Unit (ODU)

• Indoors:– NEC Indoor Unit

(IDU)

– Server with ASN GW


WiMAX Build-out Next Steps

• Next steps for operating sites :– Complete integration, harden software package– Procure endpoint devices (Windows PCs with dongle, Linux PCs with

WiMAX card, Android handsets, mobile nodes, etc.) – Add site monitoring– Evaluate coverage and throughput (consider antenna choice: sector

and/or omni)– Establish OMF/OML– Connect to GENI backbone– Federate with other sites for coordinated experiments

• Next steps for non-operating sites :– Complete site selection and planning, particularly RF cell design– Complete installation and bring-up


Outline

• What is GENI?

• Meso-scale infrastructure build-out

• WiMAX base station– Kit– Data path– OMF/OML for experiment control– Clients



WiMAX Base Station


WiMAX Base Station Kit

• Kit provided for each site– Additional kits can be ordered

• Kits built and distributed by Rutgers WINLAB; see http://groups.geni.net/geni/wiki/WIMXRG

• Commercial WiMAX hardware (and low-level software) provided by NEC– Affordable (because limited to one 120-degree sector)– Full 360-dgree cell possible with additional hardware

• Software developed by Rutgers WINLAB and NEC Labs; see http://groups.geni.net/geni/wiki/WiMAX – Open and programmable (or configurable) where possible– Virtualizible: can be shared, to support multiple experiments


Base Station Kit: NEC Hardware


Base Station Data Path

• Virtualizable into multiple slices for multiple researchers/experiments– Each Client is assigned to one slice– Traffic flows from different slices are handled separately– All packet forwarding is done at L2, so can be used for

experiments with non-IP protocols

• Programmable– Can set WiMAX radio configurations for all traffic– API defined for each virtual base station– Similar features to that provided on the raw base station (Add

client, remove client, setup service flows …)


Base Station Data Path: BTS

• The BTS itself is a black box• Hence, the slice isolation mechanism and control

framework is outside of this box

ASN GW

VirtualBTS

Base Station (BTS)

Un-modified WiMAXBTS

(Black box)

Dataandcontrolpipes


Base Station Data Path: ASN GW

• Removed all default IP routing, simplified ASN controller*• All switching purely based on MAC addresses• Implemented the VNTS shaping mechanism in click for

slice isolation

ASN GW

VirtualBTS

Base Station (BTS)

* work done at NEC


Base Station Data Path: VirtualBTS

• Redirect all traffic from VLANs to individual slices• Similar redirection from slices to outbound VLAN

interfaces• AggMgr for creation, destruction, maintenance of slices,

adding clients, slice allocation control …

Virtual machine instances

Dynamicallycreated VLANs

ASN GW

VirtualBTS

Base Station (BTS)

28


OMF/OML for Experiment Control


WiMAX Clients

• Windows PC with USB-connected WiMAX modem– Example: AWB (Accton Wireless Broadband) US210 WiMAX USB

adapter, using Beceem chips, and works with any network ID– No current support for application on PC– Summary: Limited use

• Linux PC with Intel 5150/5350 mini-PCI express card WiMAX modem

• Android handset with WIMAX capability

• Mobile Linux PC platform with WiMAX modem


WiMAX Client: Linux PC

• Linux PC with Intel 5150/5350 mini-PCI express card WiMAX modem– Examples: Samsung NC10,

Dell Inspiron Mini 1012– Open-source driver, can work

with any network ID– Full support for custom

applications– Full support for OMF/OML

applications and control, including image loading

– Summary: Currently the most capable client

Intel 5150/5350mini-PCI express cardwith Linux driver

OMF/OML Client Srvc’s

Experiment App Resource Cntrl Measurement Client


WiMAX Client: Android Handset

• Android handset with WIMAX capability– Example: HTC EVO 4G

handset, sold by Sprint– As sold, locked to Sprint; how

to allow connection to GENI network?

– How to support custom applications?

– How to support OMF/OML applications and control?

– Summary: Very attractive for certain uses; working to resolve issues


WiMAX Client: Mobile Linux PC Platform

• Mobile Linux PC platform with WiMAX modem– Example: Modified ORBIT

node, developed by Rutgers WINLAB with added WiMAX modem

– Full support for OMF/OML applications and control

– Summary: Has worked well for significant mobile experiments

ORBIT Node




• What is GENI?• Meso-scale infrastructure build-out• WiMAX base station

• WiMAX research experiments– Default slice for Internet access– Coverage and throughput evaluation– Custom applications for campus opt-in– Mobile experiments using OMF/OML features– Next?


WiMAX Experiments: Internet Access

• Internet access– Default slice– Mobile associates, after matching with entry in access

list– Mobile gets added to default slice, starts UL traffic– Allows browsing, etc., from mobile, and verifies basic

functionality– Status: Working

PhysicalBTS

ASN-GWAir

InterfaceInternet


WiMAX Experiments: Site Coverage

• WiMAX site coverage and throughput evaluation– Needs to be done for each site– Use Linux PC with Intel card, GPS sensor, and full support

for OMF/OML applications and control – Need to measure RSSI vs location, and run iperf, to

evaluate coverage and throughput– Status: Started, based on existing WiFi application

PhysicalBTS

AirInterface




WiMAX Experiments: Campus Opt-In

• Campus opt-in – Custom applications of any type, networking to social– Handset or laptop, or both?– One site or multiple sites?– Is coverage at site sufficient? outside and inside?

– How do we attract such experiments?– How do we support such experiments?

– What would you like to do?

PhysicalBTS

ASN-GWAir

InterfaceApplication

Server


WiMAX Experiments: Mobile

• Mobile experiments– Use OMF/OML mobility features: cache when disconnected;

GPS-driven trip wire/area– Example: ParkNet experiment; done using WiFi; see Marco

Gruteser and “ParkNet: Drive-by Sensing of Road-Side Parking Statistics”, at MobiSys 2010

– See planned demo for GEC9, using WiMAX

– What would you like to do?



Ultrasonic sensor on car, connected to mobile Linux PC with GPS sensor



Visualization of data on available parking spaces


WiMAX Experiments: Next?

• Next?– Compare handover mechanisms?– Evaluate transport mechanisms?– Try new security mechanisms?– What would you like to do?

• How?– The GPO is here to help– Become part of the GENI community– Evaluate what can be done– Utilize one of the GENI sites, working with owner– Contribute new capabilities

• Limited only by your imagination!


Acknowledgements

• Ray Raychaudhuri (Rutgers WINLAB) has championed the inclusion of wireless infrastructure into GENI for many years

• All GENI WiMAX projects are supported by awards from the NSF • Ray Raychaudhuri (Rutgers WINLAB), Sampath Rangarajan (NEC Labs) and Ivan

Seskar (Rutgers WINLAB) are responsible for the GENI WiMAX kit project

• Rajesh Mahindra (NEC Labs), Gautam Bhanage (Rutgers WINLAB) and Ivan Seskar (Rutgers WINLAB) have contributed much to the base station software

• Max Ott (NICTA), Ivan Seskar (Rutgers WINLAB) and Marco Gruteser (Rutgers WINLAB) have contributed much to OMF/OML, and it’s use with the WiMAX base station

• Tony Michel (Raytheon BBN Technologies) has much radio expertise and has contributed to the FCC license process

• Manu Gosain (Raytheon BBN Technologies) has been responsible for installing the site at BBN


Learning more about GENI

• Check www.geni.net

• Ask those who are involved with WiMAX; see acknowledgements

• Attend the next GENI Engineering Conference:– Nov 2-4, Wash DC– Travel grants are available

sponsored by the national science foundation a geni wimax infrastructure for research experiments...

Documents