AHM Overview

OptIPuter Overview

Third All Hands Meeting

OptIPuter Project

San Diego Supercomputer Center

University of California, San Diego

January 26 , 2005

Dr. Larry Smarr

Director, California Institute for Telecommunications and Information Technologies

Harry E. Gruber Professor,

Dept. of Computer Science and Engineering

Jacobs School of Engineering, UCSD

AHM Overview

What We Need to Focus on Completing

• Year 3: MILESTONE: By Year 3, the goal is to have operational OptIPuter testbeds on the campus, metro, regional, national and international levels, connecting OptIPuter partner sites in Southern California to Chicago by use of either TeraGrid or National Light Rail and Pacific Light Rail. A full set of system software, visualization, data management and collaboration systems will be in place. Enhanced transport protocols to improve end-to-end performance will be demonstrated. Extensive monitoring and tuning of OptIPuter applications and middleware subcomponents will provide feedback for ongoing research efforts.

• Year 4: e-Science advancements facilitated by the OptIPuter testbed will be demonstrated.

AHM Overview

What Are the Technical Challenges We Need to Address This Year?

• Multiple Latency Application and Networking Persistent Testbeds– Need DVC Integrated with Signaling, Management, and Transport Protocols– Stabilize for Apps to Use– Extensive Monitoring, Analysis, and Optimization Needs to Occur– Identify and Support Four Different Scale Testbeds for Next 2.5 Years

– Campus UCSD

– Metro Chicago

– National CAVEwave UCSD to UW to UIC

– International UCSD to Starlight to Amsterdam

• DVC– Integrate GTP, LambdaStream, UDT into DVC

• Applications Using WAN OptIPuter– Coupling Application Kernels to DVCs– Demonstrate on Four Testbeds Above

• Collaboration Rooms– Regular Use of CAVEwave and SoCal LambdaGrid– Partner with Social Science Researchers in Collaborative Works

AHM Overview

UCSD Campus LambdaStoreArchitecture

SIO Ocean SupercomputerIBM Storage Cluster

Extreme switch with 2 ten gigabit uplinks

Streaming Microscope

AHM Overview

EVL

OptIPuter National Testbed 10GE CAVEwave Rides the National LambdaRail

Next Step: Coupling NASA Centers

to NSF OptIPuter Testbed

Source: Tom DeFanti, OptIPuter co-PI

AHM Overview

What Are the Technical Challenges We Need to Address This Year?

• Streaming Data Flows– LambdaStream– CineGrid– HDTV

• Control of Parallel Lambdas– DWDM Coupled to Parallel Cluster I/O– For Multiple Data Flows (HD, Control, Vis)– For High Bandwidth to Match Clusters– “Terabits to the Desktop” and Cluster/ WAN bandwidth balance as Goal

• Security– Evaluate Globus GSI for LambdaGrids– Collective Trust Problems

• Publishing– Define High Level Computer Science Research Topics– Target Publications in Top Journals– Presentations at Key Conferences

AHM Overview

Today’s Lecture--Uncompressed HDTV at 1.5 GpbsLive From Seattle to Osaka

Osaka

Seattle

Chicago

Japan: NiCT/ JGN II, NiCT/APAN, NTT Group, KDDI, WIDE Project

USA: University of California San Diego/Calit2, University of Washington/Pacific Northwest Gigapop, PacificWave, ResearchChannel, Pacific Interface, Inc., StarLight (Argonne National Laboratory, Northwestern University, University of Illinois at Chicago), Indiana University, Intel

Circuits: JGN II, WIDE, KDDI, NTT Group, IEEAF, NLR (National Lambda Rail)

Enabled by International Human Networks

AHM Overview

OptIPuter User InterfaceScaling to 100 MegaPixels!

55-Panel Display 100 Megapixels

30 x 10GE interfaces1/3 Tera bit/sec

Driven by 30 Node Cluster of 64 bit Dual Opterons

60 TB Disk

Linked to OptIPuter

Working with NASA Teams to Unify Software

Source: Jason Leigh, Tom DeFanti, EVL@UICOptIPuter Co-PIs

AHM Overview

Enhancements and Extensions of OptIPuter Project

• Extension to Include Web and Grid Services– LOOKING ITR Funded UWash and UCSD

• Switching of Lambdas– Quartzite MRI Funded at UCSD

• Teraflow Testbed– Bob Grossman

• RR at UIC• Sloan with OptIPuter• U Amsterdam• Scalable Visualization Nodes

– LambdaVision MRI Funded at UIC– Macintosh G5 Cluster and 30” Display Tiled Wall at SIO

• Lambda Connectivity– CAVEwave Funded by UIC

• International Partners– iGRID 2005– LOOKING (Mexico and Canada)– NCMIR Telescience and BIRN (Japan, Korea, UK)– SARA New Partner

• New Applications– Bringing JPL, Ames, Goddard onto OptIPuter and NLR– fMRI NIH Grant Funded at UCI– Stereo HD to a Varrier Wall

AHM Overview

OptIPuter Interactive Browsing of Remote Earth Sciences Images on Scalable Displays

Earth Science Data Sets Created by GSFC's Scientific Visualization Studio were Retrieved

Across the NLR in Real Time from OptIPuter Servers in Chicago & San Diego and From

GSFC Servers in McLean, VA, then Displayed at SC2004 in Pittsburgh

Enables Scientists To Perform Coordinated Studies Of Multiple Remote-Sensing Or Simulation Datasets

http://esdcd.gsfc.nasa.gov/LNetphoto3.html

Source: Milt Halem & Randall Jones, NASA GSFC& Maxine Brown, UIC EVL

Eric Sokolowsky

AHM Overview

September 26-30, 2005University of California, San Diego

California Institute for Telecommunications and Information Technology

Announcing…

iGrid

2oo5T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y

Call for Applications Using the GLIF SuperNetwork

Maxine Brown, Tom DeFanti, Co-Organizers

www.startap.net/igrid2005/