internet2 day university of maryland college park, md march 30, 2001 george brett nlanr distributed...

Internet2 Day University of MarylandCollege Park, MDMarch 30, 2001

George BrettNLANR Distributed Applications Support Team

(NCSA/UIUC)

Current Internet2 Applications

30 March, 2001 Internet2 Day -- [email protected] 2

The GlobalTechnology Grid

• Networks – high performance network services

• Computational Resources – supercomputers, clusters, distributed computing resources

• Communications Resources– inter personal (1, few, many)– inter device / system

• Other Services– Remotely controlled research equipment– Immersive environments


The Grid


What are Advanced Applications?

• They deliver qualitative and quantitative improvements in how we conduct research and engage in teaching and learning

• They require advanced networks to work c/o Ted Hanss, Internet2


Suggested Application Categories

Category Examples Characteristics

Distributed Supercomputing DISStellar dynamicsAb initio chemistry

Very large problems needig lots ofCPU, memory, etc.

High Throughput Chip DesignParameter studiesCryptographic problems

Harnessing many otherwise idleresources to increase aggregatethroughput

On demand Medical InstrumentationNetwork-enabled solversCloud detection

Remote resources integrated withlocal computation, often forbounded amount of time

Data intensive Sky surveyPhysics dataData assimilation

Synthesis of new information frommany or large data sources

Collaborative Collaborative designData explorationEducation

Support communication orcollaborative work betweenmultiple participants

The Grid: Blueprint for a New Computing Environment. Foster, Ian & Kesselman, Carl ed. Morgan Kaufman Publ. Inc. San Francisco, CA 1998 ISBN 1-55860-475-8


Different Disciplines/Contexts

• Sciences• Arts• Humanities• Health care• Business/Law• Administration• …

• Library• Classroom• Clinic• Office• Laboratory• Dorm room• …


Some Technical Requirements

Grid Table 6.1Teleimmersion Performance Requirements

Flow Type Latency Bandwidth Reliable Multicast Security StreamDynamic

QoSControl < 30 ms 64 Kb/s Yes No High No LowText < 100 ms 64 Kb/s Yes No Medium No LowAudio < 30 ms N x 128 Kb/s No Yes Medium Yes MediumVideo < 100 ms N x 5 Mb/s No Yes Low Yes MediumTracking < 10 ms N x 128 Kb/s No Yes Low Yes MediumDatabase < 100 ms > 1 GB/s Yes Maybe Medium Maybe HighSimulation < 30 ms > 1 GB/s Mixed Maybe Medium Maybe HighHaptics < 10 ms > Mb/s Mixed Maybe High Yes HighRendering < 30 ms > 1 GB/s No Maybe Low Maybe Medium

The Grid: Blueprint for a New Computing Environment. Foster, Ian & Kesselman, Carl ed. Morgan Kaufman Publ. Inc. San Francisco, CA 1998 ISBN 1-55860-475-8


Application Attributes

• Interactive research collaboration and instruction

• Real-time access to remote scientific instruments

c/o Ted Hanss, Internet2


Application Attributes(cont’d)

• Large-scale, multi-site computation and database processing

• Shared virtual reality

• Any combination of the above

c/o Ted Hanss, Internet2


• Up to broadcast quality videoconferencing

• Both live distribution and on-demand access to a variety of content

• HDTV-based digital cinema, network-based studio production, …

Digital Video Applications


The ACCESS Grid

• CollaborationsMultiple Participants Share:

• Applications • Chat • White Boards• Presentations...

• Visualization – Group Analysis of:

• Scientific Data • Virtual Reality • Instrument Steering


Video Futures

• Tele-immersive “Office of the Future”

Source: University of North Carolina-Chapel Hill


Music Teaching

University of Oklahoma


Distributed nanoManipulator

University of North Carolina-Chapel Hill


Advanced RegionalPrediction System

University of Oklahoma


Space Physics and Aeronomy Research Collaboratory

University of Michigan


Special 2.5m telescope, located at Apache Point, NM3 degree field of view.Zero distortion focal plane.

Two surveys in one:Photometric survey in 5 bands.Spectroscopic redshift survey.

Huge CCD Mosaic30 CCDs 2K x 2K (imaging)22 CCDs 2K x 400 (astrometry)

Two high resolution spectrographs2 x 320 fibers, with 3 arcsec diameter.R=2000 resolution with 4096 pixels.Spectral coverage from 3900Å to 9200Å.

Automated data reductionOver 100 man-years of development effort.(Fermilab + collaboration scientists)

Very high data volumeExpect over 40 TB of raw data.About 1 TB processed catalogs.Data made available to the public.

The Sloan Digital Sky Survey

c/o Prof. Alex Szalay


TeleImmersion

The CAVE


Immersadesk


Virtual Temporal Bone

College of Health and Human Development Sciences, University of Illinois at Chicago

Dept. of Otolaryngology - Head and Neck Surgery,


Health Sciences

• Collaboratories– Visible Human Project

• Medical Middleware– Security– Electronic Health Record

Mary Kratz mkratz @internet2.eduhttp://www.internet2.edu/health/

http://www.internet2.edu/health/




• Share information• Facilitate use in instruction, planning,

and performance• Example events:

– Halloween Concert– Performing Arts Presenters Conference

Ann Doyle [email protected]://apps.internet2.edu/html/arts.html

Arts & Humanties


• NEESGrid– www.neesgrid.org

• GriPhyN– www.griphyn.org

• Infrastructure– www.gridforum.org

Grid Projects


NLANR

• An NSF Cooperative Agreement for:– Distributed Applications Support Team

• user applications support/optimization; lead by NCSA/UIUC

– National Center for Network Engineering• end-to-end engineering support; lead by PSC/CMU

– Measurement and Operations Analysis Team

• network performance characterization; lead by SDSC/UCSD


NLANR-MOAT

• Improving our understanding of service models, service metrics, and tool requirements

• Searching for macro-level insights into high performance internetworking

http://moat.nlanr.net/





NLANR-MOAT Focus Areas

• Passive Network Monitoring– OCXmon

• Active Measurement Program (AMP)– distribution of monitors

• Visualization– Cichlid


NLANR-NCNE

• Assist in the establishment and use of high-performance network connections (vBNS and Abilene)

• Help optimize overall end-to-end performance

• Provide information, training, and tools to manage high performance networks

http://ncne.nlanr.net/







NLANR-NCNE Focus Areas

• Direct engineering support– supporting campus engineers– ‘on-call’ engineer to help solve problems– specialists available to answer complex

questions

• Education and Training– NLANR/Internet2 Techs Workshops

• May 2001 in Lincoln, NE

– multicast seminars• http://www.ncne.org/training.html

http://www.ncne.org/training.html




NLANR-DAST

• Goal: to promote the use of high performance networks by– supporting users and applications

developers– developing training materials and

documentation– disseminating techniques to the

applications development population– maintaining the Advanced Applications

Clearinghouse


NLANR-DAST Focus Areas

• Support users and applications developers– general usage and availability issues– advanced applications development support– problem reporting– directory of available resources (people & apps)

• Training and documentation – distributed Applications Workshops– extensive on-line information targeted to application

developers

• Apps Support Help Desk– basic users and advanced developers– problem tracking and response coordination


NLANR-DAST Projects

• Applications– CACTUS - communications layer

optimization of a large, distributed code.

• Middleware– GLOBUS - Heartbeat monitor development

• Performance– netlog library, viznet tools


NLANR-DAST Advanced Applications Clearinghouse

• Advanced Applications Clearinghouse– A data base / inventory of projects, resources,

applications, and people using high performance networks

– Sources• NSF vBNS Awardee Proposals• Internet2 Applications Area• Regional Groups: CENIC, SURA, NYSERnet• Discipline Communities

– Staff: • 1 dBase designer / programmer / Genius• 2 graduate students

– Information & Library Science

http://dast.nlanr.net/Clearinghouse/clearing_main.htm


NLANR-DAST Advanced Applications Clearinghouse

• 2400 projects – an activity of research or education

• 1500 resources – specific software, hardware, or technology that a

project develops or uses

• 920 contacts

• 14 discipline categories

• 620 institutions or organizations

• 30 countries


Clearinghouse Links

• Examples from the Query Page– Chart by Grid Categories– Chart by Type– Chart by Discipline– Report: Projects by Institution– Sample Project Info– Report: Resources by Project– Sample Resource Info– Affiliations– Survey

http://dast.nlanr.net/Clearinghouse/

http://www.ncsa.uiuc.edu/SCD/DAST/clearing/graphics/cat.htm

http://www.ncsa.uiuc.edu/SCD/DAST/clearing/graphics/res.htm

http://www.ncsa.uiuc.edu/SCD/DAST/clearing/graphics/disc.htm

http://cgi.ncsa.uiuc.edu/cgi-bin/General/CC/irg/clearing/projectByInst.pl

http://cgi.ncsa.uiuc.edu/cgi-bin/General/CC/irg/clearing/projectAbstract.pl?projid=775

http://cgi.ncsa.uiuc.edu/cgi-bin/General/CC/irg/clearing/resByProj.pl

http://cgi.ncsa.uiuc.edu/cgi-bin/General/CC/irg/clearing/resAbstract.pl?resid=32

http://cgi.ncsa.uiuc.edu/cgi-bin/General/CC/irg/clearing/projectByAff.pl

http://dast.nlanr.net/Clearinghouse/websurvey.htm


The Klearinghouse


Ted’s Info

•www.internet2.edu•[email protected]•apps.internet2.edu/talks/•Ted Hanss Internet2 3025 Boardwalk Suite 100 Ann Arbor, MI 48108 +1.734.913.4256


George H. Brett IINCSA NLANR / [email protected]://www.ncsa.edu/~ghbv. 703-248-0120f. 703-248-0100


http://www.nlanr.net/http://dast.nlanr.net/http://ncne.nlanr.net/http://moat.nlanr.net/

Contact Info

mailto:[email protected]




http://www.ncsa.edu/~ghb











http://www.nlanr.net/
















internet2 day university of maryland college park, md march 30, 2001 george brett nlanr distributed...

Documents

internet2internet2 day

gridinternet2 day

8internet2 day

high performance computing

new computing environment

idle resources

morgan kaufman

san francisco