Engineering Education and Centers (EEC) CI Team: Lynn Preston and Bob Norwood

Current EEC CI Funding Strategy FY02-03Partnerships for Cyberinfrastructure: From K to Industry

• Research: Large Scale-Long Term Investments in Centers ($25M in CI)• Interdisciplinary from fundamentals to systems• Collaboration with industry• Enabling and system technology with proof-of-concept test beds• CI-enabled educational repositories and multimedia modules • New CI-related courses and degree programs

• Education & Human Resources: Broad Based Across Education and Human Resource Spectrum (CI $30M)• Combined Research & Curriculum Development – Department Level

Reform• Research Experiences for Undergraduates • Research Experiences for Teachers

% o

f EE

C E

duca

tion

and

HR

C

I Inv

estm

ent i

n E

ach

Cat

egor

y

EEC Education and HR Cyberinfrastructure Investments in FY02 and FY03

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

Education and Community Building Functional Systems EngineeringPhysical Assets Research/SoftwareResearch/Physical Assets Domain-neutral SoftwareDomain-specific Software Social, Industrial and Technological Dimensions

% o

f EE

C C

ente

rs C

I In

vest

men

t in

Eac

h C

ateg

ory

EEC Centers Cyberinfrastructure Investments in FY02 and FY03

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

Education and Community Building Functional Systems EngineeringPhysical Assets Research/SoftwareResearch/Physical Assets Domain-neutral SoftwareDomain-specific Software Social, Industrial and Technological Dimensions

EEC Cyberinfrastructure Investments

• Architectures for modeling and simulations of multi-scale systems; grid architectures for networks of physical sensors, and distributed computation. (FSE)

• Modeling, design and visualization of distributed sensor/hardware; networks for environmental and atmospheric sensing; interface of CI technology and human sensory perception. (P)

• Large shared networks of web accessible image/data bases; simulation and computation of molecular and nano-scale phenomena; web-accessible repository for bioengineering courses and learning technology; user interface technology (S & CB)

• CI-related engineering curriculum development; educator and undergraduate research experiences; development of tools and techniques for CI engineering pedagogy (E )

USC ERC’s Immersive Media Vision Goal: create seamless immersive environment for

distributed, interactive real and virtual events Reproduce audio, video, and other senses with fidelity

approaching the limits of human perception

Relevant to any type of human interaction: entertainment, education, communications

New World Symphony, Miami Beach 550-seat Bing Theater at USC

Behind the Scenes:

Network barriers include: low latency, synchronization, error management, routing control.

End to end media process control is vital - capture, network interface, transmission, rendering - control over the “quality of experience.”

immersive audio and hi-def video provide quality of experience that are unique to IMSC (and immersion in general)

Specific IMSC research issues include Immersive audio capture, processing, and rendering - using “virtual-microphone” signal processing and 10.2 rendering developed at IMSC

Stream synchronization via GPS time stamps (within 10 microseconds)

Distributed Yima server clusters with scalable performance for recording and distributing (live or recorded) media - nodes provide streaming network-services

Latency and error management via an array of algorithms for routing control, error correction, and error concealment

Current Research and Testbed activities include:Multiple musicians playing together at a distance with an audience at USC

USC music students playing with New World Symphony in Miami Beach

2-way teleconference with low latency (<20ms) audio and video

Three hour session with MPEG2 video and 10.2 immersive audio

Teacher reports improved presence with immersive audio

Many psychophysical, perceptual and artistic tests to be done

Student at New World Symphony

in Miami Beach

LA Philharmonic cellist at USC

Teacher

USC ERC’s Immersive Media VisionRemote Master Class

Radar/Computation Grid Deployed in “Tornado Alley” for Severe Weather Detection and Prediction

ERC for Collaborative Adaptive Sensing of the Atmosphere (CASA)Umass-Amherst, U. of Oklahoma, Colorado State

adaptively targets multiple radar beams to sense tornadoes, other hazards

sensors, models, detection algorithms interact to dynamically optimize data collection, use

computing everywhere: sensors, in-network fusion, control points, storage, user access

multiple, changing end-user needs met via policy-driven system optimization

testbed: engages engineers, computer

scientists, meteorologists, sociologists, end-users

prototype for regional/national deployment

networked sensor package low cost low power computation/storage compact antenna

30 km coverage

radius

UserCommunity:

access, control

Authors

SequencingModelsMetadata

AssessmentsLearningObjectives

Packages

Learning Materials

Courseware

Create/Integrate

CAPE Authoring EnvironmentLearners

Upload Repository

Delivery Platform

Model-BasedDelivery Engine

Experiential Data

Authors

SequencingModelsMetadata

AssessmentsLearningObjectives

Packages

Learning Materials

Courseware

Create/Integrate

CAPE Authoring Environment

Authors

SequencingModelsMetadata

AssessmentsLearningObjectives

Packages

Learning Materials

Courseware

Create/Integrate

Authors

SequencingModelsMetadata

AssessmentsLearningObjectives

Packages

Learning Materials

Courseware

Create/Integrate

CAPE Authoring EnvironmentLearners

Upload Repository

Delivery Platform

Model-BasedDelivery Engine

Experiential DataExperiential Data

Learning Technology Research in the VaNTH ERCVanderbilt, Northwestern, Texas, MIT/Harvard

VaNTH research has synthesized learning science, learning technology, and learning domains in bioengineering, producing:

• CAPE a Course development system allowing authors to create instruction from assessments, learning objectives, sequencing plans, and learning materials (slides, simulations, videos).

• These can be stored in web-accessible repositories and delivered to students.

Future Center Topics for Cyberinfrastructure

• Complex Dynamic – Self Correcting Networks• National/regional power grid management• Interactive traffic flow management

• Trustworthy Highly Integrated H/W and S/W Networks• Necessary for distributed & collaborative engineering/research• Optimal integration of human interaction with networks• Distributed and adaptive, secure and nested specific networks

•Web-enabled Medical Research, Diagnosis and Treatment• CI enabled massive data mining and remote service delivery

• Domain-specific Networks and Simulations of Complex Systems• Efficient and timely engineering capability• Multi-disciplinary and collaborative research

Future Education Topics for Cyberinfrastructure

• Future Education Topics• Shared repositories for domain-specific curriculum development and learning technologies• Research Experiences for Teachers and Undergrads in CI • Immersive learning experiences using interactive

visualization learning technology• Remote access to learning materials for rural areas, the workforce