DEPT. OF INFO. & COMM., KJIST

Access Grid with Access Grid with High Quality DV VideoHigh Quality DV Video

JongWon Kim, Ph.D.

17th APAN Meeting /JointTech WS

Jan. 29th, 2004

Networked Media LaboratoryDept. of Information & Communications

Kwang-Ju Institute of Science & Technology (K-JIST)jongwon@kjist.ac.kr

http://netmedia.kjist.ac.kr

DEPT. OF INFO. & COMM., KJIST

Access Grid & Remote Collaboration Access Grid & Remote Collaboration

Group to Group Interaction on the GridConnecting People and Applications via the Grid

Integrating Group and Group Collaboration and Visualization.

Supporting distributed research collaborations Distributed Lectures and seminars Remote participation in design and development Virtual site visits and team meetings Complex distributed grid based applications Long term collaborative workflows

DEPT. OF INFO. & COMM., KJIST

Media Quality Challenge in AG Media Quality Challenge in AG (K-JIST with KISTI On-going 2003-2004)(K-JIST with KISTI On-going 2003-2004)

VICVIC DVDV HDHD StereoStereo …

Access Grid Service Manager

RATRAT

Audio data Video dataMonitoring ModuleMonitoring Module

RTP

RTCP RTP

…

Video dataAudio dataRTCP statistics

Traffic meter

Traffic Reader

Traffic analysi

s

Traffic Manager

Packet

RTP

RTCP RTP

…

High Speed Network

Access Grid Service Manager

Access Grid Service Manager

Feedback

DEPT. OF INFO. & COMM., KJIST

Demonstration of DVTS with AGDemonstration of DVTS with AG

Demonstration Between K-JIST, Gwangju <-> Hawaii

Using both VIC (web camera) and DV (digital cam, ieee1394) in each PC.

DV-Recv Agent

DV-Send Agent

DV form test_A PC DV form test_B PC

Video stream(test_A PC)

VIC

Video stream(test_B PC)

VIC

VIC RAT

NodeService

DEPT. OF INFO. & COMM., KJIST

Deploying DV to AG systemDeploying DV to AG system

Connection scenario of the DV to AGTk2.0

DEPT. OF INFO. & COMM., KJIST

AG 2.0 Toolkit Architecture

Find the connection point to call VIC• Video Producer Service

Executes vic to transmit video stream Configurable through Node Management Client

How to connect DV into AG• Upgrade Venue Server and Venue Client to aware DV

Venue Server allocate DV multicast address for DV transmission

• Implement DVTS Agent

Analysis AGTk2.0Analysis AGTk2.0

DEPT. OF INFO. & COMM., KJIST

Analysis AGTk2.0 (cont.)Analysis AGTk2.0 (cont.) Flow architecture in AGTk2.0

DEPT. OF INFO. & COMM., KJIST

Implementation of the proposed system Modify Capability Class

Add ConfigureStreams function in AGService class• Each DV stream has unique multicast address and port• Send all multicast address and port of all DV stream to Service

Modify NegotiatedCapabilities function in Venue class• If a client can receive DVstreams, return a set of Dvstreams• Allocate new multicast address and port for each Dvstream and notify A

dd stream event to all clients. Add DVProducerService, DVConsumerService Add DVTS (Digital Video Transmission System) -agent

Deploying DV to AG systemDeploying DV to AG system

ROLE[producer, consumer]

ROLE[producer, consumer]

TYPE[audio, video, text,DV]

TYPE[audio, video, text, DV]

PARAMETERSPARAMETERS

Add “DV” stream type

DEPT. OF INFO. & COMM., KJIST

Deploying DV to AG system (Cont.)Deploying DV to AG system (Cont.)

DV (Digital Video) format Three hierarchical structure:

• DIF data (10 sequences/frame) x DIF blocks(150 block/sequence) * 80 bytes/block * 8 bits/byte * 29.97 frames/sec = 28.77 Mbps

Video (standard NTSC quality as 525 lines, 29.97 fps) Audio (PCM format)

What is DVTS? ‘Digital Video Transport System’ made by WIDE Project in Japan Transmit DV streams from IEEE1394 over IP Using RTP fixed header with same video frame DVTS Supports

• Frame discard for network utilization Bandwidth: 30Mbps with standard NTSC quality (29.97 f/s) Discarding picture frames and preserving audio frames

• Error concealment strategies for packet loss Use the related data from the previous frame

• Using frame buffering for absorbing jitters• Providing Multicast (Using PIM-SM routing protocol)

DEPT. OF INFO. & COMM., KJIST

Deploying DV to AG system (Cont.)Deploying DV to AG system (Cont.)

Simple modification of DVTS For network bandwidth

• Frame discarding (without quality degradation ~ 1/5 frame) For CPU resource

• Removing sound rendering part in direct show.

DVTS-agent (connects DVTS into AG) DVSend

• Execute DVTS for DV sending • Advertise its own DV transmission multicast address

DVRecv• Maintain the DVSend list• DVRecv execute DVTS with DVSend address by user requests• When receive ‘Start Video Message’ from DVSend

adds new participant item into user list maintains the mapping information about session participant and process ID

• When receive ‘Stop Video Message’ from DVSend removes the participant item from user list kills the process of corresponding DVTS

DEPT. OF INFO. & COMM., KJIST

Deploying DV to AG system (Cont.)Deploying DV to AG system (Cont.) User Interface

DVTS Agent into AG DVProducerService

• DVSend –s <DV session addr> –v <DV transmission addr> Ex.) DVSend –s 224.1.1.1 –v 225.1.1.1

DVConsumerService• DVRecv –s <DV session addr>

Ex.) DVRecv –s 224.1.1.1

DVSend DVRecv

DEPT. OF INFO. & COMM., KJIST

Hybrid monitoring schemeHybrid monitoring scheme

Implementation scenario

DEPT. OF INFO. & COMM., KJIST

Advanced Collaboration Testbed Advanced Collaboration Testbed (K-JIST, Dec. 2003)(K-JIST, Dec. 2003)

MediaServer

Overlay MulticastServer

NAS

DEPT. OF INFO. & COMM., KJIST

Immersive Media Delivery Testbed Immersive Media Delivery Testbed (to be built 2003-2005)(to be built 2003-2005)

Network Emulator

KOREN/KREONET(1 Gbps)

Admin & WWW Server

Gbps SW

Contents Server

3D Graphics

Server

HD H/W Decoder

HD 2D/3DVOD Server

Virtual Studio

3D HD AuthoringSystem Set

Stereo 3D Wall

Access Grid

DEPT. OF INFO. & COMM., KJIST

Questions?Questions?

Thank you!