introduction

50
Introduction Tsung-Yi Wu

Upload: sai

Post on 23-Jan-2016

16 views

Category:

Documents


0 download

DESCRIPTION

Introduction. Tsung-Yi Wu. Introduction. What is a multimedia system? A multimedia system supports the integrated storage, transmission and representation of the discrete media types text , graphics and image and the continuous media types audio and video on a digital computer. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Introduction

Introduction

Tsung-Yi Wu

Page 2: Introduction

Introduction What is a multimedia system?

– A multimedia system supports the integrated storage, transmission and representation of the discrete media types text, graphics and image and the continuous media types audio and video on a digital computer.

Page 3: Introduction

A Hybrid (analog/digital)

Multimedia System Early multimedia system, around 1985

Page 4: Introduction

Digital Multimedia System

The media streams are digital. They can be processed (e.g., compressed/ decompressed,analyzed) in the computer.

Page 5: Introduction

Time-Independent Media

Information is not related to timing of the data stream

All „classic“ media in the computer, such as:– text– graphics (line drawings, vector graphic)– image (photo, pixel graphics).

Page 6: Introduction

Time-Independent Media

Example [Kitaoka 2003]

Page 7: Introduction

Time-Independent Media

Illusory Motion (Ming-Te Chi et al.)Ming-Te Chi et al.)

Page 8: Introduction

Time-Independent Media

Example (Image)

Page 9: Introduction

Time-Independent Media

Example (Image)

Page 10: Introduction

Time-Independent Media

Example (Image)

Page 11: Introduction

Time-Independent Media

Hybrid Image– http://cvcl.mit.edu/publications/

publications.html

Page 12: Introduction

Time-Independent Media

Example (Graph)

Page 13: Introduction

Time-Independent Media

Example (3D Stereogram)

Page 14: Introduction

Time-Independent Media

Example (How to see, 14 cyclic stones)

Page 15: Introduction

Time-Independent Media

3D Stereogram – DIY

http://www.flash-gear.com/stereo/

Why do they look 3D? – http://www.kondo3d.com/stereo/why-3d/

why-3d-e.html Paper

Page 16: Introduction

Time-Independent Media

Why do they look 3D?

Page 17: Introduction

Time-Independent Media

Example (3D ASCII Stereogram)

Page 18: Introduction

Time-Independent Media

Example (3D ASCII Stereogram)

Page 19: Introduction

Time-Independent Media

Optical Illusion– http://www.johnsadowski.com/

big_spanish_castle.php

Page 20: Introduction

Time-Dependent Media

Information is time-related, must be shown to the user at specific points in time

Continuous data streams– Data appears in regular intervals

Examples:– Video (continuous)

Page 21: Introduction

Time-Dependent Media

Examples:– An animation (not a continuous stream,

but time-dependent)

– An interactive game on the Internet (not a continuous stream, but has real-time requirements)

– Audio (continuous)

Page 22: Introduction

Time-Dependent Media

Image Morphing – Morphing is a special effect in motion pictures and

animations that changes (or morphs) one image into another through a seamless transition.

Morph Tools– FantaMorph– Fun Morph

Page 23: Introduction

Time-Dependent Media

3D Stereogram Movie in Ascii http://www.kammerl.de/ascii/AsciiStereoMovie.php

3D Animated Stereograms – http://www.hidden-3d.com/

stereogram_theory.php

Page 24: Introduction

Multimedia System Integrated

production,processing,storage,representation, Transmission, etc.

of several time-dependent and time-independent media streams

Page 25: Introduction

History of Bandwidth in Computer Networks

Page 26: Introduction

Network Requirements of Different Types of

Data Streams

Page 27: Introduction

Multimedia Processing Compression/Decompression Encryption/Decryption Enhancement Transformation Recognition Etc.

Page 28: Introduction

Compression Goal

– The compression of multimedia data streams saves

storage space transmission

bandwidth

Page 29: Introduction

Compression Lossless

– If the recovered data are assured to be identical to the source

– Lossless compression techniques are requisite for applications involving textual data

e.g. ZIP

Lossy– Other applications, such as those involving voice

and image data, may be sufficiently flexible to allow controlled degradation in the data

Page 30: Introduction

Compression Lossy

– Example (DCT) Although there is some loss of quality in the reconstructed

image, it is clearly recognizable, even though almost 85% of the DCT coefficients were discarded.

Page 31: Introduction

Encryption Example

3

1

0

2

Page 32: Introduction

Encryption Example

Page 33: Introduction

Encryption Example

Page 34: Introduction

Encryption Example (Decryption)

Page 35: Introduction

Encryption Text/String

plaintextciphertext

KA-B

encryptionalgorithm

decryption algorithm

KA-B

plaintextmessage, m

K (m)A-B

K (m)A-Bm = K ( )

A-B

Page 36: Introduction

Enhancement Examples

Page 37: Introduction

Transformation Example

Page 38: Introduction

Transformation Example

– Original – Changed

Page 39: Introduction

Recognition Example

Page 40: Introduction

Tools Matlab

I = imread('cameraman.tif');I = im2double(I);T = dctmtx(8);B = blkproc(I,[8 8],'P1*x*P2',T,T');mask = [1 1 1 1 0 0 0 0 1 1 1 0 0 0 0 0 1 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0];B2 = blkproc(B,[8 8],'P1.*x',mask);I2 = blkproc(B2,[8

8],'P1*x*P2',T',T);imshow(I), figure, imshow(I2)

Page 41: Introduction

Tools Matlab

Page 42: Introduction

Tools PhotoImpact

Page 43: Introduction

Tools Audacity

Page 44: Introduction

FrontPage HTML Javascript

function encode() { if(document.form2.R1[0].checked){ Result="0 分 "; } if(document.form2.R1[1].checked){ Result="30 分 "; }document.form1.S1.value=Result;}

Java

Page 45: Introduction

Anfy Anfy (Java™) includes 52 applets, top

effects and menu for web sites and blogs. Plus screensaver.

Page 46: Introduction

Flash MX

Page 47: Introduction

PowerPoint Example

Page 48: Introduction

PowerPoint Example

Page 49: Introduction

PowerPoint

49

Page 50: Introduction

App http://processing.org/tutorials/android/