1 multimedia communications 1 zlecturer: prof. xinhua zhuang zcecs & ee departments zuniversity...
TRANSCRIPT
![Page 1: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/1.jpg)
1
Multimedia Communications
1
Lecturer: Prof. Xinhua Zhuang CECS & EE Departments University of Missouri Columbia, MO 65211
![Page 2: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/2.jpg)
2
The Multimedia Experience
1
Daily Newspaper TV Program Video-on-demand Video Animation Virtual Meeting Room Distance Learning Virtual Library Living Books
![Page 3: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/3.jpg)
3
Multimedia
1
including or involving the use of several media of communication, entertainment, or expression
![Page 4: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/4.jpg)
4
Multimedia vs. Multiple Media
1
Multiple Media: unique delivery mechanism, unique repository or mailbox electronic mail voice mail data files
Multimedia: single repository messages with integrated text, sound, images, video,
data files, handwriting single access mechanism handling all media
![Page 5: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/5.jpg)
5
Multimedia Communications
1
basic currency of communications switches from narrowband voice telephony to seamlessly integrated, high quality, broad-band transmission of multimedia signals
basic access method switches from wireline connections to combinations of wired and wireless (copper cable, ber, cell sites, satellite, and electrical power lines)
basic mode of communications expands from people-to-people communications to include people-to-machine communications
![Page 6: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/6.jpg)
6
Driving Forces in Multimedia Communications
1
evolution of communications and data networks into modern POTS (plain old telephone service) and PACKET (a data unit belonging to level 3 of the ISO (International Standards Organization) reference model) networks, and further into an integrated structure
increasing availability of almost unlimited bandwidth on demand in both the office and the home, and eventually on road, due to proliferation of high speed data modems, cable modems, hybrid fiber-coax systems, and fixed wireless access systems
availability of ubiquitous (anywhere, anytime) access to network via LANs, and wireline and wireless networks
![Page 7: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/7.jpg)
7
Driving Forces in Multimedia Communications
1
ever increasing amount of memory and computing power brought to bear on virtually any communications and computing systems
proliferation of smart terminals such as sophisticated screen phones, digital telephones, multimedia PCs natively handling a wide range of text, image, audio, and video signals
digitization of virtually all devices such as cameras, video capture devices, handwriting terminals, sound capture devices
standards for interconnections and communications between all devices attached to the network
![Page 8: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/8.jpg)
8
Where are we Today?
1
![Page 9: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/9.jpg)
9
Where are we Today?
1
POTS: good for narrowband voice trac PACKET: good for data trac Services are separate for POTS and PACKET Networks Control is separate for POTS and PACKET Networks
![Page 10: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/10.jpg)
10
Tomorrow's Network
1
intelligence inside network intelligence at the desktop intelligence at the terminal ubiquitous services works with all types of access devices such as telephones,
PC's
![Page 11: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/11.jpg)
11
Technology Aspects of MM Systems
1
compression and coding of multimedia signals; standards organizing, storing, and retrieving multimedia signals;
streaming (real time transmission of multimedia signals), layering, QoS (Quality of Service) issues
accessing multimedia signals by matching the user to the machine; GUI (graphical user interface), SLI (spoken language interface), media conversion, agents
searching multimedia archives and databases based on machine intelligence; text, image, speech
browsing multimedia archives and documents based on human intelligence; text, image, audio, video
![Page 12: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/12.jpg)
12
Illustrative Multimedia Systems
1
teleconferencing systems which integrate voice, video, application sharing, data sharing
FusionNet service which integrates the POTS and PACKET networks by exploiting Internet search and VCR-like features for viewing video, with POTS access to video content
CYBRARY digital virtual library which aims to provide a digital library experience which is better than being there live
Pictorial Transcripts system which provides a content-based sampled representation of video over the Internet
![Page 13: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/13.jpg)
13
Technology Assumptions
1
multimedia processing is a lot more than compression and coding
multimedia applications need to be standard-based handling (delivery, display) of multimedia signals is crucial user interface is critical to usability of most applications multimedia experience is shared between people and
machines
![Page 14: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/14.jpg)
14
Image Coding Principles
1
spatial redundancy repeated patterns image correlations in space spectral correlations
temporal redundancy repeated objects in video sequence predictable moves of objects
take advantage of human visual system perceptual masking of intensity, color, texture, time sequence
![Page 15: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/15.jpg)
15
Image Coders: FAX
1
Group 3 FAX: simple 1-D search Group 4 FAX: simple 2-D search JBIG-1: prediction based on local neighborhood JBIG-2: soft pattern matching on segmented regions
![Page 16: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/16.jpg)
16
Image Coders: Continuous Tone
1
JPEG block-based DCT psychophysically based scalar quantization entropy coding
JPEG-2000 modern architecture and standard downloadable software handles a broad range of conditions
![Page 17: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/17.jpg)
17
JPEG Performance
1
8:1 Indistinguishable 10.7:1 Excellent 21.4:1 Very Good 32:1 Good 64:1 Fair
![Page 18: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/18.jpg)
18
Video Coders
1
H.261, H.262, H.263: motion compensated coder for interframe coding
MPEG-1: multimedia standard with specifications for coding, compression and transmission of audio, video, and data streams in a series of packets
MPEG-2: multimedia standard with capability of compressing, coding and transmitting high quality, multi-channel multimedia signals over broadband networks
MPEG-4: object-based approach to multimedia with independent coding of objects, interactive compression of objects, ability to integrate synthetic and natural objects
MPEG-7: searching, indexing, authentication of large databases
![Page 19: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/19.jpg)
19
Video Coding
1
video conferencing: H.261 for ISDN, H.263 for POTS movie storage on CDROM: MPEG-1, 1.2 Mb/s for video, 256
kb/s for audio broadcast video on DVD (digital video disk): MPEG-2, 2-15
Mb/s for video/audio low bit rate telephony over POTS network: MPEG-4, 10 kb/s
for video, 5.3 kb/s for voice HDTV with 15-400 Mb/s for video
![Page 20: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/20.jpg)
20
Searching of Multimedia Documents
1
text-based indexing structured (field-based) in databases SQL (Structured Query
Language) queries unstructured or natural language text full text search
uses inverted index for each word; records document and location can do partial matches can find word variants
information extraction from documents speech indexing
full recognition of text (error prone) event detection (word spotting) speaker identification used to align speech and text
![Page 21: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/21.jpg)
21
Searching of Multimedia Documents
1
audio indexing start and end of speech musical signatures for instruments singing voice
image indexing classification by color and brightness histograms, texture,
extracted shapes hand-drawn description of image content figure captions, textual description of image content
video indexing
![Page 22: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/22.jpg)
22
Browsing of Multimedia Documents
1
text-based browsing table of contents, index, skimming
image-based browsing find image of interest, examine associated text
scene-based browsing find place in video for full search or editing
video skimming browsing high speed playback
audio skimming browsing high speed playback
![Page 23: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/23.jpg)
23
Multimedia Conferencing
1
![Page 24: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/24.jpg)
24
FusionNet Concept
1
High quality audio/video over the network Internet provides vast development and information
resources for browsing, searching POTS provides guaranteed QoS transmission with security
and billing Client needs to gain access to both the Internet and POTS Server needs to gain access to both the Internet and POTS
![Page 25: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/25.jpg)
25
The CYBRARY Project at AT&T
1
virtual presence in a library see documents in their original form on any screen
connected to the Internet create a new standard for document image compression
(DJVU) geared towards screen display rather than printing efficient document compression allows fast page flipping
and browsing OCR allows full text search and indexing
![Page 26: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/26.jpg)
26
Pictorial Transcripts
1
Fully automatic generation of multimedia document from full motion video source material
Enables broadcasters to go on-line with no additional manual effort
Generate content for network-based hosting service
![Page 27: 1 Multimedia Communications 1 zLecturer: Prof. Xinhua Zhuang zCECS & EE Departments zUniversity of Missouri zColumbia, MO 65211](https://reader030.vdocument.in/reader030/viewer/2022032805/56649ef05503460f94c00818/html5/thumbnails/27.jpg)
27
Summary
1
multimedia is more than multiple media multimedia merges computing, communications, and
information sciences multimedia depends on networking, computation, and
memory multimedia depends on compression, standards, user
interfaces, searching, and browsing multimedia involves integration, systems, testing, and
conformance testing