![Page 1: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/1.jpg)
Overview of The
Multimedia Networks
Instructor: Hamid R. Rabiee
Spring 2012
![Page 2: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/2.jpg)
Multimedia Networking
Instructors: Hamid R. Rabiee, PhD ([email protected])
Office: CE department #804 or #803 (DML)
TAs:
Mostafa Salehi ([email protected])
Office: CE department #803 (DML lab)
Navid Bayat ([email protected])
Office: CE department #803 (DML lab)
Maryam Tahani([email protected])
Office: CE department #808
Nasim Nabavi ([email protected])
Office: CE department #803 (DML lab)
Elahe Ghalebi ([email protected])
Office: CE department #803 (DML lab
Hours:
Class hours: Saturdays & Mondays (15:00 to 16:30)
Exercise hours: Saturdays 12:00 to 13:15, Room 201
Course web page: http://ce.sharif.edu/courses/90-91/2/ce873-1/
Digital Media Lab - Sharif University of Technology2
![Page 3: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/3.jpg)
Course Textbooks (References)
“Fundamental of Multimedia”, by ZeNian Li and Mark Drew, Prentice-
Hall, 2003.
“Computer Networking: A Top-Down Approach (4th edition)”, by J.
Kurose and K. Ross, Addison-Wesley, 2008.
“Quality of Service Control in High-speed Networks”, by H.J. Chao, X.
Guo, John Wiley and Sons, 2002.
“Multimedia over IP and Wireless Networks: Compression, Networking,
and Systems”, by M. Van Der Schaar, P. Chou, Academic Press, 2007.
Digital Media Lab - Sharif University of Technology3
![Page 4: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/4.jpg)
Digital Media Lab - Sharif University of Technology4
Lecture Outlines
Course Introduction (Syllabus)
Course Outline
Why Multimedia Networking?
![Page 5: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/5.jpg)
Course Introduction
The course goal:
This course is primarily concerned with the problems that arise when
carrying audio/video contents over the modern communication networks
The course will :
Present an overview of current/future multimedia applications and
architectures
Discuss deployment problems
Discuss Multimedia Network Design and study solutions
Examine emerging technologies and open research problems related to
multimedia networking
Digital Media Lab - Sharif University of Technology5
![Page 6: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/6.jpg)
Course Introduction
Prerequisites:
Signal and Systems, Multimedia Systems, Computer Networks
Background in Computer Systems Performance Evaluation (e.g., Simulation,
Experimental, or Analytical approaches)
Experience with Matlab and GNU/Linux.
Simulation Tool: OpNet
Style:
Both slides and whiteboard
Reading List:
Recommended books and papers
Slides
Handouts
Digital Media Lab - Sharif University of Technology6
![Page 7: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/7.jpg)
Course Introduction
Evaluation:
Homework $ Mini - Projects
About 5 series of homework
and mini - projects
40 (Points)
Quiz
About 12 number of quizzes
10 (Points)
Midterm written exam
25 (Points)
Final written exam
35 (Points)
Total :
110 (Points)
Digital Media Lab - Sharif University of Technology7
![Page 8: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/8.jpg)
Course Outline
Introduction
Fundamentals of Multimedia
Background information similar to the ones covered in the Multimedia Systems
Fundamentals of Next Generation Networks
Quality of Service
Principles (e.g. Admission Control and Shaping/Policing)
QoS Architecture (Integrated services; Differentiated services)
Traffic engineering (Fair Scheduling)
Flow and congestion control (Buffer Management)
Error correction & concealment
Digital Media Lab - Sharif University of Technology8
![Page 9: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/9.jpg)
Course Outline
Multimedia over IP (IP multicast)
Multimedia over Overlay networks
Multimedia Applications
Multimedia Protocols
Signaling Protocols (SIP, H.323), Streaming (Real-time) Protocols (RTP, RTCP)
IP Multimedia Subsystem (IMS)
Multimedia over Wireless/ sensor network
Multimedia Networking Applications
Digital TV, Voice Over IP, IPTV, Audio/video Conferencing, Interactive Multiplier
Games, Application-Level Framing, Video Servers
Digital Media Lab - Sharif University of Technology9
![Page 10: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/10.jpg)
Course Outline
Multimedia Network Security
Encryption, digital signatures, authentication, IP security
Digital watermarking security features in multimedia compression standards,
secure media streaming
Content Networks
Convergence Networks
Hot Research Topics
Digital Media Lab - Sharif University of Technology10
![Page 11: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/11.jpg)
Why Multimedia Networking?
The use of IP-based Internet is growing , both in business & home usage
Growth of networked multimedia applications on the Internet
A balance of digital broadcasting with multimedia streaming over IP networks
IP network, especially Internet, is becoming a very attractive channel for multimedia
communications.
Dedicated networks and ATM are not widely available to bulk of users
There are many applications for Internet multimedia:
Internet telephone, Internet TV, video conferencing, network games, remote
corroboration, media rich social networks, …
IP uses packet switching
Suitable for unexpected burst of data without establishing an explicit connection
Bandwidth is shared and so data can be sent at any time
Digital Media Lab - Sharif University of Technology11
![Page 12: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/12.jpg)
Networked Multimedia Applications
Digital Media Lab - Sharif University of Technology12
Music
Streaming
Information
SearchMovies
StreamingFinance,
Brokerage
Digital Photos
The Internet cloud
Video Clip
Attachment
Video
Conference
VoIP
Wireless Browsing
![Page 13: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/13.jpg)
Networked Multimedia Applications
Multimedia Extended Email
World Wide Web
Video Distribution Services
Video Conferencing
Interactive Distributed Games
Virtual Reality
E-Learning
Instant Messaging
Sometimes there may be only one media, but similar requirements:
Image Distribution, Telephony, Radio, Jukebox Services, Document Archives
Digital Media Lab - Sharif University of Technology13
![Page 14: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/14.jpg)
Classes of Internet Multimedia Apps
Streaming stored media
Stored on server
Examples: pre-recorded songs, famous lectures, video-on-demand
Streaming live media
“Captured” from live camera, radio, T.V.
1-way communication, maybe multicast
Examples: concerts, radio broadcasts, lectures
Real-time interactive media
2-way communication
Examples: Internet phone, video conference
Digital Media Lab - Sharif University of Technology14
![Page 15: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/15.jpg)
A Sample Framework of Media Delivery
Media
Encoding
Audio
Video
Animation
Web
Server
Send Request
to Media
Server
Media
Server
Proprietary
Format
•Multicast capable
•More Robust
•Access to Storage
•Relieves Web Server
Send Stream
To Clients
•Standalone player
•Java based player
•Browser plug-in player
•Appliance
•Decode
•Buffer
•Sync.
To hear or view a media file
without downloading it
Note: P2P applications and
Services increasing
Clients
Send Request
To Servers
![Page 16: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/16.jpg)
Multimedia Expectations
Multimedia Expectations from a Communication Network
Traffic Requirements
limits on real-time parameters (delay, jitter)
bandwidth and reliability
synchronization
Functional Requirements
support for multimedia services such as multicasting, security,
mobility and session management
More about media & multimedia on next session
Digital Media Lab - Sharif University of Technology16
![Page 17: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/17.jpg)
Main Problems in Multimedia Applications
Supporting multimedia applications over a computer network renders the
application distributed.
Multimedia Transmission over Wireless/Wired networks
Convergence on Wireless, Multimedia, and Internet
Digital Media Lab - Sharif University of Technology17
Multimedia Capability
Enhanced Mobility
Full ConnectivityMultimedia Internet
Wireless
![Page 18: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/18.jpg)
Main Problems in Multimedia Applications
Multimedia data is huge
Audio, Images, graphics, and video
Wireless/Internet lacks performance guarantee
Best effort service, no QoS provision by itself
Packet loss, congestion, latency, delay jitters
Errors in wireless links
Internet is heterogeneous
Varying network conditions, user preferences, device capabilities
Question : How to Enable EFFICIENT, ROBUST, UBIQUITOUS Delivery?
Digital Media Lab - Sharif University of Technology18
![Page 19: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/19.jpg)
Multimedia Networking Issues
Media Issues
Huge amount of data
Different formats of media (need for
Coders & Decoders, Different
Applications, transmission protocols, ...)
Issues for real-time transport of
streaming multimedia
Quality of media
Network Issues
Availability and Performance of
Network Bandwidth
Reliability of Transport and
Performance
Availability of “Media-aware”
Middleware
Availability and Performance of
Applications
Required standards for data exchange
in heterogeneous environments
Security and copyright Issues
Wireless networks issues
Integration of wired and wireless
heterogeneous networking systems
Digital Media Lab - Sharif University of Technology19
![Page 20: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/20.jpg)
Solutions
Two basic Approaches
Network- Centric
End- system Based
Digital Media Lab - Sharif University of Technology20
![Page 21: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/21.jpg)
Network - Centric Based Solutions
Network - Centric
Packet Classification
Packet is marked based on the Type of Service
Packet Scheduling
choose next packet to send on link
Integrated Services: flow based
architecture for providing QOS guarantees in IP networks for individual application
sessions
Differentiated Services: packet based
Mark IP packet to specify treatment
Multi Protocol Label Switching: flow+ packet based
A forwarding scheme that tags packets with labels
Digital Media Lab - Sharif University of Technology21
![Page 22: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/22.jpg)
End-System Based Solutions
End-System Based
Compression
Layered and scalable coding
Base layer, enhancement layers
MPEG: SNR, spatial, temporal scalability
MPEG-4 fine granularity scalability (FGS), and H.264
MPEG Scalable Video Coding (SVC)
Media distribution
Media synchronization
Multimedia network protocol
Digital Media Lab - Sharif University of Technology22
![Page 23: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/23.jpg)
End-System Based Solutions
End-system Based
QoS Control
Congestion Control
Source-based rate control, Receiver-based rate control, Hybrid
rate control
Rate-adaptive source encoding
Rate shaping
Error Control
FEC, retransmission (ARQ), error-resilient encoding, error concealment
Digital Media Lab - Sharif University of Technology23
![Page 24: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/24.jpg)
Sharif University of Technology, Department of Computer Engineering, Multimedia Systems Course
Next Session
Multimedia Networking
24
![Page 25: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/25.jpg)
References
Shashank Khanvilkar, Faisal Bashir, Dan Schonfeld, and Ashfaq Khokhar,
“Multimedia Networks and Communication”, University of Illinois at
Chicago, 2004.
Jenq-Neng Hwang, “Introduction to multimedia networking”, Cambridge
University Press,
Digital Media Lab - Sharif University of Technology25
![Page 26: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading](https://reader031.vdocument.in/reader031/viewer/2022022514/5af13d087f8b9abc788e2f05/html5/thumbnails/26.jpg)
Acknowledgement
The following graduate students have helped to prepare the slides for this
course:
Mostafa Salehi
Fatemeh Dabiran
Hoda Ayatollahi
Digital Media Lab - Sharif University of Technology26