saudio & video db
TRANSCRIPT
![Page 1: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/1.jpg)
Audio and Video Database Management Techniques
![Page 2: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/2.jpg)
www.company.com
AGENDA
• Introduction to Multimedia DBMS
• Elements of Multimedia DBMS
• Audio/ Video
• Multimedia DBMS Characteristics
• Multimedia Objects
• Text Data
• Audio
• Video
• Video database
• Properties and Objects
• Video Content
• Video Library
![Page 3: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/3.jpg)
www.company.com
AGENDA
•Query Language
•Video Functions
•Video Query Language
•Video Data Management
• Metadata
• Text
• Video Parsing
• Video Indexing
• Video Retrieval
•Multimedia Database Components
•Multimedia Database Applications
•Conclusion
![Page 4: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/4.jpg)
www.company.com
What is Multimedia DBMS
• Definition of Multimedia
• Elements Of Multimedia :
Multimedia
Text
Graphic
Sound
Animation
Video
Introduction to Multimedia
DBMS
Topic 1
![Page 5: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/5.jpg)
www.company.com
Audio / Sound
What is Audio/Sound?
Types Of Audio Speech Music Sound Effects
Operations On Audio File Opening Existing File Playing a File Playing selected portion Saving File
Subtopic
Elements of Multimedia
![Page 6: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/6.jpg)
www.company.com
Video
What is Video?
Operations On Video File :• Importing Clips
• Timeline Structure
• Playback of Clips
• Trimming Of Clips
• Splitting a Clip
Subtopic
Elements of Multimedia
![Page 7: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/7.jpg)
www.company.com
• Characteristics Of Multimedia Database
• Large sizes
• Real-time nature
• Raw nature of information
Topic
Multimedia DB Characteristics
2
Characteristics
![Page 8: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/8.jpg)
www.company.com
• Audio Data :• Example
• normal voice digitized at 8 KHz 8 bits/sample 64 Kb/s of data.
• CD quality digitized at 44.1 KHz 16 bits/sample 1.4 Mb/s of data.
• Video Data :
• Video Frame
• Pixel Size
• Quality of Frame
Topic
Multimedia DB Objects
3
![Page 9: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/9.jpg)
www.company.com
Video Database
• Retrieving a Specified video
• Identifying and Retrieving video segments
Example- “Find all video John appears with gun”
Topic 4
Video DB
![Page 10: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/10.jpg)
www.company.com
• Organizing video.
• Index all associations.
• Example –Consider movie, sound of music.
-Inanimate Object like piano
-Animate Object Duck, birds
-Activity Singing and Dancing
Cont…..
![Page 11: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/11.jpg)
www.company.com
Properties and Objects
• Property- Name , Value
• Property Instance- Type, Color, Age
• Object Scheme- Frame Dependent, Independent
• Object Instance- Object id, Structure,Statement
• Activity schema- Number of activity
• Activity/Event- Name , values
Video DB Properties &
Objects
Topic 5
![Page 12: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/12.jpg)
www.company.com
Video Content
• Suppose v is a video
• Let framenum (v)
• v=(OBJ,AC,Z)
-where ,
OBJ- finite set of Object
AC- finite set of Activity
Z- Maps OBJ and AC associate with frame video
Topic 6
Video Contents
![Page 13: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/13.jpg)
www.company.com
Video Library
• A Video Library, VidLib, consist of finite set of 5 tuples
(Vid_Id, VidContent, framenum, plm, R)
7Topic
Video Library
![Page 14: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/14.jpg)
www.company.com
Query Languages for Video Data
• Segment Retrievals
• Object Retrievals
• Activity Retrievals
• Property-based Retrievals
Topic 8
Query Languages
![Page 15: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/15.jpg)
www.company.com
Video Functions
• FindVideoWithObject(o)
• FindVideoWithActivity(a)
• FindVideoWithActivityAndProperty(a,p,z)
• FindVideoWithObjectAndProperty(o,p,z)
Topic 9
Video Functions
![Page 16: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/16.jpg)
www.company.com
Cont….
• FindObjectInVideo(v,s,e)
• FindActivityInVideo(v,s,e)
• FindActivityAndPropertyInVideo(v,s,e)
• FindObjectAndPropertyInVideo(v,s,e)
![Page 17: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/17.jpg)
www.company.com
Video Query Languages
• “Find all videos and their relevant segments from video library VidLib1 that contain Sachin Tendulkar.”
Query-
SELECT Vid:[s,e]
FROM video: VidLib1
WHERE (Vid,s,e) IN FindVideoWithObject( Sachin Tendulkar)
Topic 10
Video Query Languages
![Page 18: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/18.jpg)
www.company.com
Video consists of:
• Text
• Audio
• Images
All change over time
• Metadata-based method
• Text-based method
• Audio-based method
• Content-based method
Topic
Video Data Management
11
![Page 19: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/19.jpg)
www.company.com
•Video is retrieved based on metadata
•Examples • Title
• Author
• Producer
• Director
• Date
• types of video.
Subtopic
Metadata Based Method
1
![Page 20: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/20.jpg)
www.company.com
• Video retrieved based on associated subtitles (text)
• Examples• Transcripts
• subtitles
Subtopic
Text Based Method
2
![Page 21: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/21.jpg)
www.company.com
• Video is indexed and retrieved based on associated soundtracks
• Speech recognition is applied if necessary.
Subtopic
Audio Based Method
3
![Page 22: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/22.jpg)
www.company.com
• There are two approaches for content-based video retrieval:
• Treat video as a collection of images
• Divide video sequences into groups of similar frames
Subtopic
Content Based Method
4
![Page 23: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/23.jpg)
www.company.com
• Video Parsing• Manipulation of whole video for breakdown
into key frames.
• Video Indexing• Retrieving information about the frame for
indexing in a database.
• Video Retrieval and browsing• Users access the database through queries
or through interactions.
Subtopics of Video Data Mangement
![Page 24: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/24.jpg)
www.company.com
• User query interface
• Allow users to query by:
content, example, time, spatial
• Query interface can provide suggestive inputs so as to ease the process of querying.
Topic
Multimedia DB Components
12
![Page 25: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/25.jpg)
www.company.com
• There are a number of fields where multimedia could be of use.
• Applications are:-• Business
• Education
• Entertainment
• Home
• Public Places
Topic
Applications of Multimedia
13
![Page 26: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/26.jpg)
www.company.com
• For Multimedia applications Audio and Video plays an Important role
• From this seminar we have studied audio and video database techniques
Topic
Conclusion
14
![Page 27: sAudio & video db](https://reader034.vdocument.in/reader034/viewer/2022042818/55c133d1bb61eb6c3e8b45e2/html5/thumbnails/27.jpg)
www.company.com
THANK YOU