non-negative matrix factor deconvolution; extracation of multiple sound sources from monophonic...
TRANSCRIPT
![Page 1: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/1.jpg)
Non-negative Matrix Factor Deconvolution;Extracation of Multiple Sound Sources from Monophonic Inputs
International Symposium on Independent Component Analysis and Blind Source Separation, ICA 2004
Paris Smaragdis / Mitsubishi Electric Research Laboratories
Presenter: Jain_De ,Lee
![Page 2: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/2.jpg)
Outline
• Introduction
• Non-negative Matrix Factorization
• Non-negative Matrix Factor Deconvolution
• Conclusions
![Page 3: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/3.jpg)
Introduction
• Theory of The Origin
• An extension to the Non-Negative Matrix Factorization algorithm – Identifying components with temporal
structure
Paatero (1997)
Lee&Seung (1999)
![Page 4: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/4.jpg)
Non-negative Matrix Factorization
• The Original Formulation of NMF
NRRMNM HWV
[W] : Basis Functions Matrix
[H] :Time Weights Matrix
![Page 5: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/5.jpg)
Non-negative Matrix Factorization
• The Cost Function
• Multiplicative Update Algorithm
1
T
T
WHWV
WHH T
T
H
HHWV
WW
1
F
WHVWH
VVD )ln(
![Page 6: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/6.jpg)
Non-negative Matrix Factorization
• NMF for Sound Object Extraction
STFT
![Page 7: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/7.jpg)
Non-negative Matrix Factorization
![Page 8: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/8.jpg)
Non-negative Matrix Factor Deconvolution
• The Formulation of NMFD
• The Operator Shifts The Columns
WHV
1
0
T
t
t
t HWV
987
654
321
A
870
540
2101
A
700
400
1002
A ….
i
)(
![Page 9: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/9.jpg)
Non-negative Matrix Factor Deconvolution
• The Cost Function
• The Update Rules
F
VV
VD
ln
1
Tt
t
Tt
W
VW
HH Tt
Tt
tt
H
HV
WW
1
10 Tt
1
0
T
t
t
t HW, where
,
![Page 10: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/10.jpg)
Non-negative Matrix Factor Deconvolution
![Page 11: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/11.jpg)
Non-negative Matrix Factor Deconvolution
• In this example the drum sounds exhibit some overlap at both time and frequency
Three types of drum sounds present into the scece Sampled at 11.025 kHz 256-point DFTs which were overlapping by 128-points Performed for 3 basis functions
![Page 12: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/12.jpg)
Non-negative Matrix Factor Deconvolution
• Reconstruction
tT
t
jtj HWV
1
0
)(
![Page 13: Non-negative Matrix Factor Deconvolution; Extracation of Multiple Sound Sources from Monophonic Inputs International Symposium on Independent Component](https://reader035.vdocument.in/reader035/viewer/2022062305/5697bf8e1a28abf838c8c9f7/html5/thumbnails/13.jpg)
Conclusions
• Pinpointed some of the shortcomings of conventional NMF when analyzing temporal patterns and presented an extension
• Spectral bases have been used on spectrograms to extract sound objects from single channel sound scenes