ilmenau university of technology communications research laboratory 1 comparison of model order...
TRANSCRIPT
![Page 1: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/1.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 1
Comparison of Model Order Selection Comparison of Model Order Selection Techniques for High-Resolution Techniques for High-Resolution
Parameter Estimation AlgorithmsParameter Estimation AlgorithmsJoão Paulo C. L. da Costa, Arpita Thakre,
Florian Roemer, and Martin Haardt
Ilmenau University of TechnologyCommunications Research Laboratory
P.O. Box 10 05 65D-98684 Ilmenau, GermanyE-Mail: [email protected]
Homepage: http://www.tu-ilmenau.de/crl
![Page 2: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/2.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 2
MotivationMotivation
The model order selection (MOS) problem is encountered in a variety of signal processing applications including radar, sonar, communications, channel modeling,
medical imaging, and the estimation of the parameters of the dominant multipath components from
MIMO channel measurements. Not only for signal processing applications, but also in several science fields, e.g.,
chemistry, food industry, stock markets, pharmacy and psychometrics, the MOS problem is investigated.
A large number of model order selection (MOS) schemes have been proposed in the literature. However, most of the proposed MOS schemes are compared only to Akaike’s
Information Criterion (AIC) [1] and Minimum Description Length (MDL) [1]; the Probability of correct Detection (PoD) of these schemes is a function of
the array size (number of snapshots and number of sensors). [1]: M. Wax and T. Kailath “Detection of signals by information theoretic criteria”, in IEEE Trans. on
Acoustics, Speech, and Signal Processing, vol. ASSP-33, pp. 387-392, 1974.
![Page 3: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/3.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 3
MotivationMotivation Our first contribution in this work
Comparison of the state-of-the-art MOS schemes based on the PoD. We consider different array sizes and the noise is assumed Zero Mean Circularly Symmetric (ZMCS) white Gaussian
Since real-valued noise is encountered in sound applications, our second contribution is extension of our Modified Exponential Fitting Test (M-EFT) [2] for the case of real-valued
Gaussian noise; Usual in multidimensional problems, the number of sensors may be greater than the number of
snapshots. Therefore, our third contribution is expressions for our 1-D AIC [2] and 1-D MDL [2].
[2]: J. P. C. L. da Costa, M. Haardt, F. Roemer, and G. Del Galdo, “Enhanced model order estimation using higher-order arrays”, in Proc. 40th Asilomar Conf. on Signals, Systems, and Computers, Pacific Grove, CA, USA, Nov. 2007.
![Page 4: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/4.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 4
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 5: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/5.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 5
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 6: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/6.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 6
Data modelData model Noiseless case
Our objective is to estimate Our objective is to estimate dd from the noisy observations . from the noisy observations .
Matrix data model
![Page 7: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/7.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 7
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 8: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/8.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 8
Analysis of the Noise Eigenvalues ProfileAnalysis of the Noise Eigenvalues Profile
SNR 1, N 1
M - d zero eigenvalues
d nonzero signal eigenvalues
1 2 3 4 5 6 7 80
2
4
6
8
10
Eigenvalue index i
i
d = 2, M = 8
The eigenvalues of the sample covariance matrix
![Page 9: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/9.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 9
Analysis of the Noise Eigenvalues ProfileAnalysis of the Noise Eigenvalues Profile
Finite SNR, N 1
M - d equal noise eigenvalues
d signal plus noise eigenvalues
Asymptotic theory of the noise [3]
This is the assumption in AIC, MDL
The eigenvalues of the sample covariance matrix
1 2 3 4 5 6 7 80
2
4
6
8
10
Eigenvalue index i
i
d = 2, M = 8, SNR = 0 dB
[3]: T. W. Anderson, “Asymptotic theory for principal component analysis”, Annals of Mathematical Statistics, vol. 34, no. 1, pp. 122-148, 1963.
![Page 10: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/10.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 10
1 2 3 4 5 6 7 80
2
4
6
8
10
Eigenvalue index i
i
Analysis of the Noise Eigenvalues ProfileAnalysis of the Noise Eigenvalues Profile
Finite SNR, Finite N
M - d noise eigenvalues follow a
Wishart distribution.
d signal plus noise eigenvalues
d = 2, M = 8, SNR = 0 dB, N = 10
The eigenvalues of the sample covariance matrix
![Page 11: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/11.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 11
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 12: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/12.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 12
Review of the State of the Art of the MOSReview of the State of the Art of the MOS
MOS approach
Classification ScenarioGaussian
Noiseoutperforms
EDC [4] 1986 Eigenvalue based - White AIC, MDL
ESTER [5]
2004
Subspace based M = 128;
N = 128White/Colored EDC, AIC, MDL
RADOI [6] 2004
Eigenvalue based M = 4; N = 16 White/Colored Greschgörin Disk Estimator (GDE), AIC, MDL
EFT [7,8]
2007
Eigenvalue based M = 5; N = 6 White AIC, MDL, MDLB, PDL
SAMOS [9]
2007
Subspace based M = 65;
N = 65White/Colored ESTER
NEMO [10]
2008
Eigenvalue based N = 8*M (various)
White AIC, MDL
SURE [11]
2008
Eigenvalue based M = 64;
N = [96,128]White Laplace, BIC
- M > N?
- Small values of N?
- Comparisons in-between?
![Page 13: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/13.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 13
Review of the State of the Art of the MOSReview of the State of the Art of the MOS
[4]: P. R. Krishnaiah, L. C. Zhao, and Z. D. Bai, “On detection of the number of signals in presence of white noise”, Journal of Multivariate Analysis, vol. 20, pp. 1-25, 1986.
[5]: R. Badeau, B. David, and G. Richard, “Selecting the modeling order for the ESPRIT high resolution method: an alternative approach”, in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2004), Montreal, Canada, May 2004.
[6]: E. Radoi and A. Quinquis, “A new method for estimating the number of harmonic components in noise with application in high resolution RADAR”, EURASIP Journal on App. Sig. Proc., pp. 1177-1188, 2004.
[7]: J. Grouffad, P. Larzabal, and H. Clergeot, “Some properties of ordered eigenvalues of a Wishart matrix: application in detection test and model order selection”, in Proc. IEEE Internation Conference on Acoustics, Speech, and Signal Processing (ICASSP 1996), May 1996, vol. 5, pp.2463-2466.
[8]: A. Quinlan, J.-P. Barbot, P. Larzabal, and M. Haardt, “Model Order selection for short data: An Exponential Fitting Test (EFT)”, EURASIP Journal on Applied Signal Processing, 2007, Special Issue on Advances in Subspace-based Techniques for Signal Processing and Communications.
[9]: J.-M. Papy, L. De Lathauwer, and S. Van Huffel, “A shift invariance-based order-selection technique for exponential data modeling”, IEEE Signal Processing Letters, vol. 14, pp. 473-476, July 2007.
[10]:R. R. Nadakuditi and A. Edelman, “Sample eigenvalue based detection of high-dimensional signals in white noise using relatively few samples”, IEEE Trans. of Sig. Proc., vol. 56, pp. 2625-2638, July 2008.
[11]:M. O. Ulfarsson and V. Solo, “Rank selection in noisy PCA with SURE and random matrix theory”, in Proc. International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2008), Las Vegas, USA, Apr. 2008.
![Page 14: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/14.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 14
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 15: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/15.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 15
Exponential Fitting Test (EFT)Exponential Fitting Test (EFT)
It was shown in [7,8], that in the noise-only case
![Page 16: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/16.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 16
Exponential Fitting Test (EFT)Exponential Fitting Test (EFT)
Observation is a superposition of noise and signal
The noise eigenvalues still exhibit the exponential profile
We can predict the profileof the noise eigenvaluesto find the “breaking point”
Let P denote the number of candidate noise eigenvalues.
• choose the largest P such that the P noise eigenvalues can be fitted with a decaying exponential
d = 3, M = 8, SNR = 20 dB, N = 10
![Page 17: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/17.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 17
Exponential Fitting Test (EFT)Exponential Fitting Test (EFT)
Finding the breaking point. For P = 2
Predict M-2 based on M-1 and M
relative distance
d = 3, M = 8, SNR = 20 dB, N = 10
![Page 18: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/18.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 18
Exponential Fitting Test (EFT)Exponential Fitting Test (EFT)
Finding the breaking point. For P = 3
Predict M-3 based on M-2, M-1, and M
relative distance
d = 3, M = 8, SNR = 20 dB, N = 10
![Page 19: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/19.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 19
Exponential Fitting Test (EFT)Exponential Fitting Test (EFT)
Finding the breaking point. For P = 4
Predict M-4 based on M-3, M-2, M-1, and M
relative distance
d = 3, M = 8, SNR = 20 dB, N = 10
![Page 20: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/20.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 20
Exponential Fitting Test (EFT)Exponential Fitting Test (EFT)
Finding the breaking point. For P = 5
Predict M-5 based on M-4 , M-3, M-2, M-1, and M
relative distance
The relative distance becomes very big, we have found the break point.
d = 3, M = 8, SNR = 20 dB, N = 10
![Page 21: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/21.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 21
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 22: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/22.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 22
ModifiedModified EFT (M-EFT) EFT (M-EFT)
In [7,8], it was assumed that N > M
The result can be generalized by defining
Our first modification
![Page 23: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/23.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 23
ModifiedModified EFT (M-EFT) EFT (M-EFT)
(1) Set the number of candidate noise eigenvalues to P = 1
(2) Estimation step: Estimate noise eigenvalue M - P
(3) Comparison step: Compare estimate with observation.
If set P = P + 1, go to (2).
(4) The final estimate is
(second modification w.r.t. original EFT)
![Page 24: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/24.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 24
ModifiedModified EFT (M-EFT) EFT (M-EFT)
For every P: vary and determine numerically the probability to detect a signal in noise-only data. Then choose such that the desired is met.
Example:
Determining the threshold coefficients
![Page 25: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/25.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 25
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 26: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/26.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 26
1-D AIC and 1-D MDL1-D AIC and 1-D MDL
For AIC [12]
For MDL [13]
Similarly to [1], we use the log-likelihood expression for the asymptotic theory of noise for principal component analysis [3] considering that
[12]: H. Akaike, “Information theory and extension of the maximum likelihood principle”, 2nd Int. Symp. Inform.
Theory suppl. Problems of Control and Inform. Theory, pp. 267-281, 1973.
[13]: J. Rissanen, “Modeling by shortest data description”, Automatica, vol. 14, pp. 465-471, 1978.
Free parameters
![Page 27: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/27.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 27
1-D AIC and 1-D MDL1-D AIC and 1-D MDL
Penalty functions According to [1]
We propose (taking into account also that M > N)
![Page 28: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/28.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 28
1-D AIC and 1-D MDL1-D AIC and 1-D MDL
Our proposed expressions
![Page 29: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/29.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 29
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 30: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/30.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 30
M-EFT IIM-EFT II
Deriving q considering that the noise can be both real-valued or complex-valued, we obtain that
where for complex-valued Gaussian white noise
and for real-valued Gaussian white noise
![Page 31: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/31.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 31
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 32: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/32.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 32
SimulationsSimulations
According to [5], for M > N, AIC and MDL is used by practitioners. Comparing to our proposed versions.
![Page 33: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/33.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 33
SimulationsSimulations
According to [5], for M > N, AIC and MDL is used by practitioners. Comparing to our proposed versions.
![Page 34: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/34.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 34
SimulationsSimulations
According to [5], for M > N, AIC and MDL is used by practitioners. Comparing to our proposed versions.
![Page 35: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/35.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 35
SimulationsSimulations
According to [5], for M > N, AIC and MDL is used by practitioners. Comparing to our proposed versions.
![Page 36: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/36.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 36
SimulationsSimulations
According to [5], for M > N, AIC and MDL is used by practitioners. Comparing to our proposed versions.
![Page 37: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/37.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 37
SimulationsSimulations
According to [5], for M > N, AIC and MDL is used by practitioners. Comparing to our proposed versions.
The greater M, the greater is the improvement.
No gain for 1-D EDC.
![Page 38: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/38.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 38
SimulationsSimulations
Comparing the M-EFT II to M-EFT for the case of real-valued Gaussian white noise.
![Page 39: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/39.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 39
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 40: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/40.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 40
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 41: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/41.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 41
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 42: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/42.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 42
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 43: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/43.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 43
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 44: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/44.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 44
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 45: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/45.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 45
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 46: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/46.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 46
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 47: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/47.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 47
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 48: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/48.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 48
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 49: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/49.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 49
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 50: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/50.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 50
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 51: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/51.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 51
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 52: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/52.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 52
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 53: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/53.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 53
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 54: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/54.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 54
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 55: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/55.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 55
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 56: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/56.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 56
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 57: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/57.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 57
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 58: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/58.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 58
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 59: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/59.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 59
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 60: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/60.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 60
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 61: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/61.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 61
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 62: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/62.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 62
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 63: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/63.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 63
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 64: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/64.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 64
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 65: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/65.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 65
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 66: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/66.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 66
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 67: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/67.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 67
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 68: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/68.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 68
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 69: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/69.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 69
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 70: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/70.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 70
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 71: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/71.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 71
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 72: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/72.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 72
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 73: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/73.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 73
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 74: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/74.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 74
SimulationsSimulations
Comparing the state-of-the-art model order selection techniques
![Page 75: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/75.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 75
OutlineOutline
Data Model Analysis of the Noise Eigenvalues Profile Review of the State of the Art of the Model Order Selection (MOS)
Exponential Fitting Test (EFT) Modified EFT (M-EFT)
1-D AIC and 1-D MDL M-EFT II Simulations Conclusions
![Page 76: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/76.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 76
ConclusionsConclusions
1-D AIC and 1-D MDL are fundamental for the following multidimensional extensions R-D AIC and R-D MDL in [2].
A more general expression for the M-EFT rate of the predicted exponential profile is presented considering real-value white Gaussian noise.
After a campaign of simulations comparing the state-of-the-art matrix based model order selection techniques in the presence of white Gaussian noise, the following general rules were obtained
The best PoD is achieved by M-EFT for all array sizes;
In case that N >> M, then in general any technique can be applied, since they all have quite close performance. We suggest M-EFT, as well as AIC and MDL.
![Page 77: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/77.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 77
Thank you for your attention!Thank you for your attention!Vielen Dank für Ihre Aufmerksamkeit!Vielen Dank für Ihre Aufmerksamkeit!
Ilmenau University of TechnologyCommunications Research Laboratory
P.O. Box 10 05 65D-98684 Ilmenau, GermanyE-Mail: [email protected]
![Page 78: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/78.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 78
BACKUPBACKUP
![Page 79: Ilmenau University of Technology Communications Research Laboratory 1 Comparison of Model Order Selection Techniques for High-Resolution Parameter Estimation](https://reader036.vdocument.in/reader036/viewer/2022081520/56649e025503460f94aed6d2/html5/thumbnails/79.jpg)
Ilmenau University of TechnologyCommunications Research Laboratory 79
Data modelData model Noiseless case
Matrix data model
Our objective is to estimate Our objective is to estimate dd from the noisy observations . from the noisy observations .