Hans Peter Bernhard, Georges A. Darbellay,
"Performance analysis of the mutual information function for nonlinear and linear signal processing"
: Proceedings of the 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP99, Seite(n) 1297-1300, 3-1999
Performance analysis of the mutual information function for nonlinear and linear signal processing
Sprache des Titels:
Proceedings of the 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP99
Nonlinear signal processing is now well established both in theory and applications. Nevertheless, very few tools are available for the analysis of nonlinear systems. We introduce the mutual information function (MIF) as a nonlinear correlation function and describe the practicalities of estimating it from data. Even if an estimator is consistent, it is of great interest to check what the bias and variance are with a finite sample. We discuss these questions, as well as the computational efficiency, for two estimators. Both algorithms are of complexity Nlog2N, where N is the sample length, but they use different methods to find the histogram for the estimation of the mutual information. An efficient implementation makes it possible to apply the algorithm on real time signal processing problems where the linear correlation analysis breaks down. Examples involving linear and nonlinear channels are discussed.