Information Theoretic Equivalent Bandwidths of Random Processes and Their Applications

Summary

Objectives : Since most of the biomedical signals, such as electroencephalogram (EEG), electromyogram (EMG) and phonocardiogram (PCG), are nonstationary random processes, the time-frequency analysis has recently been extensively applied to those signals in order to achieve precise characterization and classification. In this paper, we have first defined a new class of information theoretic equivalent bandwidths (EBWs) of stationary random processes, then instantaneous EBWs (IEBWs) using nonnegative time-frequenc distributions have been defined in order to track the change of the EBW of a nonstationary random process.

Methods : The new class of EBWs which includes spectral flatness measure (SFM) for stationary random processes is defined by using generalized Burg entropy. Generalized Burg entropy is derived from the relation between Rényi entropy and Rényi information divergence of order α. In order to track the change of EBWs of a nonstationary random process, the IEBWs are defined on the nonnegative time-frequency distributions, which are constructed by the Copula theory.

Results : We evaluate the IEBWs for a first order stationary auto-regressive (AR) process and three types of time-varying AR processes. The results show that the IEBWs proposed here properly represent a signal bandwidth. In practical application to PCGs, the proposed method was successful in extracting the information that the bandwidth of the innocent systolic murmur was much smaller than that of the abnormal systolic murmur.

Conclusions : We have defined new information theoretic EBWs and have proposed a novel method to track the change of the IEBWs. Some computer simulation showed effectiveness of the methods. Applying the IEBWs to PCGs, we could extract some features of a systolic murmur.

Keywords

Instantaneous equivalent bandwidths - Rényi divergence - Burg entropy - positive time-frequency distribution - Copula theory

• References

• 1. Akay M. Time Frequency and Wavelets in Biomedical Signal Processing. IEEE Press; 1998
• 2. Kikkawa S, Yoshida H. On Unification of Equivalent Bandwidths of a Random Process. IEEE Signal Processing Letters 2004; 11 (08) 670-674.
• 3. Yoshida H, Kikkawa S. A New Class of equivalent bandwidths and its applications to bio-signals. In: ITC-CSCC; 2001: 652-655.
• 4. Yoshida H, Ikegami T, Kikkawa S. Copula-based Positive Time-Frequency Distributions of the Phonocardiogram. In: Proceedings of the 26th Annual International conference of the IEEE EMBS; 2004: 388-391.
• 5. Yoshida H, Kikkawa S. Tracking of the instantaneous bandwidth in bio-signals: the Copulabased positive distribution and generalized equivalent bandwidth. Proceedings of SPIE 2004; 5559: 325-334.
• 6. Rényi A. Probability theory. North-Holand Publishing Company; 1970
• 7. Kikkawa S, Ishida M. Number of degrees of freedom, correlation times, and equivalent bandwidths of a random process. IEEE Trans Inform Theory 1988; 34 (01) 151-155.
• 8. Campbell LL. Minimum coefficient rate for stationary random processes. Information and Control 1960; 3: 360-371.
• 9. Wong P. Rate distortion efficiency of subband coding with cross prediction. IEEE Trans Information Theory 1997; 43 (01) 352-356.
• 10. Fischer TR. On the rate-distortion function efficiency of subband coding. IEEE Trans Information Theory 1997; 38 (02) 426-428.
• 11. Tan SL, Fischer TR. Linear prediction of subband signals crossband prediction. IEEE Journal on Selected Papers in Communications 1994; 12 (09) 1576-1583.
• 12. Rao S, Pearlman WA. Analysis of linear prediction, coding, and spectral estimation from sub bands. IEEE Trans Information Theory 1996; 43 (04) 1160-1178.
• 13. Maison B, Vandendorp L. About the asymptotic performance of multiple-input/multiple-output linear prediction of subband signals. IEEE Signal Processing Letters 1998; 5 (12) 315-317.
• 14. Burp JP. The relationship between maximum entropy spectra and maximum likelyhood spectra. In: Childrers DG editor. Mordern spectral analysis; 1972: 130-131.
• 15. Kapur JN, Kesavan HK. Entropy optimization principles with applications. Academic Press; 1992
• 16. Wigner E. Quantum mechanical distribution functions revisited. In: Yougrau W van der Merwe A editors. Perspectives in quantum theory. Dover, New York; 1979
• 17. Janssen AEM. Bilinear phase-plane distribution function and positivity. J Math Phys 1985; 26 (08) 1986-1994.
• 18. Cohen L. Time-Frequency distribution - a review. ProcIEEE 1989; 77 (07) 941-981.
• 19. Nelsen RB. An Introduction to Copulas. Springer Verlag; 1998
• 20. Davy M, Doucet A. Copulas: A New Insight Into Positive Time-Frequency Distributions. IEEE Signal Processing Letters 2003; 10 (07) 215-218.