Download PDF
Methods Inf Med 2007; 46(02): 110-116
DOI: 10.1055/s-0038-1625392
Original Article
Schattauer GmbH

Information Theoretic Equivalent Bandwidths of Random Processes and Their Applications

H. Yoshida
1   Department of Electronic Systems and Information Engineering, Kinki University, Wakayama, Japan
,
S. Kikkawa
1   Department of Electronic Systems and Information Engineering, Kinki University, Wakayama, Japan
› Author Affiliations
Further Information

Publication History

Publication Date:
11 January 2018 (online)

    Permissions and Reprints

Summary

Objectives : Since most of the biomedical signals, such as electroencephalogram (EEG), electromyogram (EMG) and phonocardiogram (PCG), are nonstationary random processes, the time-frequency analysis has recently been extensively applied to those signals in order to achieve precise characterization and classification. In this paper, we have first defined a new class of information theoretic equivalent bandwidths (EBWs) of stationary random processes, then instantaneous EBWs (IEBWs) using nonnegative time-frequenc distributions have been defined in order to track the change of the EBW of a nonstationary random process.

Methods : The new class of EBWs which includes spectral flatness measure (SFM) for stationary random processes is defined by using generalized Burg entropy. Generalized Burg entropy is derived from the relation between Rényi entropy and Rényi information divergence of order α. In order to track the change of EBWs of a nonstationary random process, the IEBWs are defined on the nonnegative time-frequency distributions, which are constructed by the Copula theory.

Results : We evaluate the IEBWs for a first order stationary auto-regressive (AR) process and three types of time-varying AR processes. The results show that the IEBWs proposed here properly represent a signal bandwidth. In practical application to PCGs, the proposed method was successful in extracting the information that the bandwidth of the innocent systolic murmur was much smaller than that of the abnormal systolic murmur.

Conclusions : We have defined new information theoretic EBWs and have proposed a novel method to track the change of the IEBWs. Some computer simulation showed effectiveness of the methods. Applying the IEBWs to PCGs, we could extract some features of a systolic murmur.

Keywords

Instantaneous equivalent bandwidths - Rényi divergence - Burg entropy - positive time-frequency distribution - Copula theory
 

  • References

  • 1. Akay M. Time Frequency and Wavelets in Biomedical Signal Processing. IEEE Press; 1998
    PubMedSearch in Google Scholar
  • 2. Kikkawa S, Yoshida H. On Unification of Equivalent Bandwidths of a Random Process. IEEE Signal Processing Letters 2004; 11 (08) 670-674.
    CrossrefPubMedSearch in Google Scholar
  • 3. Yoshida H, Kikkawa S. A New Class of equivalent bandwidths and its applications to bio-signals. In: ITC-CSCC; 2001: 652-655.
    PubMedSearch in Google Scholar
  • 4. Yoshida H, Ikegami T, Kikkawa S. Copula-based Positive Time-Frequency Distributions of the Phonocardiogram. In: Proceedings of the 26th Annual International conference of the IEEE EMBS; 2004: 388-391.
    PubMedSearch in Google Scholar
  • 5. Yoshida H, Kikkawa S. Tracking of the instantaneous bandwidth in bio-signals: the Copulabased positive distribution and generalized equivalent bandwidth. Proceedings of SPIE 2004; 5559: 325-334.
    PubMedSearch in Google Scholar
  • 6. Rényi A. Probability theory. North-Holand Publishing Company; 1970
    PubMedSearch in Google Scholar
  • 7. Kikkawa S, Ishida M. Number of degrees of freedom, correlation times, and equivalent bandwidths of a random process. IEEE Trans Inform Theory 1988; 34 (01) 151-155.
    CrossrefPubMedSearch in Google Scholar
  • 8. Campbell LL. Minimum coefficient rate for stationary random processes. Information and Control 1960; 3: 360-371.
    CrossrefPubMedSearch in Google Scholar
  • 9. Wong P. Rate distortion efficiency of subband coding with cross prediction. IEEE Trans Information Theory 1997; 43 (01) 352-356.
    CrossrefPubMedSearch in Google Scholar
  • 10. Fischer TR. On the rate-distortion function efficiency of subband coding. IEEE Trans Information Theory 1997; 38 (02) 426-428.
    PubMedSearch in Google Scholar
  • 11. Tan SL, Fischer TR. Linear prediction of subband signals crossband prediction. IEEE Journal on Selected Papers in Communications 1994; 12 (09) 1576-1583.
    PubMedSearch in Google Scholar
  • 12. Rao S, Pearlman WA. Analysis of linear prediction, coding, and spectral estimation from sub bands. IEEE Trans Information Theory 1996; 43 (04) 1160-1178.
    PubMedSearch in Google Scholar
  • 13. Maison B, Vandendorp L. About the asymptotic performance of multiple-input/multiple-output linear prediction of subband signals. IEEE Signal Processing Letters 1998; 5 (12) 315-317.
    CrossrefPubMedSearch in Google Scholar
  • 14. Burp JP. The relationship between maximum entropy spectra and maximum likelyhood spectra. In: Childrers DG editor. Mordern spectral analysis; 1972: 130-131.
    PubMedSearch in Google Scholar
  • 15. Kapur JN, Kesavan HK. Entropy optimization principles with applications. Academic Press; 1992
    PubMedSearch in Google Scholar
  • 16. Wigner E. Quantum mechanical distribution functions revisited. In: Yougrau W van der Merwe A editors. Perspectives in quantum theory. Dover, New York; 1979
    PubMedSearch in Google Scholar
  • 17. Janssen AEM. Bilinear phase-plane distribution function and positivity. J Math Phys 1985; 26 (08) 1986-1994.
    CrossrefPubMedSearch in Google Scholar
  • 18. Cohen L. Time-Frequency distribution - a review. ProcIEEE 1989; 77 (07) 941-981.
    PubMedSearch in Google Scholar
  • 19. Nelsen RB. An Introduction to Copulas. Springer Verlag; 1998
    PubMedSearch in Google Scholar
  • 20. Davy M, Doucet A. Copulas: A New Insight Into Positive Time-Frequency Distributions. IEEE Signal Processing Letters 2003; 10 (07) 215-218.
    CrossrefPubMedSearch in Google Scholar