A new entropy measure based on the Renyi entropy rate using Gaussian kernels

D. Woodcock, Ian T. Nabney

Research output: Preprint or Working paperTechnical report


The concept of entropy rate is well defined in dynamical systems theory but is impossible to apply it directly to finite real world data sets. With this in mind, Pincus developed Approximate Entropy (ApEn), which uses ideas from Eckmann and Ruelle to create a regularity measure based on entropy rate that can be used to determine the influence of chaotic behaviour in a real world signal. However, this measure was found not to be robust and so an improved formulation known as the Sample Entropy (SampEn) was created by Richman and Moorman to address these issues. We have developed a new, related, regularity measure which is not based on the theory provided by Eckmann and Ruelle and proves a more well-behaved measure of complexity than the previous measures whilst still retaining a low computational cost.
Original languageEnglish
Place of PublicationBirmingham
PublisherAston University
Number of pages15
ISBN (Print)NCRG/2006/008
Publication statusPublished - 24 Feb 2006


  • approximate entropy
  • ApEn
  • entropy rate
  • dynamical systems theory
  • sample entropy
  • SampEn


Dive into the research topics of 'A new entropy measure based on the Renyi entropy rate using Gaussian kernels'. Together they form a unique fingerprint.

Cite this