A dynamical systems-based Hierarchy for Shannon, metric and topological entropy

Raymond Addabbo, Denis Blackmore

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

A rigorous dynamical systems-based hierarchy is established for the definitions of entropy of Shannon (information), Kolmogorov-Sinai (metric) and Adler, Konheim & McAndrew (topological). In particular, metric entropy, with the imposition of some additional properties, is proven to be a special case of topological entropy and Shannon entropy is shown to be a particular form of metric entropy. This is the first of two papers aimed at establishing a dynamically grounded hierarchy comprising Clausius, Boltzmann, Gibbs, Shannon, metric and topological entropy in which each element is ideally a special case of its successor or some kind of limit thereof.

Original languageEnglish (US)
Article number938
JournalEntropy
Volume21
Issue number10
DOIs
StatePublished - Oct 1 2019

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Mathematical Physics
  • Physics and Astronomy (miscellaneous)
  • General Physics and Astronomy
  • Electrical and Electronic Engineering

Keywords

  • Bernoulli scheme
  • Shannon entropy: metric entropy
  • Topological entropy

Fingerprint

Dive into the research topics of 'A dynamical systems-based Hierarchy for Shannon, metric and topological entropy'. Together they form a unique fingerprint.

Cite this