Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System

Georgios Balasis*, Reik V. Donner, Stelios M. Potirakis, Jakob Runge, Constantinos Papadimitriou, Ioannis A. Daglis, Konstantinos Eftaxias, Juergen Kurths

*Corresponding author for this work

Research output: Contribution to journalLiterature review

31 Citations (Scopus)
4 Downloads (Pure)

Abstract

This review provides a summary of methods originated in (non-equilibrium) statistical mechanics and information theory, which have recently found successful applications to quantitatively studying complexity in various components of the complex system Earth. Specifically, we discuss two classes of methods: (i) entropies of different kinds (e. g., on the one hand classical Shannon and Renyi entropies, as well as non-extensive Tsallis entropy based on symbolic dynamics techniques and, on the other hand, approximate entropy, sample entropy and fuzzy entropy); and (ii) measures of statistical interdependence and causality (e. g., mutual information and generalizations thereof, transfer entropy, momentary information transfer). We review a number of applications and case studies utilizing the above-mentioned methodological approaches for studying contemporary problems in some exemplary fields of the Earth sciences, highlighting the potentials of different techniques.

Original languageEnglish
Pages (from-to)4844-4888
Number of pages45
JournalEntropy
Volume15
Issue number11
DOIs
Publication statusPublished - 7 Nov 2013

Keywords

  • entropy measures
  • symbolic dynamics
  • non-extensive statistical mechanics
  • causality
  • Earth sciences
  • self-organized criticality
  • time-series analysis
  • holocene climate variability
  • El-Nino/Southern-Oscillation
  • Nino-Southern-Oscillation
  • magnetic-field topology
  • low-dimensional chaos
  • electromagnetic emissions
  • recurrence plots
  • permutation entropy

Cite this

Balasis, G., Donner, R. V., Potirakis, S. M., Runge, J., Papadimitriou, C., Daglis, I. A., ... Kurths, J. (2013). Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System. Entropy, 15(11), 4844-4888. https://doi.org/10.3390/e15114844

Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System. / Balasis, Georgios; Donner, Reik V.; Potirakis, Stelios M.; Runge, Jakob; Papadimitriou, Constantinos; Daglis, Ioannis A.; Eftaxias, Konstantinos; Kurths, Juergen.

In: Entropy, Vol. 15, No. 11, 07.11.2013, p. 4844-4888.

Research output: Contribution to journalLiterature review

Balasis, G, Donner, RV, Potirakis, SM, Runge, J, Papadimitriou, C, Daglis, IA, Eftaxias, K & Kurths, J 2013, 'Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System', Entropy, vol. 15, no. 11, pp. 4844-4888. https://doi.org/10.3390/e15114844
Balasis G, Donner RV, Potirakis SM, Runge J, Papadimitriou C, Daglis IA et al. Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System. Entropy. 2013 Nov 7;15(11):4844-4888. https://doi.org/10.3390/e15114844
Balasis, Georgios ; Donner, Reik V. ; Potirakis, Stelios M. ; Runge, Jakob ; Papadimitriou, Constantinos ; Daglis, Ioannis A. ; Eftaxias, Konstantinos ; Kurths, Juergen. / Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System. In: Entropy. 2013 ; Vol. 15, No. 11. pp. 4844-4888.
@article{4d33544a37644e9086102db0a23d2d53,
title = "Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System",
abstract = "This review provides a summary of methods originated in (non-equilibrium) statistical mechanics and information theory, which have recently found successful applications to quantitatively studying complexity in various components of the complex system Earth. Specifically, we discuss two classes of methods: (i) entropies of different kinds (e. g., on the one hand classical Shannon and Renyi entropies, as well as non-extensive Tsallis entropy based on symbolic dynamics techniques and, on the other hand, approximate entropy, sample entropy and fuzzy entropy); and (ii) measures of statistical interdependence and causality (e. g., mutual information and generalizations thereof, transfer entropy, momentary information transfer). We review a number of applications and case studies utilizing the above-mentioned methodological approaches for studying contemporary problems in some exemplary fields of the Earth sciences, highlighting the potentials of different techniques.",
keywords = "entropy measures, symbolic dynamics, non-extensive statistical mechanics, causality, Earth sciences, self-organized criticality, time-series analysis, holocene climate variability, El-Nino/Southern-Oscillation, Nino-Southern-Oscillation, magnetic-field topology, low-dimensional chaos, electromagnetic emissions, recurrence plots, permutation entropy",
author = "Georgios Balasis and Donner, {Reik V.} and Potirakis, {Stelios M.} and Jakob Runge and Constantinos Papadimitriou and Daglis, {Ioannis A.} and Konstantinos Eftaxias and Juergen Kurths",
year = "2013",
month = "11",
day = "7",
doi = "10.3390/e15114844",
language = "English",
volume = "15",
pages = "4844--4888",
journal = "Entropy",
issn = "1099-4300",
publisher = "Multidisciplinary Digital Publishing Institute (MDPI)",
number = "11",

}

TY - JOUR

T1 - Statistical Mechanics and Information-Theoretic Perspectives on Complexity in the Earth System

AU - Balasis, Georgios

AU - Donner, Reik V.

AU - Potirakis, Stelios M.

AU - Runge, Jakob

AU - Papadimitriou, Constantinos

AU - Daglis, Ioannis A.

AU - Eftaxias, Konstantinos

AU - Kurths, Juergen

PY - 2013/11/7

Y1 - 2013/11/7

N2 - This review provides a summary of methods originated in (non-equilibrium) statistical mechanics and information theory, which have recently found successful applications to quantitatively studying complexity in various components of the complex system Earth. Specifically, we discuss two classes of methods: (i) entropies of different kinds (e. g., on the one hand classical Shannon and Renyi entropies, as well as non-extensive Tsallis entropy based on symbolic dynamics techniques and, on the other hand, approximate entropy, sample entropy and fuzzy entropy); and (ii) measures of statistical interdependence and causality (e. g., mutual information and generalizations thereof, transfer entropy, momentary information transfer). We review a number of applications and case studies utilizing the above-mentioned methodological approaches for studying contemporary problems in some exemplary fields of the Earth sciences, highlighting the potentials of different techniques.

AB - This review provides a summary of methods originated in (non-equilibrium) statistical mechanics and information theory, which have recently found successful applications to quantitatively studying complexity in various components of the complex system Earth. Specifically, we discuss two classes of methods: (i) entropies of different kinds (e. g., on the one hand classical Shannon and Renyi entropies, as well as non-extensive Tsallis entropy based on symbolic dynamics techniques and, on the other hand, approximate entropy, sample entropy and fuzzy entropy); and (ii) measures of statistical interdependence and causality (e. g., mutual information and generalizations thereof, transfer entropy, momentary information transfer). We review a number of applications and case studies utilizing the above-mentioned methodological approaches for studying contemporary problems in some exemplary fields of the Earth sciences, highlighting the potentials of different techniques.

KW - entropy measures

KW - symbolic dynamics

KW - non-extensive statistical mechanics

KW - causality

KW - Earth sciences

KW - self-organized criticality

KW - time-series analysis

KW - holocene climate variability

KW - El-Nino/Southern-Oscillation

KW - Nino-Southern-Oscillation

KW - magnetic-field topology

KW - low-dimensional chaos

KW - electromagnetic emissions

KW - recurrence plots

KW - permutation entropy

U2 - 10.3390/e15114844

DO - 10.3390/e15114844

M3 - Literature review

VL - 15

SP - 4844

EP - 4888

JO - Entropy

JF - Entropy

SN - 1099-4300

IS - 11

ER -