Successful network inference from time-series data using mutual information rate

E. Bianco-Martinez, N. Rubido, Ch. G. Antonopoulos, M. S. Baptista

Research output: Contribution to journalArticle

15 Citations (Scopus)
11 Downloads (Pure)

Abstract

The Mutual Information Rate (MIR) measures the time rate of information exchanged between two non-random and correlated variables. Since variables in complex systems are not purely random, the MIR is an appropriate quantity to access the amount of information exchanged in complex systems. However, its calculation requires infinitely long measurements with arbitrary resolution. Having in mind that it is impossible to perform infinitely long measurements with perfect accuracy, this work shows how to estimate the MIR taking into consideration this fundamental limitation and how to use it for the characterization and understanding of dynamical and complex systems. Moreover, we introduce a novel normalized form of MIR that successfully infers the structure of small networks of interacting dynamical systems. The proposedinference methodology is robust in the presence of additive noise, different time-series lengths, and heterogeneous node dynamics and coupling strengths. Moreover, it also outperforms inference methods based on Mutual Information when analysing networks formed by nodes possessing different time-scales.
Original languageEnglish
Article number043102
Pages (from-to)1-9
Number of pages9
JournalChaos
Volume26
Issue number4
Early online date12 Apr 2016
DOIs
Publication statusPublished - Apr 2016

Fingerprint

Information Rates
Time Series Data
Mutual Information
inference
Large scale systems
Time series
Dynamical systems
Complex Systems
complex systems
Additive noise
Dynamical system
dynamical systems
Additive Noise
Vertex of a graph
Time Scales
Methodology
Arbitrary
methodology
Estimate
estimates

Cite this

Successful network inference from time-series data using mutual information rate. / Bianco-Martinez, E.; Rubido, N.; Antonopoulos, Ch. G.; Baptista, M. S.

In: Chaos, Vol. 26, No. 4, 043102, 04.2016, p. 1-9.

Research output: Contribution to journalArticle

Bianco-Martinez, E. ; Rubido, N. ; Antonopoulos, Ch. G. ; Baptista, M. S. / Successful network inference from time-series data using mutual information rate. In: Chaos. 2016 ; Vol. 26, No. 4. pp. 1-9.
@article{18358c78ec7643c28f9b9e03bab38748,
title = "Successful network inference from time-series data using mutual information rate",
abstract = "The Mutual Information Rate (MIR) measures the time rate of information exchanged between two non-random and correlated variables. Since variables in complex systems are not purely random, the MIR is an appropriate quantity to access the amount of information exchanged in complex systems. However, its calculation requires infinitely long measurements with arbitrary resolution. Having in mind that it is impossible to perform infinitely long measurements with perfect accuracy, this work shows how to estimate the MIR taking into consideration this fundamental limitation and how to use it for the characterization and understanding of dynamical and complex systems. Moreover, we introduce a novel normalized form of MIR that successfully infers the structure of small networks of interacting dynamical systems. The proposedinference methodology is robust in the presence of additive noise, different time-series lengths, and heterogeneous node dynamics and coupling strengths. Moreover, it also outperforms inference methods based on Mutual Information when analysing networks formed by nodes possessing different time-scales.",
author = "E. Bianco-Martinez and N. Rubido and Antonopoulos, {Ch. G.} and Baptista, {M. S.}",
note = "ACKNOWLEDGMENTS E.B.M., M.S.B., and C.G.A. acknowledge the financial support provided by the EPSRC “EP/I032606/1” grant. C.G.A. contributed to this work while working at the University of Aberdeen and then, while working at the University of Essex, United Kingdom. N.R. acknowledges the support of PEDECIBA, Uruguay",
year = "2016",
month = "4",
doi = "10.1063/1.4945420",
language = "English",
volume = "26",
pages = "1--9",
journal = "Chaos",
issn = "1054-1500",
publisher = "American Institute of Physics",
number = "4",

}

TY - JOUR

T1 - Successful network inference from time-series data using mutual information rate

AU - Bianco-Martinez, E.

AU - Rubido, N.

AU - Antonopoulos, Ch. G.

AU - Baptista, M. S.

N1 - ACKNOWLEDGMENTS E.B.M., M.S.B., and C.G.A. acknowledge the financial support provided by the EPSRC “EP/I032606/1” grant. C.G.A. contributed to this work while working at the University of Aberdeen and then, while working at the University of Essex, United Kingdom. N.R. acknowledges the support of PEDECIBA, Uruguay

PY - 2016/4

Y1 - 2016/4

N2 - The Mutual Information Rate (MIR) measures the time rate of information exchanged between two non-random and correlated variables. Since variables in complex systems are not purely random, the MIR is an appropriate quantity to access the amount of information exchanged in complex systems. However, its calculation requires infinitely long measurements with arbitrary resolution. Having in mind that it is impossible to perform infinitely long measurements with perfect accuracy, this work shows how to estimate the MIR taking into consideration this fundamental limitation and how to use it for the characterization and understanding of dynamical and complex systems. Moreover, we introduce a novel normalized form of MIR that successfully infers the structure of small networks of interacting dynamical systems. The proposedinference methodology is robust in the presence of additive noise, different time-series lengths, and heterogeneous node dynamics and coupling strengths. Moreover, it also outperforms inference methods based on Mutual Information when analysing networks formed by nodes possessing different time-scales.

AB - The Mutual Information Rate (MIR) measures the time rate of information exchanged between two non-random and correlated variables. Since variables in complex systems are not purely random, the MIR is an appropriate quantity to access the amount of information exchanged in complex systems. However, its calculation requires infinitely long measurements with arbitrary resolution. Having in mind that it is impossible to perform infinitely long measurements with perfect accuracy, this work shows how to estimate the MIR taking into consideration this fundamental limitation and how to use it for the characterization and understanding of dynamical and complex systems. Moreover, we introduce a novel normalized form of MIR that successfully infers the structure of small networks of interacting dynamical systems. The proposedinference methodology is robust in the presence of additive noise, different time-series lengths, and heterogeneous node dynamics and coupling strengths. Moreover, it also outperforms inference methods based on Mutual Information when analysing networks formed by nodes possessing different time-scales.

U2 - 10.1063/1.4945420

DO - 10.1063/1.4945420

M3 - Article

VL - 26

SP - 1

EP - 9

JO - Chaos

JF - Chaos

SN - 1054-1500

IS - 4

M1 - 043102

ER -