Relating Fisher information to order parameters.

نویسندگان

  • Mikhail Prokopenko
  • Joseph T Lizier
  • Oliver Obst
  • X Rosalind Wang
چکیده

We study phase transitions and relevant order parameters via statistical estimation theory using the Fisher information matrix. The assumptions that we make limit our analysis to order parameters representable as a negative derivative of thermodynamic potential over some thermodynamic variable. Nevertheless, the resulting representation is sufficiently general and explicitly relates elements of the Fisher information matrix to the rate of change in the corresponding order parameters. The obtained relationships allow us to identify, in particular, second-order phase transitions via divergences of individual elements of the Fisher information matrix. A computational study of random Boolean networks supports the derived relationships, illustrating that Fisher information of the magnetization bias (that is, activity level) is peaked in finite-size networks at the critical points, and the maxima increase with the network size. The framework presented here reveals the basic thermodynamic reasons behind similar empirical observations reported previously. The study highlights the generality of Fisher information as a measure that can be applied to a broad range of systems, particularly those where the determination of order parameters is cumbersome.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Fisher Information Study of Phase Transitions in Random Boolean Networks

We are interested in studying the order-chaos phase transition in random Boolean networks (RBNs), which have been used as models of gene regulatory networks. In particular we seek to characterise the phase diagram in informationtheoretic terms, focussing on the effect of the control parameters (activity level and connectivity). The Fisher information, which measures how much a system’s dynamics...

متن کامل

Strong matching of frequentist and Bayesian parametric inference

We de/ne a notion of strong matching of frequentist and Bayesian inference for a scalar parameter, and show that for the special case of a location model strong matching is obtained for any interest parameter linear in the location parameters. Strong matching is de/ned using one-sided interval estimates constructed by inverting test quantities. A brief survey of methods for choosing a prior, of...

متن کامل

Fisher Information at the Edge of Chaos in Random Boolean Networks

We study the order-chaos phase transition in random Boolean networks (RBNs), which have been used as models of gene regulatory networks. In particular we seek to characterize the phase diagram in information-theoretic terms, focusing on the effect of the control parameters (activity level and connectivity). Fisher information, which measures how much system dynamics can reveal about the control...

متن کامل

Use and abuse of the Fisher information matrix in the assessment of gravitational-wave parameter-estimation prospects

The Fisher-matrix formalism is used routinely in the literature on gravitational-wave detection to characterize the parameter-estimation performance of gravitational-wave measurements, given parametrized models of the waveforms, and assuming detector noise of known colored Gaussian distribution. Unfortunately, the Fisher matrix can be a poor predictor of the amount of information obtained from ...

متن کامل

An Information Geometric Perspective on Active Learning

The Fisher information matrix plays a very important role in both active learning and information geometry. In a special case of active learning (nonlinear regression with Gaussian noise), the inverse of the Fisher information matrix – the dispersion matrix of parameters – induces a variety of criteria for optimal experiment design. In information geometry, the Fisher information matrix defines...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Physical review. E, Statistical, nonlinear, and soft matter physics

دوره 84 4 Pt 1  شماره 

صفحات  -

تاریخ انتشار 2011