Relating Fisher information to order parameters.
نویسندگان
چکیده
We study phase transitions and relevant order parameters via statistical estimation theory using the Fisher information matrix. The assumptions that we make limit our analysis to order parameters representable as a negative derivative of thermodynamic potential over some thermodynamic variable. Nevertheless, the resulting representation is sufficiently general and explicitly relates elements of the Fisher information matrix to the rate of change in the corresponding order parameters. The obtained relationships allow us to identify, in particular, second-order phase transitions via divergences of individual elements of the Fisher information matrix. A computational study of random Boolean networks supports the derived relationships, illustrating that Fisher information of the magnetization bias (that is, activity level) is peaked in finite-size networks at the critical points, and the maxima increase with the network size. The framework presented here reveals the basic thermodynamic reasons behind similar empirical observations reported previously. The study highlights the generality of Fisher information as a measure that can be applied to a broad range of systems, particularly those where the determination of order parameters is cumbersome.
منابع مشابه
A Fisher Information Study of Phase Transitions in Random Boolean Networks
We are interested in studying the order-chaos phase transition in random Boolean networks (RBNs), which have been used as models of gene regulatory networks. In particular we seek to characterise the phase diagram in informationtheoretic terms, focussing on the effect of the control parameters (activity level and connectivity). The Fisher information, which measures how much a system’s dynamics...
متن کاملStrong matching of frequentist and Bayesian parametric inference
We de/ne a notion of strong matching of frequentist and Bayesian inference for a scalar parameter, and show that for the special case of a location model strong matching is obtained for any interest parameter linear in the location parameters. Strong matching is de/ned using one-sided interval estimates constructed by inverting test quantities. A brief survey of methods for choosing a prior, of...
متن کاملFisher Information at the Edge of Chaos in Random Boolean Networks
We study the order-chaos phase transition in random Boolean networks (RBNs), which have been used as models of gene regulatory networks. In particular we seek to characterize the phase diagram in information-theoretic terms, focusing on the effect of the control parameters (activity level and connectivity). Fisher information, which measures how much system dynamics can reveal about the control...
متن کاملUse and abuse of the Fisher information matrix in the assessment of gravitational-wave parameter-estimation prospects
The Fisher-matrix formalism is used routinely in the literature on gravitational-wave detection to characterize the parameter-estimation performance of gravitational-wave measurements, given parametrized models of the waveforms, and assuming detector noise of known colored Gaussian distribution. Unfortunately, the Fisher matrix can be a poor predictor of the amount of information obtained from ...
متن کاملAn Information Geometric Perspective on Active Learning
The Fisher information matrix plays a very important role in both active learning and information geometry. In a special case of active learning (nonlinear regression with Gaussian noise), the inverse of the Fisher information matrix – the dispersion matrix of parameters – induces a variety of criteria for optimal experiment design. In information geometry, the Fisher information matrix defines...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Physical review. E, Statistical, nonlinear, and soft matter physics
دوره 84 4 Pt 1 شماره
صفحات -
تاریخ انتشار 2011