Recently, a great deal of interest has been paid in the field of Bayesian optimization to methods which take an information-theoretic approach to the design of acquisition functions. Such techniques equate the value of potential query points directly with their information content. The first of these techniques, developed separately as an informational approach to global optimization (IAGO) [9]...

Avoided crossings are the most distinctive atomic spectroscopic features in the presence of magnetic and electric fields. We point out the role of Shannon's information entropy as an indicator or predictor of these phenomena by studying the dynamics of some excited states of hydrogen in the presence of parallel magnetic and electric fields. Moreover, in addition to the well-known energy level r...

Several aspects of the Thermodynamics of systems away from equilibrium are considered. Particular attention is given to the question of the concepts of entropy and temperature in arbitrary nonequilibrium conditions. Even though such state function and thermodynamic variable are elusive in such conditions, it is elaborated and discussed an approach to them that can be obtained in the framework o...

Alphabet size and informational entropy, two formal measures of sequence complexity, are herein applied to two prior studies on the folding of minimal proteins. These measures show a designed four-helix bundle to be unlike its natural counterparts but rather more like a coiled-coil dimer. Segments from a simplified sarc homology 3 domain and more than 2000000 segments from globular proteins bot...

Rooted trees with probabilities are convenient to represent a class of random processes with memory. They allow to describe and analyze variable length codes for data compression and distribution matching. In this work, the Leaf-Average Node-Sum Interchange Theorem (LANSIT) and the well-known applications to path length and leaf entropy are re-stated. The LANSIT is then applied to informational...

The informational energy of Onicescu is a positive quantity that measures the amount uncertainty random variable. However, contrary to Shannon’s entropy, strictly convex and increases when randomness decreases. We report closed-form formula for Onicescu’s its associated correlation coefficient probability distributions belong an exponential family. show how instantiate generic several common fa...

Robustness of water distribution networks is related to their connectivity and topological structure, which also affect their reliability. Flow entropy, based on Shannon’s informational entropy, has been proposed as a measure of network redundancy and adopted as a proxy of reliability in optimal network design procedures. In this paper, the scaling properties of flow entropy of water distributi...

A new notion of empirical informational divergence (relative entropy) between two individual sequences is introduced. If the two sequences are independent realizations of two finiteorder, finite alphabet, stationary Markov processes, the empirical relative entropy converges to the relative entropy almost surely. This new empirical divergence is based on a version of the Lempel-Ziv data compress...