The Essential Equivalence of Pairwise and Mutual Conditional Independence∗
نویسندگان
چکیده
For a large collection of random variables, pairwise conditional independence and mutual conditional independence are shown to be essentially equivalent. Unlike in the finite setting, a large collection of random variables remains essentially conditionally independent under further conditioning. The essential equivalence of pairwise and multiple versions of exchangeability also follows as a corollary. Our proof is based on an iterative extension of Bledsoe and Morse’s completion of a product measure on a pair of measure spaces. ∗Part of this work was done while Peter Hammond was visiting the National University of Singapore in March–April 2004. This version was completed while Yeneng Sun was visiting the University of Illinois at Urbana–Champaign in October 2004 – February 2005. †Department of Economics, Stanford University, Stanford, CA 94305. e-mail: [email protected] ‡Department of Mathematics, National University of Singapore, 2 Science Drive 2, Singapore 117543; and Department of Economics, National University of Singapore, 1 Arts Link, Singapore 117570. e-mail: [email protected]
منابع مشابه
The One - way Fubini Property and Conditional Independence : An Equivalence Result
A general parameter process defined by a continuum of random variables is not jointly measurable with respect to the usual product σ-algebra. For the case of independent random variables, a one-way Fubini extension of the product space was constructed in [11] to satisfy a limited form of joint measurability. For the general case we show that this extension exists if and only if there is a count...
متن کاملCausality Discovery with Additive Disturbances: An Information-Theoretical Perspective
We consider causally sufficient acyclic causal models in which the relationship among the variables is nonlinear while disturbances have linear effects, and show that three principles, namely, the causal Markov condition (together with the independence between each disturbance and the corresponding parents), minimum disturbance entropy, and mutual independence of the disturbances, are equivalen...
متن کاملOn Equivalence of Markov Propertiesover Undirected
The dependence of coincidence of the global, local and pairwise Markov properties on the underlying undirected graph is examined. The pairs of these properties are found to be equivalent for graphs with some small exluded subgraphs. Prob-abilistic representations of the corresponding conditional independence structures are discussed.
متن کاملQuantified Interference : Information Theory and Information Flow ( Extended Abstract )
The paper investigates which of Shannon’s measures (entropy, conditional entropy, mutual information) is the right one for the task of quantifying information flow in a programming language. We examine earlier relevant contributions from Denning, McLean and Gray and we propose and motivate a specific quantitative definition of information flow. We prove results relating equivalence relations, i...
متن کاملInformation-theoretic characterizations of conditional mutual independence and Markov random fields
We take the point of view that a Markov random field is a collection of so-called full conditional mutual independencies. Using the theory of -Measure, we have obtained a number of fundamental characterizations related to conditional mutual independence and Markov random fields. We show that many aspects of conditional mutual independence and Markov random fields have very simple set-theoretic ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005