Kernel Measures of Conditional Dependence

نویسندگان

  • Kenji Fukumizu
  • Arthur Gretton
  • Xiaohai Sun
  • Bernhard Schölkopf
چکیده

We propose a new measure of conditional dependence of random variables, based on normalized cross-covariance operators on reproducing kernel Hilbert spaces. Unlike previous kernel dependence measures, the proposed criterion does not depend on the choice of kernel in the limit of infinite data, for a wide class of kernels. At the same time, it has a straightforward empirical estimate with good convergence behaviour. We discuss the theoretical properties of the measure, and demonstrate its application in experiments.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Scale Invariant Conditional Dependence Measures

Proof. We will prove the general case of conditional dependence measure since the other case follows trivially as a special case when Z = ∅. The kernel-free property of the dependence measures is used to prove the result. The proof essentially uses change of variables formulas for transformation of random variables. From Theorem 1, we have

متن کامل

Markov Blanket Ranking using Kernel-based Conditional Dependence Measures

Developing feature selection algorithms that move beyond a pure correlational to a more causal analysis of observational data is an important problem in the sciences. Several algorithms attempt to do so by discovering the Markov blanket of a target, but they all contain a forward selection step which variables must pass in order to be included in the conditioning set. As a result, these algorit...

متن کامل

An Operator Viewpoint to Analysis of Conditional Kernel Canonical Correlation

Kernel canonical correlation analysis (CCA) is a nonlinear extension of CCA, which aims at extracting information shared by two random variables. In this paper, a new notion of conditional kernel CCA is introduced. Conditional kernel CCA aims at analyzing the effect of variable Z to the dependence between X and Y . Rates of convergence of an empirical normalized conditional cross-covariance ope...

متن کامل

Unsupervised Kernel Dimension Reduction Supplemental Material

We start by noting that conditional independence X ⊥ Y |B⊤X does not necessarily imply the correlation between BX and Y is maximized. To see this, let X be a Gaussian random vairable with zero mean and diagonal covariance matrix. AssumeB is an identity matrix and Y = X = (BX) (elementwise square for a vectorial X). The conditional independence is obviously satisfied yet the correlation between ...

متن کامل

Learning causality by identifying common effects with kernel-based dependence measures

We describe a method for causal inference that measures the strength of statistical dependence by the Hilbert-Schmidt norm of kernelbased conditional cross-covariance operators. We consider the increase of the dependence of two variables X and Y by conditioning on a third variable Z as a hint for Z being a common effect of X and Y . Based on this assumption, we collect “votes” for hypothetical ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007