Bayesian optimization with approximate set kernels

نویسندگان

چکیده

We propose a practical Bayesian optimization method over sets, to minimize black-box function that takes set as single input. Because inputs are permutation-invariant, traditional Gaussian process-based strategies which assume vector can fall short. To address this, we develop with kernel is used build surrogate functions. This accumulates similarity elements enforce permutation-invariance, but this comes at greater computational cost. reduce burden, two key components: (i) more efficient approximate still positive-definite and an unbiased estimator of the true upper-bounded variance in terms number subsamples, (ii) constrained acquisition uses symmetry feasible region defines Finally, present several numerical experiments demonstrate our outperforms other methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Reliability-Aware Optimization of Approximate Computational Kernels with Rely

Emerging high-performance architectures are anticipated to contain unreliable components (e.g., ALUs) that offer low power consumption at the expense of soft errors. Some applications (such as multimedia processing, machine learning, and big data analytics) can often naturally tolerate soft errors and can therefore trade accuracy of their results for reduced energy consumption by utilizing thes...

متن کامل

Local Kernels that Approximate Bayesian Regularization and Proximal Operators

In this work, we broadly connect kernel-based filtering (e.g. approaches such as the bilateral filters and nonlocal means, but also many more) with general variational formulations of Bayesian regularized least squares, and the related concept of proximal operators. The latter set of variational/Bayesian/proximal formulations often result in optimization problems that do not have closed-form so...

متن کامل

Approximate Kernels for Trees

Convolution kernels for trees provide effective means for learning with treestructured data, such as parse trees of natural language sentences. Unfortunately, the computation time of tree kernels is quadratic in the size of the trees as all pairs of nodes need to be compared: large trees render convolution kernels inapplicable. In this paper, we propose a simple but efficient approximation tech...

متن کامل

Approximate Tree Kernels

Convolution kernels for trees provide simple means for learning with tree-structured data. The computation time of tree kernels is quadratic in the size of the trees, since all pairs of nodes need to be compared. Thus, large parse trees, obtained from HTML documents or structured network data, render convolution kernels inapplicable. In this article, we propose an effective approximation techni...

متن کامل

Geodesics and Approximate Heat Kernels

We use the gradient flow on the path space to obtain estimates on the heat kernel k(t, x, y) on a complete Riemannian manifold. This approach gives a sharp formula for the small-time asymptotics of k(t, x, y) and an upper bound for all time for pairs x and y are not conjugate. It also gives a theorem about convolutions of heat kernels that makes precise the intuition that heat flows in packets ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Machine Learning

سال: 2021

ISSN: ['0885-6125', '1573-0565']

DOI: https://doi.org/10.1007/s10994-021-05949-0