Bayesian optimization with approximate set kernels
نویسندگان
چکیده
We propose a practical Bayesian optimization method over sets, to minimize black-box function that takes set as single input. Because inputs are permutation-invariant, traditional Gaussian process-based strategies which assume vector can fall short. To address this, we develop with kernel is used build surrogate functions. This accumulates similarity elements enforce permutation-invariance, but this comes at greater computational cost. reduce burden, two key components: (i) more efficient approximate still positive-definite and an unbiased estimator of the true upper-bounded variance in terms number subsamples, (ii) constrained acquisition uses symmetry feasible region defines Finally, present several numerical experiments demonstrate our outperforms other methods.
منابع مشابه
Reliability-Aware Optimization of Approximate Computational Kernels with Rely
Emerging high-performance architectures are anticipated to contain unreliable components (e.g., ALUs) that offer low power consumption at the expense of soft errors. Some applications (such as multimedia processing, machine learning, and big data analytics) can often naturally tolerate soft errors and can therefore trade accuracy of their results for reduced energy consumption by utilizing thes...
متن کاملLocal Kernels that Approximate Bayesian Regularization and Proximal Operators
In this work, we broadly connect kernel-based filtering (e.g. approaches such as the bilateral filters and nonlocal means, but also many more) with general variational formulations of Bayesian regularized least squares, and the related concept of proximal operators. The latter set of variational/Bayesian/proximal formulations often result in optimization problems that do not have closed-form so...
متن کاملApproximate Kernels for Trees
Convolution kernels for trees provide effective means for learning with treestructured data, such as parse trees of natural language sentences. Unfortunately, the computation time of tree kernels is quadratic in the size of the trees as all pairs of nodes need to be compared: large trees render convolution kernels inapplicable. In this paper, we propose a simple but efficient approximation tech...
متن کاملApproximate Tree Kernels
Convolution kernels for trees provide simple means for learning with tree-structured data. The computation time of tree kernels is quadratic in the size of the trees, since all pairs of nodes need to be compared. Thus, large parse trees, obtained from HTML documents or structured network data, render convolution kernels inapplicable. In this article, we propose an effective approximation techni...
متن کاملGeodesics and Approximate Heat Kernels
We use the gradient flow on the path space to obtain estimates on the heat kernel k(t, x, y) on a complete Riemannian manifold. This approach gives a sharp formula for the small-time asymptotics of k(t, x, y) and an upper bound for all time for pairs x and y are not conjugate. It also gives a theorem about convolutions of heat kernels that makes precise the intuition that heat flows in packets ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Machine Learning
سال: 2021
ISSN: ['0885-6125', '1573-0565']
DOI: https://doi.org/10.1007/s10994-021-05949-0