ویراساینس.
سند علمی

Bayes Point Machines: Estimating the Bayes Point in Kernel Space

Ralf Herbrich, Thore Graepel, Colin Campbell

چکیده

From a Bayesian perspective Support Vector Machines choose the hypothesis corresponding to the largest possible hypersphere that can be inscribed in version space, i.e. in the space of all consistent hypotheses given a training set. Those boundaries of version space which are tangent to the hypersphere define the support vectors. An alternative and potentially better approach is to construct the hypothesis using the whole of version space. This is achieved by using a Bayes Point Machine which finds the midpoint of the region of intersection of all hyperplanes bisecting version space into two halves of equal volume (the Bayes point). It is known that the center of mass of version space approximates the Bayes point [Watkin, 1993]. We suggest estimating the center of mass by averaging over the trajectory of a billiard ball bouncing in version space. Experimental results are presented indicating that Bayes Point Machines consistently outperform Support Vector Machines.

اسناد مشابه

  • Empirical Results on the Generalization Capabilities and Convergence Properties of the Bayes Point Machine

    سند علمی۲۰۰۱Sumit Basu

    We explore some of the convergence and generalization properties of the Bayes Point Machine (BPM) developed by Herbrich [3], an alternative to the Support Vector Machine (SVM) for classi cation. In the separable case, there are an in nite number of hyperplanes in version space th

  • Bayes Point Machines

    سند علمی۲۰۰۱Journal of Machine Learning ResearchRalf Herbrich, Thore Graepel, Colin Campbell

    Kernel-classifiers comprise a powerful class of non-linear decision functions for binary classification. The support vector machine is an example of a learning algorithm for kernel classifiers that singles out the consistent classifier with the largest margin, i.e. minimal real-v

  • Robust Bayes Point Machines

    سند علمی۲۰۰۰ESANNRalf Herbrich, Thore Graepel, Colin Campbell

    Support Vector Machines choose the hypothesis corresponding to the centre of the largest hypersphere that can be inscribed in version space. If version space is elongated or irregularly shaped a potentially superior approach is take into account the whole of version space. We pro

  • Soft Margin Bayes-Point-Machine Classification via Adaptive Direction Sampling

    سند علمی۲۰۱۷SCIAKarsten Vogt, Jörn Ostermann

    Supervised machine learning is an important building block for many applications that involve data processing and decision making. Good classifiers are trained to produce accurate predictions on a training set while also generalizing well to unseen data. To this end, Bayes-PointM

  • Large Scale Bayes Point Machines

    سند علمی۲۰۰۰NIPSRalf Herbrich, Thore Graepel

    The concept of averaging over classifiers is fundamental to the Bayesian analysis of learning. Based on this viewpoint, it has recently been demonstrated for linear classifiers that the centre of mass of version space (the set of all classifiers consistent with the training set)

  • Channel equalization and the Bayes point machine

    سند علمی۲۰۰۳ICASSPEdward Harrington, Jyrki Kivinen, Robert C. Williamson

    Equalizers trained with a large margin have an ability to better handle noise in unseen data and drift in the target solution. We present a method of approximating the Bayes optimal strategy which provides a large margin equalizer, the Bayes point equalizer. The method we use to