This paper is the extension of two-stage vector quantization–(spherical) lattice vector quantization (VQ–(S)LVQ) recently introduced by Pan and Fischer [1]. First, according to high resolution quantization theory, generalized vector quantization–lattice vector quantization (G-VQ–LVQ) is formulated in order to release the constraint of the spherical boundary for the second-stage lattice vector q...

Learning vector quantization (LVQ) constitutes a powerful and intuitive method for adaptive nearest prototype classification. However, original LVQ has been introduced based on heuristics and numerous modifications exist to achieve better convergence and stability. Recently, a mathematical foundation by means of a cost function has been proposed which, as a limiting case, yields a learning rule...

In this correspondence, we propose a novel class of learning vector quantizers (LVQ’s) based on multivariate data ordering principles. A special case of the novel LVQ class is the median LVQ, which uses either the marginal median or the vector median as a multivariate estimator of location. The performance of the proposed marginal median LVQ in color image quantization is demonstrated by experi...

The statistical physics analysis of offline learning is applied to cost function based learning vector quantization (LVQ) schemes. Typical learning behavior is obtained from a model with data drawn from high dimensional Gaussian mixtures and a system of two or three competing prototypes. The analytic approach becomes exact in the limit of high training temperature. We study two cost function re...

We introduce a novel way to employ codebooks trained by Learning Vector Quantization together with hidden Markov models. In previous work, LVQ-codebooks have been used as frame labelers. The resulting label stream has been modeled and decoded by discrete observation HMMs. We present a way to extract more information out of the LVQ stage. This is accomplished by modeling the class-wise quantizat...

Learning vector quantization (LVQ) is a supervised neural network method applicable in non-linear separation problems and widely used for data classification. Existing LVQ algorithms are mostly focused on numerical data. This paper presents a batch type LVQ algorithm used for classifying data with categorical values. The batch learning rules make possible to construct the learning methodology f...

In this paper, we investigate and systematically evaluate two machine learning algorithms for analog fault detection and isolation: (1) Restricted Coloumb Energy (RCE) Neural Network, and (2) Learning Vector Quantization (LVQ). The RCE and LVQ models excel at recognition and classiication types of problems. In order to evaluate the eecacy of the two learning algorithms, we have developed a soft...

This paper presents an algorithm that jointly optimizes a lattice vector quantizer (LVQ) and an entropy coder in a subband coding at all ranges of bit rate. Estimation formulas for both entropy and distortion of lattice quantized subband images are derived. From these estimates, we then develop dynamic algorithm optimizing the LVQ and entropy coder together for a given entropy rate. Compared to...

We present a new way to take advantage of the dis-criminative power of Learning Vector Quantization in combination with continuous density hidden Markov models. This is based on viewing LVQ as a non-linear feature transformation. Class-wise quantization errors of LVQ are modeled by continuous density HMMs, whereas the practice in the literature regarding LVQ/HMM hybrids is to use LVQ-codebooks ...

Prototype-based classification models, and particularly Learning Vector Quantization (LVQ) frameworks with adaptive metrics, are powerful supervised classification techniques with good generalization behaviour. This thesis proposes three advanced learning methodologies, in the context of LVQ, aiming at better classification performance under various classification settings. The first contributi...