Hierarchical neural network with high storage capacity
نویسندگان
چکیده
منابع مشابه
Storage Capacity of a Multilayer Neural Network with Binary Weights
Statistical mechanics is applied to estimate the maximal capacity per weight (a3 of a two-layer feed-forward network with binary weights, functioning as a parity machine of the hidden units. For K 2 2 hidden units, the maximal theoretical capacity is achieved, a, = 1, and the average overlap between different solutions is zero. These results agree with the simulations. At finite temperature one...
متن کاملAutoassociative Memory with high Storage Capacity
The general neural unit (GNU) 1] is known for its high storage capacity as an autoassociative memory. The exponential increase in its storage capacity with the number of inputs per neuron is far greater than the linear growth in the famous Hoppeld network 2]. This paper shows that the GNU attains an even higher capacity with the use of pyramids of neurons instead of single neurons as its nodes....
متن کاملWord Recognition with a Hierarchical Neural Network
In this paper we propose a feedforward neural network for syllable recognition. The core of the recognition system is based on a hierarchical architecture initially developed for visual object recognition. We show that, given the similarities between the primary auditory and visual cortexes, such a system can successfully be used for speech recognition. Syllables are used as basic units for the...
متن کاملHiNet: Hierarchical Classification with Neural Network
Traditionally, classifying large hierarchical labels with more than 10000 distinct traces can only be achieved with flatten labels. Although flatten labels is feasible, it misses the hierarchical information in the labels. Hierarchical models like HSVM by Vural & Dy (2004) becomes impossible to train because of the sheer number of SVMs in the whole architecture. We developed a hierarchical arch...
متن کاملDeep Neural Network Capacity
In recent years, deep neural network exhibits its powerful superiority on information discrimination in many computer vision applications. However, the capacity of deep neural network architecture is still a mystery to the researchers. Intuitively, larger capacity of neural network can always deposit more information to improve the discrimination ability of the model. But, the learnable paramet...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical Review A
سال: 1989
ISSN: 0556-2791
DOI: 10.1103/physreva.40.5356