Time-Multiplexed In-Memory Computation Scheme for Mapping Quantized Neural Networks on Hybrid CMOS-OxRAM Building Blocks
نویسندگان
چکیده
In this work, we experimentally demonstrate two key building blocks for realizing Binary/Ternary Neural Networks (BNNs/TNNs): (i) 130 nm CMOS based sigmoidal neurons and (ii) HfO$_{2}$ multi-level (MLC) OxRAM-synaptic blocks. An optimized vector matrix multiplication (VMM) programming scheme that utilizes the is also presented. Compared to prior approaches utilize differential synaptic structures, a single device per synapse with sets of READ operations used. Proposed hardware mapping strategy shows performance change $< $5% (decrease 2-5% TNN, increase 0.2% BNN) compared software-based implementation significant memory savings in order 16-32× classification problem on Fashion MNIST (FMNIST) dataset. Impact OxRAM variability Hardware BNN/TNN analyzed.
منابع مشابه
Quantized Memory-Augmented Neural Networks
Memory-augmented neural networks (MANNs) refer to a class of neural network models equipped with external memory (such as neural Turing machines and memory networks). These neural networks outperform conventional recurrent neural networks (RNNs) in terms of learning long-term dependency, allowing them to solve intriguing AI tasks that would otherwise be hard to address. This paper concerns the ...
متن کاملBuilding blocks for electronic spiking neural networks
We present an electronic circuit modelling the spike generation process in the biological neuron. This simple circuit is capable of simulating the spiking behaviour of several different types of biological neurons. At the same time, the circuit is small so that many neurons can be implemented on a single silicon chip. This is important, as neural computation obtains its power not from a single ...
متن کاملDesign Exploration of Hybrid CMOS-OxRAM Deep Generative Architectures
Deep Learning and its applications have gained tremendous interest recently in both academia and industry. Restricted Boltzmann Machines (RBMs) offer a key methodology to implement deep learning paradigms. This paper presents a novel approach for realizing hybrid CMOS-OxRAM based deep generative models (DGM). In our proposed hybrid DGM architectures, HfOx based (filamentary-type switching) OxRA...
متن کاملCorrigendum: Spiking Neural Networks Based on OxRAM Synapses for Real-Time Unsupervised Spike Sorting
In this paper, we present an alternative approach to perform spike sorting of complex brain signals based on spiking neural networks (SNN). The proposed architecture is suitable for hardware implementation by using resistive random access memory (RRAM) technology for the implementation of synapses whose low latency (<1μs) enables real-time spike sorting. This offers promising advantages to conv...
متن کاملPAMAM Dendrimers as Quantized Building Blocks for Novel Nanostructures.
The desire to synthesize soft supramolecular structures with size scales similar to biological systems has led to work in assembly of polymeric nanomaterials. Recent advances in the isolation of generationally homogenous poly(amidoamine) (PAMAM) dendrimer enables their use as quantized building blocks. Here, we report their assembly into precise nanoclusters. In this work, click-functional liga...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Nanotechnology
سال: 2022
ISSN: ['1536-125X', '1941-0085']
DOI: https://doi.org/10.1109/tnano.2022.3193921