Time-Multiplexed In-Memory Computation Scheme for Mapping Quantized Neural Networks on Hybrid CMOS-OxRAM Building Blocks

نویسندگان

چکیده

In this work, we experimentally demonstrate two key building blocks for realizing Binary/Ternary Neural Networks (BNNs/TNNs): (i) 130 nm CMOS based sigmoidal neurons and (ii) HfO$_{2}$ multi-level (MLC) OxRAM-synaptic blocks. An optimized vector matrix multiplication (VMM) programming scheme that utilizes the is also presented. Compared to prior approaches utilize differential synaptic structures, a single device per synapse with sets of READ operations used. Proposed hardware mapping strategy shows performance change $< $5% (decrease 2-5% TNN, increase 0.2% BNN) compared software-based implementation significant memory savings in order 16-32× classification problem on Fashion MNIST (FMNIST) dataset. Impact OxRAM variability Hardware BNN/TNN analyzed.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Quantized Memory-Augmented Neural Networks

Memory-augmented neural networks (MANNs) refer to a class of neural network models equipped with external memory (such as neural Turing machines and memory networks). These neural networks outperform conventional recurrent neural networks (RNNs) in terms of learning long-term dependency, allowing them to solve intriguing AI tasks that would otherwise be hard to address. This paper concerns the ...

متن کامل

Building blocks for electronic spiking neural networks

We present an electronic circuit modelling the spike generation process in the biological neuron. This simple circuit is capable of simulating the spiking behaviour of several different types of biological neurons. At the same time, the circuit is small so that many neurons can be implemented on a single silicon chip. This is important, as neural computation obtains its power not from a single ...

متن کامل

Design Exploration of Hybrid CMOS-OxRAM Deep Generative Architectures

Deep Learning and its applications have gained tremendous interest recently in both academia and industry. Restricted Boltzmann Machines (RBMs) offer a key methodology to implement deep learning paradigms. This paper presents a novel approach for realizing hybrid CMOS-OxRAM based deep generative models (DGM). In our proposed hybrid DGM architectures, HfOx based (filamentary-type switching) OxRA...

متن کامل

Corrigendum: Spiking Neural Networks Based on OxRAM Synapses for Real-Time Unsupervised Spike Sorting

In this paper, we present an alternative approach to perform spike sorting of complex brain signals based on spiking neural networks (SNN). The proposed architecture is suitable for hardware implementation by using resistive random access memory (RRAM) technology for the implementation of synapses whose low latency (<1μs) enables real-time spike sorting. This offers promising advantages to conv...

متن کامل

PAMAM Dendrimers as Quantized Building Blocks for Novel Nanostructures.

The desire to synthesize soft supramolecular structures with size scales similar to biological systems has led to work in assembly of polymeric nanomaterials. Recent advances in the isolation of generationally homogenous poly(amidoamine) (PAMAM) dendrimer enables their use as quantized building blocks. Here, we report their assembly into precise nanoclusters. In this work, click-functional liga...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Nanotechnology

سال: 2022

ISSN: ['1536-125X', '1941-0085']

DOI: https://doi.org/10.1109/tnano.2022.3193921