A Novel Method for Scalable VLSI Implementation of Hyperbolic Tangent Function

نویسندگان

چکیده

Hyperbolic tangent and Sigmoid functions are used as non-linear activation units in the artificial deep neural networks. Since, these networks computationally expensive, customized accelerators designed for achieving required performance at lower cost power. The function MAC key building blocks of A low complexity accurate hardware implementation is to meet area targets such network accelerators. Moreover, a scalable recent studies show that DNNs may use different precision layers. This paper presents novel method based on trigonometric expansion properties hyperbolic which can be easily tuned accuracy requirements.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

CMOS VLSI Hyperbolic Tangent Function & its Derivative Circuits for Neuron Implementation

The hyperbolic tangent function and its derivative are key essential element in analog signal processing and especially in analog VLSI implementation of neuron of artificial neural networks. The main conditions of these types of circuits are the small silicon area, and the low power consumption. The objective of this paper is to study and design CMOS VLSI hyperbolic tangent function and its der...

متن کامل

A Neural Network Implementation of Hyperbolic Tangent Function Using Approximation Method

Neural network is mainly used in faster applications. Non linear activation function is one of the main building blocks in the neural networks. Hyperbolic and tangent sigmoid function used in neural network. The approximation is based on a mathematical analysis considering the maximum allowable error as design parameter. To derive the optimal finding of the number of input and output bits requi...

متن کامل

Implementation of Hyperbolic Tangent Function to Estimate Size Distribution of Rock Fragmentation by Blasting in Open Pit Mines

Rock fragmentation is one of the desired results of rock blasting. So, controlling and predicting it, has direct effects on operational costs of mining. There are different ways that could be used to predict the size distribution of fragmented rocks. Mathematical relations have been widely used in these predictions. From among three proposed mathematical relations, one was selected in this stud...

متن کامل

Universal Approximator Property of the Space of Hyperbolic Tangent Functions

In this paper, first the space of hyperbolic tangent functions is introduced and then the universal approximator property of this space is proved. In fact, by using this space, any nonlinear continuous function can be uniformly approximated with any degree of accuracy. Also, as an application, this space of functions is utilized to design feedback control for a nonlinear dynamical system.

متن کامل

A Note on the Soboleva’ Modified Hyperbolic Tangent Activation Function

In this note we construct a family of parametric Soboleva’ modified hyperbolic tangent activation function (PSMHTAF). We prove upper and lower estimates for the Hausdorff approximation of the sign function by means of this family. Numerical examples, illustrating our results are given.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE design & test

سال: 2022

ISSN: ['2168-2364', '2168-2356']

DOI: https://doi.org/10.1109/mdat.2021.3063308