An Initialization Method for Feedforward Artificial Neural Networks Using Polynomial Bases

نویسندگان

  • Thanasis M. Varnava
  • Andrew J. Meade
چکیده

We propose an initialization method for feedforward artificial neural networks (FFANNs) trained to model physical systems. A polynomial solution of the physical system is obtained using a mathematical model and then mapped into the neural network to initialize its weights. The network can next be trained with a dataset to refine its accuracy. We focus attention on an elliptical partial differential equation modeled using a feedforward backpropagation network. We present a numerical example and compare our method with other initialization methods. Our method converges nearly 90% faster compared to random weights, with higher probability of convergence to an acceptable local minimum.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A new initialization method for neural networks using sensitivity analysis

The learning methods for feedforward neural networks find the network’s optimal parameters through a gradient descent mechanism starting from an initial state of the parameters. This initial state influences both in convergence speed and the error that finally is achieved. In this paper, we present a sensitivity analysis based initialization method for two-layer feedforward neural networks, whi...

متن کامل

A New Weight Initialization Method Using Cauchy’s Inequality Based on Sensitivity Analysis

In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analysis to improve the convergence speed in single hidden layer feedforward neural networks. The proposed method ensures that the outputs of hidden neurons are in the active region which increases the rate of convergence. Also the weights are learned by minimizing the sum of squa...

متن کامل

Initialization of Recurrent Networks Using Fourier Analysis

Time-Delayed recurrent neural network models preserve information through time and are more powerful than the static feedforward networks, especially in dynamic problems. At present, recurrent networks are mostly formulated as nonlinear autoregression models [4] when applied to time series prediction problem. In this paper, we use a novel approach to interpret the recurrent networks. We build t...

متن کامل

Comparison of the Experimental and Predicted Data for Thermal Conductivity of Fe3O4/water Nanofluid Using Artificial Neural Networks

Objective(s): This study aims to evaluate and predict the thermal conductivity of iron oxide nanofluid at different temperatures and volume fractions by artificial neural network (ANN) and correlation using experimental data. Methods: Two-layer perceptron feedforward artificial neural network and backpropagation Levenberg-Marquardt (BP-LM) tra...

متن کامل

Using Artificial Neural Network Algorithm to Predict Tensile Properties of Cotton-Covered Nylon Core Yarns

Artificial Neural Networks are information processing systems. Over the past several years, these algorithms have received much attention for their applications in pattern completing, pattern matching and classification and also for their use as a tool in various areas of problem solving. In this work, an Artificial Neural Network model is presented for predicting the tensile properties of co...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Advances in Adaptive Data Analysis

دوره 3  شماره 

صفحات  -

تاریخ انتشار 2011