An Initialization Method for Feedforward Artificial Neural Networks Using Polynomial Bases
نویسندگان
چکیده
We propose an initialization method for feedforward artificial neural networks (FFANNs) trained to model physical systems. A polynomial solution of the physical system is obtained using a mathematical model and then mapped into the neural network to initialize its weights. The network can next be trained with a dataset to refine its accuracy. We focus attention on an elliptical partial differential equation modeled using a feedforward backpropagation network. We present a numerical example and compare our method with other initialization methods. Our method converges nearly 90% faster compared to random weights, with higher probability of convergence to an acceptable local minimum.
منابع مشابه
A new initialization method for neural networks using sensitivity analysis
The learning methods for feedforward neural networks find the network’s optimal parameters through a gradient descent mechanism starting from an initial state of the parameters. This initial state influences both in convergence speed and the error that finally is achieved. In this paper, we present a sensitivity analysis based initialization method for two-layer feedforward neural networks, whi...
متن کاملA New Weight Initialization Method Using Cauchy’s Inequality Based on Sensitivity Analysis
In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analysis to improve the convergence speed in single hidden layer feedforward neural networks. The proposed method ensures that the outputs of hidden neurons are in the active region which increases the rate of convergence. Also the weights are learned by minimizing the sum of squa...
متن کاملInitialization of Recurrent Networks Using Fourier Analysis
Time-Delayed recurrent neural network models preserve information through time and are more powerful than the static feedforward networks, especially in dynamic problems. At present, recurrent networks are mostly formulated as nonlinear autoregression models [4] when applied to time series prediction problem. In this paper, we use a novel approach to interpret the recurrent networks. We build t...
متن کاملComparison of the Experimental and Predicted Data for Thermal Conductivity of Fe3O4/water Nanofluid Using Artificial Neural Networks
Objective(s): This study aims to evaluate and predict the thermal conductivity of iron oxide nanofluid at different temperatures and volume fractions by artificial neural network (ANN) and correlation using experimental data. Methods: Two-layer perceptron feedforward artificial neural network and backpropagation Levenberg-Marquardt (BP-LM) tra...
متن کاملUsing Artificial Neural Network Algorithm to Predict Tensile Properties of Cotton-Covered Nylon Core Yarns
Artificial Neural Networks are information processing systems. Over the past several years, these algorithms have received much attention for their applications in pattern completing, pattern matching and classification and also for their use as a tool in various areas of problem solving. In this work, an Artificial Neural Network model is presented for predicting the tensile properties of co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Advances in Adaptive Data Analysis
دوره 3 شماره
صفحات -
تاریخ انتشار 2011