Neural networks are now one of the most successful learning formalisms. Neurons transform inputs x1, ..., xn into an output f(w1x1 + ... + wnxn), where f is a non-linear function and wi are adjustable weights. What f to choose? Usually the logistic function is chosen, but sometimes the use of different functions improves the practical efficiency of the network. We formulate the problem of choos...
