A deterministic rescaled perceptron algorithm
نویسندگان
چکیده
The perceptron algorithm is a simple iterative procedure for finding a point in a convex cone F . At each iteration, the algorithm only involves a query to a separation oracle for F and a simple update on a trial solution. The perceptron algorithm is guaranteed to find a point in F after O(1/τ F ) iterations, where τF is the width of the cone F . We propose a version of the perceptron algorithm that includes a periodic rescaling of the ambient space. In contrast to the classical version, our rescaled version finds a point in F in O(m log(1/τF )) perceptron updates. This result is inspired by and strengthens the previous work on randomized rescaling of the perceptron algorithm by Dunagan and Vempala [Math. Program. 114 (2006), 101–114] and by Belloni, Freund, and Vempala [Math. Oper. Res. 34 (2009), 621–641]. In particular, our algorithm and its complexity analysis are simpler and shorter. Furthermore, our algorithm does not require randomization or deep separation oracles.
منابع مشابه
An Improved Deterministic Rescaling for Linear Programming Algorithms
Theperceptron algorithm for linear programming, arising frommachine learning, has been around since the 1950s. While not a polynomial-time algorithm, it is useful in practice due to its simplicity and robustness. In 2004, Dunagan and Vempala showed that a randomized rescaling turns the perceptron method into a polynomial time algorithm, and later Peña and Soheili gave a deterministic rescaling....
متن کاملAn Example with Decreasing Largest Inscribed Ball for Deterministic Rescaling Algorithms
Recently, Peña and Sohèili presented a deterministic rescaling perceptron algorithm and proved that it solves a feasible perceptron problem in O(mn log(ρ−1)) perceptron update steps, where ρ is the radius of the largest inscribed ball. The original stochastic rescaling perceptron algorithm of Dunagan and Vempala is based on systematic increase of ρ, while the proof of Peña and Sohèili is based ...
متن کاملA Deterministic and Polynomial Modified Perceptron Algorithm
We construct a modi ed perceptron algorithm that is deterministic, polynomial and also as fast as previous known algorithms. The algorithm runs in time O(mn log n log(1/ρ)), where m is the number of examples, n the number of dimensions and ρ is approximately the size of the margin. We also construct a non-deterministic modi ed perceptron algorithm running in time O(mn log n log(1/ρ)). 1 A Deter...
متن کاملPerceptron like Algorithms for Online Learning to Rank
Perceptron is a classic online algorithm for learning a classification function. In this paper, we provide a novel extension of the perceptron algorithm to the learning to rank problem in information retrieval. We consider popular listwise performance measures such as Normalized Discounted Cumulative Gain (NDCG) and Average Precision (AP). A modern perspective on perceptron for classification i...
متن کاملComparative Analysis of Genetic Algorithm, Simulated Annealing and Cutting Angle Method for Artificial Neural Networks
Neural network learning is the main essence of ANN. There are many problems associated with the multiple local minima in neural networks. Global optimization methods are capable of finding global optimal solution. In this paper we investigate and present a comparative study for the effects of probabilistic and deterministic global search method for artificial neural network using fully connecte...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Math. Program.
دوره 155 شماره
صفحات -
تاریخ انتشار 2016