Highly efficient hierarchical online nonlinear regression using second order methods
نویسندگان
چکیده
منابع مشابه
Highly Efficient Hierarchical Online Nonlinear Regression Using Second Order Methods
We introduce highly efficient online nonlinear regression algorithms that are suitable for real life applications. We process the data in a truly online manner such that no storage is needed, i.e., the data is discarded after being used. For nonlinear modeling we use a hierarchical piecewise linear approach based on the notion of decision trees where the space of the regressor vectors is adapti...
متن کاملFSR methods for second-order regression models
Most variable selection techniques focus on first-order linear regression models. Often, interaction and quadratic terms are also of interest, but the number of candidate predictors grows very fast with the number of original predictors, making variable selection more difficult. Forward selection algorithms are thus developed that enforce natural hierarchies in second-order models to control th...
متن کاملEfficient Second Order Online Learning by Sketching
We propose Sketched Online Newton (SON), an online second order learning algorithm that enjoys substantially improved regret guarantees for ill-conditioned data. SON is an enhanced version of the Online Newton Step, which, via sketching techniques enjoys a linear running time. We further improve the computational complexity to linear in the number of nonzero entries by creating sparse forms of ...
متن کاملSecond-order non-stationary online learning for regression
The goal of a learner, in standard online learning, is to have the cumulative loss not much larger compared with the best-performing function from some fixed class. Numerous algorithms were shown to have this gap arbitrarily close to zero, compared with the best function that is chosen off-line. Nevertheless, many real-world applications, such as adaptive filtering, are non-stationary in nature...
متن کاملO-space imaging: Highly efficient parallel imaging using second-order nonlinear fields as encoding gradients with no phase encoding.
Recent improvements in parallel imaging have been driven by the use of greater numbers of independent surface coils placed so as to minimize aliasing along the phase-encode direction(s). However, gains from increasing the number of coils diminish as coil coupling problems begin to dominate and the ratio of acceleration gain to expense for multiple receiver chains becomes prohibitive. In this wo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Signal Processing
سال: 2017
ISSN: 0165-1684
DOI: 10.1016/j.sigpro.2017.01.029