In this paper, we study a Tikhonov-type regularization for restricted Boltzmann machines (RBM). We present two alternative formulations of the Tikhonov-type regularization which encourage an RBM to learn a smoother probability distribution. Both formulations turn out to be combinations of the widely used weight-decay and sparsity regularization. We empirically evaluate the effect of the propose...

In this paper we discuss general regularization estimators. This class includes Tikhonov type and spectral cut-off estimators as well as iterative methods, such as ν-methods and the Landweber iteration. The latter estimators achieve the same (optimal) convergence rates as spectral cut-off, but do not require explicit spectral information on the operator and are often much faster to compute than...

We consider Tikhonov regularization of large linear discrete ill-posed problems with a regularization operator of general form and present an iterative scheme based on a generalized Krylov subspace method. This method simultaneously reduces both the matrix of the linear discrete ill-posed problem and the regularization operator. The reduced problem so obtained may be solved, e.g., with the aid ...

Abstract. Tikhonov regularization is one of the most popular approaches to solve discrete ill-posed problems with error-contaminated data. A regularization operator and a suitable value of a regularization parameter have to be chosen. This paper describes an iterative method, based on Golub-Kahan bidiagonalization, for solving large-scale Tikhonov minimization problems with a linear regularizat...

The generalized singular value decomposition (GSVD) often is used to solve Tikhonov regularization problems with a regularization matrix without exploitable structure. This paper describes how the standard methods for the computation of the GSVD of a matrix pair can be simplified in the context of Tikhonov regularization. Also, other regularization methods, including truncated GSVD, are conside...

We consider joint Tikhonovand Lavrentiev-regularization of control problems with pointwise controland state-constraints. We derive error estimates for the error which is introduced by the Tikhonov regularization. With the help of this results we show, that if the solution of the unconstrained problem has no active constraints, the same holds for the Tikhonov-regularized solution if the regulari...

Tikhonov functionals are known to be well suited for obtaining regularized solutions of linear operator equations. We analyze two iterative methods for finding the minimizer of norm-based Tikhonov functionals in Banach spaces. One is the steepest descent method, whereby the iterations are directly carried out in the underlying space, and the other one performs iterations in the dual space. We p...

Large linear discrete ill-posed problems with contaminated data are often solved with the aid of Tikhonov regularization. Commonly used regularization matrices are finite difference approximations of a suitable derivative and are rectangular. This paper discusses the design of square regularization matrices that can be used in iterative methods based on the Arnoldi process for large-scale Tikho...

Image restoration is one of the classical inverse problems in image processing and computer vision, which consists in recovering information about the original image from incomplete or degraded data. This paper presents analytical solution for onedimensional case of the Tikhonov regularization method and algorithm of parameter α selection by discrepancy, which finds the mostly smoothed function...

In this paper, we present a novel approach to imaging sparse and focal neural current sources from MEG (magnetoencephalography) data. Using the framework of Tikhonov regularization theory, we introduce a new stabilizer that uses the concept of controlled support to incorporate a priori assumptions about the area occupied by focal sources. The paper discusses the underlying Tikhonov theory and i...