This work gives a simultaneous analysis of both the ordinary least squares estimator and the ridge regression estimator in the random design setting under mild assumptions on the covariate/response distributions. In particular, the analysis provides sharp results on the “out-of-sample” prediction error, as opposed to the “in-sample” (fixed design) error. The analysis also reveals the effect of ...

Random coefficient regression models have received considerable attention, especially from econometricians. Previous work has assumed that the coefficients have normal distributions. The variances of the coefficients have, in previous papers, been estimated by maximum likelihood or by least squares methodology applied to the squared residuals from a preliminary (unweighted) fit. Maximum likelih...

The random design setting for linear regression concerns estimators based on a random sample of covariate/response pairs. This work gives explicit bounds on the prediction error for the ordinary least squares estimator and the ridge regression estimator under mild assumptions on the covariate/response distributions. In particular, this work provides sharp results on the “out-of-sample” predicti...

A simulation based method for the numerical solution of PDEs with random coefficients is presented. By the Feynman-Kac formula, the solution can be represented as conditional expectation of a functional of a corresponding stochastic differential equation driven by independent noise. A time discretization of the SDE for a set of points in the domain and a subsequent Monte Carlo regression lead t...

In this paper, we propose a dimension reduction model for spatially dependent variables. Namely, we investigate an extension of the inverse regression method under strong mixing condition. This method is based on estimation of the matrix of covariance of the expectation of the explanatory given the dependent variable, called the inverse regression. Then, we study, under strong mixing condition,...

We propose LOCO, a distributed algorithm which solves large-scale ridge regression. LOCO randomly assigns variables to different processing units which do not communicate. Important dependencies between variables are preserved using random projections which are cheap to compute. We show that LOCO has bounded approximation error compared to the exact ridge regression solution in the fixed design...

Many recent applications of nonparametric Bayesian inference use random partition models, i.e. probability models for clustering a set of experimental units. We review the popular basic constructions. We then focus on an interesting extension of such models. In many applications covariates are available that could be used to a priori inform the clustering. This leads to random clustering models...

Random coe cient regression models have been applied in di erent elds and they constitute a unifying setup for many statistical problems. The nonparametric study of this model started with Beran and Hall (1992) and it has become a fruitful framework. In this paper we propose and study statistics for testing a basic hypothesis concerning this model: the constancy of coe cients. The asymptotic be...

Random field regression models provide an extremely flexible way to investigate nonlinearity in economic data. This paper introduces a new approach to interpreting such models, which may allow for improved inference about the possible parametric specification of nonlinearity. This paper is forthcoming in Applied Economics Letters. Corresponding author. Email: [email protected]. The views ex...

We consider the problem of estimating an unknown function f in a regression setting with random design. Instead of expanding the function on a regular wavelet basis, we expand it on the basis {ψjk(G), j, k} warped with the design. This allows to perform a very stable and computable thresholding algorithm. We investigate the properties of this new basis. In particular, we prove that if the desig...