Empirical Bayes Regression Analysis with Many Regressors but Fewer Observations
نویسندگان
چکیده
In this paper, we consider the prediction problem in multiple linear regression model in which the number of predictor variables, p, is extremely large compared to the number of available observations, n. The least squares predictor based on a generalized inverse is not efficient. We propose six empirical Bayes estimators of the regression parameters. Three of them are shown to have uniformly lower prediction error than the least squares predictors when the vector of regressor variables are assumed to be random with mean vector zero and the covariance matrix (1/n)X t X where X t = (x 1 ,. .. , x n) is the p × n matrix of observations on the regressor vector centered from their sample means. For other estimators, we use simulation to show its superiority over the least squares predictor.
منابع مشابه
Regression Analysis under Inverse Gaussian Model: Repeated Observation Case
Traditional regression analyses assume normality of observations and independence of mean and variance. However, there are many examples in science and Technology where the observations come from a skewed distribution and moreover there is a functional dependence between variance and mean. In this article, we propose a method for regression analysis under Inverse Gaussian model when th...
متن کاملEMPIRICAL BAYES ANALYSIS OF TWO-FACTOR EXPERIMENTS UNDER INVERSE GAUSSIAN MODEL
A two-factor experiment with interaction between factors wherein observations follow an Inverse Gaussian model is considered. Analysis of the experiment is approached via an empirical Bayes procedure. The conjugate family of prior distributions is considered. Bayes and empirical Bayes estimators are derived. Application of the procedure is illustrated on a data set, which has previously been an...
متن کاملEmpirical Bayes Forecasts of One Time Series Using Many Predictors
We consider both frequentist and empirical Bayes forecasts of a single time series using a linear model with T observations and K orthonormal predictors. The frequentist formulation considers estimators that are equivariant under permutations (reorderings) of the regressors. The empirical Bayes formulation (both parametric and nonparametric) treats the coefficients as i.i.d. and estimates their...
متن کاملAdaptive Monte Carlo for Binary Regression with Many Regressors
This article describes a method for efficient posterior simulation for Bayesian variable selection in probit regression models with many regressors but few observations. A proposal on model space is described which contains a tuneable parameter. An adaptive approach to choosing this tuning parameter is described which allows automatic, efficient computation in these models. The methods is appli...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005