Sample average approximation is a popular approach to solving stochastic optimization problems. It has been widely observed that some form of robustification these problems often improves the out-of-sample performance solution estimators. In estimation problems, this improvement boils down trade-off between opposing effects bias and shrinkage. This paper aims characterize features more general ...