We formalize the idea of probability distributions that lead to reliable predictions about some, but not all aspects of a domain. The resulting notion of ‘safety’ provides a fresh perspective on foundational issues in statistics, providing amiddle ground between imprecise probability andmultiple-priormodels on the one hand and strictly Bayesian approaches on the other. It also allows us to form...