Abstract Gauss’ 1809 discussion of least squares, which can be viewed as the beginning mathematical statistics, is reviewed. The general consensus seems to that arguments are at fault, but we show his reasoning in fact correct, given self-imposed restrictions, and persuasive without these restrictions.