Properties of the arithmetic mean
The stuff presented here is far from new, that’s all well-known and basic. See here for a source.
The arithmetic mean has a number of properties …
Residuals cancel out
… such as that the residuals cancel out, i.e, the sum of the deviations from the mean (the residuals) sum up to zero:
The sum of the squared residuals is a minimum
Take all residuals, square them, then sum them up. The resulting number will be the smallest number with respect to all alternative values to the mean (such as the median or some arbitrary number).
Suppose we would like to know which number will minimize the residuals:
Multiply out the binomial formula:
Unlock the sum:
Pull the constant in front of the sum and simplify the last sum:
To find a minimum, differentiate with respect to a:
Set to zero:
Solve for :
And that’s the mean of the values.
Since , we have a minimum.
Done. 😄.