this is an easy mistake to make. You’re thinking about one large sample, from which you derive one good estimate.
When the article says
Statistical bias is error you cannot correct by repeating the experiment many times and averaging together the results.
it means, getting many samples, and from each one of these samples, deriving an estimate from it in isolation.
You: 1 sample of n data points, n->infinity. 1 estimate.
Yudkowsky: n samples of d data points, n->infinity. n estimates.
this is an easy mistake to make. You’re thinking about one large sample, from which you derive one good estimate.
When the article says
it means, getting many samples, and from each one of these samples, deriving an estimate from it in isolation.
You: 1 sample of n data points, n->infinity. 1 estimate.
Yudkowsky: n samples of d data points, n->infinity. n estimates.