The difference between 60% credence and 80% credence seems much smaller to me than the difference between 90% and 99%. Is there a reason there’s no option between 90% and 99%? In your testing, have you found any well-calibrated users who answer 99% a non-trivial fraction of the time?
Well, in 11 out of 145 answers (7.5%) I so far have answered 99%, and I have yet to be wrong in any of my answers.
If I continue at this rate, in approximately 1,174 more answers, I’ll be able to tell you if I am well callibrated (less, if I fail at more than one answer in the intervening time)
To clarify, wrong in any of my answers at the 99% level. I have been wrong at other levels (including, surprisingly, hovering within around 1% of 90% at the 90% level.
Yes, but it also depends on your knowledge base. Unfortunately right now we don’t have a lot of questions, but I hope people will add more. Then, we hope, you’ll have more questions for which you can answer 99%.
The difference between 60% credence and 80% credence seems much smaller to me than the difference between 90% and 99%. Is there a reason there’s no option between 90% and 99%? In your testing, have you found any well-calibrated users who answer 99% a non-trivial fraction of the time?
Well, in 11 out of 145 answers (7.5%) I so far have answered 99%, and I have yet to be wrong in any of my answers.
If I continue at this rate, in approximately 1,174 more answers, I’ll be able to tell you if I am well callibrated (less, if I fail at more than one answer in the intervening time)
To clarify, wrong in any of my answers at the 99% level. I have been wrong at other levels (including, surprisingly, hovering within around 1% of 90% at the 90% level.
Yes, but it also depends on your knowledge base. Unfortunately right now we don’t have a lot of questions, but I hope people will add more. Then, we hope, you’ll have more questions for which you can answer 99%.
I would say that I know with >99% certainity that Woodrow Wilson was president earlier than George H. W. Bush.
The same is true for the fact that the atom silver gets abbreviated with Ag.