I think I agree with this—but do you see how it makes me frustrated to hear people dunk on MIRI’s doomy views as unfalsifiable? Here’s what happened in a nutshell:
MIRI: “AGI is coming and it will kill everyone.” Everyone else: “AGI is not coming and if it did it wouldn’t kill everyone.” time passes, evidence accumulates... Everyone else: “OK, AGI is coming, but it won’t kill everyone” Everyone else: “Also, the hypothesis that it won’t (edit: I meant will) kill everyone is unfalsifiable so we shouldn’t believe it.”
Yeah, I think this is actually a problem I see here, though admittedly I often see the hypotheses be vaguely formulated, and I kind of agree with Jotto999 that the verbal forecasts give far too much room for leeway here:
I think I agree with this—but do you see how it makes me frustrated to hear people dunk on MIRI’s doomy views as unfalsifiable? Here’s what happened in a nutshell:
MIRI: “AGI is coming and it will kill everyone.”
Everyone else: “AGI is not coming and if it did it wouldn’t kill everyone.”
time passes, evidence accumulates...
Everyone else: “OK, AGI is coming, but it won’t kill everyone”
Everyone else: “Also, the hypothesis that it won’t (edit: I meant will) kill everyone is unfalsifiable so we shouldn’t believe it.”
Yeah, I think this is actually a problem I see here, though admittedly I often see the hypotheses be vaguely formulated, and I kind of agree with Jotto999 that the verbal forecasts give far too much room for leeway here:
I like Eli Tyre’s comment here:
https://www.lesswrong.com/posts/ZEgQGAjQm5rTAnGuM/beware-boasting-about-non-existent-forecasting-track-records#Dv7aTjGXEZh6ALmZn