On “rerun based on different inputs”, this would work cleanly with AI forecasters. You can literally say, “Given that you get a news article announcing a major crisis X that happens tomorrow, what is your new probability on Y?” (I think I wrote about this a bit before, can’t find it right now).
Yep!
On “rerun based on different inputs”, this would work cleanly with AI forecasters. You can literally say, “Given that you get a news article announcing a major crisis X that happens tomorrow, what is your new probability on Y?” (I think I wrote about this a bit before, can’t find it right now).
I did write more about a full-scale forecasting system could be built and evaluated, here, for those interested:
https://www.lesswrong.com/posts/QvFRAEsGv5fEhdH3Q/preliminary-notes-on-llm-forecasting-and-epistemics
https://www.lesswrong.com/posts/QNfzCFhhGtH8xmMwK/enhancing-mathematical-modeling-with-llms-goals-challenges
Overall, I think there’s just a lot of neat stuff that could be done.