What’s an AI alignment result or product that would make sense to offer a $1 billion prize for?
I think longtermist funders would be excited to fund and launch such a prize if it were well-designed. I’d expect scoping the prize (to prevent spurious wins but also give maximum clarity as to the goals), promoting the prize, giving guidance to entrants, and judging entries to be a lot of work, so I’d be most excited to do it with a backdrop of having done the hard intellectual work to figure out what’s worth rewarding.
Good question. This is also very similar to one of the questions in Holden’s Important, actionable questions for the most important century, a list of AI alignment and strategy questions which I generally think should be receiving more attention:
Nice link, thanks for sharing.