I don’t believe that “this high standard”, or any other, is even relevant to what the God we might create would be like. If anyone builds it, everyone dies, to coin a phrase.
If we don’t solve alignment, I agree. You just get some random optimizer.
“Building it right” is what I’m concerned about in this post. By whose lights is it built right? Which is why I honestly sort of hope you’re right about the mathematical impossibility.
If we don’t solve alignment, I agree. You just get some random optimizer.
“Building it right” is what I’m concerned about in this post. By whose lights is it built right? Which is why I honestly sort of hope you’re right about the mathematical impossibility.