a world run by people who approached actual rationality, looking closely at what would actually benefit people and actively trying to avoid suboptimal Nash equilibria, would be pretty damn good compared to what we have now
Probably, but realize there are at least 2, maybe 3 premises here:
Run by people who approach actual rationality
These people want to benefit everyone and not just themselves
They actively try to avoid Nash equilibria (perhaps a consequence of #1)
Number 2 is the critical missing factor IMHO. I think that to a reasonable approximation the world does look like it’s formed (I hesitate to say “run” since I’m not sure anyone really does run more than small part of the world) by people behaving as rational actors in their own self-interests. Maybe UFI is the problem today, not UFAI.
Probably, but realize there are at least 2, maybe 3 premises here:
Run by people who approach actual rationality
These people want to benefit everyone and not just themselves
They actively try to avoid Nash equilibria (perhaps a consequence of #1)
Number 2 is the critical missing factor IMHO. I think that to a reasonable approximation the world does look like it’s formed (I hesitate to say “run” since I’m not sure anyone really does run more than small part of the world) by people behaving as rational actors in their own self-interests. Maybe UFI is the problem today, not UFAI.