I don’t think that that’s a bad thing. The immortal starfarers necessarily go somewhere; the status game players don’t necessarily go anywhere. Hence “winning”. The point of the post was to warn that not only answering our questions but figuring out which questions we should ask is an issue we have to tackle. We have to figure out what winning should be.
The reason that the immortal starfarers are better is that they’re trying to do that, so if all values aren’t created equally, they’re more likely to find out about it.
The immortal starfarers necessarily go somewhere; the status game players don’t necessarily go anywhere. Hence “winning”.
Deciding that going somewhere is “winning” comes from your existing utility function.
Another person could judge that the civilization with the most rich and complex social hierarchy “wins”.
Rationality can help you search the space of actions, policies, and outcomes for those which produce the highest value for you. It cannot help you pass objective judgment on your values, or discover “better” ones.
I don’t think that that’s a bad thing. The immortal starfarers necessarily go somewhere; the status game players don’t necessarily go anywhere. Hence “winning”. The point of the post was to warn that not only answering our questions but figuring out which questions we should ask is an issue we have to tackle. We have to figure out what winning should be.
The reason that the immortal starfarers are better is that they’re trying to do that, so if all values aren’t created equally, they’re more likely to find out about it.
Deciding that going somewhere is “winning” comes from your existing utility function. Another person could judge that the civilization with the most rich and complex social hierarchy “wins”.
Rationality can help you search the space of actions, policies, and outcomes for those which produce the highest value for you. It cannot help you pass objective judgment on your values, or discover “better” ones.