“If it is possible for an agent—or, say, the human species—to have an infinite future, and you cut yourself off from that infinite future and end up stuck in a future that is merely very large, this one mistake outweighs all the finite mistakes you made over the course of your existence.”
Doesn’t this arbitrarily favor future events? But future-self isn’t current-self, it’s literally a different person. Distinguishing between desirable outcomes is tautological, your values precede evaluation.
“If it is possible for an agent—or, say, the human species—to have an infinite future, and you cut yourself off from that infinite future and end up stuck in a future that is merely very large, this one mistake outweighs all the finite mistakes you made over the course of your existence.” Doesn’t this arbitrarily favor future events? But future-self isn’t current-self, it’s literally a different person. Distinguishing between desirable outcomes is tautological, your values precede evaluation.