Allowing yourself to be swayed by thought experiments of the form “If you value x at all, then if offered enough x, you would give up y, and you value one y so much more than one x!” is a recipe for letting scope insensitivity rewrite your utility function.
Be careful about making an emotional judgement on numbers bigger than you can intuitively grasp. If possible, scale down the numbers involved (Instead of 1 million x vs 1 thousand y, imagine 1 thousand x vs 1 y) before imagining each alternative as viscerally as possible.
In my own experience, not estimating a number, just thinking “Well, it’s really big” basically guarantees I will not have the proper emotional response.
Allowing yourself to be swayed by thought experiments of the form “If you value x at all, then if offered enough x, you would give up y, and you value one y so much more than one x!” is a recipe for letting scope insensitivity rewrite your utility function.
Be careful about making an emotional judgement on numbers bigger than you can intuitively grasp. If possible, scale down the numbers involved (Instead of 1 million x vs 1 thousand y, imagine 1 thousand x vs 1 y) before imagining each alternative as viscerally as possible.
In my own experience, not estimating a number, just thinking “Well, it’s really big” basically guarantees I will not have the proper emotional response.